Abu Kassim, Noor Lide (2007) Exploring rater judging behaviour using the many-facet rasch model. In: The Second Biennial International Conference on Teaching and Learning of English in Asia : Exploring New Frontiers (TELiA2), 14-16 June 2007, Holiday Villa Beach & Spa Resort, Langkawi. Faculty of Communication and Modern Languages, Universiti Utara Malaysia, Sintok, pp. 1-13. ISBN 978-983-42061-2-3

Preview

PDF Download (148kB) | Preview

Abstract

Performance assessment, unlike the traditional fixed-response assessment, has features peculiar to its assessment setting (the task choice, the task processing conditions, the raters,the rating scale, and the rating procedures) that make it much more vulnerable to construct irrelevant variance (McNamara, 1997; Upshur & Turner, 1999). Of these potential sources of variability, those associated with raters are considered to be extensive and pose serious threats to the validity of ratings (Linacre, 1989; McNamara, 1996).For performance assessment to yield valid and reliable results, it is essential that these sources of variability are eliminated or minimized. This paper illustrates how sources of rater-related variability or rater effects can be identified and controlled for using the Many-facet Rasch Model.It also illustrates how the idiosyncratic rating behaviour of individual raters can be explicated through the use of this measurement model. In this illustration, the ratings of thirty-five English language instructors on 12 paragraphs written by new intake students at the Centre for Foundation Studies, IIUM were analysed using FACETS (Linacre, 2003), a computer application which implements the Many-facet Rasch Model. The results of the analysis indicate substantial differences in rater severity, and the presence of other rater effects.

Item Type:	Book Section
Additional Information:	Organized by Department of Modern Languages, Faculty of Communication and Modern Language, Universiti Utara Malaysia
Subjects:	L Education > LB Theory and practice of education > LB2300 Higher Education Q Science > QA Mathematics
Divisions:	College of Arts and Sciences
Depositing User:	Mrs. Norazmilah Yaakub
Date Deposited:	29 May 2011 08:39
Last Modified:	29 May 2011 08:39
URI:	https://repo.uum.edu.my/id/eprint/3212

Actions (login required)

View Item