| Título: | Measuring rater consistency : an investigation into the effects of two testing instruments on raters' scores |
| Autores: | Quintieri, Marcello |
| Fecha: | 2005 |
| Publicador: | |
| Fuente: |
Ver documento |
| Tipo: |
Thesis NonPeerReviewed |
| Tema: | |
| Descripción: | This study investigates the effects of preselected model compositions and a multiple weighted trait scale on the consistency of raters' scores in a direct ESL writing assessment context. Twenty experienced ESL teachers at the institution where this study took place were divided into two equal groups. One group used model compositions and the weighted multiple trait scale to grade a set of sixteen authentic ESL exam papers. The second group graded the same set of compositions using the trait scale alone. Ratings were analyzed using traditional statistical techniques, such as a t -test analysis, as well as Minifac Facets software, a student version of the multi-faceted Rasch analysis program FACETS. Findings from the t-test showed more significant score variance among the teachers who used the trait scale alone to grade the compositions than those who used model compositions in addition to the trait scale. This difference between the two groups was supported in the Rasch analysis, which identified a greater spread in the over-all severity measures for the group of teachers who graded with the trait scale alone |
| Idioma: | No aplica |
1 | 6 The Universal Negro Improvement Association of Montreal, 1917-1979 por Bertley, Leo W |
2 | 7 |
3 | 8 Propaedeutic for an aesthetic theory of political communication por Dowler, Kevin L |
4 Punning and other linguistic devices in advertising headlines por Tash, Marlene | 9 Triglyceride synthesis in normal and hyperapoB fibroblasts por Cianflone, Katherine M |
5 Simultaneous interpretation : contextual and translation aspects por Anderson, Linda | 10 Technology and public policy : patent protection for new drugs in Canada por Collins, Robert J |