Análisis de un test de desempeño en expresión escrita mediante el modelo de MFRM

Abstract

Análisis de un test de desempeño en expresión escrita mediante el modelo de MFRM * Resumen. Este trabajo muestra la utilidad de un modelo de Rasch (Many-Facet Rasch Measurement, MFRM) para medir la competencia de los examinados, la severidad de los calificadores, la dificultad de las tareas y de las variables puntuadas en las pruebas de respuesta construida que se suelen emplear para evaluar el desempeño. Inicialmente se describe el modelo y sus estadísticos básicos. Finalmente se presenta un ejemplo ilustrativo en el que se analizan, mediante el programa FACETS, las fuentes de la variabilidad de las calificaciones de los estudiantes en un test de expresión escrita. Los resultados muestran que el procedimiento es útil para detectar a los calificadores que presentan valores extremos en la variable severidad/ benignidad y para obtener calificaciones objetivas de los examinados (libres de la severidad del calificador).Palabras clave. Evaluación con calificadores, Evaluación del desempeño, Evaluación de la expresión escrita, Modelo de Rasch, Modelo de Muchas Facetas.Abstract. This paper describes how a Rasch model (Many-Facet Rasch Measurement) can be applied to performance assessment focusing on analysis of examinee, raters, tasks and variables. The article provides an introduction to MFRM, a description of analysis procedures, and an illustrative example to examine the effects of various sources of variability on students' performance on a writing test by means of the FACETS program. Results highlight the usefulness of the MFRM to detect raters that have extreme values on the continuum of severity/leniency as well as providing objective measurement of examinee (scores free of rater severity).

Construct validity of the self-report instrument of perceived stress in the general Costa Rican population of retirement age

“…Conversely, "Take care of sick relatives" was the most di cult item, as only a few individuals reported feeling stressed about this activity. The INFIT values for all six items fell within the acceptable range of 0.8 to 1.2, indicating adequate t (Table 6) (42).…”

“…According to Rasch's model, after removing this item, the remaining items in the scale t well into the stress measurement model. (42). Moreover, it is worth noting that the item related to stress about the health of parents or relatives shows some lack of t, albeit to a lesser extent and in the opposite direction, as it re ects the highest prevalence of stress.…”

“…A Rasch analysis was used for this purpose. According to Prieto and Delgado (42), Rasch analysis is based on a mathematical model that describes the relationship between the probability of a correct (or prede ned) response to an item and the difference between the ability of the respondent. The procedure assesses the t of each response and item to a unidimensional model, where a single construct or latent variable underlies and is re ected in the correct response to the item (43).…”