Analyzing test structure by multidimensional scaling.

Oltman, Philip K.; Stricker, Lawrence J.; Barrows, Thomas S.

doi:10.1037/0021-9010.75.1.21

Cited by 20 publications

(12 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Aunque hay varios procedimientos para valorar la validez de contenido de un cuestionario, como la aplicación de técnicas de escalamiento multidimensional, análisis cluster (Deville, 1996;Oltman, Stricker y Barrows, 1990) análisis factorial (Dorans y Lawrence, 1987), modelos de ecuaciones estructurales (Ding y Hershberger, 2002), etc; el procedimiento más habitual se basa en el trabajo con jueces expertos en el tema que se pretende estudiar (Sireci, 1998). Se han desarrollado diversos índices basados en el trabajo con expertos para valorar la validez de contenido.…”

Section: La Validez De Contenido Y Los Métodos De Expertosunclassified

La metodología Delphi como técnica de estudio de la validez de contenido

Liaño

Pascual‐Ezama

2012

analesps

View full text Add to dashboard Cite

Resumen: Encontrar procedimientos que nos garanticen altos niveles de validez es uno de los grandes retos de la metodología en psicología hoy en día. En el presente estudio presentamos la metodología Delphi como técni-ca para el estudio de la validez de contenido. Esta metodología presenta una ventaja esencial respecto a los métodos de expertos tradicionales: su aplicación es flexible y dinámica permitiendo una mayor retroalimentación entre los expertos participantes. Se aplicó la metodología Delphi en la elaboración de un cuestionario sobre el comportamiento de inversores individuales en bolsa (Pascual-Ezama, et al., 2010) y se calcularon los índices de congruencia (Rovinelli y Hambleton, 1977) a lo largo de las distintas fases del Delphi. Los resultados ponen de manifiesto que la metodología Delphi puede ser una buena herramienta que nos permita garantizar altos niveles de validez de contenido en un cuestionario. Se discuten también las ventajas e inconvenientes de los métodos de expertos habituales respecto a la metodología Delphi, y cómo el presente estudio aúna metodologías esencialmente cuantitativas con metodologías más cualitativas como el método Delphi. Este nexo entre métodos tan dispares es, sin duda, uno de los campos a explorar y desarrollar en la metodología actualmente. Palabras clave: Validez de Contenido, Metodología Delphi, Métodos de Expertos, Metodologías Cuantitativas y Cualitativas. Title:The Delphi Method as a technique to study Validity of Content. Abstract: Finding procedures that may guarantee high levels of validity is one of the big challenges in methods in psychology nowadays. In the present study, we show the Delphi method as a technique to study the validity of content. This method shows an important advantage regarding to traditional expert methods: it is flexible and dynamic in its application, allowing the presence of feedback between the expert participants. We applied the Delphi method during the development of a questionnaire of individual investors' behavior in the stock exchange (Pascual-Ezama, et al., 2010), also calculating congruency indexes (Rovinelli y Hambleton, 1977) along the different stages of the Delphi application. The results show that the Delphi method may be a good tool in order to guarantee high levels of validity of content in a questionnaire. Advantages as well as disadvantages of the traditional expert methods and the Delphi method, and how the present study joins quantitative and qualitative methods like the Delphi, are discussed. This link between those different types of methods is, with no doubt, one of the fields to explore and develop in methodology nowadays. Key words: Validity of Content, Delphi Method, Expert Methods, Quantitative and Qualitative Methods. IntroducciónDentro del estudio de las propiedades psicométricas de los cuestionarios, los conceptos más importantes que se han tratado de desarrollar han sido esencialmente los conceptos de fiabilidad y validez. Sin embargo, así como el estudio de la fiabilidad ha sido ampliamente desarrollado (...

show abstract

Section: La Validez De Contenido Y Los Métodos De Expertosunclassified

La metodología Delphi como técnica de estudio de la validez de contenido

Liaño

Pascual‐Ezama

2012

analesps

View full text Add to dashboard Cite

show abstract

“…Interestingly, the nature and number of regions that emerged from the MDS analysis were highly comparable to those of the initial applicant reaction model. In addition to the MDS analysis, we also applied additive tree modeling as an extra check of the demarcation of the resulting MDS regions (Oltman, Stricker, & Barrows, 1990). Additive tree modeling supported the MDS solution very well, strengthening the validity of MDS findings.…”

Section: Discussionmentioning

confidence: 97%

Modeling the Structure of Applicant Reactions: An Empirical Study Within the Belgian Military

Derous

Schreurs

2009

Military Psychology

View full text Add to dashboard Cite

This article describes the modeling of applicant reactions within the Belgian military. In a preparatory phase, 250 applicants were interviewed about the three-hurdle hiring procedure of the military. Content analysis resulted in an initial model with 221 applicant-generated items. Subsequently, an expert analysis was performed to validate the model's underlying structure. Fifty-three military field experts (e.g., recruiters) sorted the items and labeled each Q-sort according to its underlying meaning. Multidimensional scaling and additive tree modeling revealed a two-dimensional solution for the first and second selection hurdle and a three-dimensional solution for the third hurdle. Interpretative analyses were performed on the labeling of the Q-sorts. Both the graphic MDS solution and labeling came close to the theoretical categories of the initial model. Besides generic categories, very context-specific also categories

show abstract

“…Ward's method (Aldenderfer & Blashfield, 1984) was used on the item coordinates, because of its use in the literature (Oltman, Stricker, & Barrows, 1990;Sireci & Geisinger, 1992) and because of its demonstrated ability to recover structure (Milligan & Cooper, 1987). In addition, discriminant analysis was used to predict group membership of the items from the stimulus solution to determined how well the values from the stimulus coordinates would classify the 32 SAT items with respect to the original test specifications.…”

Section: Discussionmentioning

confidence: 99%

An Empirical Link of Content and Construct Validity Evidence

Deville¹,

Prometric

1996

Applied Psychological Measurement

View full text Add to dashboard Cite

Since the 1940s, measurement specialists have called for an empirical validation technique that combines content-and construct-related evidence. This study investigated the value of such a technique. A self-assessment instrument designed to cover four traditional foreign language skills was administered to 1,404 college-level foreign language students. Four subject-matter experts were asked to provide item dissimilarity judgments, using whatever criteria they thought appropriate. The data from the students and the experts were examined separately using multidimensional scaling followed by cluster and discriminant analyses. Results showed that the structure of the data underlying both the student and expert scaling solutions corresponded closely to that specified in the instrument blueprint. In addition, using canonical correlation, a comparison of the two scaling solutions revealed a high degree of similarity in the two solutions.

show abstract

Analyzing test structure by multidimensional scaling.

Cited by 20 publications

References 21 publications

La metodología Delphi como técnica de estudio de la validez de contenido

La metodología Delphi como técnica de estudio de la validez de contenido

Modeling the Structure of Applicant Reactions: An Empirical Study Within the Belgian Military

An Empirical Link of Content and Construct Validity Evidence

Contact Info

Product

Resources

About