The Method of Sorting as a Data-Gathering Procedure in Multivariate Research

Abstract

This study compares two basic variants of the sorting method: single-sort in which each respondent is given only one opportunity to sort the items; and multiple-sort in which the respondent is given several opportunities to sort, each time on a different basis. Kinship terms serve as stimulus materials. Multidimensional scaling solutions show large differences between the two methods with respect to the degree to which the kinship dimensions are used as a basis for sorting. In particular, most respondents ignore the most obvious dimension (sex of the terms) when they believe they have only one opportunity to indicate the dimensions in the set. Similar observations of pairwise judgments in another stimulus domain (consonant phonemes) suggest the same bias may be present in such judgments. Moreover, in both instances hierarchical clustering completely fails to represent the minority of judges who do not ignore the given dimension. These results indicate that a multiple set of judgments from each set of respondents may be superior to a single set of judgments for certain stimulus domains. Finally, the kinship data also indicate that male and female respondents emphasize different kinship dimensions but that aggregated multiple-sort data do appear to reflect the cognitive dimensions present in any given individual.

Extending the ALCOVE model of category learning to featural stimulus domains

“…As a concrete example of an additive clustering representation, Table 4 presents the results of analyzing Rosenberg and Kim's (1975) similarity data for kinship terms. This representation was generated by using a modified version of the algorithm described by Lee (2002), based on a stochastic hill-climbing approach to combinational optimization.…”

An efficient method for obtaining similarity data

“…With a sorting measure, subjects are instructed to place items into groups (e.g., Rosenberg & Kim, 1975). It is assumed that the frequency with which two items are placed in the same group is proportional to their similarity.…”

A semi-automated approach for structuring multi criteria decision problems

“…The sorting of a sample of participants serves as a measure of psychological distance which can be used in multivariate analysis like multi-dimensional scaling or clustering. While there are more accurate ways to measure psychological distances, the main advantage of card sorting is its economy, especially if the number of items is large (Rosenberg and Kim, 1975).…”