The assessment of expertise is vital both in practical situations that call for expert judgment and in theoretical research on the psychology of experts. It can be difficult, however, to determine whether a judge is in fact performing expertly. Our goal was to develop an empirical measure of expert judgment. We argue that two necessary characteristics of expertise are discrimination of the various stimuli in the domain and consistent treatment of similar stimuli. We combine measures of these characteristics to form a ratio we call the Cochran-Weiss-Shanteau (CWS) index of expertise. The proposed index was demonstrated using two studies that distinguished experts from nonexperts based on their judgmental performance. The index provides new insights into expertise and offers a partial definition of expertise that may be useful in a variety of theoretical and applied settings. Potential applications of this research include selection, training, and evaluation of experts and of expert-machine systems.
To estimate frequencies of behaviors not carried out in public view, researchers generally must rely on self‐report data. We explored 2 factors expected to influence the decision to reveal: (a) privacy (anonymity vs. confidentiality) and (b) normalization (providing information so that a behavior is reputedly commonplace or rare). We administered a questionnaire to I55 undergraduates. For 79 respondents, we had corroborative information regarding a negative behavior: cheating. The privacy variable had an enormous impact; of those who had cheated, 25% acknowledged having done so under confidentiality, but 74% admitted the behavior under anonymity. Normalization had no effect. There were also dramatic differences between anonymity and confidentiality on some of our other questions, for which we did not have validation.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.