Measuring Once Twice: An Evaluation of Recalling Attitudes in Survey Research

Abstract

We compare retrospective attitudinal accounts that were gathered in 2006 to the contemporaneous attitudes people had in 1995 towards euthanasia, homosexuality, and the presence of migrants. We study the usefulness of recalled attitudes for descriptive purposes on the individual level, as well as on the aggregate level, and the value of statistically modelling change with recalled data. We show (i) how accurate retrospective accounts are, (ii) respondents with which characteristics are more accurate in recollecting their 1995 attitude, and (iii) whether causal inferences with recalled accounts of the 1995 attitudes lead to similar results compared to the use of the contemporaneous accounts of the 1995 attitudes. We found evidence for a strong consistency bias, as well as an aggregate trend bias. Furthermore, almost no categories of respondents turned out to make better recollections, except for those who claimed to be more certain. For making causal inferences, recalled attitudes seem promising, as we found few significant differences between the use of recalled attitudes and contemporaneous attitudes in our causal models. This contribution offers important clues for future survey researchers who wish to make use of recalled attitudes.

Do sexist organizational cultures create the Queen Bee?

“…Importantly, the moderate size of the correlation implied that only 18% of the variance in initial gender identification was shared with current gender identification leaving 82% of unique variance to independently predict other variables associated with the Queen Bee phenomenon. Moreover, almost all respondents (83 out of 94) indicated a different degree of current gender identification compared to when they started their career (both lower and higher levels were reported) indicating that they were able to differentiate between these two variables (for evidence of the reliability of retrospective self‐reports, see Jaspers, Lubbers, & De Graaf, 2009).…”

“Living Here has Changed My Whole Perspective”: How Escaping Inner-City Poverty Shapes Neighborhood and Housing Choice

“…Responses may be reinterpreted in light of current experiences, and therefore some respondents may have exaggerated the changes resulting from their relocation with the Baltimore program (see also Mason, ; Reissman, ). However, dissonance theory suggests that respondents would attempt to “maintain a coherent self‐image” and thus would be more likely to describe attitudes that are consistent with current thinking and would “under‐report actual change rates” (Jaspers, Lubbers, & de Graag, , p. 289) Therefore, the changes families report in their thinking about residential priorities could be considered even more striking.…”

Family Influences on Intermarriage Attitudes: A Sibling Analysis in the Netherlands

“…In societies with ethnic cleavages, understanding the strength and origins of interethnic attitudes is of the utmost importance, as these attitudes may shape behavioral patterns toward members of other ethnic groups. For instance, ethnic attitudes have been demonstrated to influence voting behavior, interethnic (friendship) contacts, and interethnic romantic relationships (Bélanger & Aarts, 2006; Jaspers, Lubbers, & De Graaf, 2008; Levin, Taylor, & Caudle, 2007; Levin, Van Laar, & Sidanius, 2003). Researchers have proposed and tested many different explanations for ethnic attitudes.…”