The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual differences, and 3 data quality indicators over the course of the academic semester in 20 participant pools (N = 2,696) and with an online sample (N = 737). Weak time of semester effects were observed on data quality indicators, participant sex, and a few individual differences-conscientiousness, mood, and stress. However, there was little evidence for time of semester qualifying experimental or correlational effects. The generality of this evidence is unknown because only a subset of the tested effects demonstrated evidence for the original result in the whole sample. Mean characteristics of pool samples change slightly during the semester, but these data suggest that those changes are mostly irrelevant for detecting effects. Word count = 151Keywords: social psychology; cognitive psychology; replication; participant pool; individual differences; sampling effects; situational effects 4 Many Labs 3: Evaluating participant pool quality across the academic semester via replication University participant pools provide access to participants for a great deal of published behavioral research. The typical participant pool consists of undergraduates enrolled in introductory psychology courses that require students to complete some number of experiments over the course of the academic semester. Common variations might include using other courses to recruit participants or making study participation an option for extra credit rather than a pedagogical requirement. Research-intensive universities often have a highly organized participant pool with a participant management system for signing up for studies and assigning credit. Smaller or teaching-oriented institutions often have more informal participant pools that are organized ad hoc each semester or for an individual class.To avoid selection bias based on study content, most participant pools have procedures to avoid disclosing the content or purpose of individual studies during the sign-up process.However, students are usually free to choose the time during the semester that they sign up to complete the studies. This may introduce a selection bias in which data collection on different dates occurs with different kinds of participants, or in different situational circumstances (e.g., the carefree semester beginning versus the exam-stressed semester end).If participant characteristics differ across time during the academic semester, then the results of studies may be moderated by the time at which data collection occurs. Indeed, among behavioral researchers there are widespread intuitions, superstitions, and anecdotes about the "best" time to collect data in order to minimize error and maximize power. It is common, for example, to hear stories of an effect being obtained in the first part of the semester that then "d...

Inbar and Lammers asked members of APA Division 8 (personality and social psychology) about their political orientation, hostility experienced related to their political orientation, and their willingness to discriminate against others based on perceived political orientation. In this replication and extension, 618 faculty members from various academic disciplines across four California State University campuses completed an online questionnaire that added parallel questions about the liberal experience to the original questions about the conservative experience. Participants were overwhelmingly liberal in self-report across all academic areas except agriculture. The conservative minority reported experiencing more hostility than the liberal majority, but both groups expressed similar “in-group/out-group” attitudes. Results supported the ideological-conflict hypothesis for discrimination and a “birds of a feather flock together” interpretation of the lack of political diversity among the professoriate.

In 2019 at the SPSP Political Psychology Pre-Conference, key stakeholders and researchers were invited to debate the question “does ideological diversity impact the quality of our research?” If Clark and Winegard's (in press) review of ideological epistemology and its significance to social science is mostly on target, it would predict that many at the debate were unconvinced by those arguing that political bias matters. Why? To the extent that social psychologists function as a moral tribal community (as Clark and Winegard argue), motivated to protect their professional and political interests, they will fight tooth and nail to defend their sacred values and professional statuses against charges of political bias. Of course, they might also do so out of a justified belief that they were unfairly accused. How can one tell the difference? In this paper we argue that this can be accomplished by identifying how political biases manifest in social psychology. To that end, we expand upon two of Clark and Winegard's (in press) arguments: 1. there are no reasons to believe that social scientists are immune to the biases, errors, and social processes that can lead to distortions that stem from tribal loyalties; 2. these tribal tendencies, combined with extreme ideological homogeneity, work to create significant problems for the pursuit of scientific truth. Specifically, we present a heuristic model of political bias that identifies ways they manifest, and we review evidence that bears on it.

This paper explores the suppression of ideas within an academic scholarship by academics, either by self-suppression or because of the efforts of other academics. Legal, moral, and social issues distinguishing freedom of speech, freedom of inquiry, and academic freedom are reviewed. How these freedoms and protections can come into tension is then explored by an analysis of denunciation mobs that exercise their legal free speech rights to call for punishing scholars who express ideas they disapprove of and condemn. When successful, these efforts, which constitute legally protected speech, will suppress certain ideas. Real-world examples over the past five years of academics that have been sanctioned or terminated for scholarship targeted by a denunciation mob are then explored.