Every research project has limitations. The limitations that authors acknowledge in their articles offer a glimpse into some of the concerns that occupy a field’s attention. We examine the types of limitations authors discuss in their published articles by categorizing them according to the four validities framework and investigate whether the field’s attention to each of the four validities has shifted from 2010 to 2020. We selected one journal in social and personality psychology (Social Psychological and Personality Science; SPPS), the subfield most in the crosshairs of psychology’s replication crisis. We sampled 440 articles (with half of those articles containing a subsection explicitly addressing limitations), and we identified and categorized 831 limitations across the 440 articles. Articles with limitations sections reported more limitations than those without (avg. 2.6 vs. 1.2 limitations per article). Threats to external validity were the most common type of reported limitation (est. 52% of articles), and threats to statistical conclusion validity were the least common (est. 17% of articles). Authors reported slightly more limitations over time. Despite the extensive attention paid to statistical conclusion validity in the scientific discourse throughout psychology’s credibility revolution, our results suggest that concerns about statistics-related issues were not reflected in social and personality psychologists’ reported limitations. The high prevalence of limitations concerning external validity might suggest it is time that we improve our practices in this area, rather than apologizing for these limitations after the fact.
Every research project has limitations. The limitations that authors acknowledge in their articles offer a glimpse into the concerns that occupy a field’s attention. We examine the types of limitations authors discuss in their published articles by categorizing them according to the four validities framework and investigate whether the field’s attention to each of the four validities has shifted from 2010 to 2020. We selected one journal in social and personality psychology (Social Psychological and Personality Science; SPPS), the subfield most in the crosshairs of psychology’s replication crisis. We sampled 440 articles (with half of those articles containing a subsection explicitly addressing limitations) and we identified and categorized 831 limitations across the 440 articles. Articles with limitations sections reported more limitations than those without (avg. 2.6 vs. 1.2 limitations per article). Threats to external validity were the most common type of reported limitation (est. 52% of articles) and threats to statistical conclusion validity were the least common (est. 17% of articles). Authors reported slightly more limitations over time. Despite the extensive attention paid to statistical conclusion validity in the scientific discourse throughout psychology’s credibility revolution, our results suggest that concerns about statistics-related issues were not reflected in social and personality psychologists’ reported limitations. The high prevalence of limitations concerning external validity might suggest it is time that we improve our practices in this area, rather than apologizing for these limitations after the fact.
Social interaction and loneliness have received much research interest. However, the direction of their relationship is unclear—does social interaction shape loneliness, or does loneliness shape willingness to interact? We explored dynamics of these social experiences under exceptional circumstances: COVID-19 lockdowns, which were necessary for public health but impacted people’s social lives. Specifically, we investigated the relationship between social interaction and loneliness in and out of lockdown in Australia. We used experience sampling methodology to follow 233 people across one week (Mage=30; 8,495 surveys) in a period that spanned one of the longest lockdowns in the world. While loneliness did not predict subsequent social interaction, having a social interaction predicted lower subsequent loneliness, particularly in (vs. out of) lockdown. These findings suggest social interactions may limit loneliness, especially during physical isolation. In short, times when we are apart from others may be times we benefit from interacting with them most.
The rules and procedures regulating the admission of potentially unreliable expert evidence have been substantially weakened over the past several years. We respond to this trend by focusing on one aspect of the rules that has not been explicitly curtailed: unfair prejudice. Unfair prejudice is an important component of trial judges’ authority to exclude evidence, which they may do when that unfair prejudice outweighs the evidence’s probative value. We develop the concept of unfair prejudice by first examining how it has been interpreted by judges and then relating that to the relevant social scientific research on the characteristics of expertise that can make it prejudicial. In doing so, we also discuss the research behind a common reason that judges admit expert evidence despite its prejudice, which is that judicial directions help jurors understand and weigh it. As a result, this article provides two main contributions. First, it advances knowledge about unfair prejudice, which is an important part of expert evidence law that has received relatively little attention from legal researchers. Second, it provides guidance to practitioners for challenging expert evidence under one of the few avenues left to do so.
Social interaction and loneliness have received much research interest. However, the direction of their relationship is unclear—does social interaction shape loneliness, or does loneliness shape willingness to interact? We explored dynamics of these social experiences under exceptional circumstances: COVID-19 lockdowns, which were necessary for public health but impacted people’s social lives. We investigated the relationship between social interaction and loneliness in and out of lockdown in Australia. We used experience sampling methodology to follow 233 people across 1 week ( Mage=30; 8,495 surveys) in a period that spanned one of the longest lockdowns in the world. Although loneliness did not predict subsequent social interaction, having a social interaction predicted lower subsequent loneliness, particularly in (vs. out of) lockdown. These findings suggest social interactions may limit loneliness, especially during physical isolation. In short, times when we are apart from others may be times we benefit from interacting with them the most.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.