Research Without Borders: How to Identify and Overcome Potential Pitfalls in International Large-Team Online Research Projects

Baum, Myriam; Hart, Alexander; Elsherif, Mahmoud Medhat; Ilchovska, Zlatomira; Moreau, David; Dokovova, Marie; LaPlume, Annalise; Krautter, Kai; Staal, Justine

doi:10.4135/9781529602074

Cited by 5 publications

(5 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…More specifically, hackathons are short organized sessions that allow scientific teams, including experts, researchers, and designers to collaborate more effectively in a brief, but intensive, session to attain the goal at hand (Parsons et al., 2022; Pe‐Than & Herbsleb, 2019). Ideally, hackathons produce outputs that affect the methodology and theoretical rationale of how psychological science should be conducted (e.g., Baum et al., 2022).…”

Section: Methodology: Hackathonmentioning

confidence: 99%

Guidelines to improve internationalization in the psychological sciences

Puthillam

Doble

Santos

et al. 2023

Social & Personality Psych

Self Cite

View full text Add to dashboard Cite

Conversations about the internationalization of psychological sciences have occurred over a few decades with very little progress. Previous work shows up to 95% of participants in the studies published in mainstream journals are from Western, Educated, Industrialized, Rich, Democratic nations. Similarly, a large proportion of authors are based in North America. This imbalance is well‐documented across a range of subfields in psychology, yet the specific steps and best practices to bridge publication and data gaps across world regions are still unclear. To address this issue, we conducted a hackathon at the Society for the Improvement of Psychological Science 2021 conference to develop guidelines to improve international representation of authors and participants, adapted for various stakeholders in the production of psychological knowledge. Based on this hackathon, we discuss specific guidelines and practices that funding bodies, academic institutions, professional academic societies, journal editors and reviewers, and researchers should engage with to ensure psychology is the scientific discipline of human behavior and cognition across the world. These recommendations will help us develop a more valid and fairer science of human sociality.

show abstract

Section: Methodology: Hackathonmentioning

confidence: 99%

Guidelines to improve internationalization in the psychological sciences

Puthillam

Doble

Santos

et al. 2023

Social & Personality Psych

Self Cite

View full text Add to dashboard Cite

show abstract

“…Preregistration is where a researcher publishes their planned study procedure as an immutable document in a time-stamped database (e.g., Open Science Framework, As Predicted; Baum et al, 2022;Parsons et al, 2022). Typically, preregistration includes specifying research questions/hypotheses, the research design, and data analysis plan before conducting analyses (e.g.…”

Section: Optional But Recommended: Preregistration Of Missing Data De...mentioning

confidence: 99%

Best practices for addressing missing data through multiple imputation

Woods

Gerasimova

Dusen

et al. 2023

Infant and Child Development

Self Cite

View full text Add to dashboard Cite

A common challenge in developmental research is the amount of incomplete and missing data that occurs from respondents failing to complete tasks or questionnaires, as well as from disengaging from the study (i.e., attrition). This missingness can lead to biases in parameter estimates and, hence, in the interpretation of findings. These biases can be addressed through statistical techniques that adjust for missing data, such as multiple imputation. Although multiple imputation is highly effective, it has not been widely adopted by developmental scientists given barriers such as lack of training or misconceptions about imputationThe foundation for this paper was created during a 'hackathon' session occurring on 23 June 2021, at the annual virtual meeting of the Society for Improving Psychological Science. We invited anyone interested in the topic to attend, welcoming both experts and those with little experience addressing missing data in their research, specifically welcoming participation from those who were not sure how to address the missing data they experienced.Decisional guidelines for analyzing the type and extent of missing data were then crowdsourced and curated during this hackathon, resulting in a missing data and multiple imputation decision tree (Woods et al., 2021, available at https://doi.org/10.31234/osf.io/mdw5r) and a companion infographic (Woods & Schmidt, 2021, available at https://miro.com/app/board/o9_J18JGJQk=/). We also created multiple imputation coding templates for several prominent software languages (Stata, Mplus, R, SPSS, SAS and Blimp). All hackathon materials and coding templates are available at https://osf.io/j3f8m/.

show abstract

“…The usefulness of such tools is not confined to the social sciences, and it is important to note that they have also been considered across other disciplines (e.g., animal behavior, Farrar et al, 2020Farrar et al, , 2022; cancer biology, Errington et al, 2021;economics, Camerer et al, 2016). While the discussions surrounding openness and reproducibility have led to promising and productive changes in research culture (e.g., Baum et al, 2022;Munafò et al, 2022;Stewart et al, 2022), there remains progress to be made (see Devezer et al, 2021;Ledgerwood et al, 2022;Whitaker & Guest, 2020). Specifically, there is an urgent, ongoing need to embed these principles into teaching, learning, training, and pedagogy (Azevedo et al, 2022).…”

Section: The Impact Of Open and Reproducible Scholarship On Students'...mentioning

confidence: 99%

Teaching Open and Reproducible Scholarship: A Critical Review of the Evidence Base for Current Pedagogical Methods and their Outcomes

Pownall¹,

König²,

Slack³

et al. 2022

Preprint

View full text Add to dashboard Cite

In recent years, the scientific community has called for improvements in the credibility, robustness, and reproducibility of research, characterized by higher standards of scientific evidence, increased interest in open practices, and promotion of transparency. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Currently, the impact of integrating an open and reproducible approach into the curriculum on student outcomes is not well articulated in the literature. Therefore, in this paper, we provide the first comprehensivereview of how integrating open and reproducible scholarship into teaching and learning may impact students, using a large-scale, collaborative, team-science approach. Our review highlighted how embedding open and reproducible scholarship may impact: (1) students’ scientific literacies (i.e., students’ understanding of open research, consumption of science, and the development of transferable skills); (2) student engagement (i.e., motivation and engagement with learning, collaboration, and engagement in open research), and (3) students’attitudes towards science (i.e., trust in science and confidence in research findings). Our review also identified a need for more robust and rigorous methods within evaluations of teaching practice. We discuss implications for teaching and learning scholarship in this area.

show abstract

Research Without Borders: How to Identify and Overcome Potential Pitfalls in International Large-Team Online Research Projects

Cited by 5 publications

References 8 publications

Guidelines to improve internationalization in the psychological sciences

Guidelines to improve internationalization in the psychological sciences

Best practices for addressing missing data through multiple imputation

Teaching Open and Reproducible Scholarship: A Critical Review of the Evidence Base for Current Pedagogical Methods and their Outcomes

Contact Info

Product

Resources

About