Beyond online participant crowdsourcing: The benefits and opportunities of big team addiction science.

Pennington, Charlotte Rebecca; Jones, Andrew; Tzavella, Loukia; Chambers, Chris; Button, Katherine S

doi:10.1037/pha0000541

Cited by 11 publications

(10 citation statements)

References 93 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Indeed, as we have noted in an earlier paper, news outlets and social media recruitment are more likely to attract malicious actors [ 37 ] and, as we demonstrate here, less-committed research participants. However, despite the benefits of paid crowdsourcing platforms in effectively reaching and recruiting participants, researchers should carefully consider other factors that could influence the findings of a study [ 53 - 57 ] when recruiting participants from such platforms. These include (1) the primary motivation to remain engaged in remote studies, which may be tied to monetary incentives linked to task completion, and (2) the recruited population may not be representative of the general population [ 58 ] or of target health conditions.…”

Section: Discussionmentioning

confidence: 99%

Recruitment and Retention in Remote Research: Learnings From a Large, Decentralized Real-world Study

Li¹,

Halabi²,

Selvarajan³

et al. 2022

JMIR Form Res

View full text Add to dashboard Cite

Background Smartphones are increasingly used in health research. They provide a continuous connection between participants and researchers to monitor long-term health trajectories of large populations at a fraction of the cost of traditional research studies. However, despite the potential of using smartphones in remote research, there is an urgent need to develop effective strategies to reach, recruit, and retain the target populations in a representative and equitable manner. Objective We aimed to investigate the impact of combining different recruitment and incentive distribution approaches used in remote research on cohort characteristics and long-term retention. The real-world factors significantly impacting active and passive data collection were also evaluated. Methods We conducted a secondary data analysis of participant recruitment and retention using data from a large remote observation study aimed at understanding real-world factors linked to cold, influenza, and the impact of traumatic brain injury on daily functioning. We conducted recruitment in 2 phases between March 15, 2020, and January 4, 2022. Over 10,000 smartphone owners in the United States were recruited to provide 12 weeks of daily surveys and smartphone-based passive-sensing data. Using multivariate statistics, we investigated the potential impact of different recruitment and incentive distribution approaches on cohort characteristics. Survival analysis was used to assess the effects of sociodemographic characteristics on participant retention across the 2 recruitment phases. Associations between passive data-sharing patterns and demographic characteristics of the cohort were evaluated using logistic regression. Results We analyzed over 330,000 days of engagement data collected from 10,000 participants. Our key findings are as follows: first, the overall characteristics of participants recruited using digital advertisements on social media and news media differed significantly from those of participants recruited using crowdsourcing platforms (Prolific and Amazon Mechanical Turk; P<.001). Second, participant retention in the study varied significantly across study phases, recruitment sources, and socioeconomic and demographic factors (P<.001). Third, notable differences in passive data collection were associated with device type (Android vs iOS) and participants’ sociodemographic characteristics. Black or African American participants were significantly less likely to share passive sensor data streams than non-Hispanic White participants (odds ratio 0.44-0.49, 95% CI 0.35-0.61; P<.001). Fourth, participants were more likely to adhere to baseline surveys if the surveys were administered immediately after enrollment. Fifth, technical glitches could significantly impact real-world data collection in remote settings, which can severely impact generation of reliable evidence. Conclusions Our findings highlight several factors, such as recruitment platforms, incentive distribution frequency, the timing of baseline surveys, device heterogeneity, and technical glitches in data collection infrastructure, that could impact remote long-term data collection. Combined together, these empirical findings could help inform best practices for monitoring anomalies during real-world data collection and for recruiting and retaining target populations in a representative and equitable manner.

show abstract

Section: Discussionmentioning

confidence: 99%

Recruitment and Retention in Remote Research: Learnings From a Large, Decentralized Real-world Study

Li¹,

Halabi²,

Selvarajan³

et al. 2022

JMIR Form Res

View full text Add to dashboard Cite

show abstract

“…Although open access is not necessarily a prerequisite for this consideration, it does bundle together ideas for increasing the objectivity and validity of scientific results. Initiatives, such as big team programs, foster such research strategies and are growing in different fields, be it in general medical science (Steer et al, 2017), psychological science (Forscher et al, 2020), or in a more specific manner, like addiction science (e.g., Pennington et al, 2022). As mentioned above, the troubleshooting process is urgent, but also intense.…”

Section: Discussionmentioning

confidence: 99%

Future Objectivity Requires Perspective and Forward Combinatorial Meta-Analyses

Hanfstingl

2022

Front. Psychol.

View full text Add to dashboard Cite

This manuscript contributes to a future definition of objectivity by bringing together recent statements in epistemology and methodology. It outlines how improved objectivity can be achieved by systematically incorporating multiple perspectives, thereby improving the validity of science. The more result-biasing perspectives are known, the more a phenomenon of interest can be disentangled from these perspectives. Approaches that call for the integration of perspective into objectivity at the epistemological level or that systematically incorporate different perspectives at the statistical level already exist and are brought together in the manuscript. Recent developments in research methodology, such as transparency, reproducibility of research processes, pre-registration of studies, or free access to raw data, analysis strategies, and syntax, promote the explication of perspectives because they make the entire research process visible. How the explication of perspectives can be done practically is outlined in the manuscript. As a result, future research programs can be organized in such a way that meta-analyses and meta-meta-analyses can be conducted not only backward but forward and prospectively as a regular and thus well-prepared part of objectification and validation processes.

show abstract

“…Clark et al [100] also describe how students benefit from working with peers; the authors created a Peer Research Consultant programme, which trained students in research support, and found that students enjoyed seeking research assistance from peers over librarians. As Button et al [44] argue, collaborative, team-based approaches to research with students could improve students' comfort and creativity with research processes (see also [31,101]), but more empirical research is necessary to corroborate this notion. More detail on the team science approach which elicited these positive attitudes towards participating in team science, and the knowledge exchange that results from it is described in Button et al [44].…”

Section: Collaboration and Student Involvementmentioning

confidence: 99%

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes

et al. 2023

Self Cite

View full text Add to dashboard Cite

In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students’ understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.

show abstract

Beyond online participant crowdsourcing: The benefits and opportunities of big team addiction science.

Cited by 11 publications

References 93 publications

Recruitment and Retention in Remote Research: Learnings From a Large, Decentralized Real-world Study

Recruitment and Retention in Remote Research: Learnings From a Large, Decentralized Real-world Study

Future Objectivity Requires Perspective and Forward Combinatorial Meta-Analyses

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes

Contact Info

Product

Resources

About