Psychometrics Anonymous: Does a Transparent Data Sharing Policy Affect Data Collection?

Abstract

As researchers, we are advised to share our data to improve transparency and increase the reproducibility of experiments. Simultaneously, making data freely accessible can raise ethical questions regarding the participants’ privacy. We first outline the challenges regarding “open data” for researchers in light of the GDPR. Then, we turn to the impact of an open-access data sharing policy on the participants: could the participants’ knowledge about the future use of the data alter the data itself? Through two pre-registered studies (N = 193, collected on campus and N = 543, online participation), we investigate whether disclosing that anonymized data will be publicly shared vs. not shared influences a potential participants’ intention to take part in the study. Using both frequentist and Bayesian analysis, we conclude towards an absence of effect of a difference in data sharing policy on scores in the Big Five questionnaire and social desirability, careless response behavior, and results in the anchoring paradigm. In the second study, a lexicometric analysis of participants’ reactions to openly sharing data reveals a readiness to share data and support transparency under the condition of preserved anonymity. Hence, if anonymity can be ensured, there seems to be no methodological or ethical drawback in transparent and open data sharing policies for many psychological studies.

Making data meaningful: guidelines for good quality open data

“…Ethics forms should always state how data will be stored and shared and it is straightforward to include a statement about open data. Evidence suggests that participants are not discouraged from taking part in a study when informed that their anonymized data will be shared openly (Eberlen et al, 2019). We suggest including a copy of the ethics form in a project repository to provide everyone accessing the archive clarity about permissions.…”

Les pratiques de recherche ouvertes en psychologie

“…La barrière logistique ou financière n’est plus une excuse, car il est extrêmement aisé de déposer ses données sur une plateforme spécifiquement dédiée à cet effet (e.g., sur OSF ; Soderberg, 2018 ). Enfin, compte tenu des connaissances actuelles, il n’y a pas de preuves qu’annoncer que les données récoltées (et préalablement anonymisées) sont destinées à être librement accessibles sur un site internet public affecte négativement le taux de participations ou la teneur des réponses recueillies via un certain nombre d’échelles de mesure psychologiques ( Eberlen, Nicaise, Leveaux, Mora, & Klein, 2019 ).…”