CrowdED

Abstract

People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website.• The final author version and the galley proof are versions of the publication after peer review.• The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.• Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal.If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the "Taverne" license above, please follow below link for the End User Agreement:

CrowdED 1.0: Statistical Guideline for Designing Optimal Crowdsourcing Experiments

“…The contributions of this paper are: -4 stand-alone modules that can be executed independently to simulate a crowdsourcing experiment -CrowdED methodology and function to simulate the two-staged experiment -evaluation of CrowdED via simulations and a real-world experiment -open-source code, available as a Python library, executable in a Jupyter notebook 2 . The library builds on the CrowdExperiments code (Zaveri et al, 2018).…”