Creating Crowdsourced Research Talks at Scale

Abstract

There has been a marked shift towards learning and consuming information through video. Most academic research, however, is still distributed only in text form, as researchers often have limited time, resources, and incentives to create video versions of their work. To address this gap, we propose, deploy, and evaluate a scalable, end-to-end system for crowdsourcing the creation of short, 5-minute research videos based on academic papers. Doing so requires solving complex coordination and collaborative video production problems. To assist coordination, we designed a structured workow that enables ecient delegation of tasks, while also motivating the crowd through a collaborative learning environment. To facilitate video production, we developed an online tool with which groups can make micro-audio recordings that are automatically stitched together to create a complete talk. We tested this approach with a group of volunteers recruited from 52 countries through an open call. This distributed crowd produced over 100 video talks in 12 languages based on papers from top-tier computer science conferences. The produced talks consistently received high ratings from a diverse group of non-experts and experts, including the authors of the original papers. These results indicate that our crowdsourcing approach is a promising method for producing high-quality research talks at scale, increasing the distribution and accessibility of scientic knowledge.

A Low-Code Framework for Complex Crowdsourcing Work Based on Process Modeling

“…ese characteristics pose new challenges to the crowdsourcing process modeling. Similarly, Vaish et al [26] analyze task dependencies based on data view, indicating that complex work may achieve global goals through a large number of local (individual) efforts. Inspired by these, we explore combining business process modeling techniques to cover the dynamic execution features of complex crowdsourcing processes, especially when considering open-ended work.…”

Causeway

“…These include online labor markets providing opportunities for on-the-job learning [5,11,23] and micro-mentorship [16]; Citizen Science [8,37] for service learning; and computational ecosystems like Agile Research Studios [51] and Crowd Research [40] supporting novel forms of communities of practice. Some use learning to support crowdsourcing [11,41], or even to achieve crowdsourcing objectives through clever coordination of learner activity [14,43,47,49], an idea called learnersourcing [20].…”

From Paper to Card: Transforming Design Implications with Generative AI

“…Further, even if researchers are motivated, they may have limited understanding of what designers are seeking in design implications, and lack the skills needed to generate these cards so that they are inspiring [57]. A potential solution may be to leverage crowdwork-ideally crowds of designers-to perform this translational work; this approach has been explored for the creation of videos for research talks [65]. Nonetheless, changes in incentives are required for long-term sustainability.…”