Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems 2020
DOI: 10.1145/3313831.3376320
|View full text |Cite
|
Sign up to set email alerts
|

"Hi! I am the Crowd Tasker" Crowdsourcing through Digital Voice Assistants

Abstract: Inspired by the increasing prevalence of digital voice assistants, we demonstrate the feasibility of using voice interfaces to deploy and complete crowd tasks. We have developed Crowd Tasker, a novel system that delivers crowd tasks through a digital voice assistant. In a lab study, we validate our proof-ofconcept and show that crowd task performance through a voice assistant is comparable to that of a web interface for voicecompatible and voice-based crowd tasks for native English speakers. We also report on … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
16
0

Year Published

2020
2020
2024
2024

Publication Types

Select...
4
2
2

Relationship

2
6

Authors

Journals

citations
Cited by 19 publications
(16 citation statements)
references
References 61 publications
0
16
0
Order By: Relevance
“…Gold Standard Questions & Qualification Tests [84], [113] Current Answer Distribution [168], [98], [8], [136] Previous Answers & Reputation Scores [133], [146] Worker Attributes Demographics [96], [148], [41], [30] Personality Tests [95], [96], [114] Skills [119], [106] Cognitive Tests [52], [71], [72] Work Device Features [44], [70] Worker Context [82], [73] Worker Behaviour Behavioural Traces [142], [65], [45], [60] Social Media Data [33], [165] 5.3.1 Gold Standard estions. Gold Standard Questions are questions with a known answer.…”
Section: Methods Literaturementioning
confidence: 99%
See 2 more Smart Citations
“…Gold Standard Questions & Qualification Tests [84], [113] Current Answer Distribution [168], [98], [8], [136] Previous Answers & Reputation Scores [133], [146] Worker Attributes Demographics [96], [148], [41], [30] Personality Tests [95], [96], [114] Skills [119], [106] Cognitive Tests [52], [71], [72] Work Device Features [44], [70] Worker Context [82], [73] Worker Behaviour Behavioural Traces [142], [65], [45], [60] Social Media Data [33], [165] 5.3.1 Gold Standard estions. Gold Standard Questions are questions with a known answer.…”
Section: Methods Literaturementioning
confidence: 99%
“…In addition, device sensing capabilities and battery level can also impact the quality of crowd contributions [68]. Hettiachchi et al [70] explore voice-based crowdsourcing, where workers complete crowd tasks through smart speakers and investigate if there is a performance difference compared to regular crowd work through desktop computers.…”
Section: Worker a Ributesmentioning
confidence: 99%
See 1 more Smart Citation
“…This problem, however, is not limited to crowdsourcing platforms or tasks and persists even in applications marketed at older adults [5]. To alleviate this problem crowdsourcing in a non-computer scenario may bring good results, such as with a remote on a TV screen [32], making use of familiar modes of interaction, as visible in Fig 4 or via a voice interface [10,31].…”
Section: Platformmentioning
confidence: 99%
“…Naturally, crowd task requesters are cautious of the additional costs that can be associated with more complex task assignment methods or quality control mechanisms [2,35]. For the majority of common methods, such as gold standard questions and qualification tests, this additional cost is repeated for every new task.…”
Section: Crowdcog Task Assignmentmentioning
confidence: 99%