Monotasking or Multitasking

Lascau, Laura; Gould, Sandy J. J.; Cox, Anna L.; Karmannaya, Elizaveta; Brumby, Duncan P.

doi:10.1145/3290605.3300649

Cited by 39 publications

(19 citation statements)

References 58 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…A final technical consideration which affected the user experience was how tasks could be resumed. Crowdworkers may choose to operate on many tasks at once [24], and switch between these tasks [10]. To prevent participants loosing their work, but also from preparing answers in advance away from the environment, the implementation caused questions which were revisited (such as due to a browser refresh, or picking up the question in a latter HIT) to be skipped.…”

Section: Discussionmentioning

confidence: 99%

Companion Proceedings of the 5th International Conference on the Art, Science, and Engineering of Programming

2021

View full text Add to dashboard Cite

Developing and maintaining a correct and consistent model of how code will be executed is an ongoing challenge for software developers. However, validating the tools and techniques we develop to aid programmers can be a challenge plagued by small sample sizes, high costs, or poor generalisability. This paper serves as a case study using a web-based crowdsourcing approach to study programmer behaviour at scale. We demonstrate this method to create controlled coding experiments at modest cost, highlight the efficacy of this approach with objective validation, and comment on notable findings from our prototype experiment into one of the most ubiquitous, yet understudied, features of modern software development environments: syntax highlighting. CCS CONCEPTS• Human-centered computing → Empirical studies in HCI; • Software and its engineering → Integrated and visual development environments.

show abstract

Section: Discussionmentioning

confidence: 99%

Companion Proceedings of the 5th International Conference on the Art, Science, and Engineering of Programming

2021

View full text Add to dashboard Cite

show abstract

“…Several researchers have emphasized the need to more deeply consider the "ethics and values of crowdwork" [51], especially as it becomes a significant source for invisible and underpaid labor [39,45,51]. This area of research has produced a rich qualitative description of Turkers' experiences [20,44,61,70,102], including through ethnographic [40,71,72,88] approaches. This work highlights issues such as power imbalances between the higher social and socioeconomic status that requesters have compared to Turkers [41] and Turkers' need to develop task-specific skills while "on-the-job" so that their work will be compensated [29,55,74].…”

Section: Social and Ethical Issues Inmentioning

confidence: 99%

"I Hope This Is Helpful"

Simons

Gurari

Fleischmann

2020

Proc. ACM Hum.-Comput. Interact.

View full text Add to dashboard Cite

AI image captioning challenges encourage broad participation in designing algorithms that automatically create captions for a variety of images and users. To create large datasets necessary for these challenges, researchers typically employ a shared crowdsourcing task design for image captioning. This paper discusses findings from our thematic analysis of 1,064 comments left by Amazon Mechanical Turk workers using this task design to create captions for images taken by people who are blind. Workers discussed difficulties in understanding how to complete this task, provided suggestions of how to improve the task, gave explanations or clarifications about their work, and described why they found this particular task rewarding or interesting. Our analysis provides insights both into this particular genre of task as well as broader considerations for how to employ crowdsourcing to generate large datasets for developing AI algorithms.

show abstract

“…Last, online workers may be affected by a multitude of stimuli due to multitasking [40]. Workers on crowdsourcing platforms, in particular, are known to engage in multitasking as a strategy to maximise their earnings [30,38]. It is possible that multitasking may reduce the effectiveness of computational priming on crowdsourcing platforms because the context of workers cannot be controlled.…”

Section: Design Recommendations For Using Roles In Computational Primingmentioning

confidence: 99%

Design recommendations for augmenting creative tasks with computational priming

Oppenlaender

Hosio

2019

Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

View full text Add to dashboard Cite

Supporting creativity is a grand challenge in HCI. A critical component of creativity is the ability for divergent thinking, and divergent thinking can be fostered through looking at the problem through the lens of a different person, by assuming a role. Prior work found that assuming a role and affective stimulation with images may lead individuals to be more creative. In this work, we investigate the use of roles in stimulating the creativity of individuals in two complementary studies. In the first study, we implemented an online instrument for augmenting creativity with roles and images, and recruited crowd workers (n = 60) to complete a divergent thinking task while assuming a role. Interestingly, and in contrast to earlier findings, our analysis could not confirm the computational priming having an effect on the outcome of a small batch of creative tasks. In the second study, we observed the effect of roles on the ideation process of individuals when they reach an impasse in the flow of ideas. Our complementary studies highlight that adopting roles can help when one runs out of ideas, but this is not a silver bullet for improving divergent thinking, especially in online crowdsourcing environments that are increasingly being used for experiments and data collection in behavioural science. Our work informs the design of future crowd-powered creativity support tools and contributes a timely case study to the body of literature in the growing field of creativity support online.

show abstract

Monotasking or Multitasking

Cited by 39 publications

References 58 publications

Companion Proceedings of the 5th International Conference on the Art, Science, and Engineering of Programming

Companion Proceedings of the 5th International Conference on the Art, Science, and Engineering of Programming

"I Hope This Is Helpful"

Design recommendations for augmenting creative tasks with computational priming

Contact Info

Product

Resources

About