Microtask programming

LaToza, Thomas D.; Towne, W. Ben; Adriano, Christian M.; Hoek, André van der

doi:10.1145/2642918.2647349

Cited by 75 publications

(32 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Some even enable collaborative, decentralized coordination instead of step-by-step instructions [46,86]. As the area advanced, it began to make progress in achieving significantly more complex and interdependent goals [43], such as knowledge aggregation [30], writing [43,61,78], ideation [84,85], clustering [12], and programming [11,50].…”

Section: Crowdsourcing Workflowsmentioning

confidence: 99%

“…Recent work instead sought to achieve complex goals by moving from microtask workers to expert workers. Such systems now support user interface prototyping [70], questionanswering and debugging for software engineers [11,22,50], worker management [28,45], remote writing tasks [61], and skill training [77]. For example, flash teams demonstrated that expert workflows can achieve far more complex goals than can be accomplished using microtask workflows [70].…”

Section: Crowdsourcing Workflowsmentioning

confidence: 99%

See 1 more Smart Citation

Flash Organizations

Valentine

Retelny

et al. 2017

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

126

View full text Add to dashboard Cite

This paper introduces flash organizations: crowds structured like organizations to achieve complex and open-ended goals. Microtask workflows, the dominant crowdsourcing structures today, only enable goals that are so simple and modular that their path can be entirely pre-defined. We present a system that organizes crowd workers into computationally-represented structures inspired by those used in organizations-roles, teams, and hierarchies-which support emergent and adaptive coordination toward open-ended goals. Our system introduces two technical contributions: 1) encoding the crowd's division of labor into de-individualized roles, much as movie crews or disaster response teams use roles to support coordination between on-demand workers who have not worked together before; and 2) reconfiguring these structures through a model inspired by version control, enabling continuous adaptation of the work and the division of labor. We report a deployment in which flash organizations successfully carried out open-ended and complex goals previously out of reach for crowdsourcing, including product design, software development, and game production. This research demonstrates digitally networked organizations that flexibly assemble and reassemble themselves from a globally distributed online workforce to accomplish complex work.

show abstract

Section: Crowdsourcing Workflowsmentioning

confidence: 99%

Section: Crowdsourcing Workflowsmentioning

confidence: 99%

Flash Organizations

Valentine

Retelny

et al. 2017

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

126

View full text Add to dashboard Cite

show abstract

“…The great innovation of the use of microtasks in software development resides in the atomization of the work in portions that employ the minimum of effort and time in its conclusion [8]. Microtasks can be represented by a similar concept of division of labor into small tasks Microtasks represent a promising area of research because of the gaps that are perceived in the literature, this is reflected by the absence of a taxonomy on the microtask (microtask, microtask, micro-task, etc.)…”

Section: A Microtasksmentioning

confidence: 99%

“…Microtasks are simple CS activities with a short duration time that can be paralleled [8]. Thus microtasks employ reduced time and effort, in addition to a relatively low development cost [9].…”

Section: Introductionmentioning

confidence: 99%

The Use of Microtasks in Crowdsourcing Software Development

Deus

Fabri

L’Erário

2017

JADI

View full text Add to dashboard Cite

show abstract

“…This decomposition is done to decrease complexity and the time required to solve the work given that several smaller tasks that can be tackled in parallel. Depending on the size of each task, they can be either a microtask [8], which refers to minute-length tasks with low cognitive effort, as discussed in [3,6] or a complex and time-consuming sub-problem, which remain simpler than the original project. Nevertheless, it is worth noticing that the benefit of presenting a software project as a collection of sub-tasks might be lost by the effort of putting back together the small pieces of code.…”

Section: Introductionmentioning

confidence: 99%

Correctness assessment of a crowdcoding project in a computer programming introductory course

Ferrán

Beghelli

Huerta-Cánepa

et al. 2017

Comp Applic In Engineering

View full text Add to dashboard Cite

Crowdcoding is a programming model that outsources a software project implementation to the crowd. As educators, we think that crowdcoding could be leveraged as part of the learning path of engineering students from a computer programming introductory course to solve local community problems. The benefits are twofold: on the one hand the students practice the concepts learned in class and, on the other hand, they participate in real-life problems. Nevertheless, several challenges arise when developing a crowdcoding platform, the first one being how to check the correctness of student's code without giving an extra burden to the professors in the course. To overcome this issue, we propose a novel system that does not resort to expert review; neither requires knowing the right answers beforehand. The proposed scheme automatically clusters the student's codes based solely on the output they produce. Our initial results show that the largest cluster contains the same codes selected as correct by the automated and human testing, as long as some conditions apply. K E Y W O R D Sautomated code correctness assessment, computer programming education, crowdcoding, software crowdsourcing | INTRODUCTIONCrowdsourcing gathers a vast and diverse group of people distributed around the world working towards a common goal resorting to the "wisdom of crowds." The assumption under this new collaborative work model is that the crowd can perform a task with higher speed and quality than any expert. In the crowdsourcing language, a requester is an organization or person that submits a task to a crowdsourcing platform. The workers are the people willing to carry out the task and submit their contributions to the same platform. Wikipedia is a wellknown example of crowdsourcing, but nowadays many organizations are using this collaborative work model to improve their business in diverse areas such as product design, drug development, mining, and software development [4,15].Crowdcoding (also known as Software Crowdsourcing) builds on the idea of crowdsourcing for software development projects. In a crowdcoding-based development, the original project (either as a whole or divided into smaller/simpler tasks) is presented as a coding challenge to an online community of software engineers. A group of reviewers ranks the submissions, and the best ones are selected to build the original project. One of the advantages attributed to crowdcoding is the lowering of defect rate thanks to the various development capacity provided by different programmers [7].We argue that crowdcoding can be successfully used in educative environments as a way to solve computer-related challenges from local communities. That is, resorting to students (workers) of computer programming courses to build 162 |

show abstract

Microtask programming

Cited by 75 publications

References 18 publications

Flash Organizations

Flash Organizations

The Use of Microtasks in Crowdsourcing Software Development

Correctness assessment of a crowdcoding project in a computer programming introductory course

Contact Info

Product

Resources

About