Achieving Complex Media Annotation through Collective Wisdom and Effort from the Crowd

Amorim, Marcello N. de; Neto, Fábio R. Assis; Santos, Celso A. S.

doi:10.1109/iwssip.2018.8439402

Cited by 5 publications

(9 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On the first project, Dwarakanath et al [5] applied crowdsourcing in the software domain using a parallel workflow with an outsourcing branch for the development. In the second project, Amorim et al [4] aggregated individual workers' contributions for achieving complex video annotation. In the sequel, concepts of our general-purpose conceptual model are highlighted in bold.…”

Section: Applying the Conceptual Model In Real Crowd-powered Projectsmentioning

confidence: 99%

“…According to Horton [1], Mason and Suri [2] and Mourelatos et al [3], widely known crowdsourcing platforms are, in fact, an online labour market based on platforms where the developers of such markets provide an infrastructure for individual payments, screen users who do not have legitimate accounts and restrict workers from connecting with each other. In Information Systems, crowdsourcing is usually applied to process digital objects and many fields can apply the obtained results, such as Multimedia [4], Software Engineering [5,6], Data Management and Analytic Tasks [7] and Crisis Management [8].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Essential elements, conceptual foundations and workflow design in crowd-powered projects

Santos

Baldi

Neto

et al. 2022

Journal of Information Science

View full text Add to dashboard Cite

Crowdsourcing arose as a problem-solving strategy that uses a large number of workers to achieve tasks and solve specific problems. Although there are many studies that explore crowdsourcing platforms and systems, little attention has been paid to define what a crowd-powered project is. To address this issue, this article introduces a general-purpose conceptual model that represents the essential elements involved in this kind of project and how they relate to each other. We consider that the workflow in crowdsourcing projects is context-oriented and should represent the planning and coordination by the crowdsourcer in the project, instead of only facilitating decomposing a complex task into subtask sets. Since structural models are limited to cannot properly represent the execution flow, we also introduce the use of behavioural conceptual models, specifically Unified Modeling Language (UML) activity diagrams, to represent the user, tasks, assets, control activities and products involved in a specific project.

show abstract

Section: Applying the Conceptual Model In Real Crowd-powered Projectsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Essential elements, conceptual foundations and workflow design in crowd-powered projects

Santos

Baldi

Neto

et al. 2022

Journal of Information Science

View full text Add to dashboard Cite

show abstract

“…The first case used four different tasks to produce videos enriched with multimedia features by adding additional content and navigation on raw videos [2]. The second case used two different tasks to analyze videos and produce MPEG-V file with metadata about sensory effects of wind and vibration [3].…”

Section: Case Studiesmentioning

confidence: 99%

Integrating Crowdsourcing and Human Computation for Complex Video Annotation Tasks

Amorim

Santos

Tavares

2020

Anais Estendidos Do XXVI Simpósio Brasileiro De Sistemas Multimídia E Web (WebMedia 2020)

Self Cite

View full text Add to dashboard Cite

Video annotation is an activity that aims to supplement this type of multimedia object with additional content or information about its context, nature, content, quality and other aspects. These annotations are the basis for building a variety of multimedia applications for various purposes ranging from entertainment to security. Manual annotation is a strategy that uses the intelligence and workforce of people in the annotation process and is an alternative to cases where automatic methods cannot be applied. However, manual video annotation can be a costly process because as the content to be annotated increases, so does the workload for annotating. Crowdsourcing appears as a viable solution strategy in this con- text because it relies on outsourcing the tasks to a multitude of workers, who perform specific parts of the work in a distributed way. However, as the complexity of required media annoyances increases, it becomes necessary to employ skilled labor, or willing to perform larger, more complicated, and more time-consuming tasks. This makes it challenging to use crowdsourcing, as experts demand higher pay, and recruiting tends to be a difficult activity. In order to overcome this problem, strategies based on the decom- position of the main problem into a set of simpler subtasks suitable for crowdsourcing processes have emerged. These smaller tasks are organized in a workflow so that the execution process can be formalized and controlled. In this sense, this thesis aims to present a new framework that allows the use of crowdsourcing to create applications that require complex video annotation tasks. The developed framework considers the whole process from the definition of the problem and the decomposition of the tasks, until the construction, execution, and management of the workflow. This framework, called CrowdWaterfall, contemplates the strengths of current proposals, incorporating new concepts, techniques, and resources to overcome some of its limitations.

show abstract

“…In relation to the crowdsourcing processes for multimedia authoring, it is possible to cite the work of Amorim et al [2], that used a process composed by cascade microtasks to generate interactive multimedia presentations from plain videos. In this work the audience was responsible for identifying the points of interest to be enriched, as well as making available, selecting and positioning the media content in the video to generate the multimedia composition.…”

Section: Related Workmentioning

confidence: 99%

Crowdsourcing authoring of sensory effects on videos

Amorim

Saleme

Neto

et al. 2019

Multimed Tools Appl

View full text Add to dashboard Cite

Human perception is inherently multi-sensorial involving five traditional senses: sight, hearing, touch, taste, and smell. In contrast to traditional multimedia, based on audio and visual stimuli, mulsemedia seek to stimulate all the human senses. One way to produce multi-sensorial content is authoring videos with sensory effects. These effects are represented as metadata attached to the video content, which are processed and rendered through physical devices into the user's environment. However, creating sensory effects metadata is not a trivial activity because authors have to identify carefully different details in a scene such as the exact point where each effect starts, finishes, and also its presentation features such as intensity, direction, etc. It is a subjective task that requires accurate human perception and time. In this article, we aim at finding out whether a crowdsourcing approach is suitable for authoring coherent sensory effects associated with video content. Our belief is that the combination of a collective common sense to indicate time intervals of sensory effects with an expert fine-tuning is a viable way to generate sensory effects from the point of view of users. To carry out the experiment, we selected three videos from a public mulsemedia dataset, sent them to the crowd through a cascading microtask approach. The results showed that the crowd can indicate intervals in which users agree that there should be insertions of sensory effects, revealing a way of sharing authoring between the author and the crowd.

show abstract

Achieving Complex Media Annotation through Collective Wisdom and Effort from the Crowd

Cited by 5 publications

References 6 publications

Essential elements, conceptual foundations and workflow design in crowd-powered projects

Essential elements, conceptual foundations and workflow design in crowd-powered projects

Integrating Crowdsourcing and Human Computation for Complex Video Annotation Tasks

Crowdsourcing authoring of sensory effects on videos

Contact Info

Product

Resources

About