Socially-aware multimedia authoring

Abstract

Creating compelling multimedia productions is a nontrivial task. This is as true for creating professional content as it is for nonprofessional editors. During the past 20 years, authoring networked content has been a part of the research agenda of the multimedia community. Unfortunately, authoring has been seen as an initial enterprise that occurs before ‘real’ content processing takes place. This limits the options open to authors and to viewers of rich multimedia content for creating and receiving focused, highly personal media presentations. This article reflects on the history of multimedia authoring. We focus on the particular task of supporting socially-aware multimedia , in which the relationships within particular social groups among authors and viewers can be exploited to create highly personal media experiences. We provide an overview of the requirements and characteristics of socially-aware multimedia authoring within the context of exploiting community content. We continue with a short historical perspective on authoring support for these types of situations. We then present an overview of a current system for supporting socially-aware multimedia authoring within the community content. We conclude with a discussion of the issues that we feel can provide a fruitful basis for future multimedia authoring support. We argue that providing support for socially-aware multimedia authoring can have a profound impact on the nature and architecture of the entire multimedia information processing pipeline.

Ubiquitous collaborative multimedia capture of live experiences toward authoring extensible interactive multimedia documents

“…In the context of multimedia capture, even though researchers report results exploiting multiple media -such as paper and photographs as in the work by Yeh et al (2006); paper and digital audio as presented by Pearson, Robinson and Jones (2015); typed text and electronic ink as proposed by Ren, Li and Lank (2014); audio, photos and information gathered from sensors available in mobile devices as investigated by Kay et al (2012) -many researchers make use of video as the principal media element, as in the work by Guimarães et al (2011), Guimarães, Cesar and Bulterman (2013), Cunha, Uscamayta and Pimentel (2016), Cunha, Machado Neto and Pimentel (2013), Ojala et al (2014).…”

“…In the context of multimedia access, researchers from industry and academy have proposed tools for visualization, extension and enrichment of multimedia elements captured by end users, as in the contributions by and Bulterman, Cesar and Guimarães (2013). The tools let users to perform tasks individually or collaboratively -the latter called collaborative multimedia authoring of user-generated content when resulting from the extension and enrichment of multimedia elements.…”

“…Exploiting such a context, many authors proposed use these existing video to generate a video result called video mix or mashup -the proposals include using videos freely available in collaborative communities in which users can transfer their videos from a particular event. Guimarães et al (2011) and Bulterman, Cesar and Guimarães (2013) proposed MyVideos as a hybrid authoring tool that integrates and synchronizes, using audio fingerprints, videos from an event provided by a community. A web application allow users to make annotations towards identifying participants in the video and, as result, plays a video mixed focused on a specific point of view.…”

“…2 The other solution is perform a synchronization the media elements (audio or video) using computer processing of fingerprints from the audio of the media elements. The application could use matching algorithms to detect matches between the different audio streams, as in the work by Kennedy and Naaman (2009), Haitsma and Kalker (2003), Guimarães, Cesar and Bulterman (2013).…”

“…This technological feature give some problems: 1) users that likes to record in HD the photos and HD videos have a limited device storage of the device, 2) even the popularization of cloud storage servers, the users have to deal with high prices and low bandwidth mobile networks. Researchers started working with photos and audio as well as video in multimedia production, and explore scenarios where the photos and audio are as important as video; examples include the work by Guimarães et al (2011), Guimarães, Cesar and Bulterman (2013), Cunha, Uscamayta and Pimentel (2016), Cunha, Machado Neto and Pimentel (2013), Ojala et al (2014). .…”