Video and Audio Editing for Mobile Applications

Abstract

Video content creation and consumption have been increasingly available for the masses with the emergence of handheld devices capable of shooting, downloading, and playing videos. Video editing is a natural and necessary operation that is most commonly employed by users for finalizing and organizing their video content. With the constraints in processing power and memory, conventional spatial domain video editing is not a solution for mobile applications. In this paper, we present a complete video editing system for efficiently editing video content on mobile phones using compressed domain editing algorithms. A critical factor from usability point of view is the processing speed of the editing application. We show that with the proposed compressed domain editing system, typical video editing operations can be performed much faster than real-time on today's S60 phones.

ProPane

“…Even worse the Android platform does not provide direct access to arbitrary frames in the video stream. This has to do with the complex internal structure of modern video codecs [6,9]. But such a function is vital for a quick response.…”

Empirical observations on video editing in the mobile context

“…Laboratory tests and short-time field experiments are reported with good results. Hourunranta et al [6] describe a system for editing video on mobile devices but their work focuses on the necessary video editing algorithms and their implementation on mobile devices. No solution for the user interface is provided.…”

OpenCL embedded profile prototype in mobile device

“…The first of them were fixedfunction accelerators [6], whereas the latest standard, OpenGL ES 2.0 [7], allows for programmatic access to the GPU via programs written in a shading language. Applications such as mobile video editing [8] and mobile computer vision [9] are examples that have suitable computing use cases for current and future generations of mobile GPU. Usually there is no heavy 3D graphics running concurrently with these applications so the GPU is available for other processing.…”