V4Design: Intelligent Analysis and Integration of Multimedia Content for Creative Industries

Abstract

Nowadays vast amounts of multimedia content is being produced, archived and digitised, resulting in great troves of data of interest. Examples include user-generated content, such as images, videos, text and audio posted by users on social media and wikis, or content provided through official publishers and distributors, such as digital libraries, organisations and online museums. This digital content can serve as a valuable source of inspiration to the creative industries, such as architecture and gaming, to produce new innovative assets or to enhance and (re-)use existing ones. However, in its current form, this content is difficult to be reused and repurposed due to the lack of appropriate solutions for its retrieval, analysis and integration into the design process. In this paper we present V4Design, a novel framework for the automatic content analysis, linking and seamless transformation of heterogeneous multimedia content to help architects and virtual reality game designers establish innovative value chains and end-user applications. By integrating and intelligently combining state-of-the-art technologies in computer vision, 3D generation, text analysis, generation and semantic integration and interlinking, V4Design provides architects and video game designers with innovative tools to draw inspiration from archive footage and documentaries, inspiring and eventually supporting the design process.

An Extended Reality System for Situation Awareness in Flood Management and Media Production Planning

“…All in all, these users of XR4DRAMA were particularly excited about the prospect of exploiting XR for a different purpose than what has previously been explored. Recent research [10][11][12][13][14] has focused on facilitating the creation of appealing XR stories for audiences. On the other hand, this work enables media people to use a single and complete XR solution that handles and optimizes the management of any media production, addressing its requirements for collaboration, content sharing, and realistic visualizations of remote locations.…”

“…Ever since the new wave of XR tools emerged, media organizations have been experimenting with the technology. For example, the Fader Enterprise project [10] was about building an interactive, browser-based 360/VR storytelling platform, V4Design [11,12] aimed at reusing/recycling content for 3D/immersive worlds, and MediaVerse [13] has also included immersive aspects in its quest to give users access to a wealth of media assets and co-creation opportunities. There were also smaller lab or hackathon projects such as Hidden Stories (https://innovation.dw.com/articles/hackathon-visualizing-globalinequalities-heres-what-we-came-up-with (accessed on 28 May 2023)) (in situ AR storytelling and explainer journalism), Deutsche Welle 360 World Heritage (https://www.…”

A Roadmap for Craft Understanding, Education, Training, and Preservation

“…Research efforts have focused on introducing innovative design tools to architects [74,75], studying historical design and patterns as a source of inspiration and craft preservation [76][77][78]. Traditional crafts in informal intergenerational knowledge transmission often have a specific focus on product type and regulated style.…”