2012
DOI: 10.1177/1470357212446414
|View full text |Cite
|
Sign up to set email alerts
|

Interactive software for multimodal analysis

Abstract: This article presents the design and functionalities of interactive software for multimodal analysis currently being developed in the Multimodal Analysis Lab, Interactive Digital Media Institute (IDMI) at the National University of Singapore. The software is being used for the annotation, analysis, search and retrieval of semantic patterns in unified but complex semiotic actsfor example, the interaction of gesture, gaze, intonation, camera angle, and music in a film. In addition to providing a digital platform… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
20
0

Year Published

2014
2014
2022
2022

Publication Types

Select...
3
2
1

Relationship

0
6

Authors

Journals

citations
Cited by 30 publications
(20 citation statements)
references
References 13 publications
0
20
0
Order By: Relevance
“…Using video editing software, multiple sequences (consisting of onset, completion and apex frames) are analyzed for repetition. In order to amplify reoccurring embodied messages to the reader, researchers use thumbnails of the video frames and rearrange mutually resembling sequences in blocks (see Figure below for illustration) to allow for an easier visual analysis (e.g., O'Halloran et al , : 369). The block arrangement calls for an active eye to look for differences and similarities in the frame grabs and avoids the need to recall images scattered over multiple pages in the research article (Tufte, : 33).…”
Section: Toolkit For Analyzing and Presenting Video Data: Three Technmentioning
confidence: 99%
“…Using video editing software, multiple sequences (consisting of onset, completion and apex frames) are analyzed for repetition. In order to amplify reoccurring embodied messages to the reader, researchers use thumbnails of the video frames and rearrange mutually resembling sequences in blocks (see Figure below for illustration) to allow for an easier visual analysis (e.g., O'Halloran et al , : 369). The block arrangement calls for an active eye to look for differences and similarities in the frame grabs and avoids the need to recall images scattered over multiple pages in the research article (Tufte, : 33).…”
Section: Toolkit For Analyzing and Presenting Video Data: Three Technmentioning
confidence: 99%
“…A teacher prepares in advance both learning materials and attribute space, which are stored on the server side. At the client side, learning material and attribute space are fetched and presented to students via the MMA software [5], which is employed to produce a multimodal analysis using annotations in the interactive learning situation. The MMA software [5] can also be implemented as a web application, with the learning material on the browser.…”
Section: System Modelmentioning
confidence: 99%
“…At the client side, learning material and attribute space are fetched and presented to students via the MMA software [5], which is employed to produce a multimodal analysis using annotations in the interactive learning situation. The MMA software [5] can also be implemented as a web application, with the learning material on the browser. Students perform an annotation-based study, annotating the learning material with the provided attribute space (catalog).…”
Section: System Modelmentioning
confidence: 99%
See 2 more Smart Citations