Multimedia Annotation, Querying, and Analysis in Anvil

Maybury, Mark T.

doi:10.1002/9781118219546.ch21

Cited by 43 publications

(29 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…En la metodología de este estudio los videos de la actividad desplegada por cada sujeto fueron sometidos a microanálisis utilizando el sistema de anotación que posibilita el programa ANVIL (Kipp 2012). Este software permite volcar en diferentes tracks anotaciones de la información relativa a (i) la reproducción de la pista de audio, (ii) las ejecuciones con el instrumento y la voz; (iii) las evaluaciones de las armonías; y (iv) los gestos corporales.…”

Section: Acercando La Audición Extendida a La Cognición Corporeizadaunclassified

Audición armónica extendida. El rol del cuerpo y la experiencia en el uso del instrumento musical

Tanco¹,

Aún²

2013

Epistemus

View full text Add to dashboard Cite

El rol del cuerpo y la experiencia en el uso del instrumento musicalLa audición musical, entendida en el marco de la cognición corporeizada, supone una mente que se constituye más allá del cerebro, implicando a las acciones y movimientos corporales en el pensamiento. De acuerdo a la teoría de la mente extendida, el uso de un instrumento musical durante la práctica de la audición armónica cumplirá un rol esencial, constituyéndose en una herramienta de pensamiento integrada en el sistema cognitivo. Sin embargo, la idea de "mente" como producto del acoplamiento del cuerpo con el instrumento necesita ser considerada más concienzudamente en el contexto de la práctica musical, ya que se supone que la concreción de ese tipo de pensamiento en contexto sería el resultado de la forma que toman los ciclos de percepción-acción. La audición armónica en tanto práctica corporeizada implica un tipo de pensamiento orientado a "extraer" y/o sintetizar aspectos de la música en movimiento vinculados al componente armónico. En esta tarea, el uso del instrumento musical permite recuperar experiencias musicales pasadas, debido a la posibilidad que ofrece para conectar durante la performance actual las trayectorias motoras que fueron generadas anteriormente en la percepción armónica. Pensar a la audición armónica con el instrumento como una experiencia corporeizada y anclada que surge en la actividad de percepción-acción nos permitirá situar a la teoría de la mente extendida en el contexto de la práctica musical. música -audición armónica -cognición corporeizada -mente extendidaciclo de percepción-acción Epistemus (ISSN 1853-0494) Palabras Clave 124Listening to music as embodied cognition doesn't mean to consider a brain-centered system as mind only: It involves actions and body movements too. According to the theory of the extended mind, the use of a musical instrument in harmonic listening task is conceived as an integrated tool for thinking within an integrated cognitive system. However, the coupling of the body with the instrument as "mind" is required to be reviewed under the terms of musical practice, as it involves a kind of thinking and a particular context that, It is assumed, might shape the profiles of the perception-action cycles that take place during performance. In this sense, harmonic hearing involves a kind of thinking in movement, oriented to "extract" and / or synthesize aspects of music in relation to the harmonic component. In these tasks, the musical instrument employed is useful to recover musical experiences from the past, due to Its capacity to link the embodied construction of the motor pathways that are generated in performance to the harmonic percepts. In this way, thinking in harmonic hearing with the instrument as the embedded bodily experience that arise in the context of perception-action activity allow us to allocate the extended mind's theory within the context of musical practice. music -harmonic hearing -embodied cognition -extended mind -perception-action cycle Universidad Nacional de La Plata A...

show abstract

Section: Acercando La Audición Extendida a La Cognición Corporeizadaunclassified

Audición armónica extendida. El rol del cuerpo y la experiencia en el uso del instrumento musical

Tanco¹,

Aún²

2013

Epistemus

View full text Add to dashboard Cite

show abstract

“…where P (E) is obtained as follows: Table 2: Contingency tables and P (E) = 0.5 · 0.3 + 0.5 · 0.7 = 0.455 (6) For the second binarisation we receive the following coefficient (7): κ = 0.8 − 0.66 1 − 0.66 = 0.14 0.34 ≈ 0.412…”

Section: Comparison With Holle and Reinmentioning

confidence: 99%

“…As a metric reference value, the time line or the number of frames of the video film containing the recorded data has been used -cf. the time slices proposal of [6].…”

Section: Accounting For the Reliability Of Segmentationsmentioning

confidence: 99%

Assessing Agreement on Segmentations by Means of Staccato, the Segmentation Agreement Calculator according to Thomann

Lücking

Ptock

Bergmann

2012

Gesture and Sign Language in Human-Computer Interaction and Embodied Communication

View full text Add to dashboard Cite

Abstract. Staccato, the Segmentation Agreement Calculator According to Thomann, is a software tool for assessing the degree of agreement of multiple segmentations of some time-related data (e.g., gesture phases or sign language constituents). The software implements an assessment procedure developed by Bruno Thomann and will be made publicly available. The article discusses the rationale of the agreement assessment procedure and points at future extensions of Staccato. Segmentation and Annotation in Gesture StudiesNo matter what your favourite definition of co-verbal "hand and arm gesture" is, at the basic kinematic level gestures are manifested by spatio-temporal bodily movements. However, not every body movement constitutes gestural behaviour. Accordingly, a prerequisite of any empirical, data-driven account to gestures is to locate those segments in the continuous stream of hand and arm movements that make up the gestures. Furthermore, gestures are structured in themselves: a gesture basically has a tripartite movement profile, consisting of a preparation, a stroke, and a retraction phase [5]. Therefore, gestural hand-and-arm movements not only are to be identified, but are also to be subdivided into phases. In addition, temporary cessations of motion might occur either before or after the stroke phase -the so-called pre-and post-stroke holds [7].The demarcation of the temporal parts of a motion that constitutes a gesture and its phases is referred to as the segmentation problem throughout this article. The segmentation problem is not confined to gesture studies, of course; it also prevails in sign language research, and, generically, in accounts to temporally organised behaviour in general (think, e.g., of phoneticians that identify phonemes in a sound stream, choreographers that decompose dance figures, speech pathologists that demarcate deglutition phases, or traffic authority employees studying rush hour traffic). We focus on empirical work on gesture, however, where segmentation is typically carried out on video recordings, in which the significant movements are to be demarcated with respect to the video's time line.

show abstract

“…Annotation was performed by three expert viewers using ANVIL video annotation tool [74]. Movie segments that were considered salient at the audio sensory (A), visual sensory (V), audio-visual sensory (AV), and audio-visual sensory/semantic (AVS) level were labeled in separate annotation runs.…”

Section: Databasementioning

confidence: 99%

Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention

Evangelopoulos

Zlatintsi

Potamianos

et al. 2013

IEEE Trans. Multimedia

232

152

View full text Add to dashboard Cite

Abstract-Multimodal streams of sensory information are naturally parsed and integrated by humans using signal-level feature extraction and higher-level cognitive processes. Detection of attention-invoking audiovisual segments is formulated in this work on the basis of saliency models for the audio, visual and textual information conveyed in a video stream. Aural or auditory saliency is assessed by cues that quantify multifrequency waveform modulations, extracted through nonlinear operators and energy tracking. Visual saliency is measured through a spatiotemporal attention model driven by intensity, color and orientation. Textual or linguistic saliency is extracted from partof-speech tagging on the subtitles information available with most movie distributions. The individual saliency streams, obtained from modality-depended cues, are integrated in a multimodal saliency curve, modeling the time-varying perceptual importance of the composite video stream and signifying prevailing sensory events. The multimodal saliency representation forms the basis of a generic, bottom-up video summarization algorithm. Different fusion schemes are evaluated on a movie database of multimodal saliency annotations with comparative results provided across modalities. The produced summaries, based on low-level features and content-independent fusion and selection, are of subjectively high aesthetic and informative quality.

show abstract

Multimedia Annotation, Querying, and Analysis in Anvil

Cited by 43 publications

References 21 publications

Audición armónica extendida. El rol del cuerpo y la experiencia en el uso del instrumento musical

Audición armónica extendida. El rol del cuerpo y la experiencia en el uso del instrumento musical

Assessing Agreement on Segmentations by Means of Staccato, the Segmentation Agreement Calculator according to Thomann

Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention

Contact Info

Product

Resources

About