Multi-Modal Deep Learning-Based Violin Bowing Action Recognition

Liu, Bao-Yun; Jen, Yi-Hsin; Sun, Shih-Wei; Su, Li; Chang, Pao-Chi

doi:10.1109/icce-taiwan49838.2020.9257995

Cited by 3 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The movements in these studies were repetitive reciprocating motions similar to tremolo, even with a longer period, suggesting that inertial sensor measurements may be valid for mandolin tremolo as well. As another example, Liu et al (2020) also used inertial sensors to measure the bowing motion of a violin, although they also used a depth camera, making the functionality similar to optical motion capture in effect. In addition to the cases of violin, there is an example of measuring hand movements during piano playing (Hadjakos et al, 2008), which also targeted repetitive reciprocating movements such as trill and tremolo.…”

Section: Introductionmentioning

confidence: 99%

Motion measurement of the hand during playing tremolo on mandolin using an inertial sensor (Difference between tremolo by the wrist and by the elbow)

FUKUNAGA

2023

JBSE

View full text Add to dashboard Cite

Tremolo is a technique to produce the same note continuously in short spans, and is an important technique for musical performance on a mandolin. However, it is not easy for beginners to master this technique, nor is it easy for even expert players to perform a wide range of expressions. There is no unified view on the proper behavior of tremolo playing, and there are no examples of measured tremolo behavior. In this study, we measured the hand movements during tremolo playing on a mandolin. One test subject was included in this study. An inertial sensor was attached to the back of the hand, and the movement was evaluated by the angles which were the time integrated angular velocity on each axis. Tremolo playing is a combination of elbow and wrist motion. We examined how those motions were used for playing strong/weak tones or fast/slow tremolos. The results showed that there was a clear difference in motion between tremolo using the wrist and tremolo using the elbow. The results also suggested that the combination of each joint motion was changed when adjusting the volume and tremolo speed. It indicated that the measurement of hand movements by inertial sensors could be used to evaluate tremolo playing. Our future plan includes a more detailed analysis of the relationship between musical expression and tremolo movement, and an examination of how movement changes with practice.

show abstract

Section: Introductionmentioning

confidence: 99%