Human motion and musical expression: Exploring the link between physical movement and emotional resonance in performance
Abstract
Musical performance has traditionally been understood as an auditory experience, with emotions conveyed primarily through sound. However, emerging research highlights the role of physical movement—gestures, posture, and body language—in enhancing emotional expression and creating a deeper connection between performers and their audiences. While existing studies have explored some aspects of this relationship, there is limited understanding of how specific movements modulate emotional responses across different musical genres. This study addresses these gaps by investigating the interaction between human motion and musical expression, focusing on the emotional resonance experienced by performers and audience members. The need for this study arises from the lack of comprehensive data on the correlation between movement and emotional engagement during musical performances, particularly concerning different genres. Using motion capture, biometric sensors, and facial recognition technology, the research analyzed the performances of professional and amateur musicians across classical, jazz, and contemporary music. Audience members’ emotional responses were captured through physiological data and post-performance surveys. One limitation of this study is that it focused solely on live performance environments, leaving digital or virtual performances unexplored. Key findings reveal that expressive movements increased emotional intensity ratings by 1.6 points (p < 0.001), with heart rate rising by 6.9 BPM (p < 0.0012) and electrodermal activity increasing by 1.6 µS (p < 0.0008). Movement synchronization with musical elements, especially during climaxes, strongly correlated with heightened emotional responses (r = 0.85, p < 0.01). Classical performances exhibited the highest synchronization between movement and emotion, with audience emotional intensity peaking at 8.3 on a Likert scale.
References
1. Efthymiou L, Scheuregger M. Audience perception in experiential embodied music theatre: A practice-based case study. Act. Zeitschrift für Musik & Performance. 2021: 10.
2. Panda R, Malheiro R, Paiva RP. Audio Features for Music Emotion Recognition: A Survey. IEEE Transactions on Affective Computing. 2023; 14(1): 68-88. doi: 10.1109/taffc.2020.3032373
3. Baumann F. Embodied Human–Computer Interaction in Vocal Music Performance. Springer International Publishing; 2023. doi: 10.1007/978-3-031-17985-3
4. Broughton MC, Dimmick J, Dean RT. Affective and Cognitive Responses to Musical Performances of Early 20th Century Classical Solo Piano Compositions. Music Perception. 2021; 38(3): 245-266. doi: 10.1525/mp.2021.38.3.245
5. Tait P. Theory for Theatre Studies: Emotion. Bloomsbury Publishing Plc; 2021. doi: 10.5040/9781350030886
6. Chen A. Harmony Teaching Research — Implication for Music Education. Art and Society. 2024; 3(1): 13-44. doi: 10.56397/as.2024.02.02
7. Shemesh A, Leisman G, Bar M, et al. The emotional influence of different geometries in virtual spaces: A neurocognitive examination. Journal of Environmental Psychology. 2022; 81: 101802. doi: 10.1016/j.jenvp.2022.101802
8. Menolotto M, Komaris DS, Tedesco S, et al. Motion Capture Technology in Industrial Applications: A Systematic Review. Sensors. 2020; 20(19): 5687. doi: 10.3390/s20195687
9. Roggio F, Ravalli S, Maugeri G, et al. Technological advancements in the analysis of human motion and posture management through digital devices. World Journal of Orthopedics. 2021; 12(7): 467-484. doi: 10.5312/wjo.v12.i7.467
10. Mangalam M, Fragaszy DM, Wagman JB, et al. On the psychological origins of tool use. Neuroscience & Biobehavioral Reviews. 2022; 134: 104521. doi: 10.1016/j.neubiorev.2022.104521
11. Anderson DI, Lohse KR, Lopes TCV, et al. Individual differences in motor skill learning: Past, present and future. Human Movement Science. 2021; 78: 102818. doi: 10.1016/j.humov.2021.102818
12. Laroche J, Tomassini A, Volpe G, et al. Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble. Frontiers in Human Neuroscience. 2022; 16. doi: 10.3389/fnhum.2022.899676
13. Carr NR, Olsen KN, Thompson WF. The Perceptual and Emotional Consequences of Articulation in Music. Music Perception. 2023; 40(3): 202-219. doi: 10.1525/mp.2023.40.3.202
14. Rocke S, Davidson JW, Kiernan F. Emotion and Performance Practices. The Oxford Handbook of Music Performance, Volume 1. Published online January 13, 2022: 456-483. doi: 10.1093/oxfordhb/9780190056285.013.29
15. Li S. An Embodied Perspective on Piano Timbre: Conceptualisation and Communication in Performance and Educational Context [PhD thesis]. University of Sheffield; 2020.
16. Rescigno J. Conducting Opera: Where Theater Meets Music. University of North Texas Press. 2020.
17. Iott S. Thinking and Playing Music. Nomos Verlagsgesellschaft mbH & Co. KG 2021. doi: 10.5771/9781538155325
18. Taylor A. Death of the Composer? Making Meanings from Musical Performance. Music & Practice. 2020: 6.
19. Khulusi R, Kusnick J, Meinecke C, et al. A Survey on Visualizations for Musical Data. Computer Graphics Forum. 2020; 39(6): 82-110. doi: 10.1111/cgf.13905
20. Lin W, Li C. Review of Studies on Emotion Recognition and Judgment Based on Physiological Signals. Applied Sciences. 2023; 13(4): 2573. doi: 10.3390/app13042573
21. Lackmann S, Léger PM, Charland P, et al. The Influence of Video Format on Engagement and Performance in Online Learning. Brain Sciences. 2021; 11(2): 128. doi: 10.3390/brainsci11020128
22. Tong X, Chen Y, Zhou S, et al. How background visual complexity influences purchase intention in live streaming: The mediating role of emotion and the moderating role of gender. Journal of Retailing and Consumer Services. 2022; 67: 103031. doi: 10.1016/j.jretconser.2022.103031
23. Lam M. The Physicality of Music Production: Investigating the Roles of Mindful Practice and Kinesthetic Learning. Music Educators Journal. 2020; 106(3): 23-28. doi: 10.1177/0027432119895553
24. Kilgus K. Mind-Body Awareness: Reconceptualizing Higher Education Music Performance Curricula [PhD thesis]. University of Cincinnati; 2024.
25. Jola C. Quantifying dance in the audience’s mind. Routledge Companion to Audiences and the Performing Arts. 2022: 278-292. doi: 10.4324/9781003033226-22
26. Casale C, Moffat R, Cross ES. Aesthetic evaluation of body movements shaped by embodiment and arts experience: Insights from behaviour and fNIRS. 2023. doi: 10.31234/osf.io/n24kc
Copyright (c) 2024 Fei Tong
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright on all articles published in this journal is retained by the author(s), while the author(s) grant the publisher as the original publisher to publish the article.
Articles published in this journal are licensed under a Creative Commons Attribution 4.0 International, which means they can be shared, adapted and distributed provided that the original published version is cited.
Submit a Paper
