The role of biomechanics in enhancing spoken English proficiency through articulation and gesture analysis
Abstract
This study investigates the biomechanical relationship between Articulation Clarity (AC) and gesture use in spoken English, focusing on how these elements contribute to Speech Fluency (SF), vocabulary retention, and comprehension. The research explores how the integration of articulation and gestures impacts communication effectiveness in English learners at varying proficiency levels. 78 participants were recruited, comprising intermediate and advanced English learners. The study employed a comprehensive biomechanical analysis using motion capture, acoustic analysis, and electromyography (EMG) to measure articulator movements (tongue, lips, jaw) and gesture dynamics (amplitude and frequency). The coordination between gesture and speech was analyzed through gesture-speech synchronization, while the effect of gestures on vocabulary retention and comprehension was assessed using Regression Analysis (RA). The findings revealed that advanced learners demonstrated significantly higher articulation clarity (mean amplitude of 67.9 dB) and more excellent Gesture Frequency (GF) (3.05 gestures/second) compared to intermediate learners. ANOVA results showed significant differences between proficiency levels in AC (p = 0.042) and SF (p = 0.008). RA indicated that gesture use positively impacted vocabulary retention (GF coefficient B = 2.15, p = 0.001) and comprehension (GF coefficient B = 1.98, p = 0.003). A moderate correlation was found between gesture amplitude and SF (r = 0.69) and AC (r = 0.54). Muscle activation data indicated increased effort during tasks with gestures, with significant differences in facial and upper limb muscle activation (p < 0.01). The study concludes that articulation and gestures are critical in enhancing SF, clarity, and comprehension in English learners. Advanced learners exhibit better biomechanical coordination between speech and gestures, increasing their proficiency. Gesture use supports vocabulary retention and reinforces speech articulation, making it a valuable tool in language learning. These findings suggest that integrating biomechanical training for articulation and gestures could improve spoken English proficiency, especially for second-language learners.
References
1. Ali, I. M. H. (2024). Verbal and Nonverbal Communication. Midad Al-Adab Refereed Journal, 1(English Department Conference).
2. Noël, R., Miranda, D., Cechinel, C., Riquelme, F., Primo, T. T., & Munoz, R. (2022). Visualizing collaboration in teamwork: A multimodal learning analytics platform for non-verbal communication. Applied Sciences, 12(15), 7499.
3. Ezeh, N. G., Anidi, O. C., & Nwokolo, B. O. (2021). Body Language as a Communicative Aid amongst Language Impaired Students: Managing Disabilities. English Language Teaching, 14(6), 125-134.
4. Tsunemoto, A., Lindberg, R., Trofimovich, P., & McDonough, K. (2022). Visual cues and rater perceptions of second language comprehensibility, accentedness, and fluency. Studies in Second Language Acquisition, 44(3), 659-684.
5. Urbanski, K. B., & Stam, G. (2022). Overview of multimodality and gesture in second language acquisition. In Gesture and Multimodality in Second Language Acquisition (pp. 1-25). Routledge.
6. Pérez-Parra, J. E., Suaza-Restrepo, A., & Restrepo-de-Mejía, F. (2022). Analysis of Verbal Language from the Theory of Human Movement as a Complex System. Int. J. Hum. Mov. Sports Sci, 10(3), 384-95.
7. Grosso Laguna, A., & Shifres, F. (2024). Visual and sound gesture in dance communication. Research in Dance Education, 25(2), 210-233.
8. Kröger, B. J. (2022). Computer-implemented articulatory models for speech production: A review. Frontiers in Robotics and AI, 9, 796739.
9. Pouplier, M. (2020). Articulatory phonology. In Oxford research encyclopedia of linguistics.
10. Goldin-Meadow, S. (2023). Thinking with your hands: The surprising science behind how gestures shape our thoughts. Hachette UK.
11. Hu, Q. (2024). Enhancing American Sign Language Communication with Virtual Reality: A Gesture Recognition Application on Oculus Quest 2 (Doctoral dissertation, Carleton University).
12. Dargue, N., & Sweller, N. (2020). Learning stories through gesture: Gesture’s effects on child and adult narrative comprehension. Educational Psychology Review, 32(1), 249-276.
13. Sweller, N., Choi, A. J., & Austin, E. (2024). Gesture production at encoding supports narrative recall. Psychological Research, 88(2), 535-546.
14. Indumathi N et al., Impact of Fireworks Industry Safety Measures and Prevention Management System on Human Error Mitigation Using a Machine Learning Approach, Sensors, 2023, 23 (9), 4365; DOI:10.3390/s23094365.
15. Parkavi K et al., Effective Scheduling of Multi-Load Automated Guided Vehicle in Spinning Mill: A Case Study, IEEE Access, 2023, DOI:10.1109/ACCESS.2023.3236843.
16. Ran Q et al., English language teaching based on big data analytics in augmentative and alternative communication system, Springer-International Journal of Speech Technology, 2022, DOI:10.1007/s10772-022-09960-1.
17. Ngangbam PS et al., Investigation on characteristics of Monte Carlo model of single electron transistor using Orthodox Theory, Elsevier, Sustainable Energy Technologies and Assessments, Vol. 48, 2021, 101601, DOI:10.1016/j.seta.2021.101601.
18. Huidan Huang et al., Emotional intelligence for board capital on technological innovation performance of high-tech enterprises, Elsevier, Aggression and Violent Behavior, 2021, 101633, DOI:10.1016/j.avb.2021.101633.
19. Sudhakar S, et al., Cost-effective and efficient 3D human model creation and re-identification application for human digital twins, Multimedia Tools and Applications, 2021. DOI:10.1007/s11042-021-10842-y.
20. Prabhakaran N et al., Novel Collision Detection and Avoidance System for Mid-vehicle Using Offset-Based Curvilinear Motion. Wireless Personal Communication, 2021. DOI:10.1007/s11277-021-08333-2.
21. Balajee A et al., Modeling and multi-class classification of vibroarthographic signals via time domain curvilinear divergence random forest, J Ambient Intell Human Comput, 2021, DOI:10.1007/s12652-020-02869-0.
22. Omnia SN et al., An educational tool for enhanced mobile e-Learning for technical higher education using mobile devices for augmented reality, Microprocessors and Microsystems, 83, 2021, 104030, DOI:10.1016/j.micpro.2021.104030 .
23. Firas TA et al., Strategizing Low-Carbon Urban Planning through Environmental Impact Assessment by Artificial Intelligence-Driven Carbon Foot Print Forecasting, Journal of Machine and Computing, 4(4), 2024, doi: 10.53759/7669/jmc202404105.
24. Shaymaa HN, et al., Genetic Algorithms for Optimized Selection of Biodegradable Polymers in Sustainable Manufacturing Processes, Journal of Machine and Computing, 4(3), 563-574, https://doi.org/10.53759/7669/jmc202404054.
25. Hayder MAG et al., An open-source MP + CNN + BiLSTM model-based hybrid model for recognizing sign language on smartphones. Int J Syst Assur Eng Manag (2024). https://doi.org/10.1007/s13198-024-02376-x
26. Bhavana Raj K et al., Equipment Planning for an Automated Production Line Using a Cloud System, Innovations in Computer Science and Engineering. ICICSE 2022. Lecture Notes in Networks and Systems, 565, 707–717, Springer, Singapore. DOI:10.1007/978-981-19-7455-7_57.
27. Kochetov, A. (2020). Research methods in articulatory phonetics II: Studying other gestures and recent trends. Language and Linguistics Compass, 14(6), e12371.
28. Villarreal-Narvaez, S., Sluÿters, A., Vanderdonckt, J., & Vatavu, R. D. (2024). Brave new GES world: A systematic literature review of gestures and referents in gesture elicitation studies. ACM Computing Surveys, 56(5), 1-55.
29. Madzlan, N. A., Sartho, R. M., & Mokhtar, M. M. (2022). The use of gesticulation to improve ESL learner’s understanding of content words in writing. AJELP: Asian Journal of English Language and Pedagogy, 10(2), 44-55.
30. Samifanni, F. (2020). The Fluency Way: A Functional Method for Oral Communication. English Language Teaching, 13(3), 100-114.
31. Yaprak, Z., & Kaya, F. (2020). Improving EFL learners’ oral production through reasoning-gap tasks enhanced with critical thinking standards: Developing and implementing a critical TBLT model, pre-task plan, and speaking rubric. Advances in Language and Literary Studies, 11(1), 40-50.
32. Serré, H., & Rochet-Capellan, A. (2024). Body-grounded Speech Rhythm: Ubiquitous interactions between speech, breathing, and limb movement.
Copyright (c) 2024 Hongbin Yin, Hong Cai
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright on all articles published in this journal is retained by the author(s), while the author(s) grant the publisher as the original publisher to publish the article.
Articles published in this journal are licensed under a Creative Commons Attribution 4.0 International, which means they can be shared, adapted and distributed provided that the original published version is cited.
Submit a Paper
