Biomechanical data-driven prediction and analysis based on transformer model
Abstract
With the development of high-precision sensors and data acquisition equipment, biomechanical data presents high-dimensional, strong time-series dependence and nonlinear characteristics, and it is difficult for traditional physical modeling and statistical methods to process such data efficiently and accurately. The purpose of this paper is to build a biomechanical data-driven prediction framework based on Transformer model, and realize high-precision prediction by deeply mining the time series characteristics of data, which provides theoretical support and practical application value for medical diagnosis, rehabilitation monitoring and sports science. In terms of methods, this paper preprocesses biomechanical data such as joint angle, electromyography (EMG) and joint stress, and designs a time series prediction framework based on the self-attention mechanism of Transformer model. Through the simulation experiment, five indexes, namely mean square error (MSE), mean absolute error (MAE), determination coefficient (R2), prediction time and Pearson correlation coefficient, are selected to evaluate and compare the performance of the model. The experimental results show that the Transformer model is superior to the traditional LSTM, GRU and ARIMA models in all kinds of biomechanical data prediction tasks: MSE is 0.0152, R2 is as high as 0.982, and the prediction time is only 0.76 s. In addition, Pearson correlation coefficient is close to 1 in different data types, which verifies the high consistency between the predicted results of the model and the real values. The conclusion of this paper shows that the Transformer model can effectively capture the global spatio-temporal characteristics of biomechanical data, and has high precision, high efficiency and strong generalization ability, which provides new technical means and theoretical support for biomechanical data-driven analysis and application.
References
1. Yu X, Li S, Zhang Y. Incorporating convolutional and transformer architectures to enhance semantic segmentation of fine-resolution urban images. European Journal of Remote Sensing. 2024; 57(1). doi: 10.1080/22797254.2024.2361768
2. Gong H, Xi J, Li C, et al. Channel transformer based multi field-of-view model to detect tumor spread through air space in histopathological images. Expert Systems with Applications. 2025; 266: 126125. doi: 10.1016/j.eswa.2024.126125
3. Si X, Zhang S, Yang Z, et al. A bidirectional cross-modal transformer representation learning model for EEG-fNIRS multimodal affective BCI. Expert Systems with Applications. 2025; 266: 126081. doi: 10.1016/j.eswa.2024.126081
4. Vazrala S, Khatoon Mohammed T. RBTM: A Hybrid gradient Regression-Based transformer model for biomedical question answering. Biomedical Signal Processing and Control. 2025; 102: 107325. doi: 10.1016/j.bspc.2024.107325
5. Goshayesh N, Rajabi R, Kuhestani A, et al. Intelligent secure transmission in untrusted relaying systems with hardware impairments. Physical Communication. 2025; 68: 102583. doi: 10.1016/j.phycom.2024.102583
6. Cui X, Zhang C, Li J, et al. Channel estimation based on dual frequency domain Transformer in time-frequency doubly-selective fading underwater acoustic channels. Physical Communication. 2025; 68: 102585. doi: 10.1016/j.phycom.2024.102585
7. Xu Z, Dai M, Zhang Q, et al. HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation. Neurocomputing. 2025; 619: 129154. doi: 10.1016/j.neucom.2024.129154
8. Saeed F, Rehman A, Shah HA, et al. SmartFormer: Graph-based transformer model for energy load forecasting. Sustainable Energy Technologies and Assessments. 2025; 73: 104133. doi: 10.1016/j.seta.2024.104133
9. Wu P, Fang X, Fang H, et al. An Event Log Repair Method Based on Masked Transformer Model. Applied Artificial Intelligence. 2024; 38(1). doi: 10.1080/08839514.2024.2346059
10. Song Y, Zhou Q. Bi-Modal Bi-Task Emotion Recognition Based on Transformer Architecture. Applied Artificial Intelligence. 2024; 38(1). doi: 10.1080/08839514.2024.2356992
11. Burukanli M, Yumuşak N. TfrAdmCov: a robust transformer encoder based model with Adam optimizer algorithm for COVID-19 mutation prediction. Connection Science. 2024; 36(1). doi: 10.1080/09540091.2024.2365334
12. Peng X, Xu C, Zhang P, et al. Computer vision classification detection of chicken parts based on optimized Swin-Transformer. CyTA - Journal of Food. 2024; 22(1). doi: 10.1080/19476337.2024.2347480
13. Li K, Chen P, Chen Q, et al. A hybrid network using transformer with modified locally linear embedding and sliding window convolution for EEG decoding. Journal of Neural Engineering. 2024; 21(6): 066049. doi: 10.1088/1741-2552/ada30b
14. Sbei A, ElBedoui K, Barhoumi W. Assessing the Efficiency of Transformer Models with Varying Sizes for Text Classification: A Study of Rule-Based Annotation with DistilBERT and Other Transformers. Vietnam Journal of Computer Science; 2024.
15. Li X, Jin W, Klinger J, et al. Data-driven mechanical behavior modeling of granular biomass materials. Computers and Geotechnics. 2025; 177: 106907. doi: 10.1016/j.compgeo.2024.106907
16. He H, Fang C, Liu L, et al. Environmental Driving of Adaptation Mechanism on Rumen Microorganisms of Sheep Based on Metagenomics and Metabolomics Data Analysis. International Journal of Molecular Sciences. 2024; 25(20): 10957. doi: 10.3390/ijms252010957
17. Qi B, Yan Y, Zhang W. Investigations into the flow dynamics of mixed biomass particles in a fluidized bed through Hilbert-Huang transformation and data-driven modelling. Particuology. 2024; 95: 115-123. doi: 10.1016/j.partic.2024.09.010
18. Ma S, Li R, Gong Q, et al. Using Data-Driven Algorithms with Large-Scale Plasma Proteomic Data to Discover Novel Biomarkers for Diagnosing Depression. Journal of Proteome Research. 2024; 23(9): 4043-4054. doi: 10.1021/acs.jproteome.4c00389
19. Kwon YK, Kim MJ, Choi YJ, et al. Lead exposure estimation through a physiologically based toxicokinetic model using human biomonitoring data and comparison with scenario-based exposure assessment: A case study in Korean adults. Food and Chemical Toxicology. 2024; 191: 114829. doi: 10.1016/j.fct.2024.114829
20. Kim K, Wiersema P, Ir Ryu J, et al. Experimental and data-driven chemical kinetic modeling study of alcohol-to-jet (ATJ) synthetic biofuel for sustainable aviation fuels. Fuel. 2024; 368: 131630. doi: 10.1016/j.fuel.2024.131630
Copyright (c) 2025 Author(s)

This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright on all articles published in this journal is retained by the author(s), while the author(s) grant the publisher as the original publisher to publish the article.
Articles published in this journal are licensed under a Creative Commons Attribution 4.0 International, which means they can be shared, adapted and distributed provided that the original published version is cited.