Human Fall Motion Prediction: Fall Motion Forecasting and Detection with GRU

Andi Prademon Yunus, Amalia Beladinna Arifa, Yit Hong Choo

Abstract


The human fall motion prediction system is a preventive tool aimed at reducing the risk of falls. In our research, we developed a deep learning model that utilizes pose estimation to track human body posture and integrated this with a Gated Recurrent Unit (GRU) to forecast human motion and predict falls. GRU, an enhancement of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) models offers improved memorization and more efficient memory usage and performance. Our study presents the human fall motion prediction, which combines the forecasting and classification of potential falls.The CAUCAFall dataset is used as the benchmark of this study, which contains the image sequences of single human motion with ten actions conducted by ten actors. We employed the YOLOv8 Pose model to track the 2D human body pose as the input in our system. A thorough evaluation of the CAUCAFall dataset highlights the effectiveness of our proposed system. Evaluation using the CAUCAFall dataset demonstrates that the model achieved a Mean Per Joint Position Error (MPJPE) of 4.65 pixels from the ground truth, with a 70% accuracy rate in fall prediction. However, the model also exhibited a Mean Relative Error (MRE) of 0.3, indicating that 30% of the predictions were incorrect. These findings underscore the potential of the GRU-based system in fall prevention


Keywords


Human Body Motion Forecasting, Fall motion detection, Computer Vision, Deep Learning, Fall

Full Text:

PDF

References


J. G. Garrick, “The frequency of injury, mechanism of injury, and epidemiology of ankle sprains*,” Am J Sports Med, vol. 5, no. 6, pp. 241–242, Nov. 1977, doi: 10.1177/036354657700500606.

World Health Organization, “Falls,” https://www.who.int/news-room/fact-sheets/detail/falls.

D. C. Anderson, T. S. Postler, and T.-T. Dam, “Epidemiology of Hospital System Patient Falls,” American Journal of Medical Quality, vol. 31, no. 5, pp. 423–428, Sep. 2016, doi: 10.1177/1062860615581199.

S. K. Bhoi et al., “FallDS-IoT: A Fall Detection System for Elderly Healthcare Based on IoT Data Analytics,” in 2018 International Conference on Information Technology (ICIT), IEEE, Dec. 2018, pp. 155–160. doi: 10.1109/ICIT.2018.00041.

H. Ramirez, S. A. Velastin, I. Meza, E. Fabregas, D. Makris, and G. Farias, “Fall Detection and Activity Recognition Using Human Skeleton Features,” IEEE Access, vol. 9, pp. 33532–33542, 2021, doi: 10.1109/ACCESS.2021.3061626.

K. Fragkiadaki, S. Levine, P. Felsen, and J. Malik, “Recurrent Network Models for Human Dynamics.”

C. Ionescu, D. Papava, V. Olaru, and C. Sminchisescu, “Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments,” IEEE Trans Pattern Anal Mach Intell, vol. 36, no. 7, pp. 1325–1339, Jul. 2014, doi: 10.1109/TPAMI.2013.248.

J. Martinez, M. J. Black, and J. Romero, “On human motion prediction using recurrent neural networks.” [Online]. Available: https://github.com/una-dinosauria/

T. Sofianos, A. Sampieri, L. Franco, and F. Galasso, “Space-Time-Separable Graph Convolutional Network for Pose Forecasting.” [Online]. Available: https://github.com/FraLuca/STSGCN

W. Guo, Y. Du, X. Shen, V. Lepetit, X. Alameda-Pineda, and F. Moreno-Noguer, “Back to MLP: A Simple Baseline for Human Motion Prediction,” Jul. 2022.

T. Ma, Y. Nie, C. Long, Q. Zhang, and G. Li, “Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction,” Mar. 2022.

A. Bouazizi, A. Holzbock, U. Kressel, K. Dietmayer, and V. Belagiannis, “MotionMixer: MLP-based 3D Human Body Pose Forecasting,” Jul. 2022.

A. P. Yunus, K. Morita, N. C. Shirai, and T. Wakabayashi, “Time Series Self-Attention Approach for Human Motion Forecasting: A Baseline 2D Pose Forecasting,” Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 27, no. 3, pp. 445–457, May 2023, doi: 10.20965/jaciii.2023.p0445.

A. P. Yunus, K. Morita, N. C. Shirai, and T. Wakabayashi, “Temporal-Spatial Time Series Self-Attention 2D & 3D Human Motion Forecasting,” in 2023 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), IEEE, Jul. 2023, pp. 66–72. doi: 10.1109/IAICT59002.2023.10205596.

Z. Cao, G. Hidalgo, T. Simon, S.-E. Wei, and Y. Sheikh, “OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields,” Dec. 2018.

C. Diller, T. Funkhouser, and A. Dai, “Forecasting Characteristic 3D Poses of Human Actions,” Nov. 2020.

E. Vendrow, S. Kumar, E. Adeli, and H. Rezatofighi, “SoMoFormer: Multi-Person Pose Forecasting with Transformers,” Aug. 2022.

X. Li and D. Li, “GPFS: A graph-based human pose forecasting system for smart home with online learning,” ACM Trans Sens Netw, vol. 17, no. 3, Aug. 2021, doi: 10.1145/3460199.

J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling,” Dec. 2014.

J. C. E. Guerrero, E. M. España, M. M. Añasco, and J. E. P. Lopera, “Dataset for human fall recognition in an uncontrolled environment,” Data Brief, vol. 45, p. 108610, Dec. 2022, doi: 10.1016/j.dib.2022.108610.




DOI: https://doi.org/10.15408/jti.v17i2.41027 Abstract - 0 PDF - 0

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Andi Prademon Yunus, Amalia Beladinna Arifa, Yit Hong Choo

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

3rd Floor, Dept. of Informatics, Faculty of Science and Technology, UIN Syarif Hidayatullah Jakarta
Jl. Ir. H. Juanda No.95, Cempaka Putih, Ciputat Timur.
Kota Tangerang Selatan, Banten 15412
Tlp/Fax: +62 21 74019 25/ +62 749 3315
Handphone: +62 8128947537
E-mail: jurnal-ti@apps.uinjkt.ac.id


Creative Commons Licence
Jurnal Teknik Informatika by Prodi Teknik Informatika Universitas Islam Negeri Syarif Hidayatullah Jakarta is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://journal.uinjkt.ac.id/index.php/ti.

JTI Visitor Counter: View JTI Stats

 Flag Counter