A Lightweight Skeleton-Based Fall Detection Framework Using Multi-Dimensional Attention Mechanisms

Authors

  • Zongfei Zhang
  • Haoze Ni

DOI:

https://doi.org/10.65563/jeaai.v1i9.77

Abstract

Fall detection is a critical task in intelligent healthcare and smart monitoring systems, particularly for elderly care, where timely and reliable detection can significantly reduce the risk of severe injuries. In this paper, we propose a lightweight fall detection framework based on human skeleton sequences and multi-dimensional attention mechanisms. Instead of relying on raw RGB information, the proposed approach leverages skeleton-based representations to reduce sensitivity to background clutter, illumination variation, and appearance differences.

The framework consists of four main stages: skeleton keypoint extraction and preprocessing, spatial feature encoding using a Coordinate Attention enhanced Transformer, temporal motion modeling via a Temporal Attention mechanism, and final classification. The Coordinate Attention module enables direction-aware spatial modeling of human joints, while the Temporal Attention mechanism adaptively emphasizes critical motion phases associated with falls, such as sudden posture collapse and rapid descent.

Extensive experiments are conducted on two public benchmark datasets, namely the University of Rzeszow Fall Detection Dataset (URFD) and the Multiple Cameras Fall Dataset (MCFD). The experimental results demonstrate that the proposed method consistently outperforms several representative state-of-the-art fall detection approaches, achieving higher precision, recall, and F$_1$-score. In particular, the significant improvement in recall highlights the effectiveness of the proposed model in reducing missed fall detections, which is crucial for safety-critical applications.

Furthermore, the proposed framework is designed with computational efficiency in mind. By employing a compact Transformer architecture and lightweight attention modules, the system achieves real-time inference on CPU-based platforms, making it suitable for deployment in resource-constrained environments such as smart homes and elderly care facilities. Overall, this work demonstrates that combining skeleton-based representations with efficient spatial–temporal attention mechanisms provides a practical and reliable solution for real-world fall detection.

References

Kripesh Adhikari, Hamid Bouchachia, and Hammadi Nait-Charif. Activity recognition for indoor fall detection using convolutional neural network. In 2017 Fifteenth IAPR International Conference on Machine VisionApplications (MVA), pages 81–84. IEEE, 2017.

[2] Umar Asif, Benjamin Mashford, Stefan Von Cavallar, Shivanthan Yohanandan, Subhrajit Roy, Jianbin Tang, and Stefan Harrer. Privacy preserving human fall detection using video data. In Machine Learning for Health Workshop, pages 39–51. PMLR, 2020.

[3] Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei,and Yaser Sheikh. Openpose: Realtime multi-person 2d pose estimation using part affinity fields. IEEE trans actions on pattern analysis and machine intelligence, 43(1):172–186, 2019.

[4] Sarah Almeida Carneiro, Gabriel Pellegrino da Silva, Guilherme Vieira Leite, Ricardo Moreno, Silvio Jamil F Guimaraes, and Helio Pedrini. Multi-stream deep convolutional network using high-level features applied to fall detection in video sequences. In 2019 International Conference on Systems, Signals and Image Processing (IWSSIP), pages 293–298. IEEE, 2019.

[5] Weiming Chen, Zijie Jiang, Hailin Guo, and Xiaoyang Ni. Fall detection based on key points of human-skeleton using openpose. Symmetry, 12(5):744, 2020.

[6] Yueng Santiago Delahoz and Miguel Angel Labrador. Survey on fall detection and fall prevention using wear able and external sensors. Sensors, 14(10):19806–19842,2014.

[7] Nashwa El-Bendary, Qing Tan, Fr´ ed´ erique C Pivot, and Anthony Lam. Fall detection and prevention for the elderly: A review of trends and challenges. Interna tional Journal on Smart Sensing and Intelligent Systems, 6(3):1230, 2013.

[8] Qi Feng, Chenqiang Gao, Lan Wang, Yue Zhao, Tiecheng Song, and Qiang Li. Spatio-temporal fall event detection in complex scenes using attention guided lstm. Pattern Recognition Letters, 130:242–249, 2020.

[9] Martha Magali Flores-Barranco, Mario-Alberto Ibarra Mazano, and Irene Cheng. Accidental fall detection based on skeleton joint correlation and activity boundary. In International Symposium on Visual Computing,pages 489–498. Springer, 2015.

[10] Jes´ us Guti´ errez, V´ ıctor Rodr´ ıguez, and Sergio Martin.Comprehensive review of vision-based fall detection systems. Sensors, 21(3):947, 2021.

[11] Van-Ha Hoang, Jong Weon Lee, Md Jalil Piran, and Chun-Su Park. Advances in skeleton-based fall detection in rgb videos: From handcrafted to deep learning approaches. IEEe Access, 11:92322–92352, 2023.

[12] Anitha Rani Inturi, VM Manikandan, and Vignesh Gar rapally. A novel vision-based fall detection scheme using key points of human skeleton with long short-term memory network. Arabian Journal for Science and Engineering, 48(2):1143–1155, 2023.

[13] Duncan Kibet, Min Seop So, Hahyeon Kang, Yongsu Han, and Jong-Ho Shin. Sudden fall detection of human body using transformer model. Sensors, 24(24):8051, 2024.

[14] Vungsovanreach Kong, Saravit Soeng, Munirot Thon, Wan-SupCho, AnandNayyar, andTae-KyungKim. Pifr: Anovel approach for analyzing pose angle-based human activity to automate fall detection in videos. PLoS One, 20(6):e0325253, 2025.

[15] Sergio Lafuente-Arroyo, Pilar Mart´ ın-Mart´ ın, Cristian Iglesias-Iglesias, Saturnino Maldonado-Basc´ on, and Francisco Javier Acevedo-Rodr´ ıguez. Rgb camera-based fallen person detection system embedded on a mobile platform. Expert Systems with Applications, 197:116715, 2022.

[16] Chuan-BiLin, ZiqianDong, Wei-KaiKuan, andYung-Fa Huang. A framework for fall detection based on open pose skeleton and lstm/gru models. Applied Sciences, 11(1):329, 2020.

[17] Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Guang Yong, Juhyun Lee, et al. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172, 2019.

[18] Haoze Ni, Xinyue Huang, and Wuyang Zhang. From de tection to prediction: A multimodal deep learning frame work for proactive fall risk monitoring in smart aging. INNO-PRESS: Journal of Emerging Applied AI, 1(6), 2025.

[19] Nadhira Noor and In Kyu Park. A lightweight skeleton based 3d-cnn for real-time fall detection and action recognition. In Proceedings of the IEEE/CVF Inter national Conference on Computer Vision, pages 2179 2188, 2023.

[20] Adri´ an N´ u˜ nez-Marcos and Ignacio Arganda-Carreras. Transformer-based fall detection in videos. Engineering Applications of Artificial Intelligence, 132:107937, 2024.

[21] Ali Raza, Muhammad Haroon Yousaf, Sergio A Ve lastin, and Serestina Viriri. Human fall detection from sequences of skeleton features using vision transformer. In VISIGRAPP (5: VISAPP), pages 591–598, 2023.

[22] LingmeiRenandYanjunPeng. Researchoffalldetection and fall prevention technologies: A systematic review. IEEE access, 7:77702 77722, 2019. 7 Journal of Emerging Applied Artificial Intelligence (JEAAI)

[23] Yuyang Sha, Xiaobing Zhai, Junrong Li, Weiyu Meng, Henry HY Tong, and Kefeng Li. A novel lightweight deep learning fall detection system based on global-local attention and channel feature augmentation. Interdisci plinary Nursing Research, 2(2):68–75, 2023.

[24] Raju Vaishya and Abhishek Vaish. Falls in older adults are serious. Indian journal of orthopaedics, 54(1):69–74, 2020.

[25] Leiyue Yao, Weidong Min, and Keqiang Lu. A new ap proach to fall detection based on the human torso motion model. Applied Sciences, 7(10):993, 2017.

[26] Xiaoqun Yu, Chenfeng Wang, Wenyu Wu, and Shup ing Xiong. A real-time skeleton-based fall detection al gorithm based on temporal convolutional networks and transformer encoder. Pervasive and Mobile Computing, 107:102016, 2025.

[27] Chunmiao Yuan, Pengju Zhang, Qingyong Yang, and Jianming Wang. Fall detection and direction judgment based on posture estimation. Discrete dynamics in na ture and society, 2022(1):8372291, 2022

Downloads

Published

2025-12-31