- Conference Article
- 10.1117/12.3107494
A method for post-fall micro-expression perception and rehabilitation prescription recommendation based on lightweight multimodal deep learning and traditional Chinese medicine knowledge graph
- Mar 19, 2026
- Songying Wu + 5 more +5
Addressing the challenges of high fall risk among the elderly, untimely post-fall assessment, and lack of targeted rehabilitation plans, this paper proposes a method for post-fall micro-expression perception and rehabilitation prescription recommendation based on lightweight multimodal deep learning and Traditional Chinese Medicine knowledge graph. Firstly, the YOLOv9-tiny pose estimation technique is employed to achieve lightweight real-time human fall detection. Secondly, using Mini-Xception as the foundational model for facial micro-expression detection after falls, an SE-Mini-Xception model is constructed by embedding the Squeeze-and-Excitation (SE) attention mechanism to enhance facial micro-expression detection performance, while establishing a facial expression pain scale based on the Facial Action Coding System (FACS). Finally, based on the expression pain scale, Neo4j is utilized to construct a Traditional Chinese Medicine rehabilitation prescription recommendation system, with frontend-backend interaction implemented through Flask and Vue. The results demonstrate that YOLOv9-tiny achieves a precision (P) of 89.7%, recall (R) of 88.4%, and mAP@0.5 of 92.4% in human fall detection, with a parameter count of 2.62M. The improved SE-Mini-Xception model shows 8.78% and 9.04% enhancements in accuracy and recall rates respectively for facial micro-expression detection after falls compared to the original Mini-Xception. The constructed knowledge graph system for TCM classical prescriptions enables rapid matching and recommendation of corresponding rehabilitation prescriptions. In summary, the proposed method demonstrates substantial effectiveness in real-time fall detection and rehabilitation for the elderly, while being more suitable for deployment on lightweight mobile terminals, providing a novel solution for real-time fall detection and rehabilitation in practical scenarios for the elderly.
Read more