A Real-time Machine Learning Framework for Smart Home-based Yoga Teaching System

Sunney, Jothika, Jilani, Musfira, Pathak, Pramod and Stynes, Paul (2023) A Real-time Machine Learning Framework for Smart Home-based Yoga Teaching System. In: 7th International Conference on Machine Vision and Information Technology (CMVIT). IEEE Computer Society, Xiamen, China, pp. 107-114.

Full text not available from this repository.

Abstract

Practicing yoga poses in a home-based environment has increased due to Covid19. Yoga poses without a trainer can be challenging, and incorrect yoga poses can cause muscle damage. Smart home-based yoga teaching systems may aid in performing accurate yoga poses. However, the challenge with such systems is the computational time required to detect yoga poses. This research proposes a real-time machine learning framework for teaching accurate yoga poses. It combines a pose estimation model, a pose classification model, and a real-time feedback mechanism. The dataset consists of five popular yoga poses namely the downdog pose, the tree pose, the goddess pose, the plank pose, and the warrior pose. The BlazePose model was used for yoga pose estimation which transforms the image data into 3D landmark points. The output of the pose estimation model was then passed to the pose classification model for yoga pose detection. Four machine learning classifiers namely, Random Forest, Support Vector Machine, XGBoost, Decision Tree, and two neural network classifiers LSTM and CNN were evaluated based on accuracy, latency and size. Results demonstrate that XGBoost outperforms other models with an accuracy of 95.14 percentage, latency of 8 ms, and size of 513 KB. The output of the XGBoost Classifier was then used to correct yoga poses by displaying real-time feedback to the user. This novel framework has the potential to be integrated into mobile applications which can be used by people for the unsupervised practice of yoga at home.

Item Type:	Book Section
Uncontrolled Keywords:	Yoga Pose Detection; Machine Learning Framework; BlazePose; XGBoost
Subjects:	G Geography. Anthropology. Recreation > GV Recreation Leisure Q Science > QA Mathematics > Electronic computers. Computer science T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science Q Science > QP Physiology Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Machine learning
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Tamara Malone
Date Deposited:	09 Dec 2023 13:11
Last Modified:	09 Dec 2023 13:13
URI:	https://norma.ncirl.ie/id/eprint/6884

Actions (login required)

View Item