Deep learning for gesture recognition in gym training performed by a vision-based augmented reality smart mirror

This paper illustrates the development and the validation of a smart mirror for sport training. The application is based the skeletonization algorithm MediaPipe and runs on an embedded device Nvidia Jetson Nano equipped with two fisheye cameras. The software has been evaluated considering the exercise biceps curl. The elbow angle has been measured by both MediaPipe and the motion capture system BTS (ground truth), and the resulting values have been compared to determine angle uncertainty, residual errors, and intra-subject and inter-subject repeatability. The uncertainty of the joints` estimation and the quality of the image captured by the cameras reflect on the final uncertainty of the indicator over time, highlighting the areas of improvements for further developments.
© Copyright 2022 ISBS Proceedings Archive (Michigan). Northern Michigan University. Julkaistu Tekijä International Society of Biomechanics in Sports. Kaikki oikeudet pidätetään.

Aiheet: liike harjoittelu harjoitusmenetelmä biomekaniikka
Aihealueet: tekniset ja luonnontieteet vapaa-ajan urheilu ja urheilu kaikille
Tagging: deep learning Augmented Reality
Julkaisussa: ISBS Proceedings Archive (Michigan)
Toimittajat: M. Robinson, M. Lake, B. Baltzopoulos, J. Vanrenterghem
Julkaistu: Liverpool International Society of Biomechanics in Sports 2022
Vuosikerta: 40
Numero: 1
Sivuja: Article 87
Julkaisutyypit: kongressin muistiinpanot
artikkeli
Kieli: englanti (kieli)
Taso: kehittynyt