A convolutional sequence to sequence model for multimodal dynamics prediction in ski jumps

A convolutional sequence to sequence model for predicting the jump forces of ski jumpers directly from pose estimates is presented. We collect the footage of multiple, unregistered cameras together with the output of force measurement plates and present a spatiotemporal calibration procedure for all modalities which is merely based on the athlete's pose estimates. The synchronized data is used to train a fully convolutional sequence to sequence network for predicting jump forces directly from the human pose. We demonstrate that the best performing networks produce a mean squared error of 0.062 on normalized force time series while being able to identify the moment of maximal force occurrence in the original video at 55% recall within +- 2 frames around the ground truth.
© Copyright 2018 MMSports'18 Proceedings of the 1st International Workshop on Multimedia Content Analysis in Sports - Seoul, Republic of Korea — October 26 - 26, 2018. Kaikki oikeudet pidätetään.

Aiheet: analyysi liike liikkeiden koordinaatio liikkeen tarkkuus mäkihyppy mittausmenetelmä tutkimusmenetelmä biomekaniikka ohjelmisto
Aihealueet: voima ja nopeus urheilu tekniset ja luonnontieteet
DOI: 10.1145/3265845.3265855
Julkaisussa: MMSports'18 Proceedings of the 1st International Workshop on Multimedia Content Analysis in Sports - Seoul, Republic of Korea — October 26 - 26, 2018
Julkaistu: 2018
Julkaisutyypit: kongressin muistiinpanot
Kieli: englanti (kieli)
Taso: kehittynyt