Virtual Sports for Real!

Transcription

1 Virtual Sports for Real! Elmar Eisemann 1 and Stephan Lukosch 2 1 Computer Graphics and Visualization, Faculty of Electrical Engineering, Mathematics and Computer Science 2 Systems Engineering Section, Faculty of Technology, Policy and Management

2 Outline Virtual Sports Creating virtual worlds for sports Virtual reality equipment Motion data analysis and visualization Outlook

3 VIRTUAL SPORTS

4 Virtual Sports

5 Virtual Sports in the Future Physically train and exercise Create controlled environments Perform precise measurements resp-feature.jpg? Provide personalized and adaptive real-time coaching Foster engagement and motivation for sports resp-feature.jpg?

6 Virtual Sports in the Future Run with virtual trainer Run with other runners on the same track sharing performance details Run against ghosts, i.e. runners that have run here before Run with runners somewhere else on the world Run on a treadmill for precise gait evaluation and training

7 Superhuman sports

8 CREATING VIRTUAL WORLDS FOR TRAINING

9 Overview Several Different Creation Scenarios automatic Real-world Environments Reproduction of Particular Scenarios Free-Form Design of Virtual Environments user interaction

10 Creating Virtual Worlds with Real-world Data AHN 2 Data Set 8 TB [Kehl, Tutenel, de Hahn, Eisemann Geos. World F.2013]

11 Geometry Recognition [Sunkel, Jansen, Wand, Eisemann, Seidel - EG 2012] [Silva, Eisemann, Bidarra, Coelho - PCG 2015] [Wu, Wand, Hildebrandt, Jansen, Seidel - 3DV 2014] here 128 M points in 2 min

12 Tools for Creating Virtual Environments [Smelik, Tutenel, Kraker, Bidarra C&G 2010]

13 Making Environments Look Realistic [Klehm, Seidel, Eisemann TVCG 2016] [Holländer, Ritschel, Eisemann, Boubekeur - EGSR 2011] [Ritschel, Eisemann, Ha, Kim, Seidel - CGF 2011]

14 VIRTUAL REALITY EQUIPMENT

15 Virtual Reality Display Options Samsung Gear VR Oculus Rift HTC Vive

16 A Large Field-of-View Solution for Eye-tracking HMDs [Stengel, Grogorick, Eisemannx2, Magnor ACM MM 2015] Main difficulties: Maintain Large Field of View Solve Calibration due to Fabrication Imperfections

17 A Large Field-of-View Solution for Eye-tracking HMDs [Stengel, Grogorick, Eisemannx2, Magnor ACM MM 2015] Gaze evaluation useful for Gaze Evaluation Gaze-contingent Rendering Interaction with Avatars...

18 Augmented Reality [Baboud, Cadik, Eisemann, Seidel CVPR 11] Fusion of Virtual and Real World

19 DATA ANALYSIS AND VISUALIZATION

20 Motivation Need for assessment methods that allow for objective, quantitative and valid measures identifying the factors contributing to motor dysfunction

21 Motion Tracking Microsoft Kinect Perception Neuron Intel RealSense HTC Vive controller

22 Approach AR technology Serious game Cidota, Lukosch, Bank (2015) Assessment tool

23 Study on game engagement and usability Study with 8 healthy people older than 50 years Epson Moverio BT-200 OST-HMD with an Intel RealSense F200 RGB-D camera Participants sorted a set of ten packages each Session recorded and debriefed Game Experience Questionnaire (GEQ) System Usability Survey (SUS) Dezentje et al. (2015)

24

25 Results Liked the game Needs practice Difficult depth perception Difficult head-hand coordination Data from the sensors positions and orientations of the joints approx. 15MB per minute RGB and RGB-D video stream each approx. 4MB per minute per patient and session more than 1GB Offline data analysis necessary for validation Cidota et al. (2015)

26 Inertial Measurement Unit Record movement of the person

27 Analyze such Data? Sensor output in a scatterplot Often not very readable Dimensionality Reduction

28 Dimensionality Reduction - Example [Van der Maaten and Hinton 2008] Costly offline process

29 Interactive t-sne Clustering [Pezzotti, Höllt, Lelieveldt, Eisemann, Vilanova - EuroVis2016] TU Delft Sports Engineering Institute

30 Various Sensors and Data Sources Health Apps: FitBit Garmin SHealth ios 9 Health MapMyFitness

31 Analysis and Visualization Tools for Complex or High-Dimensional Data [Raidou, Eisemann, Breeuwer, Eisemann, Vilanova - Vis2015] [de Hoon, van Pelt, Jalba, Vilanova CGF15] [Kroes, Eisemannx2 GI15]

32 OUTLOOK

33 Outlook New Sports Challenges Adaptive Environments New Sensors and On-the-fly Data Analysis Advanced Virtual Reality Equipment Engagement and Gamification Data Analysis and Visualization Solutions

34 Thank you very much for your attention! Elmar Eisemann Computer Graphics & Visualization Stephan Lukosch Systems Engineering