Virtual-Reality as a Future Training Medium for Civilian Flight Procedure Training

Transcription

1 Virtual-Reality as a Future Training Medium for Civilian Flight Procedure Training Prof. Dr.-Ing. Uwe Klingauf Dr.-Ing. Marcus Bauer 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 1

2 Overview Introduction Todays Flight Training Medium Virtual-Reality More than just 3D Content and aim of the study Prototype - System Design & Scenarios Study Results Conclusion 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 2

3 Introduction Knowledge transfer and cost effective training Networked training via Intranet or Internet (LH CBT) New media can enhance quality of training and lower costs Immersive media like Virtual-Reality (VR) Using VR to visualize and analyse complex data (aeronautics) New media in game market Study took place in 2006 to evaluate VR as future training medium Acceptance of VR as training medium by user / pilots? This presentation summarizes the results of the study 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 3

4 Todays Training Medium for Civilian Flight Training Computer Based Training (CBT) Procedure Trainer (PT) Virtual-Procedure-Trainer (VPT) Full-Flight-Simulator (FFS) CBT VPT FFS Aerosim Technologies 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 4

5 Virtual-Reality More than just 3D i magination mmersion nteraction Head Tracking immersion Helmet-Mounted- Display (HMD) imagination Data Glove interaction Hand Tracking 360 Head Movement 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 5

6 Content and Aim of the Study Questions to be answered: Effectiveness of VR as an aid for Pilot Procedure Training? Does user / civilian pilots accept new media? Product readiness of VR prototype? Interaction with virtual switches acceptable? Established cooperation: EADS, Military-Air-Systems (MAS) -> Developing VR for flight simulation Lufthansa (LH) -> Trainees / Pilots Lufthansa-Flight-Training (LFT) -> CBT Technische Universität Darmstadt (TUD) -> Research (VR and training) Prototype established at LH base in Frankfurt 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 6

7 Virtual-Reality-Procedure-Trainer (VRPT) - System Design Head and Hand Tracking (6DOF) (Intersense) HMD (Kaiser XL50) 3D Sound Glove (5DT) 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 7

8 VRPT Session Prototype was operated as a stand-alone (no assistance) Trainee turned system on Questionnaire I on touch screen statistics Trainee put on data glove and HMD Selecting and performing both scenario as preferred Questionnaire II on touch screen evaluation about VRPT Additional feedback form if required Trainee turned system off 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 8

9 Initial Scenario Virtual Training Room Start of virtual lessons scenarios 1 and 2 Training room was rebuild in virtual environment Trainee can orientate and familiarize with virtual environment Familiarization with virtual hand and head movement First interaction with virtual panels to start training lesson 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 9

10 Scenario 1 Engine Startup Procedure Training Engine Startup and Pushback lesson as Airbus 320 Copilot Procedure carried out in cooperation with virtual captain Avatar performed movements and gave audio commands Scenario starts at the gate at Munich airport Aircraft displays, AC movement and environment (gate, apron) Execution of relevant checklists Finally visible contact with the marshaller at apron 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 10

11 Scenario 2 Airport Familiarization Pilots require familiarization for critical categorized airports Airport of Salzburg (Austria) has been build in VR environment Airport surroundings (obstacles, mountains, airspaces) Synthetic symbology visualizes flightpath and obstacles Explanation of approach and departure procedures Trainee participated at FFS recorded approach & missed approach 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 11

12 Results Results of questionnaire have been recorded in SQL database Trainees completed: 84% Scenario 1 and 72% Scenario 2 No technical HW or SW problems occurred (period of 5 months) 105 Lufthansa pilots tested the VRPT Airbus pilots made up 63% of all trainees Age distribution from less than 26 years up to more than 55 years Experience / flying hours 36%, <2000h 36%, 2000h to 8000h 28%, >8000h 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 12

13 Results Scenario 1 (Procedure Training) Scenario 1, Procedure Training (Engine Startup) Engine Startup in real cockpit with experienced pilots Procedure takes between 360 seconds to 500 seconds Engine Startup in VRPT 22% of all trainees took less than 500 seconds 63% of all trainees are Airbus pilots Reason for longer procedure duration 42% of trainees were A320 pilots 95% used for the first time VR Interaction with virtual glove Success for VR as PT 84% completed lesson 22% of trainees took < 500 sec. 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 13

14 Results - Questionaire HMD resolution (1024x768): 89% Good HMD field-of-view (36 V): 60% Good HMD comfort: 58% Good and 42% Poor Use of stereoscopic imagination: 90% Good Glove comfort: 90% Good Reality of Scenario 1: 87% Good Acceptance of Virtual Captain: 87% Good Interaction with data glove: 51% Good and 17% Poor Orientation in Scenario 2: 85% Good Memory of airport surroundings after training: 97% Good Use of participation in approach flight (virtual cockpit): 94% Good 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 14

15 Summary and Conclusion General VR Medium Majority of end users accepted VR as future training media VRPT has reached product readiness (Hardware, Software) VRPT can be used for different plattforms / cockpits VR is a new medium for future pilot training Procedure Training Scenario 1 VRPT occupies niche between CBT and FFS VRPT can reduce training time on FFS by cockpit FAM (VR) Cockpit interaction works but has to be improved Immersive orientation in cockpit (displays, panels and switches) Head and arm movements (procedure movements) Airport FAM Scenario 2 VR trains pilots in airport familiarization (orientation, playback) 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 15

16 Thank you for your attention! Any Questions? 24. Februar 2010 Fachbereich Maschinenbau Institut für Flugsysteme und Regelungstechnik Tzvetana Mikova, M.Sc. 16