Interactive and Immersive 3D Visualization for ATC

Transcription

1 Interactive and Immersive 3D Visualization for ATC Matt Cooper & Marcus Lange Norrköping Visualization and Interaction Studio University of Linköping, Sweden

2 Summary of last presentation A quick description of the application as presented at last year s workshop

3 3D Visualization for ATM Display flights in 3D Show waypoints Show Trajectories (flight plans) Display Terrain in 3D Use 3D models to show flights Target (Semi-)Immersive displays Workbench VR Theatre ( Reality Centre )

4 3D Visualization for ATM Other information is also 3D Not just dodging the other planes Aircraft have to be navigated around 3D obstacles: Exclusion zones Weather features Chop reports Storms and localized features

5

6 Weather(3)

7 Conflict detection

8 Immersive solution: Voice Use voice control to provide access to complex features Use in any environment (almost) No buttons required Use Voice feedback for confirmation Also warnings and other information Stay immersed

9 Future work (as at 12/2003) New features to add More weather features More powerful conflict detection turbulence wakes for spacing More flights between other airports More work on the interaction modes More work needed on voice interaction Better voice feedback

10 Better information display We have looked at displaying more information about flights Used self-sorting sorting flags Flags carry information about each flight Flight number Destination Speed Altitude Flags sort themselves so that they are visible from any angle as the camera view changes Overlaps are automatically avoided no clutter Stereo makes it easy to match labels with flights

11

12 Better orientation display Orientation information is hard to include Better orientation is included using a compass rose Shown using transparency over existing terrain display Moves with the user view in workbench display The ring described by the displayed rose can also be used for selection where appropriate

13

14 Better use of data-glove The data glove has been used to provide gesture-based interaction The combined hand-eye interaction approach allows for a more sophisticated selection mechanism Use co-ordinated ordinated selection to give user a natural selection process Picking with your hand

15 Picking using hand and dominant eye Crosshair

16 Glove-based picking

17 Wake-vortex displays Can display wake vortices according to more powerful data representation The data is based on physical modelling of the wake vortex Data obtained from Peter Choroba at ERC Provides wake vortex intensity across a grid orthogonal to flight direction Depends on weather conditions We display regions where the intensity is above some threshold

18 Wake-vortex displays Problems are that the variation of the wake vortex is small on the scale of the 3D display We see straight lines behind the aircraft Might be more appropriate where the resolution of the display is finer

19 Wake vortices

20 Conflict detection Previous work on conflict detection was very coarse Relied on checking flight s exclusion zones at a number of specific points along flight path, ahead of the current position New approach depends on checking the zones described by each flight using intersections of the described volumes

21 Conflict detection (2) The flight paths are tracked for a number of minutes into the future Each line segment describes a volume which is checked against all others in the same time zone The results are checked in real-time as a flight is manipulated Allows real-time conflict resolution

22

23 Better weather information In previous version weather information was complex Included a great deal of information but in a form which was difficult to interpret We have tried to reduce the complexity of the information without reducing it s content Based on the idea of inclusion/exclusion zones rather than detailed information

24 Better weather information Automatic identification of zones of Low pressure weather systems High turbulence High wind speed Represented using translucent surfaces which are automatically extracted from the volume weather data

25 Automatic weather hot- spots

26 Audio feedback system Sound alerts using speech to provide information Placed in the user s work environment using positional sound based on Amplitude modulation Phase delays Very realistic positional effect drawing user s attention to the correct view location

27 More Airports and Flights Original data starting to seem small Number of active flights was under 20 at any one time No flights between other airports included Needed expanding

28 More airports and flights

29 Scenario Simulator Work undertaken at Eurocontrol by Magnus Axholt and Stephen Petersson Final year Students from LiU Developed a scenario import system for the 3D application Should now be possible to expand our repertoire of data and scenarios to evaluate the system more thoroughly

30 Improved speech recognition interface Speech recognition technology has improved significantly over the last year Allowed for development of a much improved interface Based on continuous speech recognition More commands have been added Possible options have also been expanded Reliability is such that the user can be freed from almost all hand interaction except for flight and waypoint selection and placement

31 Acknowledgements The worker: Marcus Lange The management: Anders Ynnerman Vu Duong (Eurocontrol ERC)