Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

Transcription

1 Tracking Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

2 Outline of this talk Introduction: what makes a good tracking system? Example hardware and their tradeoffs Taxonomy of tasks: Traveling (Pan Ye) Way finding (Victor) Manipulation (Emma) Short (10 minute) case studies Final discussion: what does make a good tracking system?

3 What makes a good tracking system? What do we mean by tracking? The virtual environment knows where the user is The user knows where they are in the virtual system

4 Motion Tracking [1] Applications: View control Navigation Object selection and manipulation Instrument tracking Avatar animation Specific: Head tracking VR games, simulators Augmented Reality Assisted surgery Camera tracking Motion capture

5 What tracking devices do you know?

6 What tracking devices do you know? Keyboard Mouse Joystick Mobile Phone Wii remote...

7 Sensing Mechanical Inertial Acoustic Magnetic Optical Radio and microwave

8 Optical Tracking

9 Motion Capture (MoCap)

10 Body Sensor Networks

11 Inertial Body Sensors

12 Head Tracking

13 Motion Tracking - Holy Grail [1] Tracker on chip: Small form factor Self-contained 6-degrees of freedom Highly accurate Wireless Cheap Fast and accurate

14

15 What is travel? Movement between 2 locations, setting the position (and orientation) of the user s viewpoint

16 How to do it?

17 How to do it?

18 How to do it?

19 Evaluation end to end delay

20 What is wayfinding? Copyright Lauri Plummer. Location (environment) From point A to point B Path OpenBCI Labyrinth

21 What is wayfinding? King lines (2007) Orientation - Location knowledge - Body awareness Wayfinding is the cognitive process of defining a path through an environment, using and acquiring spatial knowledge, helped by (artificial) cues. 3D user interface Design, Wayfinding, Ernst Kruiff District 13 (2004)

22 How wayfinding relates to an environment? Support navigation Help to make predictions, take decisions for movement Wayfinding Real-world <> virtual world

23 Wayfinding as a decision making process Search level Wayfinding task usage acquisition Spatial orientation Compute level Spatial knowledge Spatial awareness Influenced by: Travel technique Reference frame

24 Wayfinding tasks (objective definition) Wayfinding task EverNorth: Self-orienting Map

25 How spatial orientation is constructed?

26 Spatial Knowledge Landmark Procedural Survey Build up Cognitive map

27 Spatial knowledge Landmark

28 Spatial Awareness User s Position in the context

29 Spatial Orientation S. knowledge + S. awareness User Position & orientation within the cognitive map

30 Spatial Orientation Dogfights, Jet vs. Jet: History Channel GEO spatial navigation Earthmine

31 Relation with the travel technique usage acquisition Influenced by: Travel technique Reference frame

32 Reference frames - Egocentric frame Microsoft Flight Simulator X A Virtual Body for Augmented Virtuality by Chroma-Keying of Egocentric Videos Department of Computer Science University of Munster Halo Bungie, Microsoft Game Studios

33 Reference frames - Exocentric frame 3D Learning Solutions (3DLS). Tony hawk pro skater

34 Wide field of view Motion cues Audio Divide a large-scale environment in parts with a distinct character. Simple spatial organization Use of colours and forms

35 Taxonomy of manipulations Poupyrev (2000)

36 Movement/Manipulation/Selection 3D Space Mouse (Logitech 3D Connexion Cap)

37 Manipulation/Selection/Rotation tool-free approaches

38 Manipulation High fidelity manipulation

39 Manipulation and selection tools Different manipulation tasks require different hardware.

40 NOW IT'S YOUR TURN!

41 Case Study 1: FPS Imagine you are involved in the production of a First Person Shooter game. You want to provide players with means of navigating through the game space using virtual reality. What is your solution?

42 Case Study 2: Space Station You are at the heart of a NASA project that aims to enable virtual control of space robots. This would allow a user within a space station to gain full virtual control over your robot, which is wandering around in space. What would be a suitable solution?

43 Case Study 1: MMO Imagine you are involved in the production of a Massively Multiplayer Online game. You want to provide players with means of navigating through the game space using virtual reality. Case Study 2: Space Station You are at the heart of a NASA project which aims to enable virtual control of space robots. This would allow a user within a space station to gain full virtual control over your robot, which is wandering around in space. What is your proposed solution? What are its advantages/disadvantages? How costly would your solution be?

44 Case Study: Solutions Viewing: Head Tracking & Head Mounted Display

45 Case Study: Solutions Interaction: Virtual Gloves

46 Case Study: Solutions Movement: Omni-Directional Treadmill

47 Case Study: Solutions Movement: CirculaFloor

48 Case Study: Solutions Motion Tracking: Xbox 360 Kinect

49 Conclusion: what does make a good tracking system? It depends: Task requirements - what is the nature of the: Travel Wayfinding Manipulation Operational requirements Speed Latency Precision Fidelity Affordability/availability There will always be a tradeoff!

50 Summary

51 Virtusphere - Human Hamster Ball

52 References 1. Welch, G., Foxlin, E. (2002) Motion Tracking: No Silver Bullet, but a Respectable Arsenal, IEEE Computer Graphics and Applications, 22(6), p Ernst, Kruiff: 3D user interfaces Design: Wayfinding, BauhausUniversitaet Weimar & GMD 3. Bowman, D., Kruijff, E., LaViola, J., Poupyrev, I., Mine, M., SIGGRAPH 2000 course: 3D User Interface Design: Fundamental Techniques, Theory, and Practice

53 com/watch?v=zdz_muvl9se

54 Tracking Latency [1] Important concepts: Sensor sampling rate Data throughput Data transfer delay