CSE 165: 3D User Interaction. Lecture #11: Travel

Similar documents
Virtuelle Realität. Overview. Part 13: Interaction in VR: Navigation. Navigation Wayfinding Travel. Virtuelle Realität. Prof.

3D Interaction Techniques

Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)

3D User Interfaces. Using the Kinect and Beyond. John Murray. John Murray

CSC 2524, Fall 2017 AR/VR Interaction Interface


Chapter 15 Principles for the Design of Performance-oriented Interaction Techniques

Cosc VR Interaction. Interaction in Virtual Environments

The architectural walkthrough one of the earliest

Interaction Techniques for Immersive Virtual Environments: Design, Evaluation, and Application

Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs

Classifying 3D Input Devices

CSE 165: 3D User Interaction. Lecture #14: 3D UI Design

TRAVEL IN SMILE : A STUDY OF TWO IMMERSIVE MOTION CONTROL TECHNIQUES

Guidelines for choosing VR Devices from Interaction Techniques

Testbed Evaluation of Virtual Environment Interaction Techniques

AUTOMATIC SPEED CONTROL FOR NAVIGATION IN 3D VIRTUAL ENVIRONMENT

Classifying 3D Input Devices

CSE 190: Virtual Reality Technologies LECTURE #7: VR DISPLAYS

Are Existing Metaphors in Virtual Environments Suitable for Haptic Interaction

Input devices and interaction. Ruth Aylett

IMGD 4000 Technical Game Development II Interaction and Immersion

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

A Multimodal Locomotion User Interface for Immersive Geospatial Information Systems

Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

VR System Input & Tracking

Using Pinch Gloves for both Natural and Abstract Interaction Techniques in Virtual Environments

3D UIs 101 Doug Bowman

3D User Interaction CS-525U: Robert W. Lindeman. Intro to 3D UI. Department of Computer Science. Worcester Polytechnic Institute.

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty

Virtual Experiments as a Tool for Active Engagement

Interactive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1

VR/AR Concepts in Architecture And Available Tools

TRAVEL IN IMMERSIVE VIRTUAL LEARNING ENVIRONMENTS: A USER STUDY WITH CHILDREN

Trial code included!

Virtual Environments. Ruth Aylett

Video Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces

Réalité Virtuelle et Interactions. Interaction 3D. Année / 5 Info à Polytech Paris-Sud. Cédric Fleury

Simultaneous Object Manipulation in Cooperative Virtual Environments

November 30, Prof. Sung-Hoon Ahn ( 安成勳 )

Haptic Rendering CPSC / Sonny Chan University of Calgary

HMD based VR Service Framework. July Web3D Consortium Kwan-Hee Yoo Chungbuk National University

Virtual Environment Interaction Based on Gesture Recognition and Hand Cursor

Kinect Interface for UC-win/Road: Application to Tele-operation of Small Robots

Virtual Environments: Tracking and Interaction

CSE 190: 3D User Interaction. Lecture #17: 3D UI Evaluation Jürgen P. Schulze, Ph.D.

Assignment 5: Virtual Reality Design

CS277 - Experimental Haptics Lecture 2. Haptic Rendering

Fly Over, a 3D Interaction Technique for Navigation in Virtual Environments Independent from Tracking Devices

TEACHING HAPTIC RENDERING SONNY CHAN, STANFORD UNIVERSITY

Haptics CS327A

CSE 165: 3D User Interaction. Lecture #7: Input Devices Part 2

CS277 - Experimental Haptics Lecture 1. Introduction to Haptics

Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data

Tele-Nursing System with Realistic Sensations using Virtual Locomotion Interface

Mohammad Akram Khan 2 India

The Use of Virtual Reality System for Education in Rural Areas

Recent Progress on Wearable Augmented Interaction at AIST

Realtime 3D Computer Graphics Virtual Reality

Touching and Walking: Issues in Haptic Interface

Narrative Guidance. Tinsley A. Galyean. MIT Media Lab Cambridge, MA

CSE 190: 3D User Interaction

Application and Taxonomy of Through-The-Lens Techniques

Using Hybrid Reality to Explore Scientific Exploration Scenarios

Haptic, vestibular and other physical input/output devices

Virtual Environment Interaction Techniques

3D interaction strategies and metaphors

Robot: Robonaut 2 The first humanoid robot to go to outer space


Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Virtual Reality in Neuro- Rehabilitation and Beyond

Interaction in VR: Manipulation

CS Problem Solving and Structured Programming Lab 1 - Introduction to Programming in Alice designed by Barb Lerner Due: February 9/10

VR for Pain Distraction

ROBOTICS ENG YOUSEF A. SHATNAWI INTRODUCTION

Immersive Visualization On the Cheap. Amy Trost Data Services Librarian Universities at Shady Grove/UMD Libraries December 6, 2019

User s handbook Last updated in December 2017

3D Data Navigation via Natural User Interfaces

First Things First. Logistics. Plan for this afternoon. Logistics. Logistics 9/1/08. Welcome to Applications in VR. This is /

Computer Graphics Si Lu Fall /25/2017

Roles for Sensorimotor Behavior in Cognitive Awareness: An Immersive Sound Kinetic-based Motion Training System. Ioannis Tarnanas, Vicky Tarnana PhD

Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program

Introduction to Virtual Reality (based on a talk by Bill Mark)

Graphing Motion Simulation 8 th Grade PSI Score / 23 points. Learning Goals: Be able to describe movement by looking at a motion graph

By: Celine, Yan Ran, Yuolmae. Image from oss

Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM

Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty

Look-That-There: Exploiting Gaze in Virtual Reality Interactions

Immersive Natives. Die Zukunft der virtuellen Realität. Prof. Dr. Frank Steinicke. Human-Computer Interaction, Universität Hamburg

CS 354R: Computer Game Technology

Modeling Your Motion When Walking

Virtual Reality for Real Estate a case study

Unreal Studio Project Template

Development of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane

Graph Matching. walk back and forth in front of. Motion Detector

Navigation in Immersive Virtual Reality The Effects of Steering and Jumping Techniques on Spatial Updating

revolutionizing Subhead Can Be Placed Here healthcare Anders Gronstedt, Ph.D., President, Gronstedt Group September 22, 2017

Benefits of using haptic devices in textile architecture

REPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism

Transcription:

CSE 165: 3D User Interaction Lecture #11: Travel

2 Announcements Homework 3 is on-line, due next Friday Media Teaching Lab has Merge VR viewers to borrow for cell phone based VR http://acms.ucsd.edu/students/medialab/equipment /index.html They also have 360 degree cameras (Samsung Gear 360)

3 CSE 163: Advanced Graphics Instructor: Prof. Ravi Ramamoorthi Units: 4 Course web site: http://viscomp.ucsd.edu/classes/cse163/sp17/163.html Topics include signal and image processing, geometric modeling with meshes, advanced rendering and imaging. This is intended to be a one-stop advanced graphics course, covering the whole field, including animation, modeling, rendering and imaging. Grading is based on 3 large homework assignments which can be done in groups of two. There is no midterm or final.

4 Independent Study Limited amount of CSE 198/199 projects available in spring quarter Apply by email or come to office hour Sample topics: Haptic simulator for liver patients Remote training on medical devices with AR VR for autistic kids AR demo for BodyLogical Video point cloud playback Photorealistic AR

5 Navigation Wayfinding Cognitive Component Travel Motor Component

6 Travel Motor component of navigation But good travel techniques integrate wayfinding aids Movement between two locations, setting the position (and orientation) of the user s viewpoint The most basic and common VE interaction technique, used in almost any large-scale VE

7 Travel Tasks Exploration travel which has no specific target build knowledge of environment Search naïve: travel to find a target whose position is not known primed: travel to a target whose position is known build layout knowledge; move to task location Maneuvering travel to position viewpoint for task short, precise movements

8 Travel Characteristics Travel distance Amount of curvature/number of turns in path Target visibility DOF required Accuracy required Other tasks during travel Active vs. passive Physical vs. virtual

9 A Technique Classification Component Decomposition Direction/Target Selection gaze-directed pointing choose target from list Travel Velocity/Acceleration Selection Conditions of Input gesture slow in, slow out (fast in-between) physical props (eg, pedal, lever) start/stop buttons automatic start/stop constant movement From: Bowman, Koller, and Hodges, Travel in Immersive Virtual Environments. IEEE VRAIS 97

10 Alternate Technique Classification User Control Level Travel Start to move Indicate position Indicate orientation position velocity acceleration Target specification Route specification Continuous specification Stop moving

11 Travel Techniques Physical locomotion ( natural metaphors) Steering techniques Route planning Target-based techniques Manual manipulation Viewpoint orientation techniques

12 Physical Locomotion Techniques Walking techniques Large-scale tracking Walking in place Treadmills single-direction with steering (Gait Master) omni-directional (Omni) Bicycles Other physical motion techniques Magic carpet Disney s river raft ride

Large Scale Tracking 13

14 Omni-Directional Treadmill Video: http://www.youtube.com/watch?v=bqw1tsgrjos

15 Omni https://www.kickstarter.com/projects/1944625487/omnimove-naturally-in-your-favorite-game

16 Gait Master Video http://www.youtube.com/watch?v=rddh1iqodzu

17 String Walker Video from Emerging Technologies, SIGGRAPH 2007 http://www.youtube.com/watch?v=hylkjyl-dw8

18 Steering Techniques Steering: Continuous specification of direction of motion Techniques: Eye gaze Head direction Hand pointing Torso-directed Physical device (steering wheel, etc.)

19 Steering by Eye Gaze Move viewpoint in direction of eye gaze Gaze direction determined from eye tracker Cognitively simple Doesn t allow user to look to the side while traveling

20 Steering by Head Orientation Move viewpoint in direction head is pointed Direction determined from head tracker Cognitively simple Allows user to look to the side while traveling, but hard to decouple eye gaze and head direction

21 Steering by Pointing Similar to steering by head orientation, but uses hand tracker instead of head tracker Cognitively slightly more complex than steering by eye/head Allows travel and eye gaze in different directions

22 castar https://www.youtube.com/watch?v=hl1qt0tk6aw

23 Route-Planning One-time specification of path Implementation: Draw entire path Specify points along path Manipulate user representation

24 Target-Based Techniques Direct specification of destination Techniques: Point at target object Choose target from list Enter coordinates Use Map/WIM

25 Map-Based Travel Techniques User represented by icon on 2D map Drag icon with stylus to new location on map When released, viewpoint moves smoothly to new location

26 Manual Manipulation Grabbing the Air Technique Use hand gestures to move yourself through the world Metaphor of pulling a rope Can be one-handed, but often a twohanded technique Works well with tracked gloves or Vive/Touch style controllers

27 Viewpoint Orientation Techniques Head tracking Orbital viewing Non-isomorphic rotation Virtual sphere (trackball)