Réalité Virtuelle et Interactions. Interaction 3D. Année / 5 Info à Polytech Paris-Sud. Cédric Fleury

Similar documents
Collaboration en Réalité Virtuelle

Guidelines for choosing VR Devices from Interaction Techniques

Interaction in VR: Manipulation

CSC 2524, Fall 2017 AR/VR Interaction Interface

3D Interaction Techniques

Virtuelle Realität. Overview. Part 13: Interaction in VR: Navigation. Navigation Wayfinding Travel. Virtuelle Realität. Prof.

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

Cosc VR Interaction. Interaction in Virtual Environments

Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)

Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs

EyeScope: A 3D Interaction Technique for Accurate Object Selection in Immersive Environments


3D User Interfaces. Using the Kinect and Beyond. John Murray. John Murray

Using Pinch Gloves for both Natural and Abstract Interaction Techniques in Virtual Environments

Are Existing Metaphors in Virtual Environments Suitable for Haptic Interaction

Virtual Environment Interaction Based on Gesture Recognition and Hand Cursor

Gestaltung und Strukturierung virtueller Welten. Bauhaus - Universität Weimar. Research at InfAR. 2ooo

An asymmetric 2D Pointer / 3D Ray for 3D Interaction within Collaborative Virtual Environments

Fly Over, a 3D Interaction Technique for Navigation in Virtual Environments Independent from Tracking Devices

An asymmetric 2D Pointer / 3D Ray for 3D Interaction within Collaborative Virtual Environments

3D UIs 101 Doug Bowman

Welcome. My name is Jason Jerald, Co-Founder & Principal Consultant at Next Gen Interactions I m here today to talk about the human side of VR

Accepted Manuscript (to appear) IEEE 10th Symp. on 3D User Interfaces, March 2015

Simultaneous Object Manipulation in Cooperative Virtual Environments

Multiscale traveling: crossing the boundary between space and scale

Cooperative Object Manipulation in Collaborative Virtual Environments

Mid-term report - Virtual reality and spatial mobility

CSE 165: 3D User Interaction. Lecture #11: Travel

Interaction Techniques for Immersive Virtual Environments: Design, Evaluation, and Application

3D User Interaction CS-525U: Robert W. Lindeman. Intro to 3D UI. Department of Computer Science. Worcester Polytechnic Institute.

Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

A Novel Human Computer Interaction Paradigm for Volume Visualization in Projection-Based. Environments

Issues and Challenges of 3D User Interfaces: Effects of Distraction

Wayfinding. Ernst Kruijff. Wayfinding. Wayfinding

3D interaction techniques in Virtual Reality Applications for Engineering Education

Comparing Input Methods and Cursors for 3D Positioning with Head-Mounted Displays

Virtual Universe Pro. Player Player 2018 for Virtual Universe Pro

Panel: Lessons from IEEE Virtual Reality

Using the Non-Dominant Hand for Selection in 3D

3D interaction strategies and metaphors

Experiments in the Use of Immersion for Information Visualization. Ameya Datey

Application and Taxonomy of Through-The-Lens Techniques

A Virtual Reality Framework to Validate Persuasive Interactive Systems to Change Work Habits

Testbed Evaluation of Virtual Environment Interaction Techniques

Withindows: A Framework for Transitional Desktop and Immersive User Interfaces

Explorations on Body-Gesture based Object Selection on HMD based VR Interfaces for Dense and Occluded Dense Virtual Environments

Generating 3D interaction techniques by identifying and breaking assumptions

Generating 3D interaction techniques by identifying and breaking assumptions

Chapter 1 - Introduction

Virtual Environments: Tracking and Interaction

Look-That-There: Exploiting Gaze in Virtual Reality Interactions

Augmented and mixed reality (AR & MR)

Prop-Based Haptic Interaction with Co-location and Immersion: an Automotive Application

A Study of Street-level Navigation Techniques in 3D Digital Cities on Mobile Touch Devices

Chapter 15 Principles for the Design of Performance-oriented Interaction Techniques

VR4D: An Immersive and Collaborative Experience to Improve the Interior Design Process

Haptic Camera Manipulation: Extending the Camera In Hand Metaphor

Tangible Lenses, Touch & Tilt: 3D Interaction with Multiple Displays

Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM

Object Impersonation: Towards Effective Interaction in Tablet- and HMD-Based Hybrid Virtual Environments

Through-The-Lens Techniques for Motion, Navigation, and Remote Object Manipulation in Immersive Virtual Environments

3D Interaction Techniques Based on Semantics in Virtual Environments

Realtime 3D Computer Graphics Virtual Reality

Jerald, Jason. The VR Book : Human-centered Design for Virtual Reality. First ed. ACM Books ; #8. New York] : [San Rafael, California]: Association

Research Article How 3D Interaction Metaphors Affect User Experience in Collaborative Virtual Environment

Interaction Design for Mobile Virtual Reality Daniel Brenners

Beyond Visual: Shape, Haptics and Actuation in 3D UI

Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program

A Virtual Reality Environment Supporting the Design and Evaluation of Interior Spaces

MOVING COWS IN SPACE: EXPLOITING PROPRIOCEPTION AS A FRAMEWORK FOR VIRTUAL ENVIRONMENT INTERACTION

A CAVE BASED 3D IMMERSIVE INTERACTIVE CITY WITH GESTURE INTERFACE

VR/AR Concepts in Architecture And Available Tools

Eliminating Design and Execute Modes from Virtual Environment Authoring Systems

Out-of-Reach Interactions in VR

AUTOMATIC SPEED CONTROL FOR NAVIGATION IN 3D VIRTUAL ENVIRONMENT

Coordinated 3D Interaction in Tablet- and HMD-Based Hybrid Virtual Environments

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty

Apple Photos Quick Start Guide

ThumbsUp: Integrated Command and Pointer Interactions for Mobile Outdoor Augmented Reality Systems

Building a bimanual gesture based 3D user interface for Blender

New Directions in 3D User Interfaces

Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances


Effective Iconography....convey ideas without words; attract attention...

Millennium Hardcore Minecraft team

The Effects of Finger-Walking in Place (FWIP) for Spatial Knowledge Acquisition in Virtual Environments

Outline. Paradigms for interaction. Introduction. Chapter 5 : Paradigms. Introduction Paradigms for interaction (15)

FLEXLINK DESIGN TOOL VR GUIDE. documentation

Introduction to Virtual Reality. Chapter IX. Introduction to Virtual Reality. 9.1 Introduction. Definition of VR (W. Sherman)

TRAVEL IN SMILE : A STUDY OF TWO IMMERSIVE MOTION CONTROL TECHNIQUES

Expanding the Interaction Lexicon for 3D Graphics. Jeffrey S. Pierce. CMU-CS November 2001

Evaluating Visual/Motor Co-location in Fish-Tank Virtual Reality

The architectural walkthrough one of the earliest

Bimanual Handheld Mixed Reality Interfaces for Urban Planning

ERGOS: Multi-degrees of Freedom and Versatile Force-Feedback Panoply

Is Semitransparency Useful for Navigating Virtual Environments?

Immersive Guided Tours for Virtual Tourism through 3D City Models

User Interface Constraints for Immersive Virtual Environment Applications

A Survey of 3D Interaction Techniques

Immersive Visualization and Collaboration with LS-PrePost-VR and LS-PrePost-Remote

Transcription:

Réalité Virtuelle et Interactions Interaction 3D Année 2016-2017 / 5 Info à Polytech Paris-Sud Cédric Fleury (cedric.fleury@lri.fr)

Virtual Reality Virtual environment (VE) 3D virtual world Simulated by computers Interaction in real time Trough various material devices Immersion Multi-sensorial perception of the VE 2

Virtual Reality Action/perception loop 3

Interaction 3 kinds of interaction techniques [Hand, 1997] Object manipulation (interaction) Viewpoint manipulation (navigation) Application Control [Bowman et al., 2004] 3D User Interfaces : Theory and Practice. Bowman D. A., Kruijff E., LaViola J. J. et Poupyrev I. (2004), Addison Wesley. 4

Outline 3D interaction in Virtual Reality Navigation Object Manipulation Application Control 5

Outline 3D interaction in Virtual Reality Navigation Object Manipulation Application Control 6

Navigation Move the viewpoint + Modify the scale [Hand, 1997] Manipulate its own viewpoint or Manipulate the viewpoint of the others Include path finding [Bowman et al., 2004] 7

Navigation Classical techniques Egocentric Walking metaphor Flying metaphor Driving metaphor Exocentric Navidget [Hachet et al., 2008] Grabbing the air [Mapes etmoshell, 1995] [Hachet et al., 2008] 8

Navigation Classical techniques : assisted navigation Select the destination Pointing World In Miniature (WIM) [Stoakley et al., 1995] List of defined path Move to destination Teleportation [Ruddle et al., 2000] Interpolation [Mackinlay et al., 1990] Guided visit metaphor [Elmqvist et al., 2007] [Stoakley et al., 1995] Video 9

Navigation Multi-scale techniques Manuel scale modification An additional DoF Head-butt Zoom [Mine et al., 1997] Automatic scale modification Bounding Boxes [Kopper et al., 2006] Scaled-world grab [Mine et al., 1997] 10

Outline 3D interaction in Virtual Reality Navigation Object Manipulation Application Control 11

Object Manipulation Egocentric vs Exocentric Scaled-world grab WIM 2 main tasks Selection Manipulation 12

Object Manipulation Virtual Hand [Jacoby et al., 1994] Select and manipulate by touching Video Go-Go metaphor [Poupyrev et al., 1996] Extend the virtual hand Move exponentially 3D cursor [Zhai et al., 1994] Position or speed control 13

Object Manipulation Virtual Ray [Mine, 1995] Mimic a laser pointer Image plan Interaction [Pierce et al., 1997] Select by pointing with one part of the body Video 14

Object Manipulation Selection/manipulation techniques not always suitable for manipulation Ex: virtual ray for rotations Combining several interaction tools HOMER [Bowman et Hodges, 1997] Move the manipulated object close to the user Attached the interaction tools to the objects 15

Multi-Modal Interaction Voice for performing some actions Ex: Selection, moving objects, activate new mode Video Advantages Free hand manipulation Drawbacks Users have to memorize commands Not suitable in some collaborative application or noisy environments. 16

Outline 3D interaction in Virtual Reality Navigation Object Manipulation Application Control 17

Application Control Control Application (exit, pause, ) Rendering parameters Tools/actions selection [CDS Bowman et al., 1991] Techniques used 2D menus 3D menus Control on a tablet/smartphone [CHIMP Mine et al., 1997] [Coquillart et al., 1999] 18