3D User Interfaces. Using the Kinect and Beyond. John Murray. John Murray
|
|
- Gwenda Grant
- 6 years ago
- Views:
Transcription
1 Using the Kinect and Beyond // Center for Games and Playable Media // John Murray John Murray Expressive Title Here (Arial) Intelligence Studio
2 Introduction to Interfaces User interface design (HCI) focuses on use cases and user studies Have only begun investigating 3D interfaces with the same level of rigor But have been actively researching them for the past two decades Divided into input devices, manipulation techniques, navigation techniques, and
3 Input Devices Joysticks 3D Mice 2D Mice Buttons Brain Input Gloves
4 Special Purpose Game Controllers Playstation Move Wiimote & Nunchuk Steel Battalion controller Wii Fit 360 Controller
5 Playstation Move Uses optical tracking to locate sphere Color distinguishes from environment Uses 6dof (accelerometer & gyroscope) to provide rotation around point Up to 4 controllers Very fast
6 Wiimote Began it all Uses IR LEDs in a tracker to handle exact position, but must be pointed toward sensor bar. Has accelerometer, but not gyroscope Extension adds additional resolution/detail to rotation
7 Steel Battalion
8 New wave of input devices Touche $? Leap $70 Sparkfun $400+ Emotiv EPOC neuroheadset $300
9 Output Augmented reality (Foresight, Google Glass) 3D TVs and Monitors getting cheaper Tactile (Vibration, haptic feedback) Heat/cold
10 3D MANIPULATION
11 3D Selection & Manipulation Nonstandard manipulation Deform Puppet Meshes 3D Manipulation Spatial Rigid Object Manipulation Selection Positioning: Rotation: Changing orientation of the object
12 Precision Grasp Small muscle groups (thumbs, fingers Thumbsticks on 360 and wiimote Better performance in 3d, faster, more accurate Reduce clutching Attached to hand (Kinect) Provides kinesthetic sense Uses larger muscle groups Exercise & imitates actual actions
13 Isomorphic vs Isometric Think thumbpad vs mouse or Kinect. Measuring force vs position Relative vs absolute mapping of rotation and transform Think its more natural, but isomorphic can be limited by our own physical limitations. We do not have extendable arms, for instance.
14 Selection Technique Indication of object Occlusion Object touching (list, voice set, automatic, iconic) Pointing (2d, 3d gaze, 3d hand) Indirect selection (1-1, pos->pos, vel->pos, pos->vel) Confirmation of selection (Event, gesture, voice command, no explicit command) Feedback (Text/Symbolic,Aural, visual, force/tacticle)
15 Manipulation Techniques Exocentric Metaphors World in miniature Automatic scaling Egocentric Metaphors Virtual Hand Metaphors Classical Go-Go Indirect Go-Go Virtual Pointer Metaphors Ray Casting Aperture Flashlight Image plane
16 TRAVEL AND WAYFINDING
17 Maneuvering Similar to search task: destination known. Need to have precise local changes to reach destination How far do you need to go? How many turns in path? Turning torse when less frequent, other method when they are frequent Visibility of target from start location
18 Travel Techniques Active vs Passive Active is when the user moves their viewport consciously Passive is when the user directs travel Direction/Target Selection Gaze, pointing, orientation, Stop moving Velocity/Acceleration Selection Constant, gesture, explicit, adaptive Input Conditions Constant, continuous input, start and stop inputs, automatic start/stop
CSE 165: 3D User Interaction. Lecture #11: Travel
CSE 165: 3D User Interaction Lecture #11: Travel 2 Announcements Homework 3 is on-line, due next Friday Media Teaching Lab has Merge VR viewers to borrow for cell phone based VR http://acms.ucsd.edu/students/medialab/equipment
More informationGuidelines for choosing VR Devices from Interaction Techniques
Guidelines for choosing VR Devices from Interaction Techniques Jaime Ramírez Computer Science School Technical University of Madrid Campus de Montegancedo. Boadilla del Monte. Madrid Spain http://decoroso.ls.fi.upm.es
More information3D Interaction Techniques
3D Interaction Techniques Hannes Interactive Media Systems Group (IMS) Institute of Software Technology and Interactive Systems Based on material by Chris Shaw, derived from Doug Bowman s work Why 3D Interaction?
More informationClassifying 3D Input Devices
IMGD 5100: Immersive HCI Classifying 3D Input Devices Robert W. Lindeman Associate Professor Department of Computer Science Worcester Polytechnic Institute gogo@wpi.edu Motivation The mouse and keyboard
More informationClassifying 3D Input Devices
IMGD 5100: Immersive HCI Classifying 3D Input Devices Robert W. Lindeman Associate Professor Department of Computer Science Worcester Polytechnic Institute gogo@wpi.edu But First Who are you? Name Interests
More informationCSC 2524, Fall 2017 AR/VR Interaction Interface
CSC 2524, Fall 2017 AR/VR Interaction Interface Karan Singh Adapted from and with thanks to Mark Billinghurst Typical Virtual Reality System HMD User Interface Input Tracking How can we Interact in VR?
More informationInteraction in VR: Manipulation
Part 8: Interaction in VR: Manipulation Virtuelle Realität Wintersemester 2007/08 Prof. Bernhard Jung Overview Control Methods Selection Techniques Manipulation Techniques Taxonomy Further reading: D.
More informationIMGD 4000 Technical Game Development II Interaction and Immersion
IMGD 4000 Technical Game Development II Interaction and Immersion Robert W. Lindeman Associate Professor Human Interaction in Virtual Environments (HIVE) Lab Department of Computer Science Worcester Polytechnic
More informationInteracting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)
Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine) Presentation Working in a virtual world Interaction principles Interaction examples Why VR in the First Place? Direct perception
More informationRéalité Virtuelle et Interactions. Interaction 3D. Année / 5 Info à Polytech Paris-Sud. Cédric Fleury
Réalité Virtuelle et Interactions Interaction 3D Année 2016-2017 / 5 Info à Polytech Paris-Sud Cédric Fleury (cedric.fleury@lri.fr) Virtual Reality Virtual environment (VE) 3D virtual world Simulated by
More informationRV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI
RV - AULA 05 - PSI3502/2018 User Experience, Human Computer Interaction and UI Outline Discuss some general principles of UI (user interface) design followed by an overview of typical interaction tasks
More informationCosc VR Interaction. Interaction in Virtual Environments
Cosc 4471 Interaction in Virtual Environments VR Interaction In traditional interfaces we need to use interaction metaphors Windows, Mouse, Pointer (WIMP) Limited input degrees of freedom imply modality
More informationCSE 165: 3D User Interaction. Lecture #7: Input Devices Part 2
CSE 165: 3D User Interaction Lecture #7: Input Devices Part 2 2 Announcements Homework Assignment #2 Due tomorrow at 2pm Sony Move check out Homework discussion Monday at 6pm Input Devices CSE 165 -Winter
More informationProprioception & force sensing
Proprioception & force sensing Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) School of Information Sciences University of Tampere, Finland Based on material by Jussi Rantala, Jukka
More informationVideo Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces
Video Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces Content based on Dr.LaViola s class: 3D User Interfaces for Games and VR What is a User Interface? Where
More informationGeo-Located Content in Virtual and Augmented Reality
Technical Disclosure Commons Defensive Publications Series October 02, 2017 Geo-Located Content in Virtual and Augmented Reality Thomas Anglaret Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationVR System Input & Tracking
Human-Computer Interface VR System Input & Tracking 071011-1 2017 년가을학기 9/13/2017 박경신 System Software User Interface Software Input Devices Output Devices User Human-Virtual Reality Interface User Monitoring
More informationOcclusion based Interaction Methods for Tangible Augmented Reality Environments
Occlusion based Interaction Methods for Tangible Augmented Reality Environments Gun A. Lee α Mark Billinghurst β Gerard J. Kim α α Virtual Reality Laboratory, Pohang University of Science and Technology
More informationRealtime 3D Computer Graphics Virtual Reality
Realtime 3D Computer Graphics Virtual Reality Virtual Reality Input Devices Special input devices are required for interaction,navigation and motion tracking (e.g., for depth cue calculation): 1 WIMP:
More informationTracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye
Tracking Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye Outline of this talk Introduction: what makes a good tracking system? Example hardware and their tradeoffs Taxonomy of tasks:
More informationMario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality
Mario Romero 2014/11/05 Multimodal Interaction and Interfaces Mixed Reality Outline Who am I and how I can help you? What is the Visualization Studio? What is Mixed Reality? What can we do for you? What
More informationAre Existing Metaphors in Virtual Environments Suitable for Haptic Interaction
Are Existing Metaphors in Virtual Environments Suitable for Haptic Interaction Joan De Boeck Chris Raymaekers Karin Coninx Limburgs Universitair Centrum Expertise centre for Digital Media (EDM) Universitaire
More informationVirtuelle Realität. Overview. Part 13: Interaction in VR: Navigation. Navigation Wayfinding Travel. Virtuelle Realität. Prof.
Part 13: Interaction in VR: Navigation Virtuelle Realität Wintersemester 2006/07 Prof. Bernhard Jung Overview Navigation Wayfinding Travel Further information: D. A. Bowman, E. Kruijff, J. J. LaViola,
More informationWhat was the first gestural interface?
stanford hci group / cs247 Human-Computer Interaction Design Studio What was the first gestural interface? 15 January 2013 http://cs247.stanford.edu Theremin Myron Krueger 1 Myron Krueger There were things
More informationVirtual Reality Calendar Tour Guide
Technical Disclosure Commons Defensive Publications Series October 02, 2017 Virtual Reality Calendar Tour Guide Walter Ianneo Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationChapter 15 Principles for the Design of Performance-oriented Interaction Techniques
Chapter 15 Principles for the Design of Performance-oriented Interaction Techniques Abstract Doug A. Bowman Department of Computer Science Virginia Polytechnic Institute & State University Applications
More information3D interaction techniques in Virtual Reality Applications for Engineering Education
3D interaction techniques in Virtual Reality Applications for Engineering Education Cristian Dudulean 1, Ionel Stareţu 2 (1) Industrial Highschool Rosenau, Romania E-mail: duduleanc@yahoo.com (2) Transylvania
More informationPHYSICS-BASED INTERACTIONS IN VIRTUAL REALITY MAX LAMMERS LEAD SENSE GLOVE
PHYSICS-BASED INTERACTIONS IN VIRTUAL REALITY MAX LAMMERS LEAD DEVELOPER @ SENSE GLOVE Current Interactions in VR Input Device Virtual Hand Model (VHM) Sense Glove Accuracy (per category) Optics based
More informationOmni-Directional Catadioptric Acquisition System
Technical Disclosure Commons Defensive Publications Series December 18, 2017 Omni-Directional Catadioptric Acquisition System Andreas Nowatzyk Andrew I. Russell Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationHaptic Rendering CPSC / Sonny Chan University of Calgary
Haptic Rendering CPSC 599.86 / 601.86 Sonny Chan University of Calgary Today s Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering
More informationIssues and Challenges of 3D User Interfaces: Effects of Distraction
Issues and Challenges of 3D User Interfaces: Effects of Distraction Leslie Klein kleinl@in.tum.de In time critical tasks like when driving a car or in emergency management, 3D user interfaces provide an
More informationHeads up interaction: glasgow university multimodal research. Eve Hoggan
Heads up interaction: glasgow university multimodal research Eve Hoggan www.tactons.org multimodal interaction Multimodal Interaction Group Key area of work is Multimodality A more human way to work Not
More informationInput devices and interaction. Ruth Aylett
Input devices and interaction Ruth Aylett Contents Tracking What is available Devices Gloves, 6 DOF mouse, WiiMote Why is it important? Interaction is basic to VEs We defined them as interactive in real-time
More informationTechnologies. Philippe Fuchs Ecole des Mines, ParisTech, Paris, France. Virtual Reality: Concepts and. Guillaume Moreau.
Virtual Reality: Concepts and Technologies Editors Philippe Fuchs Ecole des Mines, ParisTech, Paris, France Guillaume Moreau Ecole Centrale de Nantes, CERMA, Nantes, France Pascal Guitton INRIA, University
More informationEVALUATING 3D INTERACTION TECHNIQUES
EVALUATING 3D INTERACTION TECHNIQUES ROBERT J. TEATHER QUALIFYING EXAM REPORT SUPERVISOR: WOLFGANG STUERZLINGER DEPARTMENT OF COMPUTER SCIENCE & ENGINEERING, YORK UNIVERSITY TORONTO, ONTARIO MAY, 2011
More informationVirtual Environment Interaction Based on Gesture Recognition and Hand Cursor
Virtual Environment Interaction Based on Gesture Recognition and Hand Cursor Chan-Su Lee Kwang-Man Oh Chan-Jong Park VR Center, ETRI 161 Kajong-Dong, Yusong-Gu Taejon, 305-350, KOREA +82-42-860-{5319,
More informationJane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute
Jane Li Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Use an example to explain what is admittance control? You may refer to exoskeleton
More informationLECTURE 5 COMPUTER PERIPHERALS INTERACTION MODELS
September 21, 2017 LECTURE 5 COMPUTER PERIPHERALS INTERACTION MODELS HCI & InfoVis 2017, fjv 1 Our Mental Conflict... HCI & InfoVis 2017, fjv 2 Our Mental Conflict... HCI & InfoVis 2017, fjv 3 Recapitulation
More informationChapter 2 Introduction to Haptics 2.1 Definition of Haptics
Chapter 2 Introduction to Haptics 2.1 Definition of Haptics The word haptic originates from the Greek verb hapto to touch and therefore refers to the ability to touch and manipulate objects. The haptic
More informationCS277 - Experimental Haptics Lecture 2. Haptic Rendering
CS277 - Experimental Haptics Lecture 2 Haptic Rendering Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering A note on timing...
More informationTouch Feedback in a Head-Mounted Display Virtual Reality through a Kinesthetic Haptic Device
Touch Feedback in a Head-Mounted Display Virtual Reality through a Kinesthetic Haptic Device Andrew A. Stanley Stanford University Department of Mechanical Engineering astan@stanford.edu Alice X. Wu Stanford
More informationHaptic Camera Manipulation: Extending the Camera In Hand Metaphor
Haptic Camera Manipulation: Extending the Camera In Hand Metaphor Joan De Boeck, Karin Coninx Expertise Center for Digital Media Limburgs Universitair Centrum Wetenschapspark 2, B-3590 Diepenbeek, Belgium
More informationThe 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, / X
The 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, 2012 10.5682/2066-026X-12-103 DEVELOPMENT OF A NATURAL USER INTERFACE FOR INTUITIVE PRESENTATIONS
More informationInteraction Techniques for Immersive Virtual Environments: Design, Evaluation, and Application
Interaction Techniques for Immersive Virtual Environments: Design, Evaluation, and Application Doug A. Bowman Graphics, Visualization, and Usability Center College of Computing Georgia Institute of Technology
More informationPRODUCTS DOSSIER. / DEVELOPMENT KIT - VERSION NOVEMBER Product information PAGE 1
PRODUCTS DOSSIER DEVELOPMENT KIT - VERSION 1.1 - NOVEMBER 2017 www.neurodigital.es / hello@neurodigital.es Product information PAGE 1 Minimum System Specs Operating System Windows 8.1 or newer Processor
More informationARTISTRY IN A NEW MEDIUM: LONE ECHO AND THE MAGIC OF VR NATHAN PHAIL-LIFF ART DIRECTOR READY AT DAWN
ARTISTRY IN A NEW MEDIUM: LONE ECHO AND THE MAGIC OF VR NATHAN PHAIL-LIFF ART DIRECTOR READY AT DAWN Topics Covered Magic (and challenges) of the Medium Immersion, presence, and storytelling Social interactions
More informationE90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright
E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7
More informationVorlesung Mensch-Maschine-Interaktion. The solution space. Chapter 4 Analyzing the Requirements and Understanding the Design Space
Vorlesung Mensch-Maschine-Interaktion LFE Medieninformatik Ludwig-Maximilians-Universität München http://www.hcilab.org/albrecht/ Chapter 4 3.7 Design Space for Input/Output Slide 2 The solution space
More informationVR based HCI Techniques & Application. November 29, 2002
VR based HCI Techniques & Application November 29, 2002 stefan.seipel@hci.uu.se What is Virtual Reality? Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted
More informationPinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data
Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data Hrvoje Benko Microsoft Research One Microsoft Way Redmond, WA 98052 USA benko@microsoft.com Andrew D. Wilson Microsoft
More informationAugmented and Virtual Reality
CS-3120 Human-Computer Interaction Augmented and Virtual Reality Mikko Kytö 7.11.2017 From Real to Virtual [1] Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS
More informationTestbed Evaluation of Virtual Environment Interaction Techniques
Testbed Evaluation of Virtual Environment Interaction Techniques Doug A. Bowman Department of Computer Science (0106) Virginia Polytechnic & State University Blacksburg, VA 24061 USA (540) 231-7537 bowman@vt.edu
More informationInput devices and interaction. Ruth Aylett
Input devices and interaction Ruth Aylett Tracking What is available Devices Gloves, 6 DOF mouse, WiiMote, Kinect Contents Why is it important? Interaction is basic to VEs We defined them as interactive
More informationCSE 165: 3D User Interaction. Lecture #14: 3D UI Design
CSE 165: 3D User Interaction Lecture #14: 3D UI Design 2 Announcements Homework 3 due tomorrow 2pm Monday: midterm discussion Next Thursday: midterm exam 3D UI Design Strategies 3 4 Thus far 3DUI hardware
More informationCS277 - Experimental Haptics Lecture 1. Introduction to Haptics
CS277 - Experimental Haptics Lecture 1 Introduction to Haptics Haptic Interfaces Enables physical interaction with virtual objects Haptic Rendering Potential Fields Polygonal Meshes Implicit Surfaces Volumetric
More informationCS 315 Intro to Human Computer Interaction (HCI)
CS 315 Intro to Human Computer Interaction (HCI) Direct Manipulation Examples Drive a car If you want to turn left, what do you do? What type of feedback do you get? How does this help? Think about turning
More informationCollaboration en Réalité Virtuelle
Réalité Virtuelle et Interaction Collaboration en Réalité Virtuelle https://www.lri.fr/~cfleury/teaching/app5-info/rvi-2018/ Année 2017-2018 / APP5 Info à Polytech Paris-Sud Cédric Fleury (cedric.fleury@lri.fr)
More informationDevelopment of an Intuitive Interface for PC Mouse Operation Based on Both Arms Gesture
Development of an Intuitive Interface for PC Mouse Operation Based on Both Arms Gesture Nobuaki Nakazawa 1*, Toshikazu Matsui 1, Yusaku Fujii 2 1 Faculty of Science and Technology, Gunma University, 29-1
More informationWands are Magic: a comparison of devices used in 3D pointing interfaces
Wands are Magic: a comparison of devices used in 3D pointing interfaces Martin Henschke, Tom Gedeon, Richard Jones, Sabrina Caldwell and Dingyun Zhu College of Engineering and Computer Science, Australian
More informationEffective Iconography....convey ideas without words; attract attention...
Effective Iconography...convey ideas without words; attract attention... Visual Thinking and Icons An icon is an image, picture, or symbol representing a concept Icon-specific guidelines Represent the
More information3D interaction strategies and metaphors
3D interaction strategies and metaphors Ivan Poupyrev Interaction Lab, Sony CSL Ivan Poupyrev, Ph.D. Interaction Lab, Sony CSL E-mail: poup@csl.sony.co.jp WWW: http://www.csl.sony.co.jp/~poup/ Address:
More informationAdvancements in Gesture Recognition Technology
IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 4, Issue 4, Ver. I (Jul-Aug. 2014), PP 01-07 e-issn: 2319 4200, p-issn No. : 2319 4197 Advancements in Gesture Recognition Technology 1 Poluka
More informationPeter Berkelman. ACHI/DigitalWorld
Magnetic Levitation Haptic Peter Berkelman ACHI/DigitalWorld February 25, 2013 Outline: Haptics - Force Feedback Sample devices: Phantoms, Novint Falcon, Force Dimension Inertia, friction, hysteresis/backlash
More informationInteractive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1
VR Software Class 4 Dr. Nabil Rami http://www.simulationfirst.com/ein5255/ Audio Output Can be divided into two elements: Audio Generation Audio Presentation Page 4-1 Audio Generation A variety of audio
More informationGestaltung und Strukturierung virtueller Welten. Bauhaus - Universität Weimar. Research at InfAR. 2ooo
Gestaltung und Strukturierung virtueller Welten Research at InfAR 2ooo 1 IEEE VR 99 Bowman, D., Kruijff, E., LaViola, J., and Poupyrev, I. "The Art and Science of 3D Interaction." Full-day tutorial presented
More information3D Interaction using Hand Motion Tracking. Srinath Sridhar Antti Oulasvirta
3D Interaction using Hand Motion Tracking Srinath Sridhar Antti Oulasvirta EIT ICT Labs Smart Spaces Summer School 05-June-2013 Speaker Srinath Sridhar PhD Student Supervised by Prof. Dr. Christian Theobalt
More informationDirect Manipulation. and Instrumental Interaction. CS Direct Manipulation
Direct Manipulation and Instrumental Interaction 1 Review: Interaction vs. Interface What s the difference between user interaction and user interface? Interface refers to what the system presents to the
More informationDetermining Optimal Player Position, Distance, and Scale from a Point of Interest on a Terrain
Technical Disclosure Commons Defensive Publications Series October 02, 2017 Determining Optimal Player Position, Distance, and Scale from a Point of Interest on a Terrain Adam Glazier Nadav Ashkenazi Matthew
More informationStereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays. Habib Abi-Rached Thursday 17 February 2005.
Stereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays Habib Abi-Rached Thursday 17 February 2005. Objective Mission: Facilitate communication: Bandwidth. Intuitiveness.
More informationInterface Design V: Beyond the Desktop
Interface Design V: Beyond the Desktop Rob Procter Further Reading Dix et al., chapter 4, p. 153-161 and chapter 15. Norman, The Invisible Computer, MIT Press, 1998, chapters 4 and 15. 11/25/01 CS4: HCI
More informationFuture Rehabilitative and Assistive Technology
Future Rehabilitative and Assistive Technology John Grencer, Administrative Director Technology Program, Strategic Planning December 14 th, 2013 Financial disclosure: the speakers have no relevant financial
More informationHow is a robot controlled? Teleoperation and autonomy. Levels of autonomy 1a. Remote control Visual contact / no sensor feedback.
Teleoperation and autonomy Thomas Hellström Umeå University Sweden How is a robot controlled? 1. By the human operator 2. Mixed human and robot 3. By the robot itself Levels of autonomy! Slide material
More informationEnhancing Robot Teleoperator Situation Awareness and Performance using Vibro-tactile and Graphical Feedback
Enhancing Robot Teleoperator Situation Awareness and Performance using Vibro-tactile and Graphical Feedback by Paulo G. de Barros Robert W. Lindeman Matthew O. Ward Human Interaction in Vortual Environments
More informationCapacitive Face Cushion for Smartphone-Based Virtual Reality Headsets
Technical Disclosure Commons Defensive Publications Series November 22, 2017 Face Cushion for Smartphone-Based Virtual Reality Headsets Samantha Raja Alejandra Molina Samuel Matson Follow this and additional
More informationHaptic, vestibular and other physical input/output devices
Human Touch Sensing - recap Haptic, vestibular and other physical input/output devices SGN-5406 Virtual Reality Autumn 2007 ismo.rakkolainen@tut.fi The human sensitive areas for touch: Hand, face Many
More informationCS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty
CS123 Programming Your Personal Robot Part 3: Reasoning Under Uncertainty This Week (Week 2 of Part 3) Part 3-3 Basic Introduction of Motion Planning Several Common Motion Planning Methods Plan Execution
More information3D UIs 101 Doug Bowman
3D UIs 101 Doug Bowman Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for the Masses The Wii Remote and You 3D UI and
More informationTHE WII REMOTE AS AN INPUT DEVICE FOR 3D INTERACTION IN IMMERSIVE HEAD-MOUNTED DISPLAY VIRTUAL REALITY
IADIS International Conference Gaming 2008 THE WII REMOTE AS AN INPUT DEVICE FOR 3D INTERACTION IN IMMERSIVE HEAD-MOUNTED DISPLAY VIRTUAL REALITY Yang-Wai Chow School of Computer Science and Software Engineering
More informationCHAPTER 1. INTRODUCTION 16
1 Introduction The author s original intention, a couple of years ago, was to develop a kind of an intuitive, dataglove-based interface for Computer-Aided Design (CAD) applications. The idea was to interact
More informationEvaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment
Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment Helmut Schrom-Feiertag 1, Christoph Schinko 2, Volker Settgast 3, and Stefan Seer 1 1 Austrian
More informationTouch & Gesture. HCID 520 User Interface Software & Technology
Touch & Gesture HCID 520 User Interface Software & Technology Natural User Interfaces What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger
More informationUbiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1
Episode 16: HCI Hannes Frey and Peter Sturm University of Trier University of Trier 1 Shrinking User Interface Small devices Narrow user interface Only few pixels graphical output No keyboard Mobility
More informationMarco Cavallo. Merging Worlds: A Location-based Approach to Mixed Reality. Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO
Marco Cavallo Merging Worlds: A Location-based Approach to Mixed Reality Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO Introduction: A New Realm of Reality 2 http://www.samsung.com/sg/wearables/gear-vr/
More informationFrictioned Micromotion Input for Touch Sensitive Devices
Technical Disclosure Commons Defensive Publications Series May 18, 2015 Frictioned Micromotion Input for Touch Sensitive Devices Samuel Huang Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationInput-output channels
Input-output channels Human Computer Interaction (HCI) Human input Using senses Sight, hearing, touch, taste and smell Sight, hearing & touch have important role in HCI Input-Output Channels Human output
More informationTHE PINNACLE OF VIRTUAL REALITY CONTROLLERS
THE PINNACLE OF VIRTUAL REALITY CONTROLLERS PRODUCT INFORMATION The Manus VR Glove is a high-end data glove that brings intuitive interaction to virtual reality. Its unique design and cutting edge technology
More informationUser Interface Agents
User Interface Agents Roope Raisamo (rr@cs.uta.fi) Department of Computer Sciences University of Tampere http://www.cs.uta.fi/sat/ User Interface Agents Schiaffino and Amandi [2004]: Interface agents are
More informationSensors. human sensing. basic sensory. advanced sensory. 5+N senses <link> tactile touchless (distant) virtual. e.g. camera, radar / lidar, MS Kinect
Sensors human sensing 5+N senses basic sensory tactile touchless (distant) virtual advanced sensory e.g. camera, radar / lidar, MS Kinect Human senses Traditional sight smell taste touch hearing
More informationSketchpad Ivan Sutherland (1962)
Sketchpad Ivan Sutherland (1962) 7 Viewable on Click here https://www.youtube.com/watch?v=yb3saviitti 8 Sketchpad: Direct Manipulation Direct manipulation features: Visibility of objects Incremental action
More informationA Study of Navigation and Selection Techniques in Virtual Environments Using Microsoft Kinect
A Study of Navigation and Selection Techniques in Virtual Environments Using Microsoft Kinect Peter Dam 1, Priscilla Braz 2, and Alberto Raposo 1,2 1 Tecgraf/PUC-Rio, Rio de Janeiro, Brazil peter@tecgraf.puc-rio.br
More informationIMGD 3100 Novel Interfaces for Interactive Environments: Physical Input
IMGD 3100 Novel Interfaces for Interactive Environments: Physical Input Robert W. Lindeman Associate Professor Human Interaction in Virtual Environments (HIVE) Lab Department of Computer Science Worcester
More informationFLEXLINK DESIGN TOOL VR GUIDE. documentation
FLEXLINK DESIGN TOOL VR GUIDE User documentation Contents CONTENTS... 1 REQUIREMENTS... 3 SETUP... 4 SUPPORTED FILE TYPES... 5 CONTROLS... 6 EXPERIENCE 3D VIEW... 9 EXPERIENCE VIRTUAL REALITY... 10 Requirements
More informationGraphical User Interfaces for Blind Users: An Overview of Haptic Devices
Graphical User Interfaces for Blind Users: An Overview of Haptic Devices Hasti Seifi, CPSC554m: Assignment 1 Abstract Graphical user interfaces greatly enhanced usability of computer systems over older
More informationUsing Hybrid Reality to Explore Scientific Exploration Scenarios
Using Hybrid Reality to Explore Scientific Exploration Scenarios EVA Technology Workshop 2017 Kelsey Young Exploration Scientist NASA Hybrid Reality Lab - Background Combines real-time photo-realistic
More informationIntuitive Robot Teleoperation based on Haptic Feedback and 3-D Visualization
Intuitive Robot Teleoperation based on Haptic Feedback and 3-D Visualization Yangjun Chen A thesis submitted in partial fulfilment of the requirements of the University of Hertfordshire for the degree
More informationA Kinect-based 3D hand-gesture interface for 3D databases
A Kinect-based 3D hand-gesture interface for 3D databases Abstract. The use of natural interfaces improves significantly aspects related to human-computer interaction and consequently the productivity
More informationCOMS W4172 Design Principles
COMS W4172 Design Principles Steven Feiner Department of Computer Science Columbia University New York, NY 10027 www.cs.columbia.edu/graphics/courses/csw4172 January 25, 2018 1 2D & 3D UIs: What s the
More information3D Interactions with a Passive Deformable Haptic Glove
3D Interactions with a Passive Deformable Haptic Glove Thuong N. Hoang Wearable Computer Lab University of South Australia 1 Mawson Lakes Blvd Mawson Lakes, SA 5010, Australia ngocthuong@gmail.com Ross
More informationSubject Description Form. Upon completion of the subject, students will be able to:
Subject Description Form Subject Code Subject Title EIE408 Principles of Virtual Reality Credit Value 3 Level 4 Pre-requisite/ Corequisite/ Exclusion Objectives Intended Subject Learning Outcomes Nil To
More informationSpatial Interfaces and Interactive 3D Environments for Immersive Musical Performances
Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances Florent Berthaut and Martin Hachet Figure 1: A musician plays the Drile instrument while being immersed in front of
More information