Augmented Reality Tactile Map with Hand Gesture Recognition
|
|
- Rosamund Davis
- 5 years ago
- Views:
Transcription
1 Augmented Reality Tactile Map with Hand Gesture Recognition Ryosuke Ichikari 1, Tenshi Yanagimachi 2 and Takeshi Kurata 1 1: National Institute of Advanced Industrial Science and Technology (AIST), Japan 2: Toyohashi University of Technology, Japan 13 July 2016, ICCHP 2016@ University of Linz, Austria 1
2 Walking Assists for the visuallyimpaired people Assisting technologies when they are walking White canes & guide dogs Assisting technologies with computer Remote Sensing by RGB(-D) cameras or LRF Voice navigation system based on localization technology such as GNSS Pre-Journey learning and re-viewing before/after walking Tactile Map Tactile trajectory 2
3 Tactile Map Maps with tactile presentation for the visually-impaired people UV offset printing:printing transparent plastic on the color maps PIAF(Picture in a flash):using heat sensitive papers which can swell black-printed area (lines/images) Casio s 2.5D printer:all-in-on solution for color and detailed tactile expression. UV Offset printing PIAF Casio s 2.5D printer 3
4 Problems about tactile map Difficulties for constructing mental image of the contents with haptic sense Needs experience and training Limitation of the amount of contents Production issues Cost: UV offset printing is expensive Needs know-how to design contents Tactile Map Automated Creation System (TMACS) [Watanabe et. al, ICCHP2014 ] 4
5 5 Proposed system:utilizing AR for tactile map Augmented Reality; AR Seamless integration of real world and virtual world Visual augmentation is main stream, but AR concept can be applied for audio sense AR Tactile Map(Proposed System): Audio-visual AR [Higa et. al 2007] Provides audio-visual feedbacks in response to interactive operations Enables dynamic and multimodal contents Can be utilized for learning tactile map
6 Characteristics of AR tactile map Augmentation for the tactile map by audio representation (for completely blind people) Enlarging/enhancing display for people with week sight Providing POR(Point of reference) information Intuitive interaction by actually touching tactile maps Configuration with off-the-shelf and varsatile products Hands-free arrangement Showing enlarged map with voice 6
7 Providing POR(Point of reference) information Target contents of the AR tactile map: POI(Point of Interest)and POR(Point of Reference) POR:Specific point location where it is easily recognized for confirming routes such as characteristic shape and material of ground (steps, stairs, sloop, door), sound/noise, and scent/odor) [Okuno et. al, CSUN2015] [Denoncin,CSUN2014] [Theberge, CSUN2015] Integration with POR/POI data base Voice navigation system with POR/POI data base [Okuno et. al, CSUN2015] 7
8 System configuration System configuration of the prototype system Tablet PC For Visual-Audio feedbacks RGB-D camera:depthsense DS325 (ToF, Range:15 cm ~100 cm ) For finger gesture recognition and robust extraction of hands area, measurement of the distance between the map and finger PC for recognition Arm for fixing tablet Tablet mount parts 8
9 Related Works ATMaps (Audio-Tactile Maps) using IVEO s Interactive tactile graphics. (ICCHP2016 workshop) Image to Sound Converter [Kuroda] Image is converted to sound by changing key and difference of L/R sound Transparent tactile sheet can be overlaid Display size and UI are limited by touch display Characteristics Kiko-AR by of cybernet AR Tactile systems Map: - Using Mobile versatile AR system products based on character recognition and audio presentation - Various sizes and types of tactile maps can be used Collaborating with a printing company to produce printed material - Intuitive interface for the system are focused with tactile presentation and AR augmentation. Need to shoot with smartphone s camera 9
10 Recognition of gesture Recognizing Tapping, Double Tapping, Flat-hand gesture gestures as interaction commands Algorithm for detecting Tapping Extracting hand area by RGB-D camera with background differencing of depth image and distance threshold Detecting state transition of distances within time window (1->2->1) Distance between map and finger Size of time window 2 1 1Finger on the map 2Finger in the air for tapping time Flat-hand gesture: Tracking flat-hand position when user touches maps by gradients and distances 10
11 11 Automatic identification and tracking of tactile map ORB Feature point detector/local feature descriptor is used for identifying tactile map with RGB image Estimating homography matrix between rectified image templates and input image
12 Mapping party fo Gathering acctual sites for making map (Mapping Party) Previewing by printing as tactile map Walking assistance by voice navigation
13 Virtual Mapping Party with AR Tactile Map Omni-directional image and 3D-Sound Recording Mapping Party Anytime, Anywhere Pre-learning of the walking route with the AR Tactile Map Requests for Mapping Utilized at voice navigation
14 Workshop on Virtual Mapping Party Held at Miraikan, Tokyo, Japan March 18 th -19 th, h x 6 times (total 42 participants) Collecting POR/POI by experiencing omnidirectional images(360 deg.) and 3D sounds with HMD(Oculus, GearVR. Etc.), PC and headphone Confirming and requesting POR/POI by AR tactile Map The number of the registered POR/POI: 598
15 Usage of the AR tactile map for virtual mapping party Allowing the visually-impaired people to join the mapping party by gesture Flat-hand: Confirming the existence of POR/POI where user touches Tap: Confirming POR/POI with Text-to-Sound when user taps the specific point Double Tap: Requesting the POR/POI for the specific points of the map
16 Summery of a questionnaire for the AR tactile map Accuracy of the gesture recognition has a room for improvement Requesting function is good because the it can reflect visually-impaired people's demand. Scale size of the map was not fitted. Considering to accuracy of the gesture recognition, the scale size of tactile maps and the density of the distribution of the contents need to be carefully considered. It seems to be interesting if the voice recognition can be combined with gesture interface. A participant with visual impairment like annotations printed in Braille, but another participant with visual impairment does not like them because they disturbed perception of the shapes of roads and buildings.
17 On going works Implementing another configuration of the AR tactile map with HP s Sprout. Sprout is a PC which has A projector A touch pad depth and color cameras Sprout enables touch recognition through the map Projection onto map Sheet tracking 3D scanning 17
18 AR tactile map with Sprout Tapping: Checking registered POR/POI Dragging: Searching Double Tapping: Requesting POR/POI Projecting POR/POI points on the map No other device or PC is required 18
19 19 Comparison with the proposed system Gesture recognitions Information augmentation System configuration & cost Limitation: The proposed system hand gesture recognition by RGB-D camera AR tactile map with Sprout touch detection by touch pad audio + enlarging image audio + enlarging Image + projection onto map PC($500~) + RGB-D camera($200) can be replaced with a tablet PC with RGB-D camera no visual augmentation onto map Sprout($1500) Size of map and UI for the map Advantages mobility, flexibility of UI and size of map, moderate price visual augmentation, accurate gesture recognition
20 Conclusions AR tactile map: Audio-visual augmentation for tactile map by utilizing hand gesture interface with RGB-D camera. Virtual Mapping Party with the AR tactile Map AR tactile map by HP s Sprout Future works Increasing accuracy of the gesture recognition Covering individual difference of gesture Noise and unclear situation (sunlight, close to paper) Other configurations of AR tactile maps (Sprout etc.) Acknowledgement This research is conducted as a part of the project sponsored by JST RISTEX. 20
21 Thank you! Ryosuke Ichikari, Ph.D. Postdoctoral Researcher at AIST Contact: 21
Pre-Journey Learning System for Visually-Impaired Pedestrians using Mobile AR Tactile Maps and Crowdsourced POR Aggregation
Pre-Journey Learning System for Visually-Impaired Pedestrians using Mobile AR Tactile Maps and Crowdsourced POR Aggregation Takeshi Kurata and Ryosuke Ichikari Service Sensing, Assimilation, and Modeling
More informationHaptic presentation of 3D objects in virtual reality for the visually disabled
Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,
More informationRecent Progress on Wearable Augmented Interaction at AIST
Recent Progress on Wearable Augmented Interaction at AIST Takeshi Kurata 12 1 Human Interface Technology Lab University of Washington 2 AIST, Japan kurata@ieee.org Weavy The goal of the Weavy project team
More informationR (2) Controlling System Application with hands by identifying movements through Camera
R (2) N (5) Oral (3) Total (10) Dated Sign Assignment Group: C Problem Definition: Controlling System Application with hands by identifying movements through Camera Prerequisite: 1. Web Cam Connectivity
More informationService Cooperation and Co-creative Intelligence Cycle Based on Mixed-Reality Technology
Service Cooperation and Co-creative Intelligence Cycle Based on Mixed-Reality Technology Takeshi Kurata, Masakatsu Kourogi, Tomoya Ishikawa, Jungwoo Hyun and Anjin Park Center for Service Research, AIST
More informationMultisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills
Multisensory virtual environment for supporting blind persons acquisition of spatial cognitive mapping, orientation, and mobility skills O Lahav and D Mioduser School of Education, Tel Aviv University,
More informationMultisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study
Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Orly Lahav & David Mioduser Tel Aviv University, School of Education Ramat-Aviv, Tel-Aviv,
More informationMicrosoft Scrolling Strip Prototype: Technical Description
Microsoft Scrolling Strip Prototype: Technical Description Primary features implemented in prototype Ken Hinckley 7/24/00 We have done at least some preliminary usability testing on all of the features
More informationE90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright
E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7
More informationDevelopment of Synchronized CUI and GUI for Universal Design Tactile Graphics Production System BPLOT3
Development of Synchronized CUI and GUI for Universal Design Tactile Graphics Production System BPLOT3 Mamoru Fujiyoshi 1, Akio Fujiyoshi 2,AkikoOsawa 1, Yusuke Kuroda 3, and Yuta Sasaki 3 1 National Center
More informationHAND-SHAPED INTERFACE FOR INTUITIVE HUMAN- ROBOT COMMUNICATION THROUGH HAPTIC MEDIA
HAND-SHAPED INTERFACE FOR INTUITIVE HUMAN- ROBOT COMMUNICATION THROUGH HAPTIC MEDIA RIKU HIKIJI AND SHUJI HASHIMOTO Department of Applied Physics, School of Science and Engineering, Waseda University 3-4-1
More informationVR/AR Concepts in Architecture And Available Tools
VR/AR Concepts in Architecture And Available Tools Peter Kán Interactive Media Systems Group Institute of Software Technology and Interactive Systems TU Wien Outline 1. What can you do with virtual reality
More informationAR4VI: AR as an Accessibility Tool for People with Visual Impairments
AR4VI: AR as an Accessibility Tool for People with Visual Impairments James M. Coughlan* and Joshua Miele The Smith-Kettlewell Eye Research Institute 2318 Fillmore St. San Francisco, CA 94115 USA ABSTRACT
More informationMulti-Modal User Interaction
Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface
More informationPerception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision
11-25-2013 Perception Vision Read: AIMA Chapter 24 & Chapter 25.3 HW#8 due today visual aural haptic & tactile vestibular (balance: equilibrium, acceleration, and orientation wrt gravity) olfactory taste
More informationpreface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...
v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)
More informationInterior Design with Augmented Reality
Interior Design with Augmented Reality Ananda Poudel and Omar Al-Azzam Department of Computer Science and Information Technology Saint Cloud State University Saint Cloud, MN, 56301 {apoudel, oalazzam}@stcloudstate.edu
More information6 Ubiquitous User Interfaces
6 Ubiquitous User Interfaces Viktoria Pammer-Schindler May 3, 2016 Ubiquitous User Interfaces 1 Days and Topics March 1 March 8 March 15 April 12 April 26 (10-13) April 28 (9-14) May 3 May 10 Administrative
More informationHuman Factors. We take a closer look at the human factors that affect how people interact with computers and software:
Human Factors We take a closer look at the human factors that affect how people interact with computers and software: Physiology physical make-up, capabilities Cognition thinking, reasoning, problem-solving,
More informationmixed reality mixed reality & (tactile and) tangible interaction (tactile and) tangible interaction class housekeeping about me
Mixed Reality Tangible Interaction mixed reality (tactile and) mixed reality (tactile and) Jean-Marc Vezien Jean-Marc Vezien about me Assistant prof in Paris-Sud and co-head of masters contact: anastasia.bezerianos@lri.fr
More informationMultisensory Virtual Environment for Supporting Blind. Persons' Acquisition of Spatial Cognitive Mapping. a Case Study I
1 Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study I Orly Lahav & David Mioduser Tel Aviv University, School of Education Ramat-Aviv,
More informationsynchrolight: Three-dimensional Pointing System for Remote Video Communication
synchrolight: Three-dimensional Pointing System for Remote Video Communication Jifei Ou MIT Media Lab 75 Amherst St. Cambridge, MA 02139 jifei@media.mit.edu Sheng Kai Tang MIT Media Lab 75 Amherst St.
More informationMOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device
MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device Enkhbat Davaasuren and Jiro Tanaka 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577 Japan {enkhee,jiro}@iplab.cs.tsukuba.ac.jp Abstract.
More informationVIEW: Visual Interactive Effective Worlds Lorentz Center International Center for workshops in the Sciences June Dr.
Virtual Reality & Presence VIEW: Visual Interactive Effective Worlds Lorentz Center International Center for workshops in the Sciences 25-27 June 2007 Dr. Frederic Vexo Virtual Reality & Presence Outline:
More informationMarkerless 3D Gesture-based Interaction for Handheld Augmented Reality Interfaces
Markerless 3D Gesture-based Interaction for Handheld Augmented Reality Interfaces Huidong Bai The HIT Lab NZ, University of Canterbury, Christchurch, 8041 New Zealand huidong.bai@pg.canterbury.ac.nz Lei
More information* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged
ADVANCED ROBOTICS SOLUTIONS * Intelli Mobile Robot for Multi Specialty Operations * Advanced Robotic Pick and Place Arm and Hand System * Automatic Color Sensing Robot using PC * AI Based Image Capturing
More informationCAPACITIES FOR TECHNOLOGY TRANSFER
CAPACITIES FOR TECHNOLOGY TRANSFER The Institut de Robòtica i Informàtica Industrial (IRI) is a Joint University Research Institute of the Spanish Council for Scientific Research (CSIC) and the Technical
More informationrevolutionizing Subhead Can Be Placed Here healthcare Anders Gronstedt, Ph.D., President, Gronstedt Group September 22, 2017
How Presentation virtual reality Title is revolutionizing Subhead Can Be Placed Here healthcare Anders Gronstedt, Ph.D., President, Gronstedt Group September 22, 2017 Please introduce yourself in text
More informationAUGMENTED REALITY IN URBAN MOBILITY
AUGMENTED REALITY IN URBAN MOBILITY 11 May 2016 Normal: Prepared by TABLE OF CONTENTS TABLE OF CONTENTS... 1 1. Overview... 2 2. What is Augmented Reality?... 2 3. Benefits of AR... 2 4. AR in Urban Mobility...
More informationThe 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, / X
The 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, 2012 10.5682/2066-026X-12-103 DEVELOPMENT OF A NATURAL USER INTERFACE FOR INTUITIVE PRESENTATIONS
More informationVirtual Reality Calendar Tour Guide
Technical Disclosure Commons Defensive Publications Series October 02, 2017 Virtual Reality Calendar Tour Guide Walter Ianneo Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationHeroX - Untethered VR Training in Sync'ed Physical Spaces
Page 1 of 6 HeroX - Untethered VR Training in Sync'ed Physical Spaces Above and Beyond - Integrating Robotics In previous research work I experimented with multiple robots remotely controlled by people
More informationInteractive Simulation: UCF EIN5255. VR Software. Audio Output. Page 4-1
VR Software Class 4 Dr. Nabil Rami http://www.simulationfirst.com/ein5255/ Audio Output Can be divided into two elements: Audio Generation Audio Presentation Page 4-1 Audio Generation A variety of audio
More informationIntroduction to Virtual Reality. Chapter IX. Introduction to Virtual Reality. 9.1 Introduction. Definition of VR (W. Sherman)
Introduction to Virtual Reality Chapter IX Introduction to Virtual Reality 9.1 Introduction 9.2 Hardware 9.3 Virtual Worlds 9.4 Examples of VR Applications 9.5 Augmented Reality 9.6 Conclusions CS 397
More informationNCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects
NCCT Promise for the Best Projects IEEE PROJECTS in various Domains Latest Projects, 2009-2010 ADVANCED ROBOTICS SOLUTIONS EMBEDDED SYSTEM PROJECTS Microcontrollers VLSI DSP Matlab Robotics ADVANCED ROBOTICS
More informationToward an Augmented Reality System for Violin Learning Support
Toward an Augmented Reality System for Violin Learning Support Hiroyuki Shiino, François de Sorbier, and Hideo Saito Graduate School of Science and Technology, Keio University, Yokohama, Japan {shiino,fdesorbi,saito}@hvrl.ics.keio.ac.jp
More informationDevelopment of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
Journal of Communication and Computer 13 (2016) 329-337 doi:10.17265/1548-7709/2016.07.002 D DAVID PUBLISHING Development of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
More informationHaptics CS327A
Haptics CS327A - 217 hap tic adjective relating to the sense of touch or to the perception and manipulation of objects using the senses of touch and proprioception 1 2 Slave Master 3 Courtesy of Walischmiller
More informationOmni-Directional Catadioptric Acquisition System
Technical Disclosure Commons Defensive Publications Series December 18, 2017 Omni-Directional Catadioptric Acquisition System Andreas Nowatzyk Andrew I. Russell Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationHeads up interaction: glasgow university multimodal research. Eve Hoggan
Heads up interaction: glasgow university multimodal research Eve Hoggan www.tactons.org multimodal interaction Multimodal Interaction Group Key area of work is Multimodality A more human way to work Not
More informationIMGD 4000 Technical Game Development II Interaction and Immersion
IMGD 4000 Technical Game Development II Interaction and Immersion Robert W. Lindeman Associate Professor Human Interaction in Virtual Environments (HIVE) Lab Department of Computer Science Worcester Polytechnic
More informationGeo-Located Content in Virtual and Augmented Reality
Technical Disclosure Commons Defensive Publications Series October 02, 2017 Geo-Located Content in Virtual and Augmented Reality Thomas Anglaret Follow this and additional works at: http://www.tdcommons.org/dpubs_series
More informationBuilding a bimanual gesture based 3D user interface for Blender
Modeling by Hand Building a bimanual gesture based 3D user interface for Blender Tatu Harviainen Helsinki University of Technology Telecommunications Software and Multimedia Laboratory Content 1. Background
More informationEvaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface
Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface Xu Zhao Saitama University 255 Shimo-Okubo, Sakura-ku, Saitama City, Japan sheldonzhaox@is.ics.saitamau.ac.jp Takehiro Niikura The University
More informationEnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment
EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment Hideki Koike 1, Shin ichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of Information Systems,
More informationSMART ELECTRONIC GADGET FOR VISUALLY IMPAIRED PEOPLE
ISSN: 0976-2876 (Print) ISSN: 2250-0138 (Online) SMART ELECTRONIC GADGET FOR VISUALLY IMPAIRED PEOPLE L. SAROJINI a1, I. ANBURAJ b, R. ARAVIND c, M. KARTHIKEYAN d AND K. GAYATHRI e a Assistant professor,
More informationDESIGN OF AN AUGMENTED REALITY
DESIGN OF AN AUGMENTED REALITY MAGNIFICATION AID FOR LOW VISION USERS Lee Stearns University of Maryland Email: lstearns@umd.edu Jon Froehlich Leah Findlater University of Washington Common reading aids
More information3D Interaction Techniques
3D Interaction Techniques Hannes Interactive Media Systems Group (IMS) Institute of Software Technology and Interactive Systems Based on material by Chris Shaw, derived from Doug Bowman s work Why 3D Interaction?
More informationA Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds
6th ERCIM Workshop "User Interfaces for All" Long Paper A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds Masaki Omata, Kentaro Go, Atsumi Imamiya Department of Computer
More informationTactile Vision Substitution with Tablet and Electro-Tactile Display
Tactile Vision Substitution with Tablet and Electro-Tactile Display Haruya Uematsu 1, Masaki Suzuki 2, Yonezo Kanno 2, Hiroyuki Kajimoto 1 1 The University of Electro-Communications, 1-5-1 Chofugaoka,
More informationIDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK. Javier Sanchez
IDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK Javier Sanchez Center for Computer Research in Music and Acoustics (CCRMA) Stanford University The Knoll, 660 Lomita Dr. Stanford, CA 94305,
More informationthese systems has increased, regardless of the environmental conditions of the systems.
Some Student November 30, 2010 CS 5317 USING A TACTILE GLOVE FOR MAINTENANCE TASKS IN HAZARDOUS OR REMOTE SITUATIONS 1. INTRODUCTION As our dependence on automated systems has increased, demand for maintenance
More informationHaptics Technologies: Bringing Touch to Multimedia
Haptics Technologies: Bringing Touch to Multimedia C2: Haptics Applications Outline Haptic Evolution: from Psychophysics to Multimedia Haptics for Medical Applications Surgical Simulations Stroke-based
More informationGraVVITAS: Generic Multi-touch Presentation of Accessible Graphics
GraVVITAS: Generic Multi-touch Presentation of Accessible Graphics Cagatay Goncu and Kim Marriott Clayton School of Information Technology, Monash University cagatay.goncu@monash.edu.au, kim.marriott@monash.edu.au
More informationBuilding Spatial Experiences in the Automotive Industry
Building Spatial Experiences in the Automotive Industry i-know Data-driven Business Conference Franz Weghofer franz.weghofer@magna.com Video Agenda Digital Factory - Data Backbone of all Virtual Representations
More informationApplication of 3D Terrain Representation System for Highway Landscape Design
Application of 3D Terrain Representation System for Highway Landscape Design Koji Makanae Miyagi University, Japan Nashwan Dawood Teesside University, UK Abstract In recent years, mixed or/and augmented
More informationVirtual Tactile Maps
In: H.-J. Bullinger, J. Ziegler, (Eds.). Human-Computer Interaction: Ergonomics and User Interfaces. Proc. HCI International 99 (the 8 th International Conference on Human-Computer Interaction), Munich,
More informationBlindstation : a Game Platform Adapted to Visually Impaired Children
Blindstation : a Game Platform Adapted to Visually Impaired Children Sébastien Sablé and Dominique Archambault INSERM U483 / INOVA - Université Pierre et Marie Curie 9, quai Saint Bernard, 75,252 Paris
More informationInteractive and Immersive 3D Visualization for ATC. Matt Cooper Norrköping Visualization and Interaction Studio University of Linköping, Sweden
Interactive and Immersive 3D Visualization for ATC Matt Cooper Norrköping Visualization and Interaction Studio University of Linköping, Sweden Background Fundamentals: Air traffic expected to increase
More informationComparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians
British Journal of Visual Impairment September, 2007 Comparison between audio and tactile systems for delivering simple navigational information to visually impaired pedestrians Dr. Olinkha Gustafson-Pearce,
More informationIntelligent interaction
BionicWorkplace: autonomously learning workstation for human-machine collaboration Intelligent interaction Face to face, hand in hand. The BionicWorkplace shows the extent to which human-machine collaboration
More informationREPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism
REPORT ON THE CURRENT STATE OF FOR DESIGN XL: Experiments in Landscape and Urbanism This report was produced by XL: Experiments in Landscape and Urbanism, SWA Group s innovation lab. It began as an internal
More informationMario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality
Mario Romero 2014/11/05 Multimodal Interaction and Interfaces Mixed Reality Outline Who am I and how I can help you? What is the Visualization Studio? What is Mixed Reality? What can we do for you? What
More informationNTT DOCOMO Technical Journal. 1. Introduction. 2. Process of Popularizing Glasses-Type Devices
Wearable Device Cloud Service Intelligent Glass This article presents an overview of Intelligent Glass exhibited at CEATEC JAPAN 2013. Google Glass * 1 has brought high expectations for glasses-type devices,
More informationGesture-based interaction via finger tracking for mobile augmented reality
Multimed Tools Appl (2013) 62:233 258 DOI 10.1007/s11042-011-0983-y Gesture-based interaction via finger tracking for mobile augmented reality Wolfgang Hürst & Casper van Wezel Published online: 18 January
More informationThe Chatty Environment Providing Everyday Independence to the Visually Impaired
The Chatty Environment Providing Everyday Independence to the Visually Impaired Vlad Coroamă and Felix Röthenbacher Distributed Systems Group Institute for Pervasive Computing Swiss Federal Institute of
More informationWaves Nx VIRTUAL REALITY AUDIO
Waves Nx VIRTUAL REALITY AUDIO WAVES VIRTUAL REALITY AUDIO THE FUTURE OF AUDIO REPRODUCTION AND CREATION Today s entertainment is on a mission to recreate the real world. Just as VR makes us feel like
More informationTactile audiographics for leisure, education and employment
The 2nd Indo US Workshop on Emerging Accessibility Technologies for the Blind and Visually Impaired 11 13 February 2016 Indian Institute of Technology, Delhi, India Tactile audiographics for leisure, education
More informationCase Study. Next Generation Virtual Reality Environment for the Construction Sector. 1 COINS Fulcro Case Study. Industry: Construction
www.optoma.com Case Study Next Generation Virtual Reality Environment for the Construction Sector Industry: Construction Region: UK Equipment list: 3x EH320UST, EH415ST, PC and Xbox controller Type of
More informationInteractive and Immersive 3D Visualization for ATC
Interactive and Immersive 3D Visualization for ATC Matt Cooper & Marcus Lange Norrköping Visualization and Interaction Studio University of Linköping, Sweden Summary of last presentation A quick description
More informationGraphical User Interfaces for Blind Users: An Overview of Haptic Devices
Graphical User Interfaces for Blind Users: An Overview of Haptic Devices Hasti Seifi, CPSC554m: Assignment 1 Abstract Graphical user interfaces greatly enhanced usability of computer systems over older
More informationinteractive laboratory
interactive laboratory ABOUT US 360 The first in Kazakhstan, who started working with VR technologies Over 3 years of experience in the area of virtual reality Completed 7 large innovative projects 12
More informationPinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data
Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data Hrvoje Benko Microsoft Research One Microsoft Way Redmond, WA 98052 USA benko@microsoft.com Andrew D. Wilson Microsoft
More informationAugmented Reality And Ubiquitous Computing using HCI
Augmented Reality And Ubiquitous Computing using HCI Ashmit Kolli MS in Data Science Michigan Technological University CS5760 Topic Assignment 2 akolli@mtu.edu Abstract : Direct use of the hand as an input
More informationDevelopment of Video Chat System Based on Space Sharing and Haptic Communication
Sensors and Materials, Vol. 30, No. 7 (2018) 1427 1435 MYU Tokyo 1427 S & M 1597 Development of Video Chat System Based on Space Sharing and Haptic Communication Takahiro Hayashi 1* and Keisuke Suzuki
More informationt t t rt t s s tr t Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2
t t t rt t s s Manuel Martinez 1, Angela Constantinescu 2, Boris Schauerte 1, Daniel Koester 1, and Rainer Stiefelhagen 1,2 1 r sr st t t 2 st t t r t r t s t s 3 Pr ÿ t3 tr 2 t 2 t r r t s 2 r t ts ss
More informationShare your Live Photos with friends and family by printing, ordering prints from Snapfish (US only), and via Facebook or .
HP Live Photo app - available on ios and Android devices Make your photos come to life with HP Live Photo! HP Live Photo is a free, fun, and easy app for ios and Android that lets you share your experiences
More informationTouch Your Way: Haptic Sight for Visually Impaired People to Walk with Independence
Touch Your Way: Haptic Sight for Visually Impaired People to Walk with Independence Ji-Won Song Dept. of Industrial Design. Korea Advanced Institute of Science and Technology. 335 Gwahangno, Yusong-gu,
More informationUniversidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs
Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática Interaction in Virtual and Augmented Reality 3DUIs Realidade Virtual e Aumentada 2017/2018 Beatriz Sousa Santos Interaction
More informationDevelopment of an Intuitive Interface for PC Mouse Operation Based on Both Arms Gesture
Development of an Intuitive Interface for PC Mouse Operation Based on Both Arms Gesture Nobuaki Nakazawa 1*, Toshikazu Matsui 1, Yusaku Fujii 2 1 Faculty of Science and Technology, Gunma University, 29-1
More information1 ABSTRACT. Proceedings REAL CORP 2012 Tagungsband May 2012, Schwechat.
Oihana Otaegui, Estíbaliz Loyo, Eduardo Carrasco, Caludia Fösleitner, John Spiller, Daniela Patti, Adela, Marcoci, Rafael Olmedo, Markus Dubielzig 1 ABSTRACT (Oihana Otaegui, Vicomtech-IK4, San Sebastian,
More informationVZ-C12³ and VZ-C32³ Visualizer Systems
VZ-C12³ and VZ-C32³ Visualizer Systems EN Driving the Creation of Knowledge VZ-C12³ and VZ-C32³ Ceiling Visualizer Systems WolfVision is a worldwide provider of products and services to leading universities,
More informationExhibition Strategy of Digital 3D Data of Object in Archives using Digitally Mediated Technologies for High User Experience
, pp.150-156 http://dx.doi.org/10.14257/astl.2016.140.29 Exhibition Strategy of Digital 3D Data of Object in Archives using Digitally Mediated Technologies for High User Experience Jaeho Ryu 1, Minsuk
More informationVIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa
VIRTUAL REALITY Introduction Emil M. Petriu SITE, University of Ottawa Natural and Virtual Reality Virtual Reality Interactive Virtual Reality Virtualized Reality Augmented Reality HUMAN PERCEPTION OF
More informationFace Registration Using Wearable Active Vision Systems for Augmented Memory
DICTA2002: Digital Image Computing Techniques and Applications, 21 22 January 2002, Melbourne, Australia 1 Face Registration Using Wearable Active Vision Systems for Augmented Memory Takekazu Kato Takeshi
More informationCOLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES.
COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES. Mark Billinghurst a, Hirokazu Kato b, Ivan Poupyrev c a Human Interface Technology Laboratory, University of Washington, Box 352-142, Seattle,
More informationUbiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1
Episode 16: HCI Hannes Frey and Peter Sturm University of Trier University of Trier 1 Shrinking User Interface Small devices Narrow user interface Only few pixels graphical output No keyboard Mobility
More informationA Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung,
IJCSNS International Journal of Computer Science and Network Security, VOL.11 No.9, September 2011 55 A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang,
More informationDESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY
DESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY 1 RAJU RATHOD, 2 GEORGE PHILIP.C, 3 VIJAY KUMAR B.P 1,2,3 MSRIT Bangalore Abstract- To ensure the best place, position,
More informationRecent Progress on Augmented-Reality Interaction in AIST
Recent Progress on Augmented-Reality Interaction in AIST Takeshi Kurata ( チョヌン ) ( イムニダ ) Augmented Reality Interaction Subgroup Real-World Based Interaction Group Information Technology Research Institute,
More informationPerceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces
Perceptual Interfaces Adapted from Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Outline Why Perceptual Interfaces? Multimodal interfaces Vision
More informationUsing Mixed Reality as a Simulation Tool in Urban Planning Project for Sustainable Development
Journal of Civil Engineering and Architecture 9 (2015) 830-835 doi: 10.17265/1934-7359/2015.07.009 D DAVID PUBLISHING Using Mixed Reality as a Simulation Tool in Urban Planning Project Hisham El-Shimy
More informationGesture Recognition with Real World Environment using Kinect: A Review
Gesture Recognition with Real World Environment using Kinect: A Review Prakash S. Sawai 1, Prof. V. K. Shandilya 2 P.G. Student, Department of Computer Science & Engineering, Sipna COET, Amravati, Maharashtra,
More informationHAPTICS AND AUTOMOTIVE HMI
HAPTICS AND AUTOMOTIVE HMI Technology and trends report January 2018 EXECUTIVE SUMMARY The automotive industry is on the cusp of a perfect storm of trends driving radical design change. Mary Barra (CEO
More informationEnhancing Shipboard Maintenance with Augmented Reality
Enhancing Shipboard Maintenance with Augmented Reality CACI Oxnard, CA Dennis Giannoni dgiannoni@caci.com (805) 288-6630 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED. Agenda Virtual
More informationNew interface approaches for telemedicine
New interface approaches for telemedicine Associate Professor Mark Billinghurst PhD, Holger Regenbrecht Dipl.-Inf. Dr-Ing., Michael Haller PhD, Joerg Hauber MSc Correspondence to: mark.billinghurst@hitlabnz.org
More informationExTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality
ExTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality The MIT Faculty has made this article openly available. Please share how this access benefits you. Your
More informationInput-output channels
Input-output channels Human Computer Interaction (HCI) Human input Using senses Sight, hearing, touch, taste and smell Sight, hearing & touch have important role in HCI Input-Output Channels Human output
More informationTangible interaction : A new approach to customer participatory design
Tangible interaction : A new approach to customer participatory design Focused on development of the Interactive Design Tool Jae-Hyung Byun*, Myung-Suk Kim** * Division of Design, Dong-A University, 1
More informationAbstract. Keywords: Multi Touch, Collaboration, Gestures, Accelerometer, Virtual Prototyping. 1. Introduction
Creating a Collaborative Multi Touch Computer Aided Design Program Cole Anagnost, Thomas Niedzielski, Desirée Velázquez, Prasad Ramanahally, Stephen Gilbert Iowa State University { someguy tomn deveri
More information