HCI Outlook: Tangible and Tabletop Interaction
|
|
|
- Ralf Watts
- 5 years ago
- Views:
Transcription
1 HCI Outlook: Tangible and Tabletop Interaction multiple degree-of-freedom (DOF) input Morten Fjeld Associate Professor, Computer Science and Engineering Chalmers University of Technology Gothenburg University Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
2 Tangible and Tabletop UIs Pushing the edge of interactive technology... by constructing Tangible User Interfaces (TUI) (Ullmer, Ishii) Tabletop, Large Display User Interfaces (UI) with potential benefits, for example Creative problem solving Collaborative work Science education Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
3 Background and Goals Ubiquitous computing (Mark Weiser, 1993) Handheld, desktop, and large display Disappearing - or invisible - computer Goals of research Human-centric user interfaces (UIs) Improved cognitive support Creative problem solving Improved collaboration Task in foreground, computer in background Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
4 HCI Theories and Principles HCI Schools/Theories Distributed cognition (Hutchins) Activity theory (Engeström, Hacker, Nardi) HCI Principles Strengthen coupling betw. action and perception Capitalize on human motor skills Improve blend of time- and space-multiplexing Assure externalization of knowledge in tools Employ Augmented Reality principles (Azuma) Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
5 Areas and Projects Vision-based UIs Augmented Chemistry 3D Hand Tracking Ortholumen Touch-sensitive UIs Force Feedback Slider SpaceCat: 6DOF Input Touch & Type XXL Display UIs BUILD-IT: Collaborative Planning Sketching: Tracking of IR Pens CollaBoard: Shared Whiteboard Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
6 Vision-Based UIs Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
7 AugmentedChemistry (AC) Science education - age years - of organic chemistry, for instance octet rule and bondings M. Fjeld, J. Fredriksson, M. Ejdestig, F. Duca, K. Bötschi, B. Voegtli, P. Juchli (2007): Tangible User Interface for Chemistry Education: Comparative Evaluation and Re-Design In Proc. ACM CHI07. Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
8 AugmentedChemistry (AC) Comparative within-group study Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
9 AugmentedChemistry (AC) Comparative study, preference ranking Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
10 Combining AC and ball-and-stick Ultrasound tracking, AM radio triggered E. Larsson, H. Holm, J. Kemi, M. Ejdestig, T. Johansson (2006): Advances in the AC project and spatial ultrasound tracking. CSE/EE BSc project report. Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
11 Real-Time 3D Hand Interaction Real-Time 3D Hand Interaction: Single PC (web) camera approach Wireless CyberGlove II for Motion Builder: Up to 22 joint-angle measurements F. Duca, J. Fredriksson, M. Fjeld (2007): 3D Hand Navigation. Proc. Workshop at the IEEE Virtual Reality 2007 Conference: Trends and Issues in Tracking for Virtual Environments. Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
12 Real-Time 3D Hand Interaction J. Fredriksson, S. Berg Ryen, F. Duca, M. Fjeld (in press): Real-Time 3D Hand Interaction: Optimization and Complexity Reduction. Proc. ACM NordiCHI Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
13 Ortholumen: Light-based input Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
14 Ortholumen: Light-based input LED Pen(s) Translucent Screen LCD Projector Mirror Web Camera Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
15 Ortholumen: Light-based input Piazza, T., Fjeld, M. (2007): Ortholumen: Using Light for Direct Tabletop Input. Proc. IEEE TableTop Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
16 Applying Ortholumen: Tabletop and handheld map navigation Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
17 Applying Ortholumen: Tabletop and handheld map navigation Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
18 CERMIT (Ongoing): Emergency Response Manage (EMR): Courtesy of the U.S. Naval Research Laboratory Tool supporting creation of a Common Operational Picture H. Heller, T. Piazza, M. Fjeld (2008): CERMIT: Co-located and Remote Collaborative System for Emergency Response Management. Proc. Shareable Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
19 Touch-Sensitive UIs Slider, Mouse, Keyboard Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
20 ForceFeedbackSlider: Set of Motivations 3D Interaction has been well investigated Economics, biology, and medicine may benefit from multi dimensional tactile interaction Multiple motorized sliders may serve this purpose Force and haptic profiles can give additional cues Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
21 ForceFeedbackSlider: Proof-of-Concept Prototypical Uses (Analogue Version) A. Kretz, R. Huber and M. Fjeld (2005): Force Feedback Slider: An interactive device for learning dynamic system behavior. Proc. IEEE Int. Conf. on Advanced Learning Technologies, pp T. H. Andersen, R. Huber, A. Kretz and M. Fjeld (2006): Feel the Beat: Direct Manipulation of Sound during Playback. Proc. IEEE Int. Workshop on Horizontal Interactive Human-Computer Systems (TableTop 06), pp Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
22 ForceFeedbackSlider: Digital Design Digital System Motorized physical sliders that control position and force as input and output parameters for tangible computer interaction Digital Design: Communication with the computer through a mainboard using USB Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
23 FFSlider: JSlider & Remote Use J. Jenaro, A. Shahrokni, M. Schrittenloher, M. Fjeld (2007): One-Dimensional Force Feedback Slider: Digital platform. Proc. Workshop at IEEE Virtual Reality 2007: Mixed Reality User Interfaces: Specification, Authoring, Adaptation (MRUI07). Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
24 ForceFeedbackSlider: Digital System Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
25 FFSlider: Multiple Sliders & Acoustic Acoustic, physics-based synthesizer (with Johan Sandsjö, Hidden Interaction) R. Gabriel, J. Sandsjö, A. Shahrokni, M. Fjeld (2008): BounceSlider: Actuated Sliders for Music Composition ). In Proc. ACM NIME 2008, pp Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
26 Future FFSlider: Economic Simulation Multifactor economic modelling and trading (with Luc Girardin, MacroFocus Inc., Zurich) Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
27 Future FFSlider: Radiation Optimization Approximating convex Pareto surfaces in multiobjective IMRT (with David Craft, Harvard Medical School) Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
28 MDOF Input: Universal Input Device Ideal universal MDOF input device should allow for 2D pointing and precise manipulation and navigation within 3D environments. MDOF Mouse Requirements: Six degrees of freedom (6DOF) Motion adapted to finger manipulation Elastic suspension for rich feedback Position and rate control M. Sundin and M. Fjeld (in press): Elastic Computer Input Control in Six Degrees of Freedom. To appear in Int. Journal of Human-Computer Interaction (IJHCI). Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
29 MDOF Input: SpaceCat for Games Study (Sundin and Fjeld, in press) showed that SpaceCat is particulaly well suited for short and precise movements. SpaceBall SpaceCat Z. Francic and M. Anglart (in press): 6DOF Input Devices, Technical Report and MSc Report. Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
30 Touch&Type: Cap Sensing W. Fallot-Burghard, M. Fjeld, C. Speirs, S. Ziegenspeck, H. Krueger, T. Läubli (2006): Touch&Type: A Novel Pointing Device for Notebook Computers. Proc. ACM NordiCHI 2006, pp Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
31 XXL Display UIs For Collaborative Planning & Sketching Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
32 BUILD-IT (PhD at ETH: ) End-user: Daimler-Chrysler Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
33 BUILD-IT: Plant Layout End-users: Von Roll Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
34 BUILD-IT: Collaborative Uses Architecture Navigation End-users: ETH Architecture M. Fjeld, F. Voorhorst, M. Bichsel, H. Krueger and M. Rauterberg (2000): Navigation Methods for an Augmented Reality System (video). In the video program / extended abstracts of CHI 2000, pp Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
35 Sketching: Tracking of IR Pens T. Nescher (2007): Synchronization box for tracking of IR pens with a high-speed camera. BSc thesis, Chalmers. Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
36 Sketching: Tracking of IR Pens R. Hofer: Ph.D. dissertation, in progress Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
37 CollaBoard (EU Project, 2 PhDs) Shared application and editing Image segmentation by IR or by polarization Alpha blending on remote site Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
38 CollaBoard (EU Project, 2 PhDs) Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
39 Summary/Outlook Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr13th October /40
40 Morten Fjeld, TableTop Interaction Lab, IDC, Dr. CSE, Andreas CHALMERS Kunz 10/2004 Physical inspire Computing, icvr 13th October /40 Andy Altmann / Why Not Associates, design4science, NobelMuseum, Stockholm (S)
HCI Outlook: Tangible and Tabletop Interaction
Tangible and Tabletop UIs Pushing the edge of interactive technology... HCI Outlook: Tangible and Tabletop Interaction multiple degree-of-freedom (DOF) input Morten Fjeld Associate Professor Dept. of Computer
BUILD-IT, Tangible Interface for Collaborative Design
USER INTERFACES: A SOFTWARE AND HARDWARE FRAMEWORK BUILD-IT, Tangible Interface for Collaborative Design M. Fjeld, M. Bichsel, M. Rauterberg, ETH and t2i-lab, Chalmers Augmented Chemistry: A Tangible Approach
Advanced User Interfaces: Topics in Human-Computer Interaction
Computer Science 425 Advanced User Interfaces: Topics in Human-Computer Interaction Week 04: Disappearing Computers 90s-00s of Human-Computer Interaction Research Prof. Roel Vertegaal, PhD Week 8: Plan
From Table System to Tabletop: Integrating Technology into Interactive Surfaces
From Table System to Tabletop: Integrating Technology into Interactive Surfaces Andreas Kunz 1 and Morten Fjeld 2 1 Swiss Federal Institute of Technology, Department of Mechanical and Process Engineering
INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT
INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT TAYSHENG JENG, CHIA-HSUN LEE, CHI CHEN, YU-PIN MA Department of Architecture, National Cheng Kung University No. 1, University Road,
ubiquitous computing and augmented realities
ubiquitous computing and augmented realities chapter 20 ubiquitous computing and augmented realities ubiquitous computing filling the physical world with computers virtual and augmented reality making
Improvisation and Tangible User Interfaces The case of the reactable
Improvisation and Tangible User Interfaces The case of the reactable Nadir Weibel, Ph.D. Distributed Cognition and Human-Computer Interaction Lab University of California San Diego http://hci.ucsd.edu/weibel
Force Feedback Double Sliders for Multimodal Data Exploration
Force Feedback Double Sliders for Multimodal Data Exploration Fanny Chevalier OCAD University fchevalier@ocad.ca Jean-Daniel Fekete INRIA Saclay jean-daniel.fekete@inria.fr Petra Isenberg INRIA Saclay
Beyond Actuated Tangibles: Introducing Robots to Interactive Tabletops
Beyond Actuated Tangibles: Introducing Robots to Interactive Tabletops Sowmya Somanath Department of Computer Science, University of Calgary, Canada. ssomanat@ucalgary.ca Ehud Sharlin Department of Computer
Physical Computing: Hand, Body, and Room Sized Interaction. Ken Camarata
Physical Computing: Hand, Body, and Room Sized Interaction Ken Camarata camarata@cmu.edu http://code.arc.cmu.edu CoDe Lab Computational Design Research Laboratory School of Architecture, Carnegie Mellon
NUI. Research Topic. Research Topic. Multi-touch TANGIBLE INTERACTION DESIGN ON MULTI-TOUCH DISPLAY. Tangible User Interface + Multi-touch
1 2 Research Topic TANGIBLE INTERACTION DESIGN ON MULTI-TOUCH DISPLAY Human-Computer Interaction / Natural User Interface Neng-Hao (Jones) Yu, Assistant Professor Department of Computer Science National
Meaning, Mapping & Correspondence in Tangible User Interfaces
Meaning, Mapping & Correspondence in Tangible User Interfaces CHI '07 Workshop on Tangible User Interfaces in Context & Theory Darren Edge Rainbow Group Computer Laboratory University of Cambridge A Solid
TIMEWINDOW. dig through time.
TIMEWINDOW dig through time www.rex-regensburg.de info@rex-regensburg.de Summary The Regensburg Experience (REX) is a visitor center in Regensburg, Germany. The REX initiative documents the city s rich
Welcome, Introduction, and Roadmap Joseph J. LaViola Jr.
Welcome, Introduction, and Roadmap Joseph J. LaViola Jr. Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for the Masses
Feelable User Interfaces: An Exploration of Non-Visual Tangible User Interfaces
Feelable User Interfaces: An Exploration of Non-Visual Tangible User Interfaces Katrin Wolf Telekom Innovation Laboratories TU Berlin, Germany katrin.wolf@acm.org Peter Bennett Interaction and Graphics
IMGD 4000 Technical Game Development II Interaction and Immersion
IMGD 4000 Technical Game Development II Interaction and Immersion Robert W. Lindeman Associate Professor Human Interaction in Virtual Environments (HIVE) Lab Department of Computer Science Worcester Polytechnic
Beyond: collapsible tools and gestures for computational design
Beyond: collapsible tools and gestures for computational design The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published
Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface
Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface Xu Zhao Saitama University 255 Shimo-Okubo, Sakura-ku, Saitama City, Japan sheldonzhaox@is.ics.saitamau.ac.jp Takehiro Niikura The University
3D and Sequential Representations of Spatial Relationships among Photos
3D and Sequential Representations of Spatial Relationships among Photos Mahoro Anabuki Canon Development Americas, Inc. E15-349, 20 Ames Street Cambridge, MA 02139 USA mahoro@media.mit.edu Hiroshi Ishii
VICs: A Modular Vision-Based HCI Framework
VICs: A Modular Vision-Based HCI Framework The Visual Interaction Cues Project Guangqi Ye, Jason Corso Darius Burschka, & Greg Hager CIRL, 1 Today, I ll be presenting work that is part of an ongoing project
Short Course on Computational Illumination
Short Course on Computational Illumination University of Tampere August 9/10, 2012 Matthew Turk Computer Science Department and Media Arts and Technology Program University of California, Santa Barbara
Interactive Multimedia Contents in the IllusionHole
Interactive Multimedia Contents in the IllusionHole Tokuo Yamaguchi, Kazuhiro Asai, Yoshifumi Kitamura, and Fumio Kishino Graduate School of Information Science and Technology, Osaka University, 2-1 Yamada-oka,
VR based HCI Techniques & Application. November 29, 2002
VR based HCI Techniques & Application November 29, 2002 stefan.seipel@hci.uu.se What is Virtual Reality? Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted
MRT: Mixed-Reality Tabletop
MRT: Mixed-Reality Tabletop Students: Dan Bekins, Jonathan Deutsch, Matthew Garrett, Scott Yost PIs: Daniel Aliaga, Dongyan Xu August 2004 Goals Create a common locus for virtual interaction without having
New interface approaches for telemedicine
New interface approaches for telemedicine Associate Professor Mark Billinghurst PhD, Holger Regenbrecht Dipl.-Inf. Dr-Ing., Michael Haller PhD, Joerg Hauber MSc Correspondence to: mark.billinghurst@hitlabnz.org
The Mixed Reality Book: A New Multimedia Reading Experience
The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut
Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1
Episode 16: HCI Hannes Frey and Peter Sturm University of Trier University of Trier 1 Shrinking User Interface Small devices Narrow user interface Only few pixels graphical output No keyboard Mobility
Organic UIs in Cross-Reality Spaces
Organic UIs in Cross-Reality Spaces Derek Reilly Jonathan Massey OCAD University GVU Center, Georgia Tech 205 Richmond St. Toronto, ON M5V 1V6 Canada dreilly@faculty.ocad.ca ragingpotato@gatech.edu Anthony
ITS '14, Nov , Dresden, Germany
3D Tabletop User Interface Using Virtual Elastic Objects Figure 1: 3D Interaction with a virtual elastic object Hiroaki Tateyama Graduate School of Science and Engineering, Saitama University 255 Shimo-Okubo,
Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms
Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Published in the Proceedings of CHI '97 Hiroshi Ishii and Brygg Ullmer MIT Media Laboratory Tangible Media Group 20 Ames Street,
Designing Interactive Systems II
Designing Interactive Systems II Computer Science Graduate Programme SS 2010 Prof. Dr. Jan Borchers RWTH Aachen University http://hci.rwth-aachen.de Jan Borchers 1 Today Class syllabus About our group
Development of a telepresence agent
Author: Chung-Chen Tsai, Yeh-Liang Hsu (2001-04-06); recommended: Yeh-Liang Hsu (2001-04-06); last updated: Yeh-Liang Hsu (2004-03-23). Note: This paper was first presented at. The revised paper was presented
Exploring Brick-Based Navigation and Composition in an Augmented Reality
Exploring Brick-Based Navigation and Composition in an Augmented Reality Morten Fjeld 1, Fred Voorhorst 1, Martin Bichsel 2, Kristina Lauche 3, Matthias Rauterberg 4, and Helmut Krueger 1 1 Institute for
Tangible Lenses, Touch & Tilt: 3D Interaction with Multiple Displays
SIG T3D (Touching the 3rd Dimension) @ CHI 2011, Vancouver Tangible Lenses, Touch & Tilt: 3D Interaction with Multiple Displays Raimund Dachselt University of Magdeburg Computer Science User Interface
CHAPTER 1. INTRODUCTION 16
1 Introduction The author s original intention, a couple of years ago, was to develop a kind of an intuitive, dataglove-based interface for Computer-Aided Design (CAD) applications. The idea was to interact
Occlusion based Interaction Methods for Tangible Augmented Reality Environments
Occlusion based Interaction Methods for Tangible Augmented Reality Environments Gun A. Lee α Mark Billinghurst β Gerard J. Kim α α Virtual Reality Laboratory, Pohang University of Science and Technology
Natural User Interface (NUI): a case study of a video based interaction technique for a computer game
253 Natural User Interface (NUI): a case study of a video based interaction technique for a computer game M. Rauterberg Institute for Hygiene and Applied Physiology (IHA) Swiss Federal Institute of Technology
Physical Construction Toys for Rapid Sketching of Tangible User Interfaces
Physical Construction Toys for Rapid Sketching of Tangible User Interfaces Kristian Gohlke Bauhaus-Universität Weimar Geschwister-Scholl-Str. 7, 99423 Weimar kristian.gohlke@uni-weimar.de Michael Hlatky
Classifying 3D Input Devices
IMGD 5100: Immersive HCI Classifying 3D Input Devices Robert W. Lindeman Associate Professor Department of Computer Science Worcester Polytechnic Institute gogo@wpi.edu Motivation The mouse and keyboard
Tangible User Interfaces
Tangible User Interfaces Seminar Vernetzte Systeme Prof. Friedemann Mattern Von: Patrick Frigg Betreuer: Michael Rohs Outline Introduction ToolStone Motivation Design Interaction Techniques Taxonomy for
Interactive Tables. ~Avishek Anand Supervised by: Michael Kipp Chair: Vitaly Friedman
Interactive Tables ~Avishek Anand Supervised by: Michael Kipp Chair: Vitaly Friedman Tables of Past Tables of Future metadesk Dialog Table Lazy Susan Luminous Table Drift Table Habitat Message Table Reactive
Prototyping of Interactive Surfaces
LFE Medieninformatik Anna Tuchina Prototyping of Interactive Surfaces For mixed Physical and Graphical Interactions Medieninformatik Hauptseminar Wintersemester 2009/2010 Prototyping Anna Tuchina - 23.02.2009
MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 4 & 5 SEPTEMBER 2008, UNIVERSITAT POLITECNICA DE CATALUNYA, BARCELONA, SPAIN MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL
The Physicality of Digital Museums
Darwin College Research Report DCRR-006 The Physicality of Digital Museums Alan Blackwell, Cecily Morrison Lorisa Dubuc and Luke Church August 2007 Darwin College Cambridge University United Kingdom CB3
Interactive intuitive mixed-reality interface for Virtual Architecture
I 3 - EYE-CUBE Interactive intuitive mixed-reality interface for Virtual Architecture STEPHEN K. WITTKOPF, SZE LEE TEO National University of Singapore Department of Architecture and Fellow of Asia Research
Multi-Modal User Interaction
Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface
ISCW 2001 Tutorial. An Introduction to Augmented Reality
ISCW 2001 Tutorial An Introduction to Augmented Reality Mark Billinghurst Human Interface Technology Laboratory University of Washington, Seattle grof@hitl.washington.edu Dieter Schmalstieg Technical University
CSE 165: 3D User Interaction. Lecture #14: 3D UI Design
CSE 165: 3D User Interaction Lecture #14: 3D UI Design 2 Announcements Homework 3 due tomorrow 2pm Monday: midterm discussion Next Thursday: midterm exam 3D UI Design Strategies 3 4 Thus far 3DUI hardware
Beyond Visual: Shape, Haptics and Actuation in 3D UI
Beyond Visual: Shape, Haptics and Actuation in 3D UI Ivan Poupyrev Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for
Haptic Cues: Texture as a Guide for Non-Visual Tangible Interaction.
Haptic Cues: Texture as a Guide for Non-Visual Tangible Interaction. Figure 1. Setup for exploring texture perception using a (1) black box (2) consisting of changeable top with laser-cut haptic cues,
Computer Haptics and Applications
Computer Haptics and Applications EURON Summer School 2003 Cagatay Basdogan, Ph.D. College of Engineering Koc University, Istanbul, 80910 (http://network.ku.edu.tr/~cbasdogan) Resources: EURON Summer School
A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds
6th ERCIM Workshop "User Interfaces for All" Long Paper A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds Masaki Omata, Kentaro Go, Atsumi Imamiya Department of Computer
Virtual Chromatic Percussions Simulated by Pseudo-Haptic and Vibrotactile Feedback
Virtual Chromatic Percussions Simulated by Pseudo-Haptic and Vibrotactile Feedback Taku Hachisu The University of Electro- Communications 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan +81 42 443 5363
Haplug: A Haptic Plug for Dynamic VR Interactions
Haplug: A Haptic Plug for Dynamic VR Interactions Nobuhisa Hanamitsu *, Ali Israr Disney Research, USA nobuhisa.hanamitsu@disneyresearch.com Abstract. We demonstrate applications of a new actuator, the
Digitalisation as day-to-day-business
Digitalisation as day-to-day-business What is today feasible for the company in the future Prof. Jivka Ovtcharova INSTITUTE FOR INFORMATION MANAGEMENT IN ENGINEERING Baden-Württemberg Driving force for
AN INTERFACE BASED ON HYPER REALITY FOR VIRTUAL MOCKUPS
AN INTERFACE BASED ON HYPER REALITY FOR VIRTUAL MOCKUPS Liliane S. Machado 1, Ronei M. Moraes 2 Abstract Hyper Reality can be defined as the technological capability of join intelligence, virtual reality
A gesture based interaction technique for a planning tool for construction and design
A gesture based interaction technique for a planning tool for construction and design M. Rauterberg 1, M. Bichsel 2, M. Meier 2 & M. Fjeld 1 1 Institute for Hygiene and Applied Physiology (IHA) 2 Institute
Classifying 3D Input Devices
IMGD 5100: Immersive HCI Classifying 3D Input Devices Robert W. Lindeman Associate Professor Department of Computer Science Worcester Polytechnic Institute gogo@wpi.edu But First Who are you? Name Interests
Using Scalable, Interactive Floor Projection for Production Planning Scenario
Using Scalable, Interactive Floor Projection for Production Planning Scenario Michael Otto, Michael Prieur Daimler AG Wilhelm-Runge-Str. 11 D-89013 Ulm {michael.m.otto, michael.prieur}@daimler.com Enrico
International Journal of Informative & Futuristic Research ISSN (Online):
Reviewed Paper Volume 2 Issue 6 February 2015 International Journal of Informative & Futuristic Research An Innovative Approach Towards Virtual Drums Paper ID IJIFR/ V2/ E6/ 021 Page No. 1603-1608 Subject
Magic Touch A Simple. Object Location Tracking System Enabling the Development of. Physical-Virtual Artefacts in Office Environments
Magic Touch A Simple Object Location Tracking System Enabling the Development of Physical-Virtual Artefacts Thomas Pederson Department of Computing Science Umeå University Sweden http://www.cs.umu.se/~top
Andriy Pavlovych. Research Interests
Research Interests Andriy Pavlovych andriyp@cse.yorku.ca http://www.cse.yorku.ca/~andriyp/ Human Computer Interaction o Human Performance in HCI Investigated the effects of latency, dropouts, spatial and
preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...
v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)
MIRACLE: Mixed Reality Applications for City-based Leisure and Experience. Mark Billinghurst HIT Lab NZ October 2009
MIRACLE: Mixed Reality Applications for City-based Leisure and Experience Mark Billinghurst HIT Lab NZ October 2009 Looking to the Future Mobile devices MIRACLE Project Goal: Explore User Generated
Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances
Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances Florent Berthaut and Martin Hachet Figure 1: A musician plays the Drile instrument while being immersed in front of
Paint with Your Voice: An Interactive, Sonic Installation
Paint with Your Voice: An Interactive, Sonic Installation Benjamin Böhm 1 benboehm86@gmail.com Julian Hermann 1 julian.hermann@img.fh-mainz.de Tim Rizzo 1 tim.rizzo@img.fh-mainz.de Anja Stöffler 1 anja.stoeffler@img.fh-mainz.de
EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment
EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment Hideki Koike 1, Shin ichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of Information Systems,
Tangible Augmented Reality
Tangible Augmented Reality Mark Billinghurst Hirokazu Kato Ivan Poupyrev HIT Laboratory Faculty of Information Sciences Interaction Lab University of Washington Hiroshima City University Sony CSL Box 352-142,
LCC 3710 Principles of Interaction Design. Readings. Tangible Interfaces. Research Motivation. Tangible Interaction Model.
LCC 3710 Principles of Interaction Design Readings Ishii, H., Ullmer, B. (1997). "Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms" in Proceedings of CHI '97, ACM Press. Ullmer,
roblocks Constructional logic kit for kids CoDe Lab Open House March
roblocks Constructional logic kit for kids Eric Schweikardt roblocks are the basic modules of a computational construction kit created to scaffold children s learning of math, science and control theory
Exploration of Alternative Interaction Techniques for Robotic Systems
Natural User Interfaces for Robotic Systems Exploration of Alternative Interaction Techniques for Robotic Systems Takeo Igarashi The University of Tokyo Masahiko Inami Keio University H uman-robot interaction
COMET: Collaboration in Applications for Mobile Environments by Twisting
COMET: Collaboration in Applications for Mobile Environments by Twisting Nitesh Goyal RWTH Aachen University Aachen 52056, Germany Nitesh.goyal@rwth-aachen.de Abstract In this paper, we describe a novel
Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3102 3107 INTE 2014 Fabrication of the kinect remote-controlled cars and planning of the motion
Designing for Spatial Multi-User Interaction. Eva Eriksson. IDC Interaction Design Collegium
Designing for Spatial Multi-User Interaction Eva Eriksson Overview 1. Background and Motivation 2. Spatial Multi-User Interaction Design Program 3. Design Model 4. Children s Interactive Library 5. MIXIS
Babak Ziraknejad Design Machine Group University of Washington. eframe! An Interactive Projected Family Wall Frame
Babak Ziraknejad Design Machine Group University of Washington eframe! An Interactive Projected Family Wall Frame Overview: Previous Projects Objective, Goals, and Motivation Introduction eframe Concept
synchrolight: Three-dimensional Pointing System for Remote Video Communication
synchrolight: Three-dimensional Pointing System for Remote Video Communication Jifei Ou MIT Media Lab 75 Amherst St. Cambridge, MA 02139 jifei@media.mit.edu Sheng Kai Tang MIT Media Lab 75 Amherst St.
AUDIO-ENHANCED COLLABORATION AT AN INTERACTIVE ELECTRONIC WHITEBOARD. Christian Müller Tomfelde and Sascha Steiner
AUDIO-ENHANCED COLLABORATION AT AN INTERACTIVE ELECTRONIC WHITEBOARD Christian Müller Tomfelde and Sascha Steiner GMD - German National Research Center for Information Technology IPSI- Integrated Publication
Controlling Spatial Sound with Table-top Interface
Controlling Spatial Sound with Table-top Interface Abstract Interactive table-top interfaces are multimedia devices which allow sharing information visually and aurally among several users. Table-top interfaces
LCC 3710 Principles of Interaction Design. Readings. Sound in Interfaces. Speech Interfaces. Speech Applications. Motivation for Speech Interfaces
LCC 3710 Principles of Interaction Design Class agenda: - Readings - Speech, Sonification, Music Readings Hermann, T., Hunt, A. (2005). "An Introduction to Interactive Sonification" in IEEE Multimedia,
mixed reality & (tactile and) tangible interaction
mixed reality & (tactile and) Anastasia Bezerianos & Jean-Marc Vezien mixed reality & (tactile and) Jean-Marc Vezien & Anastasia Bezerianos Anastasia Bezerianos 1 about me Assistant prof in Paris-Sud and
VEWL: A Framework for Building a Windowing Interface in a Virtual Environment Daniel Larimer and Doug A. Bowman Dept. of Computer Science, Virginia Tech, 660 McBryde, Blacksburg, VA dlarimer@vt.edu, bowman@vt.edu
Audiopad: A Tag-based Interface for Musical Performance
Published in the Proceedings of NIME 2002, May 24-26, 2002. 2002 ACM Audiopad: A Tag-based Interface for Musical Performance James Patten Tangible Media Group MIT Media Lab Cambridge, Massachusetts jpatten@media.mit.edu
FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS
FALL 2014, Issue No. 32 ROBOTICS AT OUR FINGERTIPS FALL 2014 Issue No. 32 12 CYBERSECURITY SOLUTION NSF taps UCLA Engineering to take lead in encryption research. Cover Photo: Joanne Leung 6MAN AND MACHINE
Touching and Walking: Issues in Haptic Interface
Touching and Walking: Issues in Haptic Interface Hiroo Iwata 1 1 Institute of Engineering Mechanics and Systems, University of Tsukuba, 80, Tsukuba, 305-8573 Japan iwata@kz.tsukuba.ac.jp Abstract. This
IOSR Journal of Engineering (IOSRJEN) e-issn: , p-issn: , Volume 2, Issue 11 (November 2012), PP 37-43
IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719, Volume 2, Issue 11 (November 2012), PP 37-43 Operative Precept of robotic arm expending Haptic Virtual System Arnab Das 1, Swagat
Simulation of Tangible User Interfaces with the ROS Middleware
Simulation of Tangible User Interfaces with the ROS Middleware Stefan Diewald 1 stefan.diewald@tum.de Andreas Möller 1 andreas.moeller@tum.de Luis Roalter 1 roalter@tum.de Matthias Kranz 2 matthias.kranz@uni-passau.de
Portfolio. Swaroop Kumar Pal swarooppal.wordpress.com github.com/swarooppal1088
Portfolio About Me: I am a Computer Science graduate student at The University of Texas at Dallas. I am currently working as Augmented Reality Engineer at Aireal, Dallas and also as a Graduate Researcher
Effective Iconography....convey ideas without words; attract attention...
Effective Iconography...convey ideas without words; attract attention... Visual Thinking and Icons An icon is an image, picture, or symbol representing a concept Icon-specific guidelines Represent the
EnhancedTable: An Augmented Table System for Supporting Face-to-Face Meeting in Ubiquitous Environment
EnhancedTable: An Augmented Table System for Supporting Face-to-Face Meeting in Ubiquitous Environment Hideki Koike 1, Shinichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of
Augmented Reality Lecture notes 01 1
IntroductiontoAugmentedReality Lecture notes 01 1 Definition Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated
Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data
Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data Hrvoje Benko Microsoft Research One Microsoft Way Redmond, WA 98052 USA benko@microsoft.com Andrew D. Wilson Microsoft
Authors: Bill Tomlinson, Man Lok Yau, Jessica O Connell, Ksatria Williams, So Yamaoka
9/10/04 Dear Sir/Madam: We would like to submit an interactive installation to the CHI 2005 Interactivity program. Authors: Bill Tomlinson, Man Lok Yau, Jessica O Connell, Ksatria Williams, So Yamaoka
Touch & Gesture. HCID 520 User Interface Software & Technology
Touch & Gesture HCID 520 User Interface Software & Technology Natural User Interfaces What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger
Information Layout and Interaction on Virtual and Real Rotary Tables
Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer System Information Layout and Interaction on Virtual and Real Rotary Tables Hideki Koike, Shintaro Kajiwara, Kentaro Fukuchi
Mensch-Maschine-Interaktion 2. Interactive Environments. Prof. Dr. Andreas Butz, Dr. Julie Wagner
Mensch-Maschine-Interaktion 2 Interactive Environments Prof. Dr. Andreas Butz, Dr. Julie Wagner 1 Interactive Environments context and task challenges input challenges in interaction design output 2 Environment
Tangible Message Bubbles for Childrenʼs Communication and Play
Tangible Message Bubbles for Childrenʼs Communication and Play Kimiko Ryokai School of Information Berkeley Center for New Media University of California Berkeley Berkeley, CA 94720 USA kimiko@ischool.berkeley.edu
Admin. Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR
HCI and Design Admin Reminder: Assignment 4 Due Thursday before class Questions? Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR 3D Interfaces We
DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS. Lucia Terrenghi*
DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS Lucia Terrenghi* Abstract Embedding technologies into everyday life generates new contexts of mixed-reality. My research focuses on interaction techniques
IDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK. Javier Sanchez
IDENTIFYING AND COMMUNICATING 2D SHAPES USING AUDITORY FEEDBACK Javier Sanchez Center for Computer Research in Music and Acoustics (CCRMA) Stanford University The Knoll, 660 Lomita Dr. Stanford, CA 94305,
Figure 2. Haptic human perception and display. 2.2 Pseudo-Haptic Feedback 2. RELATED WORKS 2.1 Haptic Simulation of Tapping an Object
Virtual Chromatic Percussions Simulated by Pseudo-Haptic and Vibrotactile Feedback Taku Hachisu 1 Gabriel Cirio 2 Maud Marchal 2 Anatole Lécuyer 2 Hiroyuki Kajimoto 1,3 1 The University of Electro- Communications