Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms

Size: px
Start display at page:

Download "Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms"

Transcription

1 Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Published in the Proceedings of CHI '97 Hiroshi Ishii and Brygg Ullmer MIT Media Laboratory Tangible Media Group 20 Ames Street, Cambridge, MA USA

2 GUI => TUI

3 Key concepts 1. Interactive surfaces 2. Coupling bits & atoms 3. Ambiant media

4 Tangible Bits

5 metadesk esk/

6

7 transboard Networked digitallyenhanced physical whiteboard. Java applet Hypercard

8 Interactive public ambient displays: Transitioning form implicit to explicit, public to personal, interaction with multiple users

9 Design principles Calm aesthetics Comprehension Notification Short-Duration Fluid interaction Immediate usability Shared Use Combining public and personal information Privacy

10 Video os/uist2004_ambient.avi

11 Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science Laboratory Inc Higashigotanda, Shinagawa-ku, Tokyo 141 Japan rekimoto@csl.sony.co.jp ml

12 Abstract New field of user interfaces called multicomputer direct manipulation Pick and Drop system The pen can Pick Up As a physical object KEYWORDS: direct manipulation, graphical user interfaces, input devices, stylus interfaces, pen interfaces, dragand- drop, multi-computer user interfaces, ubiquitous computing, computer augmented environments

13 Introduction Using multiple computers without considering the user-interface = problems Restriction of input devices Today s user interface techniques are not designed for multiple-computer environments

14 Introduction

15 Introduction

16 Pick and drop system

17 Pick and drop system

18 Pick and drop system

19 Pick and drop system

20 Pick and drop system Applications Transfert a file between 2 computers, PDA Pick up information from kiosk terminal Draw on the wall with a tablet Take pictures from a book

21 Pick and drop system

22 Conclusion The difference between copy and pick and drop is about the user interface Faster More logical Pick and Drop and Drop Movie :

23 Published in the Proceedings of UIST '97, October 14-17, 1997, 1997 ACM The metadesk Models and Prototypes for Tangible User Interfaces Brygg Ullmer and Hiroshi Ishii MIT Media Lab Tangible Media Group 20 Ames St., E Cambridge, MA USA {ullmer,

24 Abstract Tangible interface Giving physical form to windows, icons, handles, menus, and controls Present design and implementation A prototype application Tangible Geospace Keywords: tangible user interfaces, input devices, haptic input, augmented reality, ubiquitous computing

25 Introduction This paper present Tangible User Interfaces (TUIs) User interfaces employing Physical objects Instruments Surfaces Spaces as physical interfaces to digital information

26 Introduction

27 Introduction What is a metadesk? A graphically intensive system driven by interaction with graspable physical objects. In this case : Geographical space Tangible Geospace

28 Introduction metadesk Components The Desk A nearly horizontal back projetcted graphical surface The active lens A flat panel display An optically transparent surface An assortment of physical object used on the desk surface

29 Design Approach

30 Design Approach

31 Prototype System

32 Prototype System

33 Prototype System

34 Implementation Magnetic and electric sensors Plexiglass diffuser surface 3 PCs Back projection

35 Interaction Issues

36 Interaction Issues

37 Future Work Explore phicons with different level of abstraction Use the metadesk in a another context Use other metaphor metadesk Movie :

Advanced User Interfaces: Topics in Human-Computer Interaction

Advanced User Interfaces: Topics in Human-Computer Interaction Computer Science 425 Advanced User Interfaces: Topics in Human-Computer Interaction Week 04: Disappearing Computers 90s-00s of Human-Computer Interaction Research Prof. Roel Vertegaal, PhD Week 8: Plan

More information

COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES.

COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES. COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES. Mark Billinghurst a, Hirokazu Kato b, Ivan Poupyrev c a Human Interface Technology Laboratory, University of Washington, Box 352-142, Seattle,

More information

Interaction Design. Chapter 9 (July 6th, 2011, 9am-12pm): Physical Interaction, Tangible and Ambient UI

Interaction Design. Chapter 9 (July 6th, 2011, 9am-12pm): Physical Interaction, Tangible and Ambient UI Interaction Design Chapter 9 (July 6th, 2011, 9am-12pm): Physical Interaction, Tangible and Ambient UI 1 Physical Interaction, Tangible and Ambient UI Shareable Interfaces Tangible UI General purpose TUI

More information

Prototyping of Interactive Surfaces

Prototyping of Interactive Surfaces LFE Medieninformatik Anna Tuchina Prototyping of Interactive Surfaces For mixed Physical and Graphical Interactions Medieninformatik Hauptseminar Wintersemester 2009/2010 Prototyping Anna Tuchina - 23.02.2009

More information

PhantomParasol: a parasol-type display transitioning from ambient to detailed

PhantomParasol: a parasol-type display transitioning from ambient to detailed PhantomParasol: a parasol-type display transitioning from ambient to detailed Koji Tsukada 1 and Toshiyuki Masui 1 National Institute of Advanced Industrial Science and Technology (AIST) Akihabara Daibiru,

More information

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT TAYSHENG JENG, CHIA-HSUN LEE, CHI CHEN, YU-PIN MA Department of Architecture, National Cheng Kung University No. 1, University Road,

More information

Tangible User Interfaces

Tangible User Interfaces Tangible User Interfaces Seminar Vernetzte Systeme Prof. Friedemann Mattern Von: Patrick Frigg Betreuer: Michael Rohs Outline Introduction ToolStone Motivation Design Interaction Techniques Taxonomy for

More information

NUI. Research Topic. Research Topic. Multi-touch TANGIBLE INTERACTION DESIGN ON MULTI-TOUCH DISPLAY. Tangible User Interface + Multi-touch

NUI. Research Topic. Research Topic. Multi-touch TANGIBLE INTERACTION DESIGN ON MULTI-TOUCH DISPLAY. Tangible User Interface + Multi-touch 1 2 Research Topic TANGIBLE INTERACTION DESIGN ON MULTI-TOUCH DISPLAY Human-Computer Interaction / Natural User Interface Neng-Hao (Jones) Yu, Assistant Professor Department of Computer Science National

More information

rainbottles: gathering raindrops of data from the cloud

rainbottles: gathering raindrops of data from the cloud rainbottles: gathering raindrops of data from the cloud Jinha Lee MIT Media Laboratory 75 Amherst St. Cambridge, MA 02142 USA jinhalee@media.mit.edu Mason Tang MIT CSAIL 77 Massachusetts Ave. Cambridge,

More information

Magic Touch A Simple. Object Location Tracking System Enabling the Development of. Physical-Virtual Artefacts in Office Environments

Magic Touch A Simple. Object Location Tracking System Enabling the Development of. Physical-Virtual Artefacts in Office Environments Magic Touch A Simple Object Location Tracking System Enabling the Development of Physical-Virtual Artefacts Thomas Pederson Department of Computing Science Umeå University Sweden http://www.cs.umu.se/~top

More information

Information Layout and Interaction on Virtual and Real Rotary Tables

Information Layout and Interaction on Virtual and Real Rotary Tables Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer System Information Layout and Interaction on Virtual and Real Rotary Tables Hideki Koike, Shintaro Kajiwara, Kentaro Fukuchi

More information

mixed reality mixed reality & (tactile and) tangible interaction (tactile and) tangible interaction class housekeeping about me

mixed reality mixed reality & (tactile and) tangible interaction (tactile and) tangible interaction class housekeeping about me Mixed Reality Tangible Interaction mixed reality (tactile and) mixed reality (tactile and) Jean-Marc Vezien Jean-Marc Vezien about me Assistant prof in Paris-Sud and co-head of masters contact: anastasia.bezerianos@lri.fr

More information

Beyond: collapsible tools and gestures for computational design

Beyond: collapsible tools and gestures for computational design Beyond: collapsible tools and gestures for computational design The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published

More information

EnhancedTable: An Augmented Table System for Supporting Face-to-Face Meeting in Ubiquitous Environment

EnhancedTable: An Augmented Table System for Supporting Face-to-Face Meeting in Ubiquitous Environment EnhancedTable: An Augmented Table System for Supporting Face-to-Face Meeting in Ubiquitous Environment Hideki Koike 1, Shinichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of

More information

Tiles: A Mixed Reality Authoring Interface

Tiles: A Mixed Reality Authoring Interface Tiles: A Mixed Reality Authoring Interface Ivan Poupyrev 1,i, Desney Tan 2,i, Mark Billinghurst 3, Hirokazu Kato 4, 6, Holger Regenbrecht 5 & Nobuji Tetsutani 6 1 Interaction Lab, Sony CSL 2 School of

More information

Ubiquitous. Waves of computing

Ubiquitous. Waves of computing Ubiquitous Webster: -- existing or being everywhere at the same time : constantly encountered Waves of computing First wave - mainframe many people using one computer Second wave - PC one person using

More information

Ubiquitous Computing. michael bernstein spring cs376.stanford.edu. Wednesday, April 3, 13

Ubiquitous Computing. michael bernstein spring cs376.stanford.edu. Wednesday, April 3, 13 Ubiquitous Computing michael bernstein spring 2013 cs376.stanford.edu Ubiquitous? Ubiquitous? 3 Ubicomp Vision A new way of thinking about computers in the world, one that takes into account the natural

More information

3D and Sequential Representations of Spatial Relationships among Photos

3D and Sequential Representations of Spatial Relationships among Photos 3D and Sequential Representations of Spatial Relationships among Photos Mahoro Anabuki Canon Development Americas, Inc. E15-349, 20 Ames Street Cambridge, MA 02139 USA mahoro@media.mit.edu Hiroshi Ishii

More information

Slurp: Tangibility, Spatiality, and an Eyedropper

Slurp: Tangibility, Spatiality, and an Eyedropper Slurp: Tangibility, Spatiality, and an Eyedropper Jamie Zigelbaum MIT Media Lab 20 Ames St. Cambridge, Mass. 02139 USA zig@media.mit.edu Adam Kumpf MIT Media Lab 20 Ames St. Cambridge, Mass. 02139 USA

More information

From Table System to Tabletop: Integrating Technology into Interactive Surfaces

From Table System to Tabletop: Integrating Technology into Interactive Surfaces From Table System to Tabletop: Integrating Technology into Interactive Surfaces Andreas Kunz 1 and Morten Fjeld 2 1 Swiss Federal Institute of Technology, Department of Mechanical and Process Engineering

More information

Embodied User Interfaces for Really Direct Manipulation

Embodied User Interfaces for Really Direct Manipulation Version 9 (7/3/99) Embodied User Interfaces for Really Direct Manipulation Kenneth P. Fishkin, Anuj Gujar, Beverly L. Harrison, Thomas P. Moran, Roy Want Xerox Palo Alto Research Center A major event in

More information

Augmented and mixed reality (AR & MR)

Augmented and mixed reality (AR & MR) Augmented and mixed reality (AR & MR) Doug Bowman CS 5754 Based on original lecture notes by Ivan Poupyrev AR/MR example (C) 2008 Doug Bowman, Virginia Tech 2 Definitions Augmented reality: Refers to a

More information

A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds

A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds 6th ERCIM Workshop "User Interfaces for All" Long Paper A Gesture-Based Interface for Seamless Communication between Real and Virtual Worlds Masaki Omata, Kentaro Go, Atsumi Imamiya Department of Computer

More information

Meaning, Mapping & Correspondence in Tangible User Interfaces

Meaning, Mapping & Correspondence in Tangible User Interfaces Meaning, Mapping & Correspondence in Tangible User Interfaces CHI '07 Workshop on Tangible User Interfaces in Context & Theory Darren Edge Rainbow Group Computer Laboratory University of Cambridge A Solid

More information

An augmented-reality (AR) interface dynamically

An augmented-reality (AR) interface dynamically COVER FEATURE Developing a Generic Augmented-Reality Interface The Tiles system seamlessly blends virtual and physical objects to create a work space that combines the power and flexibility of computing

More information

Social and Spatial Interactions: Shared Co-Located Mobile Phone Use

Social and Spatial Interactions: Shared Co-Located Mobile Phone Use Social and Spatial Interactions: Shared Co-Located Mobile Phone Use Andrés Lucero User Experience and Design Team Nokia Research Center FI-33721 Tampere, Finland andres.lucero@nokia.com Jaakko Keränen

More information

Body Cursor: Supporting Sports Training with the Out-of-Body Sence

Body Cursor: Supporting Sports Training with the Out-of-Body Sence Body Cursor: Supporting Sports Training with the Out-of-Body Sence Natsuki Hamanishi Jun Rekimoto Interfaculty Initiatives in Interfaculty Initiatives in Information Studies Information Studies The University

More information

CMSC838. Tangible Interactive Assistant Professor Computer Science

CMSC838. Tangible Interactive Assistant Professor Computer Science CMSC838 Tangible Interactive Computing Week 01 Lecture 02 Jan 29, 2014 About You, Tangible Bits Discussion, & Hackerspace Tour Human Computer Interaction Laboratory @jonfroehlich Assistant Professor Computer

More information

LCC 3710 Principles of Interaction Design. Readings. Tangible Interfaces. Research Motivation. Tangible Interaction Model.

LCC 3710 Principles of Interaction Design. Readings. Tangible Interfaces. Research Motivation. Tangible Interaction Model. LCC 3710 Principles of Interaction Design Readings Ishii, H., Ullmer, B. (1997). "Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms" in Proceedings of CHI '97, ACM Press. Ullmer,

More information

Midterm project proposal due next Tue Sept 23 Group forming, and Midterm project and Final project Brainstorming sessions

Midterm project proposal due next Tue Sept 23 Group forming, and Midterm project and Final project Brainstorming sessions Announcements Midterm project proposal due next Tue Sept 23 Group forming, and Midterm project and Final project Brainstorming sessions Tuesday Sep 16th, 2-3pm at Room 107 South Hall Wednesday Sep 17th,

More information

Programming reality: From Transitive Materials to organic user interfaces

Programming reality: From Transitive Materials to organic user interfaces Programming reality: From Transitive Materials to organic user interfaces The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation

More information

Designing Embodied Interfaces for Casual Sound Recording Devices

Designing Embodied Interfaces for Casual Sound Recording Devices Designing Embodied Interfaces for Casual Sound Recording Devices Ivan Poupyrev Interaction Lab, Sony CSL, 3-14-13 Higashigotanda, Shinagawa, Tokyo 141-0022 Japan ivan@csl.sony.co.jp Haruo Oba, Takuo Ikeda

More information

Embodiment, Immediacy and Thinghood in the Design of Human-Computer Interaction

Embodiment, Immediacy and Thinghood in the Design of Human-Computer Interaction Embodiment, Immediacy and Thinghood in the Design of Human-Computer Interaction Fabian Hemmert, Deutsche Telekom Laboratories, Berlin, Germany, fabian.hemmert@telekom.de Gesche Joost, Deutsche Telekom

More information

New Metaphors in Tangible Desktops

New Metaphors in Tangible Desktops New Metaphors in Tangible Desktops A brief approach Carles Fernàndez Julià Universitat Pompeu Fabra Passeig de Circumval lació, 8 08003 Barcelona chaosct@gmail.com Daniel Gallardo Grassot Universitat Pompeu

More information

Translucent Tangibles on Tabletops: Exploring the Design Space

Translucent Tangibles on Tabletops: Exploring the Design Space Translucent Tangibles on Tabletops: Exploring the Design Space Mathias Frisch mathias.frisch@tu-dresden.de Ulrike Kister ukister@acm.org Wolfgang Büschel bueschel@acm.org Ricardo Langner langner@acm.org

More information

Introduction. HCI DTIC Masters Josep Blat. Two motivating statements

Introduction. HCI DTIC Masters Josep Blat. Two motivating statements Introduction HCI DTIC Masters Josep Blat Two motivating statements Consider what the computer of the future might look like. Suppose I told you it wouldn t even be visible, that you wouldn t even know

More information

Application of 3D Terrain Representation System for Highway Landscape Design

Application of 3D Terrain Representation System for Highway Landscape Design Application of 3D Terrain Representation System for Highway Landscape Design Koji Makanae Miyagi University, Japan Nashwan Dawood Teesside University, UK Abstract In recent years, mixed or/and augmented

More information

Mosaic View: Modest and Informative Display

Mosaic View: Modest and Informative Display Mosaic View: Modest and Informative Display Kazuo Misue Department of Computer Science, Graduate School of Systems and Information Engineering, University of Tsukuba 1-1-1 Tennoudai, Tsukuba, 305-8573

More information

Improvisation and Tangible User Interfaces The case of the reactable

Improvisation and Tangible User Interfaces The case of the reactable Improvisation and Tangible User Interfaces The case of the reactable Nadir Weibel, Ph.D. Distributed Cognition and Human-Computer Interaction Lab University of California San Diego http://hci.ucsd.edu/weibel

More information

synchrolight: Three-dimensional Pointing System for Remote Video Communication

synchrolight: Three-dimensional Pointing System for Remote Video Communication synchrolight: Three-dimensional Pointing System for Remote Video Communication Jifei Ou MIT Media Lab 75 Amherst St. Cambridge, MA 02139 jifei@media.mit.edu Sheng Kai Tang MIT Media Lab 75 Amherst St.

More information

DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS. Lucia Terrenghi*

DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS. Lucia Terrenghi* DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS Lucia Terrenghi* Abstract Embedding technologies into everyday life generates new contexts of mixed-reality. My research focuses on interaction techniques

More information

6 Ubiquitous User Interfaces

6 Ubiquitous User Interfaces 6 Ubiquitous User Interfaces Viktoria Pammer-Schindler May 3, 2016 Ubiquitous User Interfaces 1 Days and Topics March 1 March 8 March 15 April 12 April 26 (10-13) April 28 (9-14) May 3 May 10 Administrative

More information

The Design of Internet-Based RobotPHONE

The Design of Internet-Based RobotPHONE The Design of Internet-Based RobotPHONE Dairoku Sekiguchi 1, Masahiko Inami 2, Naoki Kawakami 1 and Susumu Tachi 1 1 Graduate School of Information Science and Technology, The University of Tokyo 7-3-1

More information

Mixed Reality: A model of Mixed Interaction

Mixed Reality: A model of Mixed Interaction Mixed Reality: A model of Mixed Interaction Céline Coutrix and Laurence Nigay CLIPS-IMAG Laboratory, University of Grenoble 1, BP 53, 38041 Grenoble Cedex 9, France 33 4 76 51 44 40 {Celine.Coutrix, Laurence.Nigay}@imag.fr

More information

ISCW 2001 Tutorial. An Introduction to Augmented Reality

ISCW 2001 Tutorial. An Introduction to Augmented Reality ISCW 2001 Tutorial An Introduction to Augmented Reality Mark Billinghurst Human Interface Technology Laboratory University of Washington, Seattle grof@hitl.washington.edu Dieter Schmalstieg Technical University

More information

Tangible Augmented Reality

Tangible Augmented Reality Tangible Augmented Reality Mark Billinghurst Hirokazu Kato Ivan Poupyrev HIT Laboratory Faculty of Information Sciences Interaction Lab University of Washington Hiroshima City University Sony CSL Box 352-142,

More information

EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment

EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment Hideki Koike 1, Shin ichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of Information Systems,

More information

Ubiquitous Computing MICHAEL BERNSTEIN CS 376

Ubiquitous Computing MICHAEL BERNSTEIN CS 376 Ubiquitous Computing MICHAEL BERNSTEIN CS 376 Reminders First critiques were due last night Idea Generation (Round One) due next Friday, with a team Next week: Social computing Design and creation Clarification

More information

IMPROVING DIGITAL HANDOFF IN TABLETOP SHARED WORKSPACES. A Thesis Submitted to the College of. Graduate Studies and Research

IMPROVING DIGITAL HANDOFF IN TABLETOP SHARED WORKSPACES. A Thesis Submitted to the College of. Graduate Studies and Research IMPROVING DIGITAL HANDOFF IN TABLETOP SHARED WORKSPACES A Thesis Submitted to the College of Graduate Studies and Research In Partial Fulfillment of the Requirements For the Degree of Master of Science

More information

Precise manipulation of GUI on a touch screen with haptic cues

Precise manipulation of GUI on a touch screen with haptic cues Precise manipulation of GUI on a touch screen with haptic cues The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published

More information

Future Dining Table: Dish Recommendation Based on Dining Activity Recognition

Future Dining Table: Dish Recommendation Based on Dining Activity Recognition Future Dining Table: Dish Recommendation Based on Dining Activity Recognition Tomoo Inoue University of Tsukuba, Graduate School of Library, Information and Media Studies, Kasuga 1-2, Tsukuba 305-8550

More information

Organic Board Games with Tangible Tiles: interaction methods for small hexagonal tiles

Organic Board Games with Tangible Tiles: interaction methods for small hexagonal tiles Organic Board Games with Tangible Tiles: interaction methods for small hexagonal tiles by Michael Howard Rooke A thesis submitted to the School of Computing in conformity with the requirements for the

More information

Organic UIs in Cross-Reality Spaces

Organic UIs in Cross-Reality Spaces Organic UIs in Cross-Reality Spaces Derek Reilly Jonathan Massey OCAD University GVU Center, Georgia Tech 205 Richmond St. Toronto, ON M5V 1V6 Canada dreilly@faculty.ocad.ca ragingpotato@gatech.edu Anthony

More information

Mixed Reality Approach and the Applications using Projection Head Mounted Display

Mixed Reality Approach and the Applications using Projection Head Mounted Display Mixed Reality Approach and the Applications using Projection Head Mounted Display Ryugo KIJIMA, Takeo OJIKA Faculty of Engineering, Gifu University 1-1 Yanagido, GifuCity, Gifu 501-11 Japan phone: +81-58-293-2759,

More information

Simulation of Tangible User Interfaces with the ROS Middleware

Simulation of Tangible User Interfaces with the ROS Middleware Simulation of Tangible User Interfaces with the ROS Middleware Stefan Diewald 1 stefan.diewald@tum.de Andreas Möller 1 andreas.moeller@tum.de Luis Roalter 1 roalter@tum.de Matthias Kranz 2 matthias.kranz@uni-passau.de

More information

User Interfaces and HCI for Ambient Intelligence and Smart Environments

User Interfaces and HCI for Ambient Intelligence and Smart Environments User Interfaces and HCI for Ambient Intelligence and Smart Environments Andreas Butz 1 Input/Output Devices As this book clearly demonstrates, there are many ways to create smart environments and to realize

More information

An Interface Proposal for Collaborative Architectural Design Process

An Interface Proposal for Collaborative Architectural Design Process An Interface Proposal for Collaborative Architectural Design Process Sema Alaçam Aslan 1, Gülen Çağdaş 2 1 Istanbul Technical University, Institute of Science and Technology, Turkey, 2 Istanbul Technical

More information

Authors: Bill Tomlinson, Man Lok Yau, Jessica O Connell, Ksatria Williams, So Yamaoka

Authors: Bill Tomlinson, Man Lok Yau, Jessica O Connell, Ksatria Williams, So Yamaoka 9/10/04 Dear Sir/Madam: We would like to submit an interactive installation to the CHI 2005 Interactivity program. Authors: Bill Tomlinson, Man Lok Yau, Jessica O Connell, Ksatria Williams, So Yamaoka

More information

The big hole in HCI research. Vassilis Kostakos Center for Ubiquitous Computing University of Oulu, Finland

The big hole in HCI research. Vassilis Kostakos Center for Ubiquitous Computing University of Oulu, Finland The big hole in HCI research Vassilis Kostakos Center for Ubiquitous Computing University of Oulu, Finland Symposium on HCI Grand Challenges, UCL, London 12 Sep 2016 Why we are here 2 HCI Grand Challenges

More information

NOSTOS: A Paper Based Ubiquitous Computing Healthcare Environment to Support Data Capture and Collaboration

NOSTOS: A Paper Based Ubiquitous Computing Healthcare Environment to Support Data Capture and Collaboration NOSTOS: A Paper Based Ubiquitous Computing Healthcare Environment to Support Data Capture and Collaboration Magnus Bång, Anders Larsson, and Henrik Eriksson Department of Computer and Information Science,

More information

A Gestural Interaction Design Model for Multi-touch Displays

A Gestural Interaction Design Model for Multi-touch Displays Songyang Lao laosongyang@ vip.sina.com A Gestural Interaction Design Model for Multi-touch Displays Xiangan Heng xianganh@ hotmail ABSTRACT Media platforms and devices that allow an input from a user s

More information

for Everyday yobjects TEI 2010 Graduate Student Consortium Hyunjung KIM Design Media Lab. KAIST

for Everyday yobjects TEI 2010 Graduate Student Consortium Hyunjung KIM Design Media Lab. KAIST Designing Interactive Kinetic Surface for Everyday yobjects and Environments TEI 2010 Graduate Student Consortium Hyunjung KIM Design Media Lab. KAIST Contents 1 Background 2 Aims 3 Approach Interactive

More information

Multimodal Sensing for Explicit and Implicit Interaction

Multimodal Sensing for Explicit and Implicit Interaction Multimodal Sensing for Explicit and Implicit Interaction Andrew Wilson and Nuria Oliver Microsoft Research Redmond, WA awilson@microsoft.com, nuria@microsoft.com Abstract We present four perceptual user

More information

Making Bits and Atoms Talk Today

Making Bits and Atoms Talk Today Jo Vermeulen Ruben Thys Kris Luyten Karin Coninx {jo.vermeulen,kris.luyten,karin.coninx}@uhasselt.be ruben.thys@student.uhasselt.be Making Bits and Atoms Talk Today A Practical Architecture for Smart Object

More information

More light on your table: Table-sized Sketchy VR in support of fluid collaboration

More light on your table: Table-sized Sketchy VR in support of fluid collaboration More light on your table: Table-sized Sketchy VR in support of fluid collaboration Hiroyuki UMEMURO*, Ianus KELLER**, Pieter Jan STAPPERS** *Department of Industrial Engineering and Management, Tokyo Institute

More information

Occlusion-Aware Menu Design for Digital Tabletops

Occlusion-Aware Menu Design for Digital Tabletops Occlusion-Aware Menu Design for Digital Tabletops Peter Brandl peter.brandl@fh-hagenberg.at Jakob Leitner jakob.leitner@fh-hagenberg.at Thomas Seifried thomas.seifried@fh-hagenberg.at Michael Haller michael.haller@fh-hagenberg.at

More information

User Interfaces and HCI for Ambient Intelligence and Smart Environments

User Interfaces and HCI for Ambient Intelligence and Smart Environments User Interfaces and HCI for Ambient Intelligence and Smart Environments Andreas Butz Abstract The chapter on User Interfaces and HCI will attempt to systematically structure the field of User Interfaces,

More information

COMS W4172 Design Principles

COMS W4172 Design Principles COMS W4172 Design Principles Steven Feiner Department of Computer Science Columbia University New York, NY 10027 www.cs.columbia.edu/graphics/courses/csw4172 January 25, 2018 1 2D & 3D UIs: What s the

More information

Advanced Interaction Techniques for Augmented Reality Applications

Advanced Interaction Techniques for Augmented Reality Applications Advanced Interaction Techniques for Augmented Reality Applications Mark Billinghurst 1, Hirokazu Kato 2, and Seiko Myojin 2 1 The Human Interface Technology New Zealand (HIT Lab NZ), University of Canterbury,

More information

ExTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality

ExTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality ExTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality The MIT Faculty has made this article openly available. Please share how this access benefits you. Your

More information

AuraOrb: Social Notification Appliance

AuraOrb: Social Notification Appliance AuraOrb: Social Notification Appliance Mark Altosaar altosaar@cs.queensu.ca Roel Vertegaal roel@cs.queensu.ca Changuk Sohn csohn@cs.queensu.ca Daniel Cheng dc@cs.queensu.ca Copyright is held by the author/owner(s).

More information

Tangible Message Bubbles for Childrenʼs Communication and Play

Tangible Message Bubbles for Childrenʼs Communication and Play Tangible Message Bubbles for Childrenʼs Communication and Play Kimiko Ryokai School of Information Berkeley Center for New Media University of California Berkeley Berkeley, CA 94720 USA kimiko@ischool.berkeley.edu

More information

PhonePaint: Using Smartphones as Dynamic Brushes with Interactive Displays

PhonePaint: Using Smartphones as Dynamic Brushes with Interactive Displays PhonePaint: Using Smartphones as Dynamic Brushes with Interactive Displays Jian Zhao Department of Computer Science University of Toronto jianzhao@dgp.toronto.edu Fanny Chevalier Department of Computer

More information

! Computation embedded in the physical spaces around us. ! Ambient intelligence. ! Input in the real world. ! Output in the real world also

! Computation embedded in the physical spaces around us. ! Ambient intelligence. ! Input in the real world. ! Output in the real world also Ubicomp? Ubicomp and Physical Interaction! Computation embedded in the physical spaces around us! Ambient intelligence! Take advantage of naturally-occurring actions and activities to support people! Input

More information

Haptic Cues: Texture as a Guide for Non-Visual Tangible Interaction.

Haptic Cues: Texture as a Guide for Non-Visual Tangible Interaction. Haptic Cues: Texture as a Guide for Non-Visual Tangible Interaction. Figure 1. Setup for exploring texture perception using a (1) black box (2) consisting of changeable top with laser-cut haptic cues,

More information

ARTIFACTS FOR DISPLAYING HOME ENERGY USE

ARTIFACTS FOR DISPLAYING HOME ENERGY USE KEN CAMARATA, DREW BREGEL, ELLEN YI-LUEN DO, MARK D GROSS Design Machine Group University of Washington, Seattle, WA, 98195 USA http://dmg.caup.washington.edu 1. Introduction Abstract. Combining the easy

More information

Interaction Technique for a Pen-Based Interface Using Finger Motions

Interaction Technique for a Pen-Based Interface Using Finger Motions Interaction Technique for a Pen-Based Interface Using Finger Motions Yu Suzuki, Kazuo Misue, and Jiro Tanaka 1-1-1 Tennodai, Tsukuba, Ibaraki, 305-8573, Japan {suzuki,misue,jiro}@iplab.cs.tsukuba.ac.jp

More information

Unit 23. QCF Level 3 Extended Certificate Unit 23 Human Computer Interaction

Unit 23. QCF Level 3 Extended Certificate Unit 23 Human Computer Interaction Unit 23 QCF Level 3 Extended Certificate Unit 23 Human Computer Interaction Unit 23 Outcomes Know the impact of HCI on society, the economy and culture Understand the fundamental principles of interface

More information

Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information

Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information Published in the Proceedings of the First International Workshop on Cooperative Buildings (CoBuild '98), February 25-26, 1998, 1998 Springer 1 Ambient Displays: Turning Architectural Space into an Interface

More information

School of Computer and Information Science

School of Computer and Information Science School of Computer and Information Science CIS Research Placement Report Title: Data Mining Office Behavioural Information from Simple Sensors Name: Samuel J. O Malley Date: 20/11/2011 Supervisor: Dr Ross

More information

COMET: Collaboration in Applications for Mobile Environments by Twisting

COMET: Collaboration in Applications for Mobile Environments by Twisting COMET: Collaboration in Applications for Mobile Environments by Twisting Nitesh Goyal RWTH Aachen University Aachen 52056, Germany Nitesh.goyal@rwth-aachen.de Abstract In this paper, we describe a novel

More information

A DESIGN APPROACH FOR TANGIBLE USER INTERFACES ABSTRACT INTRODUCTION

A DESIGN APPROACH FOR TANGIBLE USER INTERFACES ABSTRACT INTRODUCTION A DESIGN APPROACH FOR TANGIBLE USER INTERFACES Bernard Champoux (Associate Researcher) Dr Sriram Subramanian (Assistant Professor) Department of Computer Sciences Human Computer Interaction Lab University

More information

Sapienza University of Rome

Sapienza University of Rome Sapienza University of Rome Ph.D. program in Computer Engineering XXIII Cycle - 2011 Improving Human-Robot Awareness through Semantic-driven Tangible Interaction Gabriele Randelli Sapienza University

More information

The Mixed Reality Book: A New Multimedia Reading Experience

The Mixed Reality Book: A New Multimedia Reading Experience The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut

More information

TViews: An Extensible Architecture for Multiuser Digital Media Tables

TViews: An Extensible Architecture for Multiuser Digital Media Tables TViews: An Extensible Architecture for Multiuser Digital Media Tables Ali Mazalek Georgia Institute of Technology Matthew Reynolds ThingMagic Glorianna Davenport Massachusetts Institute of Technology In

More information

Mixed Interaction Spaces expanding the interaction space with mobile devices

Mixed Interaction Spaces expanding the interaction space with mobile devices Mixed Interaction Spaces expanding the interaction space with mobile devices Eva Eriksson, Thomas Riisgaard Hansen & Andreas Lykke-Olesen* Center for Interactive Spaces & Center for Pervasive Healthcare,

More information

Interaction Techniques for Musical Performance with Tabletop Tangible Interfaces

Interaction Techniques for Musical Performance with Tabletop Tangible Interfaces Interaction Techniques for Musical Performance with Tabletop Tangible Interfaces James Patten MIT Media Lab 20 Ames St. Cambridge, Ma 02139 +1 857 928 6844 jpatten@media.mit.edu Ben Recht MIT Media Lab

More information

Dynamic Tangible User Interface Palettes

Dynamic Tangible User Interface Palettes Dynamic Tangible User Interface Palettes Martin Spindler 1, Victor Cheung 2, and Raimund Dachselt 3 1 User Interface & Software Engineering Group, University of Magdeburg, Germany 2 Collaborative Systems

More information

ubiquitous computing and augmented realities

ubiquitous computing and augmented realities ubiquitous computing and augmented realities chapter 20 ubiquitous computing and augmented realities ubiquitous computing filling the physical world with computers virtual and augmented reality making

More information

G-stalt: A chirocentric, spatiotemporal, and telekinetic gestural interface

G-stalt: A chirocentric, spatiotemporal, and telekinetic gestural interface G-stalt: A chirocentric, spatiotemporal, and telekinetic gestural interface The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation

More information

MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS

MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS Richard Etter 1 ) and Marcus Specht 2 ) Abstract In this paper the design, development and evaluation of a GPS-based

More information

Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface

Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface Xu Zhao Saitama University 255 Shimo-Okubo, Sakura-ku, Saitama City, Japan sheldonzhaox@is.ics.saitamau.ac.jp Takehiro Niikura The University

More information

A computer support tool for the early stages of architectural design

A computer support tool for the early stages of architectural design Interacting with Computers 18 (2006) 528 555 www.elsevier.com/locate/intcom A computer support tool for the early stages of architectural design Dzmitry Aliakseyeu *, Jean-Bernard Martens, Matthias Rauterberg

More information

CapWidgets: Tangible Widgets versus Multi-Touch Controls on Mobile Devices

CapWidgets: Tangible Widgets versus Multi-Touch Controls on Mobile Devices CapWidgets: Tangible Widgets versus Multi-Touch Controls on Mobile Devices Sven Kratz Mobile Interaction Lab University of Munich Amalienstr. 17, 80333 Munich Germany sven.kratz@ifi.lmu.de Michael Rohs

More information

Augmented Reality Applications for Nuclear Power Plant Maintenance Work

Augmented Reality Applications for Nuclear Power Plant Maintenance Work Augmented Reality Applications for Nuclear Power Plant Maintenance Work Hirotake Ishii 1, Zhiqiang Bian 1, Hidenori Fujino 1, Tomoki Sekiyama 1, Toshinori Nakai 1, Akihisa Okamoto 1, Hiroshi Shimoda 1,

More information

Feelable User Interfaces: An Exploration of Non-Visual Tangible User Interfaces

Feelable User Interfaces: An Exploration of Non-Visual Tangible User Interfaces Feelable User Interfaces: An Exploration of Non-Visual Tangible User Interfaces Katrin Wolf Telekom Innovation Laboratories TU Berlin, Germany katrin.wolf@acm.org Peter Bennett Interaction and Graphics

More information

ScrollPad: Tangible Scrolling With Mobile Devices

ScrollPad: Tangible Scrolling With Mobile Devices ScrollPad: Tangible Scrolling With Mobile Devices Daniel Fällman a, Andreas Lund b, Mikael Wiberg b a Interactive Institute, Tools for Creativity Studio, Tvistev. 47, SE-90719, Umeå, Sweden b Interaction

More information

Projection Based HCI (Human Computer Interface) System using Image Processing

Projection Based HCI (Human Computer Interface) System using Image Processing GRD Journals- Global Research and Development Journal for Volume 1 Issue 5 April 2016 ISSN: 2455-5703 Projection Based HCI (Human Computer Interface) System using Image Processing Pankaj Dhome Sagar Dhakane

More information

Audiopad: A Tag-based Interface for Musical Performance

Audiopad: A Tag-based Interface for Musical Performance Published in the Proceedings of NIME 2002, May 24-26, 2002. 2002 ACM Audiopad: A Tag-based Interface for Musical Performance James Patten Tangible Media Group MIT Media Lab Cambridge, Massachusetts jpatten@media.mit.edu

More information

Welcome, Introduction, and Roadmap Joseph J. LaViola Jr.

Welcome, Introduction, and Roadmap Joseph J. LaViola Jr. Welcome, Introduction, and Roadmap Joseph J. LaViola Jr. Welcome, Introduction, & Roadmap 3D UIs 101 3D UIs 201 User Studies and 3D UIs Guidelines for Developing 3D UIs Video Games: 3D UIs for the Masses

More information