Interaction Techniques for High Resolution Displays

Similar documents
What was the first gestural interface?

Virtual Grasping Using a Data Glove

Building a bimanual gesture based 3D user interface for Blender

COMET: Collaboration in Applications for Mobile Environments by Twisting

Direct Manipulation. and Instrumental Interaction. CS Direct Manipulation

Chapter 1 - Introduction

Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)

ISCW 2001 Tutorial. An Introduction to Augmented Reality

Press release 04/04/2018

Framework Programme 7

Projection Based HCI (Human Computer Interface) System using Image Processing

CSE 190: Virtual Reality Technologies LECTURE #7: VR DISPLAYS

AUGMENTED REALITY, FEATURE DETECTION Applications on camera phones. Prof. Charles Woodward, Digital Systems VTT TECHNICAL RESEARCH CENTRE OF FINLAND

- applications on same or different network node of the workstation - portability of application software - multiple displays - open architecture

A Hybrid Immersive / Non-Immersive

KEYWORDS virtual reality exhibition, high bandwidth, video-on-demand. interpretation

CSE 165: 3D User Interaction. Lecture #14: 3D UI Design


11Beamage-3. CMOS Beam Profiling Cameras

Zoomable User Interfaces

Information & Instructions

Realtime 3D Computer Graphics Virtual Reality

CSE 190: 3D User Interaction

Augmented Reality Lecture notes 01 1

University of California, Santa Barbara. CS189 Fall 17 Capstone. VR Telemedicine. Product Requirement Documentation

E-Learning in Virtual- und Augmented Reality. Hannes Kaufmann

Graphical User Interfaces for Blind Users: An Overview of Haptic Devices

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

10/18/2010. Focus. Information technology landscape

ScrollPad: Tangible Scrolling With Mobile Devices

Geo-Located Content in Virtual and Augmented Reality

Designing Interactive Systems II

Touch & Gesture. HCID 520 User Interface Software & Technology

What s hot right now and where is it heading?

Virtual Reality Based Scalable Framework for Travel Planning and Training

Effective Iconography....convey ideas without words; attract attention...

- Modifying the histogram by changing the frequency of occurrence of each gray scale value may improve the image quality and enhance the contrast.

ThumbsUp: Integrated Command and Pointer Interactions for Mobile Outdoor Augmented Reality Systems

Chapter 2 Understanding and Conceptualizing Interaction. Anna Loparev Intro HCI University of Rochester 01/29/2013. Problem space

Model-Based Design for Sensor Systems

3D User Interaction CS-525U: Robert W. Lindeman. Intro to 3D UI. Department of Computer Science. Worcester Polytechnic Institute.

Immersive Visualization and Collaboration with LS-PrePost-VR and LS-PrePost-Remote

Announcement: Informatik kolloquium

Resource-adaptive mobile Navigation Systems

Using Scalable, Interactive Floor Projection for Production Planning Scenario

A Multimodal Locomotion User Interface for Immersive Geospatial Information Systems

The EDA SUM Project. Surveillance in an Urban environment using Mobile sensors. 2012, September 13 th - FMV SENSORS SYMPOSIUM 2012

COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES.

Réalité Virtuelle et Interactions. Interaction 3D. Année / 5 Info à Polytech Paris-Sud. Cédric Fleury

A Modular Architecture for an Interactive Real-Time Simulation and Training Environment for Satellite On-Orbit Servicing

Vorlesung Mensch-Maschine-Interaktion. The solution space. Chapter 4 Analyzing the Requirements and Understanding the Design Space

HCI Design in the OR: A Gesturing Case-Study"

Visual Interpretation of Hand Gestures as a Practical Interface Modality

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT

Social Editing of Video Recordings of Lectures

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

Heads up interaction: glasgow university multimodal research. Eve Hoggan

Project Description. Multispectral Image Capture System The Sixth Sensor

R (2) Controlling System Application with hands by identifying movements through Camera

Collection Scanning Solutions. The ST ViewScan II System FILM FICHE FASTER TM

christian geiger Mixed&Reality&in&Lehre,& F&E&und&Third&Mission Michael Brink, Christian Geiger Februar2018

3D Graphical User Interface on personal computer using p5 Data Glove

Gestaltung und Strukturierung virtueller Welten. Bauhaus - Universität Weimar. Research at InfAR. 2ooo

BEAMAGE KEY FEATURES AVAILABLE MODELS. CMOS Beam Profiling Cameras

VR4D: An Immersive and Collaborative Experience to Improve the Interior Design Process

MEDIA AND INFORMATION

Einführung in die Erweiterte Realität. 5. Head-Mounted Displays

(BW) - elabs - Knowledge Management for Virtual & Remote Labs. escidoc Days 2009 FIZ Karlsruhe June 15-16, S. Jeschke 1

Optimum User Experience with the Juggler SIP Software Telephone

Coeno Enhancing face-to-face collaboration

Stop Compromising My Touchscreen!

Touch & Gesture. HCID 520 User Interface Software & Technology

University of Huddersfield Repository

A RANGE OF LOCATION BASED VR PRODUCTS BY

BEAMAGE-3.0 KEY FEATURES BEAM DIAGNOSTICS AVAILABLE MODELS MAIN FUNCTIONS SEE ALSO ACCESSORIES. CMOS Beam Profiling Cameras

ERS KEY FEATURES BEAM DIAGNOSTICS MAIN FUNCTIONS AVAILABLE MODEL. CMOS Beam Profiling Camera. 1 USB 3.0 for the Fastest Transfer Rates

Collection Scanning Solutions. The ST ViewScan III System FILM FICHE FASTER TM

INFO 424, UW ischool 11/15/2007

Augmented Reality. Virtuelle Realität Wintersemester 2007/08. Overview. Part 14:

VR / AR / MR in MRO & Service VDC Whitepaper

Using Hands and Feet to Navigate and Manipulate Spatial Data

RESNA Gaze Tracking System for Enhanced Human-Computer Interaction

Flexible Gesture Recognition for Immersive Virtual Environments

Introduction to Virtual Reality (based on a talk by Bill Mark)

VIRTUAL REALITY FOR NONDESTRUCTIVE EVALUATION APPLICATIONS

Approaches to the Successful Design and Implementation of VR Applications

3D INTERACTION DESIGN AND APPLICATION DEVELOPMENT LIM KIAN TECK

A new user interface for human-computer interaction in virtual reality environments

iwindow Concept of an intelligent window for machine tools using augmented reality

The 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, / X

Quick Guide. LSM 5 MP, LSM 510 and LSM 510 META. Laser Scanning Microscopes. We make it visible. M i c r o s c o p y f r o m C a r l Z e i s s

FRAUNHOFER INSTITUTE FOR OPEN COMMUNICATION SYSTEMS FOKUS COMPETENCE CENTER VISCOM

House Design Tutorial

A Kinect-based 3D hand-gesture interface for 3D databases

WHITE PAPER Need for Gesture Recognition. April 2014

CENTRE OF DIGITAL INNOVATION

A Virtual Reality Framework to Validate Persuasive Interactive Systems to Change Work Habits

IMMIView. A multi-user solution for design review in real-time. Real Time Image Processing manuscript No. (will be inserted by the editor)

virtual reality SANJAY SINGH B.TECH (EC)

A Brief Survey of HCI Technology. Lecture #3

Transcription:

Interaction Techniques for High Resolution Displays ZuiScat

2 Interaction Techniques for High Resolution Displays analysis of existing and conception of new interaction and visualization techniques for high resolution displays in consideration of human capabilities and restrictions design and evaluation of novel input devices for HRDs development of a general interaction framework. BW-FIT - Interactive Visualization for Gigapixel Displays

BW-FIT Project Partners 3 Prof. Dr. O. Deussen, Computergrafik, Universität Konstanz Prof. Dr. H. Reiterer, Mensch-Computer Interaktion, Universität Konstanz Prof. Dr. H. Bülthoff, Max-Planck Institut für biologische Kybernetik, Tübingen Prof. Dr. T. Ertl, Institut für Visualisierung und Interaktive Systeme, Universität Stuttgart Prof. Dr. D. Keim, Databanken, Data Mining & Visualisierung, Universität Konstanz Prof. Dr. A. Keller, Medieninformatik, Universität Ulm Bernd Lintermann, Zentrum für Kunst- und Medientechnologie Karlsruhe Prof. Dr. A. Schilling, Graphisch-Interaktive Systeme, Universität Tübingen

HRDs 4

Gigapixel Image 5 Gigapixel Project - www.gigapxl.org

Advantages HRDs 6 HRDs fit human capabilities: visual angle, visual acuity, superior immersion Virtual navigation enhance real one (not a replacement) direct interaction, faster Real overview & context, detail on demand, interactive wall Increased real estate for e.g. spatial information management, creative brainstorming, interactive whiteboard

Challenges & Chances 7 Small focal & large peripheral areas Varying distances (need for lightweight, small, wireless, ergonomic input devices) User / group behavior Multi user / multiple devices Collaborative Environment

Input Devices 8

Input Devices 9 Design Characteristics: [Vogel, Balakrishnan 05] Accuracy Acquisition Speed Interaction Speed Ergonomic Use Smooth Transition Between Interaction Distances

Laser Pointer Tracking 10 Already used as pointing device, intuitive and easy to use (Almost) distance independent Client-Server Architecture Highly scalable Standard, low-cost hardware Fast & easy calibration Various settings (front/back, centred/sloped, upright/horizontal)

Camera calibration 11

PowerWall camera settings 12

Further tracking tools 13 ART passive infrared optical tracking system 5DT Data Glove, 14 sensors (flexure & abduction)

Combining virtual and physical navigation 14 Robert Konstanzer, Seminar Interaction Techniques for HRDs, 2006.

Hollywood 15 Minority Report 2002 Dale Rutter

HRD Interaction 16

UI Concepts & Paradigms 17

UI Concepts & Paradigms 18 Large-display usability issues: [Robertson et al. 05] Losing the cursor Bezel problems Distal information access problems Window management problems Task management problems Configuration problems

Information organization? 19

More space more information? 20

ZOIL Paradigm 21 Zoomable Object-oriented Information Landscape No desktop information landscape No windows zoomable objects No menus, scrollbars direct manipulation with zooming and Primary panningvisual access on large information space Spatial metaphor instead of abstract hierarchies New interface paradigm inspired by Jef Raskin s ZoomWorld with the integration of HyperGrid, ZUIScat and other ZUI components.

ZOIL Paradigm 22

Next steps 23 Enhance Laser Tracking (industry cameras, infrared, filter, gestures, OCR, device combinations) Integrate ART Tracking System & 5DT Data Glove, PDA Interaction Evolve adequate interaction techniques (gestures, widgets, ) Evaluate conventional & novel input devices Develop general interaction framework Apply ZOIL Paradigm on PowerWall for specific use case