3D Projected Imagery Freespace Control Unit (PIFCU): Design, Implementation, and Analysis

Similar documents
R (2) Controlling System Application with hands by identifying movements through Camera

Haptic Holography/Touching the Ethereal

Haptic holography/touching the ethereal Page, Michael

The CHAI Libraries. F. Conti, F. Barbagli, R. Balaniuk, M. Halg, C. Lu, D. Morris L. Sentis, E. Vileshin, J. Warren, O. Khatib, K.

TOUCHABLE HOLOGRAMS AND HAPTIC FEEDBACK: REAL EXPERIENCE IN A VIRTUAL WORLD

E90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright

VIRTUAL REALITY FOR NONDESTRUCTIVE EVALUATION APPLICATIONS

Exhibition Strategy of Digital 3D Data of Object in Archives using Digitally Mediated Technologies for High User Experience

Tracking. Alireza Bahmanpour, Emma Byrne, Jozef Doboš, Victor Mendoza and Pan Ye

THE IMPORTANCE OF PLANNING AND DRAWING IN DESIGN

Project Plan Augmented Reality Mechanic Training

SIU-CAVE. Cave Automatic Virtual Environment. Project Design. Version 1.0 (DRAFT) Prepared for. Dr. Christos Mousas JBU.

Virtual Reality as Innovative Approach to the Interior Designing

DYNAMIC MEDIA INSTITUTE MFA: DESIGN COURSES

Advancements in Gesture Recognition Technology

Video Games and Interfaces: Past, Present and Future Class #2: Intro to Video Game User Interfaces

Saturday Academy Program

A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung,

3D Data Navigation via Natural User Interfaces

WHITE PAPER Need for Gesture Recognition. April 2014

Enhancing Shipboard Maintenance with Augmented Reality

Rapid Development System for Humanoid Vision-based Behaviors with Real-Virtual Common Interface

Digitalisation as day-to-day-business

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty

COURSE OUTLINE. School of Engineering Technology and Applied Science. Applied Biological and Environmental Science (ABES)

Novel machine interface for scaled telesurgery

Mobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt

VR/AR Concepts in Architecture And Available Tools

pcon.planner PRO Plugin VR-Viewer

Introduction to Virtual Reality (based on a talk by Bill Mark)

Geo-Located Content in Virtual and Augmented Reality

Mixed / Augmented Reality in Action

Neural Networks for Real-time Pathfinding in Computer Games

A Step Forward in Virtual Reality. Department of Electrical and Computer Engineering

A maze-solving educational robot with sensors simulated by a pen Thomas Levine and Jason Wright

Release Notes v KINOVA Gen3 Ultra lightweight robot enabled by KINOVA KORTEX

Virtual Co-Location for Crime Scene Investigation and Going Beyond

PROPOSED SYSTEM FOR MID-AIR HOLOGRAPHY PROJECTION USING CONVERSION OF 2D TO 3D VISUALIZATION

Requirements Specification. An MMORPG Game Using Oculus Rift

Viking Chess Using MCTS. Design Document

S. Karthika et al, International Journal of Computer Science and Mobile Computing, Vol.6 Issue.2, February- 2017, pg

ROS Tutorial. Me133a Joseph & Daniel 11/01/2017

Concerning the Potential of Using Game-Based Virtual Environment in Children Therapy

Intelligent interaction

A Step Forward in Virtual Reality. Department of Electrical and Computer Engineering

Virtual Reality in Neuro- Rehabilitation and Beyond

Realistic Robot Simulator Nicolas Ward '05 Advisor: Prof. Maxwell

Virtual Reality Devices in C2 Systems

COMPUTER. 1. PURPOSE OF THE COURSE Refer to each sub-course.

iwindow Concept of an intelligent window for machine tools using augmented reality

Study of self-interference incoherent digital holography for the application of retinal imaging

FORCE FEEDBACK. Roope Raisamo

Bring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events

PRODUCTS DOSSIER. / DEVELOPMENT KIT - VERSION NOVEMBER Product information PAGE 1

Information Session on Graphical User Interface (GUI), Icon and Typeface/Type Font Designs

KINECT HANDS-FREE. Rituj Beniwal. Department of Electrical Engineering Indian Institute of Technology, Kanpur. Pranjal Giri

The use of gestures in computer aided design

GESTUR. Sensing & Feedback Glove for interfacing with Virtual Reality

Digital Photographic Imaging Using MOEMS

Class Title Description Credit Hours Contact Hours Lecture Hours Lab Hours ESU NOTE

REPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism

TOUCH & FEEL VIRTUAL REALITY. DEVELOPMENT KIT - VERSION NOVEMBER 2017

A Hybrid Immersive / Non-Immersive

3D User Interfaces. Using the Kinect and Beyond. John Murray. John Murray

DISCOVERING COMPUTATIONAL STRUCTURES IN ARCHITECTURE

Holographic Stereograms and their Potential in Engineering. Education in a Disadvantaged Environment.

The 8 th International Scientific Conference elearning and software for Education Bucharest, April 26-27, / X

Hologram Table 2018 EUCLIDEON PTY LTD

A Laser-Based Thin-Film Growth Monitor

Adaptive Touch Sampling for Energy-Efficient Mobile Platforms

Gesture Recognition with Real World Environment using Kinect: A Review

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Touch Feedback in a Head-Mounted Display Virtual Reality through a Kinesthetic Haptic Device

Chapter 3 Graphics and Image Data Representations

Air Marshalling with the Kinect

MRT: Mixed-Reality Tabletop

Convention Paper Presented at the 124th Convention 2008 May Amsterdam, The Netherlands

Technologies. Philippe Fuchs Ecole des Mines, ParisTech, Paris, France. Virtual Reality: Concepts and. Guillaume Moreau.

A Kinect-based 3D hand-gesture interface for 3D databases

Holographic Augmented Reality: Towards Near-to-Eye Electroholography

AR 2 kanoid: Augmented Reality ARkanoid

HOLOGRAPHY All rights Reserved. Page 3923

Virtual, augmented and mixed reality: Opportunities for destinations

HCI Design in the OR: A Gesturing Case-Study"

THE Touchless SDK released by Microsoft provides the

Pure Versus Applied Informatics

Activities at SC 24 WG 9: An Overview

Using Simple Force Feedback Mechanisms as Haptic Visualization Tools.

International Journal of Informative & Futuristic Research ISSN (Online):

Computer Graphics. Spring April Ghada Ahmed, PhD Dept. of Computer Science Helwan University

interactive laboratory

Haptic Technology- Comprehensive Review Study with its Applications

SPATIAL POSITIONING SYSTEM

Investigating the Post Processing of LS-DYNA in a Fully Immersive Workflow Environment

ISO JTC 1 SC 24 WG9 G E R A R D J. K I M K O R E A U N I V E R S I T Y

Marco Cavallo. Merging Worlds: A Location-based Approach to Mixed Reality. Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO

High Performance Computing Systems and Scalable Networks for. Information Technology. Joint White Paper from the

Complete Pricing Sheet

Applying Virtual Reality, and Augmented Reality to the Lifecycle Phases of Complex Products

Team 4. Kari Cieslak, Jakob Wulf-Eck, Austin Irvine, Alex Crane, Dylan Vondracek. Project SoundAround

Transcription:

3D Projected Imagery Freespace Control Unit (PIFCU): Design, Implementation, and Analysis Holly Tina Ferguson Department of Computer Science & Engineering MI 2012-2013 Advisor: Dr. Stephen Turner 11/11/2013 Holly Ferguson 2013 IASTED Presentation 1

Today s Discussion Points: 1. Topic Introduced 2. Research Background 3. Presented Solution 4. Construction 5. Combining Control Unit with Sensors 6. Control Translation Path 7. Interface 8. Images of Built Project 9. Possible Future Uses and Conclusion 10. Questions 11/11/2013 Holly Ferguson 2013 IASTED Presentation 2

Topic Introduced: A three-dimensional interactive display system using hardware consisting of an array of linearly adjoining slices of concave mirrored surfaces This work is a proof-of-concept of the Control Unit (PIFCU) and the Interface Freespace (GCIF) which is the sensorized volume of space Translations of control through a visually bounded freespace Removes the need for keyboards and similar interface hardware Provides methods of construction, computer navigation, gaming, as well as a solution for certain physical limitations that traditional computing experiences currently exert on users (i.e. rigid hand angles for typing) 11/11/2013 Holly Ferguson 2013 IASTED Presentation 3

Research Background 1: Background in spatial architectural design Human-interactivity in computing is a personal interest Led to pursuing possibilities for computerized spaces Research began here addressing response to changes 11/11/2013 Holly Ferguson 2013 IASTED Presentation 4

Research Background 2: Sensor System Examples Kinect Binary Sensors Other Depth/Proximity Sensors Sensor Networks Robotics Location Sensing Algorithms NUI/GUI/Windows API Programming Eye Position Sensing/Audio Control * Vermeer Holographic Projection Touchable Holograms (Japanese Scientists) Drawing w/ Hand in Free Space (Pen/pencil/mouse) Microsoft Surface 360* Viewable 3D Display (Cylinder) A variety of SW Engineering Methods, Filter Methods, etc. * 11/11/2013 Holly Ferguson 2013 IASTED Presentation 5

Presented Solution: 11/11/2013 Holly Ferguson 2013 IASTED Presentation 6

Construction 1 11/11/2013 Holly Ferguson 2013 IASTED Presentation 7

Construction 2 11/11/2013 Holly Ferguson 2013 IASTED Presentation 8

Combining Control Unit with Sensors 11/11/2013 Holly Ferguson 2013 IASTED Presentation 9

Control Translation Path 11/11/2013 Holly Ferguson 2013 IASTED Presentation 10

Interface 1 11/11/2013 Holly Ferguson 2013 IASTED Presentation 11

Interface 2 11/11/2013 Holly Ferguson 2013 IASTED Presentation 12

Images of Built Project 11/11/2013 Holly Ferguson 2013 IASTED Presentation 13

Possible Future Uses and Conclusion Allows the creation of a type of holographic control unit Creates a 3D, human occupiable space, acting itself as an interface control system This approach provides freedom from the hardware (mouse, keyboard, etc.) The freedom from the hardware reduces ergonometric strain Setup allows future work to be improved for parallel computing (image side) Setup allows future work to be improved for parallel computing (screen rendering side) Setup allows future work to be improved for parallel computing (sensor field side) Will show both 2D and 3D applications of free-space API controls Could create a type of bridge between usage of current APIs This is not dependent on human/finger touch (i.e. could use a # of moving objects eventually) For later work, could become a layer acting on top of any OS Would have similar benefits to other holographic media The limits of certain parts of this system could act as beneficial in terms of security in the future In the future, could offer a new method to control an interface off-site via video feed This could build on the vast gaming application techniques Industry uses outside computing addressing security issues, hygienic issues, etc. Architectural Design Implications (personal & previous studies) Virtual reality spaces which are free of needing headgear(s) 11/11/2013 Holly Ferguson 2013 IASTED Presentation 14

Questions? Thank you!! 11/11/2013 Holly Ferguson 2013 IASTED Presentation 15