Introduction to Mediated Reality

Size: px
Start display at page:

Download "Introduction to Mediated Reality"

Transcription

1 INTERNATIONAL JOURNAL OF HUMAN COMPUTER INTERACTION, 15(2), Copyright 2003, Lawrence Erlbaum Associates, Inc. Introduction to Mediated Reality Steve Mann Department of Electrical and Computer Engineering University of Toronto Woodrow Barfield School of Law Personal Cybernetics and Humanistic Intelligence are new and rapidly growing fields of research in the area of human-computer interaction. These areas of research involve personal wearable imaging devices with intelligence that arises from the existence of a human user in the feedback loop of a computational process, in which the human user and the computational process are inextricably intertwined. Unlike the typical goal of Artificial Intelligence (AI), which is to emulate human intelligence with computers, Humanistic Intelligence (HI) creates a close synergy in which Intelligent Signal Processing is used to harness the processing power of the human brain. HI gives rise to a symbiosis between human and computer in which each uses the other within a closely coupled signal processing feedback loop. The computer performs basic low-level signal processing functions, using data obtained from a first person perspective (wearable camera, microphones, miniature wearable radar, biosensors, etc.), while the human performs high-level cognitive tasks, providing a computationally mediated reality. Personal Cybernetics and HI form a basis for augmenting, deliberately diminishing, or otherwise mediating the visual perception of reality. Although the visual modality is most often used in mediated reality systems based on current technology, other modalities such as touch, taste, and olfaction may be mediated as well. In the visual domain, a system that can augment, diminish, or otherwise alter the visual perception of reality is called a Reality Mediator (RM). By way of explanation, virtual reality creates a completely computer-generated environment, augmented reality uses an existing, real-life environment, and adds computer-generated information (virtual objects) thereto, diminished reality filters the environment (i.e., it alters real objects, replaces them with virtual ones, or renders them imperceptible), and mediated reality combines augmented and dimin- Requests for reprints should be sent to Steve Mann, University of Toronto, Department of Electrical and Computer Engineering, Room SF 2001, 10 King s College Road, Toronto, ONT M53 3G4 Canada. mann@eecg.toronto.edu

2 206 Mann and Barfield ished reality. Reality Mediators are useful, for example, in applications involving the visually challenged. In such applications, RMs simplify the visual information presented to the wearer. Mediated reality may also serve as a framework for filtering out real-world spam (advertising billboards, etc.) and for allowing individuals to communicate with one another by altering each other s perception of reality. In mediated reality, a wearer of the apparatus (e.g., glasses, sensors) may, for example, be shopping at a grocery store while a remote spouse/friend can view a transmitted video in a stabilized coordinate system and then draw directly on the retina of the wearer of the glasses using a directed (computer controlled) laser beam, such as that made possible with the Eye Tap (TM) technology when connected to a Xybernaut (TM) wearable computer system. In this way, a remote individual could collaborate with the wearer of the apparatus in everyday experiences like shopping for a new car, sightseeing, and so forth. In addition to the current direction of research in HI (e.g., Personal Imaging, and the field of Personal Technologies in general), this special issue includes articles in the field of Rehabilitative Medicine. In particular, prosthetic devices that improve the quality of the everyday lives of the visually challenged whether at work, at play, or just walking down the street constitute an important part of this new research field. Mediated reality is at the intersection of four related fields: 1. Telephone, wireless communications, videoconferencing, and so forth. 2. Photography/videography, electronic newsgathering (ENG), and so forth. 3. Visual science, (e.g., optometry, visual aids, and night vision systems). 4. Human-computer interaction (HCI). The special issue is comprised of six articles documenting research generally on the following topics. These topics represent some of the current areas of research and interest for the emerging field of mediated reality. 1. Image processing for Personal Imaging systems. 2. Signal processing for Wearable Cybernetics. 3. Wearable visual information processing. 4. Wearable applications of image processing. 5. Video-based personal safety devices for use by ordinary citizens to help them participate in crime reduction. 6. Fusion of wearable video and other sensing modalities. 7. Visual and other modality prostheses. 8. Videographic/photographic memory prostheses. 9. Visualization and data dissemination from personal imaging systems. 10. Innovative vision-based devices and systems. 11. Innovative eyewear. 12. Vision aids for the blind or partially sighted. 13. Night Vision Goggles (NVG) and low-light visual aids. 14. Vision aids for those with visual memory or visual processing disability. 15. Innovative wearable video display or processing technologies. 16. Visual pattern recognition systems suitable for use in personal imaging.

3 Introduction to Mediated Reality Computer supported collaborative living. 18. VideoOrbits image processing and algebraic projective geometr. 19. Collaborative cybernetic photography/videography and shared visual space. 20. New paradigms in photography, videography, photojournalism, and wearable electronic new gathering. 21. Signal processing of Eye Tap video signals and systems. 22. Issues in User-Interface Design. 23. Empirical studies. In the first article, Early Experiences of Visual Memory Prosthesis for Supporting Episodic Memory, Hoisko (this issue) describes a visual memory prosthesis based on a wearable camera system, which has its motivations in mediated reality. Indeed, a very important aspect of mediated reality is that of temporally mediated reality (e.g., computer induced flashbacks of previously seen items can be used as a photographic visual memory recall). In A Wearable Mobility Aid for Low Vision Using Scene Classification in a Markov Random Field Model Framework, Everingham, Thomas, and Troscianko (this issue) describe a system of great potential use to the visually challenged. Further, in Testing Visual Search Performance Using Retinal Light Scanning as a Future Wearable Low Vision Aid, Lin, Seibel, and Furness (this issue) describe the results of a study conducted to determine if a display and camera system can be used as a low vision aid. In this study, camera bearing headgear with a head worn display provide a classic form of reality mediator, which shows great promise for the visually challenged. Next, in Mediated Reality Through Glasses or Binoculars? Exploring Use Models of Wearable Computing in the Context of Aircraft Maintenance, Fallman (this issue) explores use models of wearable computing in the context of aircraft maintenance. Findings of an interpretive case study conducted at Scandinavian Airlines Systems, the largest commercial airline in Scandinavia, are presented, with respect to the usefulness of mediated reality in a real world setting. In Seeing with the Brain, Bach-y-Rita (this issue) addresses the plasticity of the brain, and the process of visual learning. In this work, images are augmented by nonsynaptic and other brain plasticity mechanisms, within the context of the cognitive value of information passing into the brain. Finally, in The Internet Chair, Cohen (this issue) describes a new kind of user interface based on an Internet connected chair. This represents a different kind of mediated reality than one might think of within the classic wearable camera and display apparatus. The Internet Chair is a spatial media interface, which combines the closeness of clothing and eyeglasses with the external properties of an intelligent environment. Thus, it shows an example of a departure from the traditional clothing and eyeglass based forms of Reality Mediators. REFERENCES Bach-y-Rita, P., Tyler, M. E., & Kaczmarek, K. (2003). Seeing with the brain. International Journal of Human-Computer Interaction, 15,

4 208 Mann and Barfield Cohen, M. (2003). The internet chair. International Journal of Human-Computer Interaction, 15, Everingham, M. R., Thomas, B. T., & Troskianko, T. (2003). A wearable mobility aid for low vision using scene classification in a Markov random field model framework. International Journal of Human-Computer Interaction, 15, Fallman, D. (2003). Mediated reality through glasses or binoculars? Exploring use models of wearable computing in the context of aircraft maintenance. International Journal of Human-Computer Interaction, 15, Hoisko, J. (2003). Early experiences of visual memory prosthesis for supporting episodic memory. International Journal of Human-Computer Interaction, 15, Lin, S.-K., Seibel, E. J., & Furness, T. A., III. (2003). Testing visual search performance using retinal light scanning as a future wearable low vision aid. International Journal of Human-Computer Interaction, 15,

5

Wearable Computing: Towards Humanistic Intelligence

Wearable Computing: Towards Humanistic Intelligence Wearable Computing: Towards istic Intelligence Steve Mann 100 Abstract istic Intelligence (HI) is a new signal processing framework in which (1) intelligence arises by having the human being in the feedback

More information

Interior Design using Augmented Reality Environment

Interior Design using Augmented Reality Environment Interior Design using Augmented Reality Environment Kalyani Pampattiwar 2, Akshay Adiyodi 1, Manasvini Agrahara 1, Pankaj Gamnani 1 Assistant Professor, Department of Computer Engineering, SIES Graduate

More information

Towards Wearable Gaze Supported Augmented Cognition

Towards Wearable Gaze Supported Augmented Cognition Towards Wearable Gaze Supported Augmented Cognition Andrew Toshiaki Kurauchi University of São Paulo Rua do Matão 1010 São Paulo, SP kurauchi@ime.usp.br Diako Mardanbegi IT University, Copenhagen Rued

More information

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT TAYSHENG JENG, CHIA-HSUN LEE, CHI CHEN, YU-PIN MA Department of Architecture, National Cheng Kung University No. 1, University Road,

More information

Abdulmotaleb El Saddik Associate Professor Dr.-Ing., SMIEEE, P.Eng.

Abdulmotaleb El Saddik Associate Professor Dr.-Ing., SMIEEE, P.Eng. Abdulmotaleb El Saddik Associate Professor Dr.-Ing., SMIEEE, P.Eng. Multimedia Communications Research Laboratory University of Ottawa Ontario Research Network of E-Commerce www.mcrlab.uottawa.ca abed@mcrlab.uottawa.ca

More information

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS ACCENTURE LABS DUBLIN Artificial Intelligence Security SILICON VALLEY Digital Experiences Artificial Intelligence

More information

UNIT 2 TOPICS IN COMPUTER SCIENCE. Emerging Technologies and Society

UNIT 2 TOPICS IN COMPUTER SCIENCE. Emerging Technologies and Society UNIT 2 TOPICS IN COMPUTER SCIENCE Emerging Technologies and Society EMERGING TECHNOLOGIES Technology has become perhaps the greatest agent of change in the modern world. While never without risk, positive

More information

September November 2010

September November 2010 September November 2010 51 November 2008 52 October 2010 53 February 2014 54 December 2010 55 December 2010, January 2011 56 November 2012 57 December 2009 58 December 2013 59 December 2013 60 Electronic

More information

Enhancing Shipboard Maintenance with Augmented Reality

Enhancing Shipboard Maintenance with Augmented Reality Enhancing Shipboard Maintenance with Augmented Reality CACI Oxnard, CA Dennis Giannoni dgiannoni@caci.com (805) 288-6630 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED. Agenda Virtual

More information

Augmented Reality. Virtuelle Realität Wintersemester 2007/08. Overview. Part 14:

Augmented Reality. Virtuelle Realität Wintersemester 2007/08. Overview. Part 14: Part 14: Augmented Reality Virtuelle Realität Wintersemester 2007/08 Prof. Bernhard Jung Overview Introduction to Augmented Reality Augmented Reality Displays Examples AR Toolkit an open source software

More information

Virtual Tactile Maps

Virtual Tactile Maps In: H.-J. Bullinger, J. Ziegler, (Eds.). Human-Computer Interaction: Ergonomics and User Interfaces. Proc. HCI International 99 (the 8 th International Conference on Human-Computer Interaction), Munich,

More information

ELG 5121/CSI 7631 Fall Projects Overview. Projects List

ELG 5121/CSI 7631 Fall Projects Overview. Projects List ELG 5121/CSI 7631 Fall 2009 Projects Overview Projects List X-Reality Affective Computing Brain-Computer Interaction Ambient Intelligence Web 3.0 Biometrics: Identity Verification in a Networked World

More information

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real... v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)

More information

First day quiz Introduction to HCI

First day quiz Introduction to HCI First day quiz Introduction to HCI CS 3724 Doug A. Bowman You are on a team tasked with developing new order tracking and management software for amazon.com. Your goal is to deliver a high quality piece

More information

VR based HCI Techniques & Application. November 29, 2002

VR based HCI Techniques & Application. November 29, 2002 VR based HCI Techniques & Application November 29, 2002 stefan.seipel@hci.uu.se What is Virtual Reality? Coates (1992): Virtual Reality is electronic simulations of environments experienced via head mounted

More information

Mario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality

Mario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality Mario Romero 2014/11/05 Multimodal Interaction and Interfaces Mixed Reality Outline Who am I and how I can help you? What is the Visualization Studio? What is Mixed Reality? What can we do for you? What

More information

This list supersedes the one published in the November 2002 issue of CR.

This list supersedes the one published in the November 2002 issue of CR. PERIODICALS RECEIVED This is the current list of periodicals received for review in Reviews. International standard serial numbers (ISSNs) are provided to facilitate obtaining copies of articles or subscriptions.

More information

Who are these people? Introduction to HCI

Who are these people? Introduction to HCI Who are these people? Introduction to HCI Doug Bowman Qing Li CS 3724 Fall 2005 (C) 2005 Doug Bowman, Virginia Tech CS 2 First things first... Why are you taking this class? (be honest) What do you expect

More information

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa VIRTUAL REALITY Introduction Emil M. Petriu SITE, University of Ottawa Natural and Virtual Reality Virtual Reality Interactive Virtual Reality Virtualized Reality Augmented Reality HUMAN PERCEPTION OF

More information

Leading the Agenda. Everyday technology: A focus group with children, young people and their carers

Leading the Agenda. Everyday technology: A focus group with children, young people and their carers Leading the Agenda Everyday technology: A focus group with children, young people and their carers March 2018 1 1.0 Introduction Assistive technology is an umbrella term that includes assistive, adaptive,

More information

Title: A Comparison of Different Tactile Output Devices In An Aviation Application

Title: A Comparison of Different Tactile Output Devices In An Aviation Application Page 1 of 6; 12/2/08 Thesis Proposal Title: A Comparison of Different Tactile Output Devices In An Aviation Application Student: Sharath Kanakamedala Advisor: Christopher G. Prince Proposal: (1) Provide

More information

Over the past 20 years, wearable computing has emerged as the perfect tool for

Over the past 20 years, wearable computing has emerged as the perfect tool for G u e s t E d i t o r s I n t r o d u c t i o n Wearable Computing: Toward istic Intelligence Steve Mann, University of Toronto Over the past 20 years, wearable computing has emerged as the perfect tool

More information

Paper on: Optical Camouflage

Paper on: Optical Camouflage Paper on: Optical Camouflage PRESENTED BY: I. Harish teja V. Keerthi E.C.E E.C.E E-MAIL: Harish.teja123@gmail.com kkeerthi54@gmail.com 9533822365 9866042466 ABSTRACT: Optical Camouflage delivers a similar

More information

Harnessing the 4th Industrial Revolution. Professor Mark Esposito Harvard University & Nexus

Harnessing the 4th Industrial Revolution. Professor Mark Esposito Harvard University & Nexus Harnessing the 4th Industrial Revolution Professor Mark Esposito Harvard University & Nexus FrontierTech @Exp_Mark Technology Foresight Series Summary 4 th Industrial Revolution Five emerging technologies

More information

Technology designed to empower people

Technology designed to empower people Edition July 2018 Smart Health, Wearables, Artificial intelligence Technology designed to empower people Through new interfaces - close to the body - technology can enable us to become more aware of our

More information

Why interest in visual perception?

Why interest in visual perception? Raffaella Folgieri Digital Information & Communication Departiment Constancy factors in visual perception 26/11/2010, Gjovik, Norway Why interest in visual perception? to investigate main factors in VR

More information

Haptic holography/touching the ethereal Page, Michael

Haptic holography/touching the ethereal Page, Michael OCAD University Open Research Repository Faculty of Design 2013 Haptic holography/touching the ethereal Page, Michael Suggested citation: Page, Michael (2013) Haptic holography/touching the ethereal. Journal

More information

Digital image processing vs. computer vision Higher-level anchoring

Digital image processing vs. computer vision Higher-level anchoring Digital image processing vs. computer vision Higher-level anchoring Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics Center for Machine Perception

More information

6 Ubiquitous User Interfaces

6 Ubiquitous User Interfaces 6 Ubiquitous User Interfaces Viktoria Pammer-Schindler May 3, 2016 Ubiquitous User Interfaces 1 Days and Topics March 1 March 8 March 15 April 12 April 26 (10-13) April 28 (9-14) May 3 May 10 Administrative

More information

HELPING THE DESIGN OF MIXED SYSTEMS

HELPING THE DESIGN OF MIXED SYSTEMS HELPING THE DESIGN OF MIXED SYSTEMS Céline Coutrix Grenoble Informatics Laboratory (LIG) University of Grenoble 1, France Abstract Several interaction paradigms are considered in pervasive computing environments.

More information

YDDON. Humans, Robots, & Intelligent Objects New communication approaches

YDDON. Humans, Robots, & Intelligent Objects New communication approaches YDDON Humans, Robots, & Intelligent Objects New communication approaches Building Robot intelligence Interdisciplinarity Turning things into robots www.ydrobotics.co m Edifício A Moagem Cidade do Engenho

More information

Insights into High-level Visual Perception

Insights into High-level Visual Perception Insights into High-level Visual Perception or Where You Look is What You Get Jeff B. Pelz Visual Perception Laboratory Carlson Center for Imaging Science Rochester Institute of Technology Students Roxanne

More information

What will the robot do during the final demonstration?

What will the robot do during the final demonstration? SPENCER Questions & Answers What is project SPENCER about? SPENCER is a European Union-funded research project that advances technologies for intelligent robots that operate in human environments. Such

More information

Integrated Vision and Sound Localization

Integrated Vision and Sound Localization Integrated Vision and Sound Localization Parham Aarabi Safwat Zaky Department of Electrical and Computer Engineering University of Toronto 10 Kings College Road, Toronto, Ontario, Canada, M5S 3G4 parham@stanford.edu

More information

IT and Systems Science Transformational Impact on Technology, Society, Work, Life, Education, Training

IT and Systems Science Transformational Impact on Technology, Society, Work, Life, Education, Training IT and Systems Science Transformational Impact on Technology, Society, Work, Life, Education, Training John S. Baras Institute for Systems Research and Dept. of Electrical and Computer Engin. University

More information

IMAGE PROCESSING PAPER PRESENTATION ON IMAGE PROCESSING

IMAGE PROCESSING PAPER PRESENTATION ON IMAGE PROCESSING IMAGE PROCESSING PAPER PRESENTATION ON IMAGE PROCESSING PRESENTED BY S PRADEEP K SUNIL KUMAR III BTECH-II SEM, III BTECH-II SEM, C.S.E. C.S.E. pradeep585singana@gmail.com sunilkumar5b9@gmail.com CONTACT:

More information

TABLE OF CONTENTS INTRODUCTION...04 PART I - HEALTH LEARNING...08 PART II - DEVICE LEARNING...12 PART III - BUILD...16 PART IV - DATA COLLECTION...

TABLE OF CONTENTS INTRODUCTION...04 PART I - HEALTH LEARNING...08 PART II - DEVICE LEARNING...12 PART III - BUILD...16 PART IV - DATA COLLECTION... YOUTH GUIDE ENGINEER NOTES TABLE OF CONTENTS INTRODUCTION...04 PART I - HEALTH LEARNING...08 PART II - DEVICE LEARNING...12 PART III - BUILD...16 PART IV - DATA COLLECTION...18 PART V - COOL DOWN...22

More information

Haptic Holography/Touching the Ethereal

Haptic Holography/Touching the Ethereal Journal of Physics: Conference Series Haptic Holography/Touching the Ethereal To cite this article: Michael Page 2013 J. Phys.: Conf. Ser. 415 012041 View the article online for updates and enhancements.

More information

P1.4. Light has to go where it is needed: Future Light Based Driver Assistance Systems

P1.4. Light has to go where it is needed: Future Light Based Driver Assistance Systems Light has to go where it is needed: Future Light Based Driver Assistance Systems Thomas Könning¹, Christian Amsel¹, Ingo Hoffmann² ¹ Hella KGaA Hueck & Co., Lippstadt, Germany ² Hella-Aglaia Mobile Vision

More information

Ubiquitous Home Simulation Using Augmented Reality

Ubiquitous Home Simulation Using Augmented Reality Proceedings of the 2007 WSEAS International Conference on Computer Engineering and Applications, Gold Coast, Australia, January 17-19, 2007 112 Ubiquitous Home Simulation Using Augmented Reality JAE YEOL

More information

Computer Graphics. Spring April Ghada Ahmed, PhD Dept. of Computer Science Helwan University

Computer Graphics. Spring April Ghada Ahmed, PhD Dept. of Computer Science Helwan University Spring 2018 10 April 2018, PhD ghada@fcih.net Agenda Augmented reality (AR) is a field of computer research which deals with the combination of real-world and computer-generated data. 2 Augmented reality

More information

A vision system for providing 3D perception of the environment via: transcutaneous electro-neural stimulation

A vision system for providing 3D perception of the environment via: transcutaneous electro-neural stimulation University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2004 A vision system for providing 3D perception of the environment via:

More information

Visual Resonator: Interface for Interactive Cocktail Party Phenomenon

Visual Resonator: Interface for Interactive Cocktail Party Phenomenon Visual Resonator: Interface for Interactive Cocktail Party Phenomenon Junji Watanabe PRESTO Japan Science and Technology Agency 3-1, Morinosato Wakamiya, Atsugi-shi, Kanagawa, 243-0198, Japan watanabe@avg.brl.ntt.co.jp

More information

Access Invaders: Developing a Universally Accessible Action Game

Access Invaders: Developing a Universally Accessible Action Game ICCHP 2006 Thursday, 13 July 2006 Access Invaders: Developing a Universally Accessible Action Game Dimitris Grammenos, Anthony Savidis, Yannis Georgalis, Constantine Stephanidis Human-Computer Interaction

More information

Recent Progress on Wearable Augmented Interaction at AIST

Recent Progress on Wearable Augmented Interaction at AIST Recent Progress on Wearable Augmented Interaction at AIST Takeshi Kurata 12 1 Human Interface Technology Lab University of Washington 2 AIST, Japan kurata@ieee.org Weavy The goal of the Weavy project team

More information

Immersive Training. David Lafferty President of Scientific Technical Services And ARC Associate

Immersive Training. David Lafferty President of Scientific Technical Services And ARC Associate Immersive Training David Lafferty President of Scientific Technical Services And ARC Associate Current Situation Great Shift Change Drive The Need For Training Conventional Training Methods Are Expensive

More information

Intelligent interaction

Intelligent interaction BionicWorkplace: autonomously learning workstation for human-machine collaboration Intelligent interaction Face to face, hand in hand. The BionicWorkplace shows the extent to which human-machine collaboration

More information

Mixed / Augmented Reality in Action

Mixed / Augmented Reality in Action Mixed / Augmented Reality in Action AR: Augmented Reality Augmented reality (AR) takes your existing reality and changes aspects of it through the lens of a smartphone, a set of glasses, or even a headset.

More information

Effective Iconography....convey ideas without words; attract attention...

Effective Iconography....convey ideas without words; attract attention... Effective Iconography...convey ideas without words; attract attention... Visual Thinking and Icons An icon is an image, picture, or symbol representing a concept Icon-specific guidelines Represent the

More information

NCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects

NCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects NCCT Promise for the Best Projects IEEE PROJECTS in various Domains Latest Projects, 2009-2010 ADVANCED ROBOTICS SOLUTIONS EMBEDDED SYSTEM PROJECTS Microcontrollers VLSI DSP Matlab Robotics ADVANCED ROBOTICS

More information

Projection Based HCI (Human Computer Interface) System using Image Processing

Projection Based HCI (Human Computer Interface) System using Image Processing GRD Journals- Global Research and Development Journal for Volume 1 Issue 5 April 2016 ISSN: 2455-5703 Projection Based HCI (Human Computer Interface) System using Image Processing Pankaj Dhome Sagar Dhakane

More information

Haptic presentation of 3D objects in virtual reality for the visually disabled

Haptic presentation of 3D objects in virtual reality for the visually disabled Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,

More information

Mission Space. Value-based use of augmented reality in support of critical contextual environments

Mission Space. Value-based use of augmented reality in support of critical contextual environments Mission Space Value-based use of augmented reality in support of critical contextual environments Vicki A. Barbur Ph.D. Senior Vice President and Chief Technical Officer Concurrent Technologies Corporation

More information

Wearable Technology Show 2017: New Developments in Smart Apparel and Mixed Reality

Wearable Technology Show 2017: New Developments in Smart Apparel and Mixed Reality Wearable Technology Show 2017: New Developments in Smart Apparel and Mixed Reality 1) The Fung Global Retail & Technology team attended the Wearable Technology Show 2017 in London this week. During the

More information

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics

Chapter 2 Introduction to Haptics 2.1 Definition of Haptics Chapter 2 Introduction to Haptics 2.1 Definition of Haptics The word haptic originates from the Greek verb hapto to touch and therefore refers to the ability to touch and manipulate objects. The haptic

More information

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many Preface The jubilee 25th International Conference on Robotics in Alpe-Adria-Danube Region, RAAD 2016 was held in the conference centre of the Best Western Hotel M, Belgrade, Serbia, from 30 June to 2 July

More information

VICs: A Modular Vision-Based HCI Framework

VICs: A Modular Vision-Based HCI Framework VICs: A Modular Vision-Based HCI Framework The Visual Interaction Cues Project Guangqi Ye, Jason Corso Darius Burschka, & Greg Hager CIRL, 1 Today, I ll be presenting work that is part of an ongoing project

More information

Logic Programming. Dr. : Mohamed Mostafa

Logic Programming. Dr. : Mohamed Mostafa Dr. : Mohamed Mostafa Logic Programming E-mail : Msayed@afmic.com Text Book: Learn Prolog Now! Author: Patrick Blackburn, Johan Bos, Kristina Striegnitz Publisher: College Publications, 2001. Useful references

More information

Seeing with the Brain Paul Bach-y-Rita, Mitchell E. Tyler & Kurt A. Kaczmarek Published online: 13 Nov 2009.

Seeing with the Brain Paul Bach-y-Rita, Mitchell E. Tyler & Kurt A. Kaczmarek Published online: 13 Nov 2009. This article was downloaded by: [Lulea University of Technology] On: 25 June 2015, At: 06:24 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered

More information

Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction

Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction Minghao Cai 1(B), Soh Masuko 2, and Jiro Tanaka 1 1 Waseda University, Kitakyushu, Japan mhcai@toki.waseda.jp, jiro@aoni.waseda.jp

More information

OUR RELENTLESS PURSUIT: Applying 3D Video / VR /AR ON THE ROAD TO ZERO

OUR RELENTLESS PURSUIT: Applying 3D Video / VR /AR ON THE ROAD TO ZERO OUR RELENTLESS PURSUIT: Applying 3D Video / VR /AR ON THE ROAD TO ZERO Consumers Energy Doug Hill 3DInternet Brian Doubinin Dramatic drop of 37% in recordables. Best in Company History. (2007 to 2008)

More information

Application Areas of AI Artificial intelligence is divided into different branches which are mentioned below:

Application Areas of AI   Artificial intelligence is divided into different branches which are mentioned below: Week 2 - o Expert Systems o Natural Language Processing (NLP) o Computer Vision o Speech Recognition And Generation o Robotics o Neural Network o Virtual Reality APPLICATION AREAS OF ARTIFICIAL INTELLIGENCE

More information

Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment

Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment Helmut Schrom-Feiertag 1, Christoph Schinko 2, Volker Settgast 3, and Stefan Seer 1 1 Austrian

More information

Medical Robotics. Part II: SURGICAL ROBOTICS

Medical Robotics. Part II: SURGICAL ROBOTICS 5 Medical Robotics Part II: SURGICAL ROBOTICS In the last decade, surgery and robotics have reached a maturity that has allowed them to be safely assimilated to create a new kind of operating room. This

More information

What is Augmented Reality?

What is Augmented Reality? What is Augmented Reality? Well, this is clearly a good place to start. I ll explain what Augmented Reality (AR) is, and then what the typical applications are. We re going to concentrate on only one area

More information

COPYRIGHTED MATERIAL. Overview

COPYRIGHTED MATERIAL. Overview In normal experience, our eyes are constantly in motion, roving over and around objects and through ever-changing environments. Through this constant scanning, we build up experience data, which is manipulated

More information

sclera pupil What happens to light that enters the eye?

sclera pupil What happens to light that enters the eye? Human Vision Textbook pages 202 215 Before You Read Some people can see things clearly from a great distance. Other people can see things clearly only when they are nearby. Why might this be? Write your

More information

Geo-Located Content in Virtual and Augmented Reality

Geo-Located Content in Virtual and Augmented Reality Technical Disclosure Commons Defensive Publications Series October 02, 2017 Geo-Located Content in Virtual and Augmented Reality Thomas Anglaret Follow this and additional works at: http://www.tdcommons.org/dpubs_series

More information

Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1

Ubiquitous Computing Summer Episode 16: HCI. Hannes Frey and Peter Sturm University of Trier. Hannes Frey and Peter Sturm, University of Trier 1 Episode 16: HCI Hannes Frey and Peter Sturm University of Trier University of Trier 1 Shrinking User Interface Small devices Narrow user interface Only few pixels graphical output No keyboard Mobility

More information

COPYRIGHTED MATERIAL OVERVIEW 1

COPYRIGHTED MATERIAL OVERVIEW 1 OVERVIEW 1 In normal experience, our eyes are constantly in motion, roving over and around objects and through ever-changing environments. Through this constant scanning, we build up experiential data,

More information

Available theses in robotics (March 2018) Prof. Paolo Rocco Prof. Andrea Maria Zanchettin

Available theses in robotics (March 2018) Prof. Paolo Rocco Prof. Andrea Maria Zanchettin Available theses in robotics (March 2018) Prof. Paolo Rocco Prof. Andrea Maria Zanchettin Ergonomic positioning of bulky objects Thesis 1 Robot acts as a 3rd hand for workpiece positioning: Muscular fatigue

More information

Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza

Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza Reinventing movies How do we tell stories in VR? Diego Gutierrez Graphics & Imaging Lab Universidad de Zaragoza Computer Graphics Computational Imaging Virtual Reality Joint work with: A. Serrano, J. Ruiz-Borau

More information

An Introduction to Geomatics. Prepared by: Dr. Maher A. El-Hallaq خاص بطلبة مساق مقدمة في علم. Associate Professor of Surveying IUG

An Introduction to Geomatics. Prepared by: Dr. Maher A. El-Hallaq خاص بطلبة مساق مقدمة في علم. Associate Professor of Surveying IUG An Introduction to Geomatics خاص بطلبة مساق مقدمة في علم الجيوماتكس Prepared by: Dr. Maher A. El-Hallaq Associate Professor of Surveying IUG 1 Airborne Imagery Dr. Maher A. El-Hallaq Associate Professor

More information

Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules.

Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules. Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules. Period 1: 27.8.2018 26.10.2018 MODULE INTRODUCTION TO AUTOMATION ENGINEERING This module introduces the

More information

Perception platform and fusion modules results. Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event

Perception platform and fusion modules results. Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event Perception platform and fusion modules results Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event 20 th -21 st November 2013 Agenda Introduction Environment Perception in Intelligent Transport

More information

SMART ELECTRONIC GADGET FOR VISUALLY IMPAIRED PEOPLE

SMART ELECTRONIC GADGET FOR VISUALLY IMPAIRED PEOPLE ISSN: 0976-2876 (Print) ISSN: 2250-0138 (Online) SMART ELECTRONIC GADGET FOR VISUALLY IMPAIRED PEOPLE L. SAROJINI a1, I. ANBURAJ b, R. ARAVIND c, M. KARTHIKEYAN d AND K. GAYATHRI e a Assistant professor,

More information

Building Spatial Experiences in the Automotive Industry

Building Spatial Experiences in the Automotive Industry Building Spatial Experiences in the Automotive Industry i-know Data-driven Business Conference Franz Weghofer franz.weghofer@magna.com Video Agenda Digital Factory - Data Backbone of all Virtual Representations

More information

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Perceptual Interfaces Adapted from Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Outline Why Perceptual Interfaces? Multimodal interfaces Vision

More information

- Basics of informatics - Computer network - Software engineering - Intelligent media processing - Human interface. Professor. Professor.

- Basics of informatics - Computer network - Software engineering - Intelligent media processing - Human interface. Professor. Professor. - Basics of informatics - Computer network - Software engineering - Intelligent media processing - Human interface Computer-Aided Engineering Research of power/signal integrity analysis and EMC design

More information

Yokohama City University lecture INTRODUCTION TO HUMAN VISION Presentation notes 7/10/14

Yokohama City University lecture INTRODUCTION TO HUMAN VISION Presentation notes 7/10/14 Yokohama City University lecture INTRODUCTION TO HUMAN VISION Presentation notes 7/10/14 1. INTRODUCTION TO HUMAN VISION Self introduction Dr. Salmon Northeastern State University, Oklahoma. USA Teach

More information

- applications on same or different network node of the workstation - portability of application software - multiple displays - open architecture

- applications on same or different network node of the workstation - portability of application software - multiple displays - open architecture 12 Window Systems - A window system manages a computer screen. - Divides the screen into overlapping regions. - Each region displays output from a particular application. X window system is widely used

More information

Augmented Presentation of Animal and Environmental Data

Augmented Presentation of Animal and Environmental Data Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of Osnabrueck Christian Plass and Manfred Ehlers Institute for Geoinformatics and Remote Sensing

More information

Challenges for AI: Mobile Robots on Construction Sites. Tim Detert

Challenges for AI: Mobile Robots on Construction Sites. Tim Detert Challenges for AI: Mobile Robots on Construction Sites Tim Detert Challenges for AI: Mobile Robots on Construction Sites What will Mobile Robots on Construction Sites be Like? In the future it eventually

More information

PROJECT BAT-EYE. Developing an Economic System that can give a Blind Person Basic Spatial Awareness and Object Identification.

PROJECT BAT-EYE. Developing an Economic System that can give a Blind Person Basic Spatial Awareness and Object Identification. PROJECT BAT-EYE Developing an Economic System that can give a Blind Person Basic Spatial Awareness and Object Identification. Debargha Ganguly royal.debargha@gmail.com ABSTRACT- Project BATEYE fundamentally

More information

Aiming to Realize People-Oriented IoT and an 8K Ecosystem

Aiming to Realize People-Oriented IoT and an 8K Ecosystem Aiming to Realize People-Oriented IoT and an 8K Ecosystem Sharp's Vision for the Future Sharp envisions a society in which people-oriented devices will enrich our lives as new partners. A future where

More information

Sensation & Perception

Sensation & Perception Sensation & Perception What is sensation & perception? Detection of emitted or reflected by Done by sense organs Process by which the and sensory information Done by the How does work? receptors detect

More information

Summary of the Report by Study Group for Higher Quality of Life through Utilization of IoT and Other Digital Tools Introduced into Lifestyle Products

Summary of the Report by Study Group for Higher Quality of Life through Utilization of IoT and Other Digital Tools Introduced into Lifestyle Products Summary of the Report by Study Group for Higher Quality of Life through Utilization of IoT and Other Digital Tools Introduced into Lifestyle Products 1. Problem awareness As consumers sense of value and

More information

ARTIFICIAL INTELLIGENCE - ROBOTICS

ARTIFICIAL INTELLIGENCE - ROBOTICS ARTIFICIAL INTELLIGENCE - ROBOTICS http://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_robotics.htm Copyright tutorialspoint.com Robotics is a domain in artificial intelligence

More information

Service Robots in an Intelligent House

Service Robots in an Intelligent House Service Robots in an Intelligent House Jesus Savage Bio-Robotics Laboratory biorobotics.fi-p.unam.mx School of Engineering Autonomous National University of Mexico UNAM 2017 OUTLINE Introduction A System

More information

Cognitive Science: What Is It, and How Can I Study It at RPI?

Cognitive Science: What Is It, and How Can I Study It at RPI? Cognitive Science: What Is It, and How Can I Study It at RPI? What is Cognitive Science? Cognitive Science: Aspects of Cognition Cognitive science is the science of cognition, which includes such things

More information

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 Product Vision Company Introduction Apostera GmbH with headquarter in Munich, was

More information

Glossary of terms. Short explanation

Glossary of terms. Short explanation Glossary Concept Module. Video Short explanation Abstraction 2.4 Capturing the essence of the behavior of interest (getting a model or representation) Action in the control Derivative 4.2 The control signal

More information

Overview: Emerging Technologies and Issues

Overview: Emerging Technologies and Issues Overview: Emerging Technologies and Issues Marie Sicat Introduction to the Course on Digital Commerce and Emerging Technologies DiploFoundation, UNCTAD, CUTS, ITC, GIP UNCTAD E-commerce Week (18 April

More information

OASIS. The new generation of BCI

OASIS. The new generation of BCI The new generation of BCI Brain Computer Interface Effectively merging in symbiotic way with digital intelligence evolves around eliminating the i/o constraint Elon Musk BCI device for the exchange (input/output)

More information

Lecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex

Lecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex Lecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex 1.Vision Science 2.Visual Performance 3.The Human Visual System 4.The Retina 5.The Visual Field and

More information

Industry 4.0: the new challenge for the Italian textile machinery industry

Industry 4.0: the new challenge for the Italian textile machinery industry Industry 4.0: the new challenge for the Italian textile machinery industry Executive Summary June 2017 by Contacts: Economics & Press Office Ph: +39 02 4693611 email: economics-press@acimit.it ACIMIT has

More information

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study

Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Multisensory Virtual Environment for Supporting Blind Persons' Acquisition of Spatial Cognitive Mapping a Case Study Orly Lahav & David Mioduser Tel Aviv University, School of Education Ramat-Aviv, Tel-Aviv,

More information

Accelerating Collective Innovation: Investing in the Innovation Landscape

Accelerating Collective Innovation: Investing in the Innovation Landscape PCB Executive Forum Accelerating Collective Innovation: Investing in the Innovation Landscape How a Major Player Uses Internal Venture Program to Accelerate Small Players with Big Ideas Dr. Joan K. Vrtis

More information

Introduction to Haptics

Introduction to Haptics Introduction to Haptics Roope Raisamo Multimodal Interaction Research Group Tampere Unit for Computer Human Interaction (TAUCHI) Department of Computer Sciences University of Tampere, Finland Definition

More information

제 1 HCI Korea, 증강현실전시기술의적용사례및분석. Woontack Woo ( 우운택 ), Ph.D. KAIST GSCT UVR Lab. Tw

제 1 HCI Korea, 증강현실전시기술의적용사례및분석. Woontack Woo ( 우운택 ), Ph.D. KAIST GSCT UVR Lab. Tw 제 1 회전시공학워크샵 @ HCI Korea, 2013.2.1 증강현실전시기술의적용사례및분석 Woontack Woo ( 우운택 ), Ph.D. KAIST GSCT UVR Lab. Tw : @wwoo_ct FB: @wtwoo Virtual vs. Augmented Reality Virtual Reality (out there): Puts people in a

More information