Computer Vision in Human-Computer Interaction

Size: px
Start display at page:

Download "Computer Vision in Human-Computer Interaction"

Transcription

1 Invited talk in 2010 Autumn Seminar and Meeting of Pattern Recognition Society of Finland, M/S Baltic Princess, Computer Vision in Human-Computer Interaction Matti Pietikäinen Machine Vision Group Department of Electrical and Information Engineering and Infotech Oulu University of Oulu, Finland Contents Introduction: Example applications Case project: Affective human-robot interaction Research on key computer vision methods for HCI in Oulu Case project: Vision-based mobile HCI Some challenges for future research

2 Example application: Microsoft s Kinect - Controller free interface for Xbox Range and color cameras - Brings 3D imaging to mass markets Example application: Human-robot interaction - Communication must be easy and natural

3 Example application: Smart environments Example application: Vision-based mobile HCI User authentication Vision-based interaction

4 Case project: Affective human-robot interaction Development of natural, affective human-computer interfaces (HCI) is of great interest in building future ubiquitous computing systems In 15 years servicing robots (social robots) will become a part of our everyday lives We should be able to inteact with robots in a natural way, like in human-human interaction Computer vision will play a key role building affective HCI and HRI (human-robot interaction) systems of the future A joint research on Affective HRI is in progress by Machine Vision Group Intelligent Systems groups of the University of Oulu Supported by the Academy of Finland, European Regional Development Fund and University of Oulu Objectives To develop leading edge approaches for affective HRI Both face to face interaction and remote interaction (using mobile phones or PDAs equipped with cameras) will be considered The robot should be able to - detect and identify the user - recognize user s emotions - communicate easily by understaning speech and gestures - provide a natural response based on its observations - learn its behavior and tasks it is supposed to do - utilize its motion in different levels of interaction (robot embodiment)

5 Work packages WP1: Machine vision for human-robot interaction WP2: Human-robot interaction WP3: Experimental validation of affective HRI WP1: Machine vision for human-robot interaction Person identification Face recognition, gender recognition, age estimation Speaker identification Gait recognition, clothing (recognition from a distance) Recognition of emotions Facial expression recognition Speech, body movements Methods for human-robot communication Hand gestures and speech ( face to face communication) Body movements (e.g. waving hands) (communication from a distance) Using camera motion (communication with a mobile device) A talking avatar on robot s flat panel display On-line machine learning and adaptation

6 WP2: Human-robot interaction Embodiment and learning in HRI: Our goal is to investigate how a robot could learn to interact with a person in a socially interesting way A possible approach is illustrated in the following figure An example target system The desired state in this example could be modified as a function of time as the the person and the robot get acquainted, e.g. the robot could learn to change its behavior in a pace of interaction.

7 WP3: Experimental validation of affective HRI Different types of tasks of affective HRI are experimentally validated and demonstrated, e.g. 1. Recognizing a person and providing a personalized robot s response 2. Recognizing emotions of a person and providing an affective robot s response on the basis of person s emotions 3. HRI demonstration where the robot utilizes its learned behaviors in order to initialize, and maintain natural interaction with a person. 4. System-level demonstrations, e.g. robot guide for the visitors in a smart environment Research of key computer vision methods for HCI in Oulu 1. Face recognition 2. Facial expression recognition 3. Visual speech recognition 4. Video synthesis for face animation 5. Object detection and recognition 6. Tracking of moving objects 7. Object re-identification in camera networks 8. Recognition of actions and gait

8 Face analysis: research challenges Face is a dynamic and non-rigid object which is difficult to model because of the large variability in its appearance. The appearance of the face varies due to changes in pose, facial expression, illumination, aging, occlusion, presence of glasses etc. Face analysis using local binary patterns Face recognition is one of the major challenges in computer vision We proposed (ECCV 2004, PAMI 2006) a face descriptor based on LBP s Our method has been adopted by many leading scientists Excellent results in face recognition and authentication, face detection, facial expression recognition, gender classification LBP has a significant role in EU projects: Mobile Biometry ( ) coordinated by IDIAP (Switzerland), and a new EU project Trusted Biometrics under Spoofing Attacks (Tabula Rasa)

9 Case: Mobile biometry (MOBIO) ( The aim of is to investigate multiple aspects of biometric authentication based on the face and voice in the context of mobile devices To increase security and user acceptance - using standard sensors already available on mobile phones Coordinator: IDIAP Research Institute (CH) Partners: University of Manchester (UK), University of Surrey (UK), Universite d Avignon (FR), Brno University of Technology (CZ), University of Oulu (FI), IdeArk (CH), EyePmedia (CH), Visidon (FI) Case: Trusted biometrics under spoofing attacks (TABULA RASA) ( The project will address some of the issues of direct (spoofing) attacks to trusted biometric systems. This is an issue that needs to be addressed urgently because it has recently been shown that conventional biometric techniques, such as fingerprints and face, are vulnerable to direct (spoof) attacks. Coordinated by IDIAP, Switzerland We will focus on face and gait recognition

10 Dynamic texture descriptors for motion analysis We proposed (PAMI 2007) simple spatiotemporal LBP descriptors for dynamic texture recognition outperforming the state-of-the-art They have been applied to facial expression regonition (PAMI 2007), face and gender recognition from video sequences (Pattern Recogn. 2009), visual speech recognition (IEEE T Multimedia 2009), and recognition of actions and gait (BMVC 2008, ICB 2009, MVA 2010) - with excellent results Our approach has potential for significant contributions in many applications and fundamental problems of motion and activity analysis Demo for facial expression recognition Future challenge: How to recognize spontaneous expressions instead of acted ones?

11 Demo for visual speech recognition Video synthesis for face animation Dynamic texture synthesis (ICIP 2009) Video-realistic speech animation (ICVGIP 2010)

12 Object detection and recognition Tracking of moving objects

13 Object re-identification in camera networks Person re-identification using global color context (VS 2010) Recognition of actions and gait B F S B F S

14 Dynamic textures for action recognition Formation of the feature histogram for an xyt volume of short duration Feature histogram of a bounding volume HMM is used for sequential modeling State-of-the-art results for Weizmann and KTH databases (BMVC 2008, MVA 2010) Case project: Vision-based mobile HCI Hand motion can be used for controlling mobile devices Camera becomes a motion sensor A fast and efficient method for image motion estimation has been proposed (CVIU 2007) Uncertainty analysis is performed for each motion feature Symbian implementation Local motion analysis: (a) 16 subregions and selected feature blocks, (b) feature motion estimates and associated error covariances.

15 Interactive Panorama Builder Motion estimation system calculates shift, rotation and scale in real time When frame is suitable for stitching (high quality), the user receives feedback and instructions Scene Panorama Builder

16 Automatic Device Activation Example case: recognizing context and sequences of actions The principle: the light is not on if no one is watching Virtual 3D Display Face-tracking based 3D rendering Face-Tracker obtains 2D face position at 25 fps Face distance to the screen estimated with face size Face distance estimated using Motion Estimation Library

17 Camera Assisted Multimodal UI UI concepts that rely on multiple sensors of modern mobile devices Used for recognizing context and sequences of actions The key motivation is to hide start-up latencies of the functionalities from the user Some future challenges for computer vision in HCI Face analysis in natural environments - changing illumination, varying view and distance, different sensors etc. Recognition of spontaneous facial expressions - instead of acted expressions Recognition of natural human actions - instead of acted ones Person tracking, identification and activity recognition in multicamera networks Use of multimodal information - e.g. emotions from facial expressions, body movements, speech, biosignals Etc.

Infotech Oulu 10 years

Infotech Oulu 10 years Infotech Oulu 10 years Prof. Matti Pietikäinen Scientific director of Infotech Oulu Focus Area: Information technology and wireless communications Infotech Oulu coordinates and spearheads the focus area

More information

Title Goes Here Algorithms for Biometric Authentication

Title Goes Here Algorithms for Biometric Authentication Title Goes Here Algorithms for Biometric Authentication February 2003 Vijayakumar Bhagavatula 1 Outline Motivation Challenges Technology: Correlation filters Example results Summary 2 Motivation Recognizing

More information

SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The

SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The 29 th Annual Conference of The Robotics Society of

More information

Short Course on Computational Illumination

Short Course on Computational Illumination Short Course on Computational Illumination University of Tampere August 9/10, 2012 Matthew Turk Computer Science Department and Media Arts and Technology Program University of California, Santa Barbara

More information

Multi-modal Human-computer Interaction

Multi-modal Human-computer Interaction Multi-modal Human-computer Interaction Attila Fazekas Attila.Fazekas@inf.unideb.hu SSIP 2008, 9 July 2008 Hungary and Debrecen Multi-modal Human-computer Interaction - 2 Debrecen Big Church Multi-modal

More information

ELG 5121/CSI 7631 Fall Projects Overview. Projects List

ELG 5121/CSI 7631 Fall Projects Overview. Projects List ELG 5121/CSI 7631 Fall 2009 Projects Overview Projects List X-Reality Affective Computing Brain-Computer Interaction Ambient Intelligence Web 3.0 Biometrics: Identity Verification in a Networked World

More information

International Journal of Scientific & Engineering Research, Volume 7, Issue 12, December ISSN IJSER

International Journal of Scientific & Engineering Research, Volume 7, Issue 12, December ISSN IJSER International Journal of Scientific & Engineering Research, Volume 7, Issue 12, December-2016 192 A Novel Approach For Face Liveness Detection To Avoid Face Spoofing Attacks Meenakshi Research Scholar,

More information

MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES

MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES -2018 S.NO PROJECT CODE 1 ITIMP01 2 ITIMP02 3 ITIMP03 4 ITIMP04 5 ITIMP05 6 ITIMP06 7 ITIMP07 8 ITIMP08 9 ITIMP09 `10 ITIMP10 11 ITIMP11 12 ITIMP12 13 ITIMP13

More information

3D Interaction using Hand Motion Tracking. Srinath Sridhar Antti Oulasvirta

3D Interaction using Hand Motion Tracking. Srinath Sridhar Antti Oulasvirta 3D Interaction using Hand Motion Tracking Srinath Sridhar Antti Oulasvirta EIT ICT Labs Smart Spaces Summer School 05-June-2013 Speaker Srinath Sridhar PhD Student Supervised by Prof. Dr. Christian Theobalt

More information

MACHINE VISION GROUP (MVG)

MACHINE VISION GROUP (MVG) MACHINE VISION GROUP (MVG) Professor Matti Pietikäinen, Professor Janne Heikkilä, and Professor Olli Silvén Information Processing Laboratory, Department of Electrical and Information Engineering, University

More information

Advances in Human!!!!! Computer Interaction

Advances in Human!!!!! Computer Interaction Advances in Human!!!!! Computer Interaction Seminar WS 07/08 - AI Group, Chair Prof. Wahlster Patrick Gebhard gebhard@dfki.de Michael Kipp kipp@dfki.de Martin Rumpler rumpler@dfki.de Michael Schmitz schmitz@cs.uni-sb.de

More information

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster)

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster) Lessons from Collecting a Million Biometric Samples 109 Expression Robust 3D Face Recognition by Matching Multi-component Local Shape Descriptors on the Nasal and Adjoining Cheek Regions 177 Shared Representation

More information

An Efficient Approach to Face Recognition Using a Modified Center-Symmetric Local Binary Pattern (MCS-LBP)

An Efficient Approach to Face Recognition Using a Modified Center-Symmetric Local Binary Pattern (MCS-LBP) , pp.13-22 http://dx.doi.org/10.14257/ijmue.2015.10.8.02 An Efficient Approach to Face Recognition Using a Modified Center-Symmetric Local Binary Pattern (MCS-LBP) Anusha Alapati 1 and Dae-Seong Kang 1

More information

SMART EXPOSITION ROOMS: THE AMBIENT INTELLIGENCE VIEW 1

SMART EXPOSITION ROOMS: THE AMBIENT INTELLIGENCE VIEW 1 SMART EXPOSITION ROOMS: THE AMBIENT INTELLIGENCE VIEW 1 Anton Nijholt, University of Twente Centre of Telematics and Information Technology (CTIT) PO Box 217, 7500 AE Enschede, the Netherlands anijholt@cs.utwente.nl

More information

List of Publications for Thesis

List of Publications for Thesis List of Publications for Thesis Felix Juefei-Xu CyLab Biometrics Center, Electrical and Computer Engineering Carnegie Mellon University, Pittsburgh, PA 15213, USA felixu@cmu.edu 1. Journal Publications

More information

Lecturers. Alessandro Vinciarelli

Lecturers. Alessandro Vinciarelli Lecturers Alessandro Vinciarelli Alessandro Vinciarelli, lecturer at the University of Glasgow (Department of Computing Science) and senior researcher of the Idiap Research Institute (Martigny, Switzerland.

More information

EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION

EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION 1 Arun.A.V, 2 Bhatath.S, 3 Chethan.N, 4 Manmohan.C.M, 5 Hamsaveni M 1,2,3,4,5 Department of Computer Science and Engineering,

More information

Face Recognition Based Attendance System with Student Monitoring Using RFID Technology

Face Recognition Based Attendance System with Student Monitoring Using RFID Technology Face Recognition Based Attendance System with Student Monitoring Using RFID Technology Abhishek N1, Mamatha B R2, Ranjitha M3, Shilpa Bai B4 1,2,3,4 Dept of ECE, SJBIT, Bangalore, Karnataka, India Abstract:

More information

Touch & Gesture. HCID 520 User Interface Software & Technology

Touch & Gesture. HCID 520 User Interface Software & Technology Touch & Gesture HCID 520 User Interface Software & Technology Natural User Interfaces What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger

More information

What was the first gestural interface?

What was the first gestural interface? stanford hci group / cs247 Human-Computer Interaction Design Studio What was the first gestural interface? 15 January 2013 http://cs247.stanford.edu Theremin Myron Krueger 1 Myron Krueger There were things

More information

Multi-modal Human-Computer Interaction. Attila Fazekas.

Multi-modal Human-Computer Interaction. Attila Fazekas. Multi-modal Human-Computer Interaction Attila Fazekas Attila.Fazekas@inf.unideb.hu Szeged, 12 July 2007 Hungary and Debrecen Multi-modal Human-Computer Interaction - 2 Debrecen Big Church Multi-modal Human-Computer

More information

A SURVEY OF SOCIALLY INTERACTIVE ROBOTS

A SURVEY OF SOCIALLY INTERACTIVE ROBOTS A SURVEY OF SOCIALLY INTERACTIVE ROBOTS Terrence Fong, Illah Nourbakhsh, Kerstin Dautenhahn Presented By: Mehwish Alam INTRODUCTION History of Social Robots Social Robots Socially Interactive Robots Why

More information

FACE VERIFICATION SYSTEM IN MOBILE DEVICES BY USING COGNITIVE SERVICES

FACE VERIFICATION SYSTEM IN MOBILE DEVICES BY USING COGNITIVE SERVICES International Journal of Intelligent Systems and Applications in Engineering Advanced Technology and Science ISSN:2147-67992147-6799 www.atscience.org/ijisae Original Research Paper FACE VERIFICATION SYSTEM

More information

Service Robots in an Intelligent House

Service Robots in an Intelligent House Service Robots in an Intelligent House Jesus Savage Bio-Robotics Laboratory biorobotics.fi-p.unam.mx School of Engineering Autonomous National University of Mexico UNAM 2017 OUTLINE Introduction A System

More information

Advanced Man-Machine Interaction

Advanced Man-Machine Interaction Signals and Communication Technology Advanced Man-Machine Interaction Fundamentals and Implementation Bearbeitet von Karl-Friedrich Kraiss 1. Auflage 2006. Buch. XIX, 461 S. ISBN 978 3 540 30618 4 Format

More information

A Comparison Study of Image Descriptors on Low- Resolution Face Image Verification

A Comparison Study of Image Descriptors on Low- Resolution Face Image Verification A Comparison Study of Image Descriptors on Low- Resolution Face Image Verification Gittipat Jetsiktat, Sasipa Panthuwadeethorn and Suphakant Phimoltares Advanced Virtual and Intelligent Computing (AVIC)

More information

APPENDIX 1 TEXTURE IMAGE DATABASES

APPENDIX 1 TEXTURE IMAGE DATABASES 167 APPENDIX 1 TEXTURE IMAGE DATABASES A 1.1 BRODATZ DATABASE The Brodatz's photo album is a well-known benchmark database for evaluating texture recognition algorithms. It contains 111 different texture

More information

A VIDEO CAMERA ROAD SIGN SYSTEM OF THE EARLY WARNING FROM COLLISION WITH THE WILD ANIMALS

A VIDEO CAMERA ROAD SIGN SYSTEM OF THE EARLY WARNING FROM COLLISION WITH THE WILD ANIMALS Vol. 12, Issue 1/2016, 42-46 DOI: 10.1515/cee-2016-0006 A VIDEO CAMERA ROAD SIGN SYSTEM OF THE EARLY WARNING FROM COLLISION WITH THE WILD ANIMALS Slavomir MATUSKA 1*, Robert HUDEC 2, Patrik KAMENCAY 3,

More information

From Conversational Tooltips to Grounded Discourse: Head Pose Tracking in Interactive Dialog Systems

From Conversational Tooltips to Grounded Discourse: Head Pose Tracking in Interactive Dialog Systems From Conversational Tooltips to Grounded Discourse: Head Pose Tracking in Interactive Dialog Systems Louis-Philippe Morency Computer Science and Artificial Intelligence Laboratory at MIT Cambridge, MA

More information

Pose Invariant Face Recognition

Pose Invariant Face Recognition Pose Invariant Face Recognition Fu Jie Huang Zhihua Zhou Hong-Jiang Zhang Tsuhan Chen Electrical and Computer Engineering Department Carnegie Mellon University jhuangfu@cmu.edu State Key Lab for Novel

More information

Identity and Message recognition by biometric signals

Identity and Message recognition by biometric signals Identity and Message recognition by biometric signals J. Bigun, F. Alonso-Fernandez, S. M. Karlsson, A. Mikaelyan Abstract The project addresses visual information representation, and extraction. The problem

More information

GESTURE RECOGNITION WITH 3D CNNS

GESTURE RECOGNITION WITH 3D CNNS April 4-7, 2016 Silicon Valley GESTURE RECOGNITION WITH 3D CNNS Pavlo Molchanov Xiaodong Yang Shalini Gupta Kihwan Kim Stephen Tyree Jan Kautz 4/6/2016 Motivation AGENDA Problem statement Selecting the

More information

Gesture Recognition with Real World Environment using Kinect: A Review

Gesture Recognition with Real World Environment using Kinect: A Review Gesture Recognition with Real World Environment using Kinect: A Review Prakash S. Sawai 1, Prof. V. K. Shandilya 2 P.G. Student, Department of Computer Science & Engineering, Sipna COET, Amravati, Maharashtra,

More information

The Center for Identification Technology Research (CITeR)

The Center for Identification Technology Research (CITeR) The Center for Identification Technology Research () Presented by Dr. Stephanie Schuckers February 24, 2011 Status Report is an NSF Industry/University Cooperative Research Center (IUCRC) The importance

More information

Implementation of Face Spoof Recognization by Using Image Distortion Analysis

Implementation of Face Spoof Recognization by Using Image Distortion Analysis Implementation of Face Spoof Recognization by Using Distortion Analysis Priyanka P. Raut 1, Namrata R. Borkar 2, Virendra P. Nikam 3 1ME Student, CSE Department, KGIET, Darapur, M.S., India 2,3 Assistant

More information

CSE Tue 10/09. Nadir Weibel

CSE Tue 10/09. Nadir Weibel CSE 118 - Tue 10/09 Nadir Weibel Today Admin Teams Assignments, grading, submissions Mini Quiz on Week 1 (readings and class material) Low-Fidelity Prototyping 1st Project Assignment Computer Vision, Kinect,

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

Real Time Face Recognition using Raspberry Pi II

Real Time Face Recognition using Raspberry Pi II Real Time Face Recognition using Raspberry Pi II A.Viji 1, A.Pavithra 2 Department of Electronics Engineering, Madras Institute of Technology, Anna University, Chennai, India 1 Department of Electronics

More information

Tablet System for Sensing and Visualizing Statistical Profiles of Multi-Party Conversation

Tablet System for Sensing and Visualizing Statistical Profiles of Multi-Party Conversation 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE) Tablet System for Sensing and Visualizing Statistical Profiles of Multi-Party Conversation Hiroyuki Adachi Email: adachi@i.ci.ritsumei.ac.jp

More information

Research Seminar. Stefano CARRINO fr.ch

Research Seminar. Stefano CARRINO  fr.ch Research Seminar Stefano CARRINO stefano.carrino@hefr.ch http://aramis.project.eia- fr.ch 26.03.2010 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks

More information

Biometric Recognition: How Do I Know Who You Are?

Biometric Recognition: How Do I Know Who You Are? Biometric Recognition: How Do I Know Who You Are? Anil K. Jain Department of Computer Science and Engineering, 3115 Engineering Building, Michigan State University, East Lansing, MI 48824, USA jain@cse.msu.edu

More information

Designing for an Internet of Humans

Designing for an Internet of Humans Designing for an Internet of Humans The Route to Adoption of IoT Paul Grace pjg@it-innovation.soton.ac.uk 24 March 2017 IT Innovation Centre The IT Innovation Centre is an applied research centre advancing

More information

Super resolution with Epitomes

Super resolution with Epitomes Super resolution with Epitomes Aaron Brown University of Wisconsin Madison, WI Abstract Techniques exist for aligning and stitching photos of a scene and for interpolating image data to generate higher

More information

Object Tracking Toolbox

Object Tracking Toolbox Project no. IST-34107 Project acronym: ARTTS Project title: Action Recognition and Tracking based on Time-of-flight Sensors Object Tracking Toolbox Duration of the project: October 2006 September 2009

More information

Touch & Gesture. HCID 520 User Interface Software & Technology

Touch & Gesture. HCID 520 User Interface Software & Technology Touch & Gesture HCID 520 User Interface Software & Technology What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger There were things I resented

More information

A Smart Home Design and Implementation Based on Kinect

A Smart Home Design and Implementation Based on Kinect 2018 International Conference on Physics, Computing and Mathematical Modeling (PCMM 2018) ISBN: 978-1-60595-549-0 A Smart Home Design and Implementation Based on Kinect Jin-wen DENG 1,2, Xue-jun ZHANG

More information

Interface Design V: Beyond the Desktop

Interface Design V: Beyond the Desktop Interface Design V: Beyond the Desktop Rob Procter Further Reading Dix et al., chapter 4, p. 153-161 and chapter 15. Norman, The Invisible Computer, MIT Press, 1998, chapters 4 and 15. 11/25/01 CS4: HCI

More information

Building Perceptive Robots with INTEL Euclid Development kit

Building Perceptive Robots with INTEL Euclid Development kit Building Perceptive Robots with INTEL Euclid Development kit Amit Moran Perceptual Computing Systems Innovation 2 2 3 A modern robot should Perform a task Find its way in our world and move safely Understand

More information

Shervin Rahimzadeh Arashloo

Shervin Rahimzadeh Arashloo Shervin Rahimzadeh Arashloo Contact Details Department of Medical Informatics Faculty of Medical Sciences Tarbiat Modares University Tehran, Iran S.Rahimzadeh@modares.ac.ir Research Interests Computer

More information

AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION

AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION COURSE OUTLINE 1. Introduction to Robot Operating System (ROS) 2. Introduction to isociobot

More information

Telling What-Is-What in Video. Gerard Medioni

Telling What-Is-What in Video. Gerard Medioni Telling What-Is-What in Video Gerard Medioni medioni@usc.edu 1 Tracking Essential problem Establishes correspondences between elements in successive frames Basic problem easy 2 Many issues One target (pursuit)

More information

KINECT CONTROLLED HUMANOID AND HELICOPTER

KINECT CONTROLLED HUMANOID AND HELICOPTER KINECT CONTROLLED HUMANOID AND HELICOPTER Muffakham Jah College of Engineering & Technology Presented by : MOHAMMED KHAJA ILIAS PASHA ZESHAN ABDUL MAJEED AZMI SYED ABRAR MOHAMMED ISHRAQ SARID MOHAMMED

More information

Toward an Augmented Reality System for Violin Learning Support

Toward an Augmented Reality System for Violin Learning Support Toward an Augmented Reality System for Violin Learning Support Hiroyuki Shiino, François de Sorbier, and Hideo Saito Graduate School of Science and Technology, Keio University, Yokohama, Japan {shiino,fdesorbi,saito}@hvrl.ics.keio.ac.jp

More information

GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL

GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL Darko Martinovikj Nevena Ackovska Faculty of Computer Science and Engineering Skopje, R. Macedonia ABSTRACT Despite the fact that there are different

More information

Computer Vision for HCI. Introduction. Machines That See? Science fiction. HAL, Terminator, Star Wars, I-Robot, etc.

Computer Vision for HCI. Introduction. Machines That See? Science fiction. HAL, Terminator, Star Wars, I-Robot, etc. Computer Vision for HCI Introduction Machines That See? Science fiction HAL, Terminator, Star Wars, I-Robot, etc. 1 Machines That See? [ movie ] Definition of Computer Vision Goal of computer vision is

More information

Activity monitoring and summarization for an intelligent meeting room

Activity monitoring and summarization for an intelligent meeting room IEEE Workshop on Human Motion, Austin, Texas, December 2000 Activity monitoring and summarization for an intelligent meeting room Ivana Mikic, Kohsia Huang, Mohan Trivedi Computer Vision and Robotics Research

More information

Student Attendance Monitoring System Via Face Detection and Recognition System

Student Attendance Monitoring System Via Face Detection and Recognition System IJSTE - International Journal of Science Technology & Engineering Volume 2 Issue 11 May 2016 ISSN (online): 2349-784X Student Attendance Monitoring System Via Face Detection and Recognition System Pinal

More information

Motivation and objectives of the proposed study

Motivation and objectives of the proposed study Abstract In recent years, interactive digital media has made a rapid development in human computer interaction. However, the amount of communication or information being conveyed between human and the

More information

A Driver Assaulting Event Detection Using Intel Real-Sense Camera

A Driver Assaulting Event Detection Using Intel Real-Sense Camera , pp.285-294 http//dx.doi.org/10.14257/ijca.2017.10.2.23 A Driver Assaulting Event Detection Using Intel Real-Sense Camera Jae-Gon Yoo 1, Dong-Kyun Kim 2, Seung Joo Choi 3, Handong Lee 4 and Jong-Bae Kim

More information

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera GESTURE BASED HUMAN MULTI-ROBOT INTERACTION Gerard Canal, Cecilio Angulo, and Sergio Escalera Gesture based Human Multi-Robot Interaction Gerard Canal Camprodon 2/27 Introduction Nowadays robots are able

More information

Tools for Iris Recognition Engines. Martin George CEO Smart Sensors Limited (UK)

Tools for Iris Recognition Engines. Martin George CEO Smart Sensors Limited (UK) Tools for Iris Recognition Engines Martin George CEO Smart Sensors Limited (UK) About Smart Sensors Limited Owns and develops Intellectual Property for image recognition, identification and analytics applications

More information

Multi-Modal User Interaction

Multi-Modal User Interaction Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface

More information

Perception. Introduction to HRI Simmons & Nourbakhsh Spring 2015

Perception. Introduction to HRI Simmons & Nourbakhsh Spring 2015 Perception Introduction to HRI Simmons & Nourbakhsh Spring 2015 Perception my goals What is the state of the art boundary? Where might we be in 5-10 years? The Perceptual Pipeline The classical approach:

More information

AFFECTIVE COMPUTING FOR HCI

AFFECTIVE COMPUTING FOR HCI AFFECTIVE COMPUTING FOR HCI Rosalind W. Picard MIT Media Laboratory 1 Introduction Not all computers need to pay attention to emotions, or to have emotional abilities. Some machines are useful as rigid

More information

HUMAN COMPUTER INTERACTION 0. PREFACE. I-Chen Lin, National Chiao Tung University, Taiwan

HUMAN COMPUTER INTERACTION 0. PREFACE. I-Chen Lin, National Chiao Tung University, Taiwan HUMAN COMPUTER INTERACTION 0. PREFACE I-Chen Lin, National Chiao Tung University, Taiwan About The Course Course title: Human Computer Interaction (HCI) Lectures: ED202, 13:20~15:10(Mon.), 9:00~9:50(Thur.)

More information

Presentation Attack Detection Algorithms for Finger Vein Biometrics: A Comprehensive Study

Presentation Attack Detection Algorithms for Finger Vein Biometrics: A Comprehensive Study 215 11th International Conference on Signal-Image Technology & Internet-Based Systems Presentation Attack Detection Algorithms for Finger Vein Biometrics: A Comprehensive Study R. Raghavendra Christoph

More information

Interactive Virtual Environments

Interactive Virtual Environments Interactive Virtual Environments Introduction Emil M. Petriu, Dr. Eng., FIEEE Professor, School of Information Technology and Engineering University of Ottawa, Ottawa, ON, Canada http://www.site.uottawa.ca/~petriu

More information

Design and Implementation of an Intuitive Gesture Recognition System Using a Hand-held Device

Design and Implementation of an Intuitive Gesture Recognition System Using a Hand-held Device Design and Implementation of an Intuitive Gesture Recognition System Using a Hand-held Device Hung-Chi Chu 1, Yuan-Chin Cheng 1 1 Department of Information and Communication Engineering, Chaoyang University

More information

INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction

INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction Xavier Suau 1,MarcelAlcoverro 2, Adolfo Lopez-Mendez 3, Javier Ruiz-Hidalgo 2,andJosepCasas 3 1 Universitat Politécnica

More information

Subjective Study of Privacy Filters in Video Surveillance

Subjective Study of Privacy Filters in Video Surveillance Subjective Study of Privacy Filters in Video Surveillance P. Korshunov #1, C. Araimo 2, F. De Simone #3, C. Velardo 4, J.-L. Dugelay 5, and T. Ebrahimi #6 # Multimedia Signal Processing Group MMSPG, Institute

More information

Mario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality

Mario Romero 2014/11/05. Multimodal Interaction and Interfaces Mixed Reality Mario Romero 2014/11/05 Multimodal Interaction and Interfaces Mixed Reality Outline Who am I and how I can help you? What is the Visualization Studio? What is Mixed Reality? What can we do for you? What

More information

ARTIFICIAL ROBOT NAVIGATION BASED ON GESTURE AND SPEECH RECOGNITION

ARTIFICIAL ROBOT NAVIGATION BASED ON GESTURE AND SPEECH RECOGNITION ARTIFICIAL ROBOT NAVIGATION BASED ON GESTURE AND SPEECH RECOGNITION ABSTRACT *Miss. Kadam Vaishnavi Chandrakumar, ** Prof. Hatte Jyoti Subhash *Research Student, M.S.B.Engineering College, Latur, India

More information

Value-added Applications with Deep Learning. src:

Value-added Applications with Deep Learning. src: SMART TOURISM Value-added Applications with Deep Learning src: https://www.wttc.org/-/media/files/reports/economic-impact-research/countries-2017/thailand2017.pdf Somnuk Phon-Amnuaisuk, Minh-Son Dao, CIE,

More information

Interior Design using Augmented Reality Environment

Interior Design using Augmented Reality Environment Interior Design using Augmented Reality Environment Kalyani Pampattiwar 2, Akshay Adiyodi 1, Manasvini Agrahara 1, Pankaj Gamnani 1 Assistant Professor, Department of Computer Engineering, SIES Graduate

More information

Driver Assistance for "Keeping Hands on the Wheel and Eyes on the Road"

Driver Assistance for Keeping Hands on the Wheel and Eyes on the Road ICVES 2009 Driver Assistance for "Keeping Hands on the Wheel and Eyes on the Road" Cuong Tran and Mohan Manubhai Trivedi Laboratory for Intelligent and Safe Automobiles (LISA) University of California

More information

A Novel Knee Position Acquisition and Face Recognition System Using Kinect v2 at Entrance for Fatigue Detection and Automated Door Opening

A Novel Knee Position Acquisition and Face Recognition System Using Kinect v2 at Entrance for Fatigue Detection and Automated Door Opening A Novel Knee Position Acquisition and Face Recognition System Using Kinect v2 at Entrance for Fatigue Detection and Automated Door Opening Ami Ogawa 1 *, Akira Mita 1, and Thomas Bock 2 1 Department of

More information

AUDIO VISUAL TRACKING OF A SPEAKER BASED ON FFT AND KALMAN FILTER

AUDIO VISUAL TRACKING OF A SPEAKER BASED ON FFT AND KALMAN FILTER AUDIO VISUAL TRACKING OF A SPEAKER BASED ON FFT AND KALMAN FILTER Muhammad Muzammel, Mohd Zuki Yusoff, Mohamad Naufal Mohamad Saad and Aamir Saeed Malik Centre for Intelligent Signal and Imaging Research,

More information

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Perceptual Interfaces Adapted from Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Outline Why Perceptual Interfaces? Multimodal interfaces Vision

More information

A*STAR Unveils Singapore s First Social Robots at Robocup2010

A*STAR Unveils Singapore s First Social Robots at Robocup2010 MEDIA RELEASE Singapore, 21 June 2010 Total: 6 pages A*STAR Unveils Singapore s First Social Robots at Robocup2010 Visit Suntec City to experience the first social robots - OLIVIA and LUCAS that can see,

More information

Prospective Teleautonomy For EOD Operations

Prospective Teleautonomy For EOD Operations Perception and task guidance Perceived world model & intent Prospective Teleautonomy For EOD Operations Prof. Seth Teller Electrical Engineering and Computer Science Department Computer Science and Artificial

More information

Face Detection System on Ada boost Algorithm Using Haar Classifiers

Face Detection System on Ada boost Algorithm Using Haar Classifiers Vol.2, Issue.6, Nov-Dec. 2012 pp-3996-4000 ISSN: 2249-6645 Face Detection System on Ada boost Algorithm Using Haar Classifiers M. Gopi Krishna, A. Srinivasulu, Prof (Dr.) T.K.Basak 1, 2 Department of Electronics

More information

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa

VIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa VIRTUAL REALITY Introduction Emil M. Petriu SITE, University of Ottawa Natural and Virtual Reality Virtual Reality Interactive Virtual Reality Virtualized Reality Augmented Reality HUMAN PERCEPTION OF

More information

Knowledge Representation and Cognition in Natural Language Processing

Knowledge Representation and Cognition in Natural Language Processing Knowledge Representation and Cognition in Natural Language Processing Gemignani Guglielmo Sapienza University of Rome January 17 th 2013 The European Projects Surveyed the FP6 and FP7 projects involving

More information

Introduction. BIL719 Computer Vision Pinar Duygulu Hacettepe University

Introduction. BIL719 Computer Vision Pinar Duygulu Hacettepe University Introduction BIL719 Computer Vision Pinar Duygulu Hacettepe University Basic Info Textbooks (suggested): Forsyth & Ponce, Computer Vision: A Modern Approach Richard Szeliski, Computer Vision: Algorithms

More information

A Kinect-based 3D hand-gesture interface for 3D databases

A Kinect-based 3D hand-gesture interface for 3D databases A Kinect-based 3D hand-gesture interface for 3D databases Abstract. The use of natural interfaces improves significantly aspects related to human-computer interaction and consequently the productivity

More information

Prof Trivedi ECE253A Notes for Students only

Prof Trivedi ECE253A Notes for Students only ECE 253A: Digital Processing: Course Related Class Website: https://sites.google.com/a/eng.ucsd.edu/ece253fall2017/ Course Graduate Assistants: Nachiket Deo Borhan Vasili Kirill Pirozenko Piazza Grading:

More information

Live Hand Gesture Recognition using an Android Device

Live Hand Gesture Recognition using an Android Device Live Hand Gesture Recognition using an Android Device Mr. Yogesh B. Dongare Department of Computer Engineering. G.H.Raisoni College of Engineering and Management, Ahmednagar. Email- yogesh.dongare05@gmail.com

More information

SKIN SEGMENTATION USING DIFFERENT INTEGRATED COLOR MODEL APPROACHES FOR FACE DETECTION

SKIN SEGMENTATION USING DIFFERENT INTEGRATED COLOR MODEL APPROACHES FOR FACE DETECTION SKIN SEGMENTATION USING DIFFERENT INTEGRATED COLOR MODEL APPROACHES FOR FACE DETECTION Mrunmayee V. Daithankar 1, Kailash J. Karande 2 1 ME Student, Electronics and Telecommunication Engineering Department,

More information

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3102 3107 INTE 2014 Fabrication of the kinect remote-controlled cars and planning of the motion

More information

VICs: A Modular Vision-Based HCI Framework

VICs: A Modular Vision-Based HCI Framework VICs: A Modular Vision-Based HCI Framework The Visual Interaction Cues Project Guangqi Ye, Jason Corso Darius Burschka, & Greg Hager CIRL, 1 Today, I ll be presenting work that is part of an ongoing project

More information

Digital Signage from static and passive to dynamic and interactive

Digital Signage from static and passive to dynamic and interactive Digital Signage from static and passive to dynamic and interactive 27.9.2011, VTT, Espoo Johannes Peltola, Sari Järvinen, Satu-Marja Mäkelä, Tommi Keränen, Tatu Harviainen VTT Technical Research Centre

More information

Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction

Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction Minghao Cai 1(B), Soh Masuko 2, and Jiro Tanaka 1 1 Waseda University, Kitakyushu, Japan mhcai@toki.waseda.jp, jiro@aoni.waseda.jp

More information

Non-Contact Vein Recognition Biometrics

Non-Contact Vein Recognition Biometrics Non-Contact Vein Recognition Biometrics www.nearinfraredimaging.com 508-384-3800 info@nearinfraredimaging.com NII s technology is multiple modality non-contact vein-recognition biometrics, the visualization

More information

YDDON. Humans, Robots, & Intelligent Objects New communication approaches

YDDON. Humans, Robots, & Intelligent Objects New communication approaches YDDON Humans, Robots, & Intelligent Objects New communication approaches Building Robot intelligence Interdisciplinarity Turning things into robots www.ydrobotics.co m Edifício A Moagem Cidade do Engenho

More information

Intro to AI. AI is a huge field. AI is a huge field 2/19/15. What is AI. One definition:

Intro to AI. AI is a huge field. AI is a huge field 2/19/15. What is AI. One definition: Intro to AI CS30 David Kauchak Spring 2015 http://www.bbspot.com/comics/pc-weenies/2008/02/3248.php Adapted from notes from: Sara Owsley Sood AI is a huge field What is AI AI is a huge field What is AI

More information

Augmented and Mixed Reality Virtual and Mirror Worlds. January 20, 2009

Augmented and Mixed Reality Virtual and Mirror Worlds. January 20, 2009 Augmented and Mixed Reality Virtual and Mirror Worlds Charles Woodward January 20, 2009 Introduction (1) Virtual Reality CAVE Systems E.g. Lumeportti at VTT Back projected screens Polarized data glasses

More information

Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data

Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data Hrvoje Benko Microsoft Research One Microsoft Way Redmond, WA 98052 USA benko@microsoft.com Andrew D. Wilson Microsoft

More information

Charting Past, Present, and Future Research in Ubiquitous Computing

Charting Past, Present, and Future Research in Ubiquitous Computing Charting Past, Present, and Future Research in Ubiquitous Computing Gregory D. Abowd and Elizabeth D. Mynatt Sajid Sadi MAS.961 Introduction Mark Wieser outlined the basic tenets of ubicomp in 1991 The

More information

Sketch Matching for Crime Investigation using LFDA Framework

Sketch Matching for Crime Investigation using LFDA Framework International Journal of Engineering and Technical Research (IJETR) Sketch Matching for Crime Investigation using LFDA Framework Anjali J. Pansare, Dr.V.C.Kotak, Babychen K. Mathew Abstract Here we are

More information

EFFECTS OF SEVERE SIGNAL DEGRADATION ON EAR DETECTION. J. Wagner, A. Pflug, C. Rathgeb and C. Busch

EFFECTS OF SEVERE SIGNAL DEGRADATION ON EAR DETECTION. J. Wagner, A. Pflug, C. Rathgeb and C. Busch EFFECTS OF SEVERE SIGNAL DEGRADATION ON EAR DETECTION J. Wagner, A. Pflug, C. Rathgeb and C. Busch da/sec Biometrics and Internet Security Research Group Hochschule Darmstadt, Darmstadt, Germany {johannes.wagner,anika.pflug,christian.rathgeb,christoph.busch}@cased.de

More information