AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION

Size: px
Start display at page:

Download "AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION"

Transcription

1 AAU SUMMER SCHOOL PROGRAMMING SOCIAL ROBOTS FOR HUMAN INTERACTION LECTURE 10 MULTIMODAL HUMAN-ROBOT INTERACTION COURSE OUTLINE 1. Introduction to Robot Operating System (ROS) 2. Introduction to isociobot and NAO robot, and demos 3. Social Robots and Applications 4. Machine Learning and Pattern Recognition 5. Speech Processing I: Acquisition of Speech, Feature Extraction and Speaker Localization 6. Speech Processing II: Speaker Identification and Speech Recognition 7. Image Processing I: Image Acquisition, Pre-processing and Feature Extraction 8. Image Processing II: Face Detection and Face Recognition 9. User Modelling 10. Multimodal Human-Robot Interaction 5 AUGUST 2015 AALBORG UNIVERSITY 2 1

2 MULTIMODAL INTERACTION WHAT? IN THE CONTEXT OF HUMAN COMPUTER INTERACTION, A MODALITY IS THE CLASSIFICATION OF A SINGLE INDEPENDENT CHANNEL OF SENSORY INPUT/OUTPUT BETWEEN A COMPUTER AND A HUMAN. A SYSTEM IS DESIGNATED UNIMODAL IF IT HAS ONLY ONE MODALITY IMPLEMENTED, AND MULTIMODAL IF IT HAS MORE THAN ONE. KARRAY, FAKHREDDINE, ET AL. "HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART." (2008). 5 AUGUST 2015 AALBORG UNIVERSITY 3 MULTIMODAL INTERACTION WHY? Extended functionality, e.g. we can speak to the robot instead of typing Human-Human like communication 5 AUGUST 2015 AALBORG UNIVERSITY 4 2

3 MULTIMODAL INTERACTION WHY? Robustness against noise Data from one modality might be very noisy, however the rest are not combine the modalities Person Identification: background music is corrupting recorded speech, however vision is unaltered. Speech Recognition: background music is corrupting recorded speech, however vision can be used to recognize lip movements and classify words How to know which modality to trust? 5 AUGUST 2015 AALBORG UNIVERSITY 5 MULTIMODAL INTERACTION WHY? Provide new information, which could not be provided by individual modalities Combination of sound + facial expression = emotion Learning: Sometimes only one modality is available, but noisy Use knowledge from one modality to re-train/adapt model in other domain Examples: Person Identification, Direction of Attention 5 AUGUST 2015 AALBORG UNIVERSITY 6 3

4 05/08/15 D U R A B L E I N T E R A C T I O N W I T H S O C I A L LY I N T E L L I G E N T ROBOTS isociobot Research project supported by The Danish Council for Independent R e s e a r c h Te c h n o l o g y a n d P r o d u c t i o n S c i e n c e s, M i n i s t r y o f Science, Innovation and Higher Education To m a k e r o b o t s s o c i a l l y i n t e l l i g e n t a n d c a p a b l e o f e s t a b l i s h i n g durable relationship with their users Multi-modal: speech, vision, facial expression etc. 5 AUGUST 2015 AALBORG UNIVERSITY 7 AALBORG UNIVERSITY 8 H A R D WA R E First generation 5 AUGUST

5 HARDWARE First generation 5 AUGUST 2015 AALBORG UNIVERSITY 9 HARDWARE Second generation 5 AUGUST 2015 AALBORG UNIVERSITY 10 5

6 HARDWARE Second generation What changed? New body material and shape New ears ipad (input and output) New robot base (Pioneer P3-DX) 5 AUGUST 2015 AALBORG UNIVERSITY 11 SOFTWARE System OS: UBUNTU Robot OS: ROS A great framework for each module/function to communicate Widely used and high-quality software available Open-source Support Python or C 5 AUGUST 2015 AALBORG UNIVERSITY 12 6

7 SOFTWARE 5 AUGUST 2015 AALBORG UNIVERSITY 13 DEMOS The Day of Research AUGUST 2015 AALBORG UNIVERSITY 14 7

8 DEMOS Sikker 7 in Nibe 5 AUGUST 2015 AALBORG UNIVERSITY 15 DEMOS The Culture Night AUGUST 2015 AALBORG UNIVERSITY 16 8

9 DEMOS The people s meeting AUGUST 2015 AALBORG UNIVERSITY 17 FUTURE WORK Research User modeling Reinforcement fusion Collaboration/Application: Future Nursing Home Potential application: Playing/learning with children 5 AUGUST 2015 AALBORG UNIVERSITY 18 9

10 COURSE OUTLINE 1. Introduction to Robot Operating System (ROS) 2. Introduction to isociobot and NAO robot, and demos 3. Social Robots and Applications 4. Machine Learning and Pattern Recognition 5. Speech Processing I: Acquisition of Speech, Feature Extraction and Speaker Localization 6. Speech Processing II: Speaker Identification and Speech Recognition 7. Image Processing I: Image Acquisition, Pre-processing and Feature Extraction 8. Image Processing II: Face Detection and Face Recognition 9. User Modelling 10. Multimodal Human-Robot Interaction 5 AUGUST 2015 AALBORG UNIVERSITY 19 10

Designing and Implementing an Interactive Social Robot from Off-the-shelf Components

Designing and Implementing an Interactive Social Robot from Off-the-shelf Components Designing and Implementing an Interactive Social Robot from Off-the-shelf Components Zheng-Hua Tan, Nicolai Bæk Thomsen and Xiaodong Duan Department of Electronic Systems, Aalborg University, Denmark e-mail:

More information

Selected Research Signal & Information Processing Group

Selected Research Signal & Information Processing Group COST Action IC1206 - MC Meeting Selected Research Activities @ Signal & Information Processing Group Zheng-Hua Tan Dept. of Electronic Systems, Aalborg Univ., Denmark zt@es.aau.dk 1 Outline Introduction

More information

Building Perceptive Robots with INTEL Euclid Development kit

Building Perceptive Robots with INTEL Euclid Development kit Building Perceptive Robots with INTEL Euclid Development kit Amit Moran Perceptual Computing Systems Innovation 2 2 3 A modern robot should Perform a task Find its way in our world and move safely Understand

More information

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera GESTURE BASED HUMAN MULTI-ROBOT INTERACTION Gerard Canal, Cecilio Angulo, and Sergio Escalera Gesture based Human Multi-Robot Interaction Gerard Canal Camprodon 2/27 Introduction Nowadays robots are able

More information

Booklet of teaching units

Booklet of teaching units International Master Program in Mechatronic Systems for Rehabilitation Booklet of teaching units Third semester (M2 S1) Master Sciences de l Ingénieur Université Pierre et Marie Curie Paris 6 Boite 164,

More information

Multi-Modal User Interaction

Multi-Modal User Interaction Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface

More information

Automatic Text-Independent. Speaker. Recognition Approaches Using Binaural Inputs

Automatic Text-Independent. Speaker. Recognition Approaches Using Binaural Inputs Automatic Text-Independent Speaker Recognition Approaches Using Binaural Inputs Karim Youssef, Sylvain Argentieri and Jean-Luc Zarader 1 Outline Automatic speaker recognition: introduction Designed systems

More information

Multi-modal Human-computer Interaction

Multi-modal Human-computer Interaction Multi-modal Human-computer Interaction Attila Fazekas Attila.Fazekas@inf.unideb.hu SSIP 2008, 9 July 2008 Hungary and Debrecen Multi-modal Human-computer Interaction - 2 Debrecen Big Church Multi-modal

More information

MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES

MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES MATLAB DIGITAL IMAGE/SIGNAL PROCESSING TITLES -2018 S.NO PROJECT CODE 1 ITIMP01 2 ITIMP02 3 ITIMP03 4 ITIMP04 5 ITIMP05 6 ITIMP06 7 ITIMP07 8 ITIMP08 9 ITIMP09 `10 ITIMP10 11 ITIMP11 12 ITIMP12 13 ITIMP13

More information

Vision & Industry 4.0: Towards smarter sensors. Dr. Amina Chebira Vision Embedded Systems, CSEM SA October 4 th, 2016

Vision & Industry 4.0: Towards smarter sensors. Dr. Amina Chebira Vision Embedded Systems, CSEM SA October 4 th, 2016 Vision & Industry 4.0: Towards smarter sensors Dr. Amina Chebira Vision Embedded Systems, CSEM SA October 4 th, 2016 Outline Perception and vision Smarter sensors Recognition applications More miniaturization,

More information

Recognizing Military Gestures: Developing a Gesture Recognition Interface. Jonathan Lebron

Recognizing Military Gestures: Developing a Gesture Recognition Interface. Jonathan Lebron Recognizing Military Gestures: Developing a Gesture Recognition Interface Jonathan Lebron March 22, 2013 Abstract The field of robotics presents a unique opportunity to design new technologies that can

More information

Multimodal Research at CPK, Aalborg

Multimodal Research at CPK, Aalborg Multimodal Research at CPK, Aalborg Summary: The IntelliMedia WorkBench ( Chameleon ) Campus Information System Multimodal Pool Trainer Displays, Dialogue Walkthru Speech Understanding Vision Processing

More information

1 Publishable summary

1 Publishable summary 1 Publishable summary 1.1 Introduction The DIRHA (Distant-speech Interaction for Robust Home Applications) project was launched as STREP project FP7-288121 in the Commission s Seventh Framework Programme

More information

HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART TECHNOLOGY

HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART TECHNOLOGY HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART TECHNOLOGY *Ms. S. VAISHNAVI, Assistant Professor, Sri Krishna Arts And Science College, Coimbatore. TN INDIA **SWETHASRI. L., Final Year B.Com

More information

DEEP DIVE ON AZURE ML FOR DEVELOPERS

DEEP DIVE ON AZURE ML FOR DEVELOPERS DEEP DIVE ON AZURE ML FOR DEVELOPERS How many dogs can you find in 4 seconds? How many dogs can you find in 4 seconds? Who had 12? DEEP DIVE ON AZURE ML FOR DEVELOPERS THOMAS MARTINSEN CEO AND FOUNDING

More information

Computer Vision in Human-Computer Interaction

Computer Vision in Human-Computer Interaction Invited talk in 2010 Autumn Seminar and Meeting of Pattern Recognition Society of Finland, M/S Baltic Princess, 26.11.2010 Computer Vision in Human-Computer Interaction Matti Pietikäinen Machine Vision

More information

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster)

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster) Lessons from Collecting a Million Biometric Samples 109 Expression Robust 3D Face Recognition by Matching Multi-component Local Shape Descriptors on the Nasal and Adjoining Cheek Regions 177 Shared Representation

More information

Short Course on Computational Illumination

Short Course on Computational Illumination Short Course on Computational Illumination University of Tampere August 9/10, 2012 Matthew Turk Computer Science Department and Media Arts and Technology Program University of California, Santa Barbara

More information

Post-Graduate Program in Computer Engineering (PPG-EC)

Post-Graduate Program in Computer Engineering (PPG-EC) Post-Graduate Program in Computer Engineering (PPG-EC) Prof. Byron Leite Dantas Bezerra, Ph.D. Adjunct Professor POLI/UPE *** Coordinator Prof. Bruno José Torres Fernandes, Ph.D. Adjunct Professor POLI/UPE

More information

Definitions and Application Areas

Definitions and Application Areas Definitions and Application Areas Ambient intelligence: technology and design Fulvio Corno Politecnico di Torino, 2013/2014 http://praxis.cs.usyd.edu.au/~peterris Summary Definition(s) Application areas

More information

Pratibha -International Journal of Computer Science information and Engg., Technologies ISSN

Pratibha -International Journal of Computer Science information and Engg., Technologies ISSN Unimodal and Multimodal Human Computer Interaction:A Modern Overview Pratibha Adkar Modern College Of Engineering MCA Department Pune-5 India pratibhakul@gmail.com Abstract. In this paper I review the

More information

Student Attendance Monitoring System Via Face Detection and Recognition System

Student Attendance Monitoring System Via Face Detection and Recognition System IJSTE - International Journal of Science Technology & Engineering Volume 2 Issue 11 May 2016 ISSN (online): 2349-784X Student Attendance Monitoring System Via Face Detection and Recognition System Pinal

More information

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Perceptual Interfaces Adapted from Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces Outline Why Perceptual Interfaces? Multimodal interfaces Vision

More information

MIN-Fakultät Fachbereich Informatik. Universität Hamburg. Socially interactive robots. Christine Upadek. 29 November Christine Upadek 1

MIN-Fakultät Fachbereich Informatik. Universität Hamburg. Socially interactive robots. Christine Upadek. 29 November Christine Upadek 1 Christine Upadek 29 November 2010 Christine Upadek 1 Outline Emotions Kismet - a sociable robot Outlook Christine Upadek 2 Denition Social robots are embodied agents that are part of a heterogeneous group:

More information

Controlling Humanoid Robot Using Head Movements

Controlling Humanoid Robot Using Head Movements Volume-5, Issue-2, April-2015 International Journal of Engineering and Management Research Page Number: 648-652 Controlling Humanoid Robot Using Head Movements S. Mounica 1, A. Naga bhavani 2, Namani.Niharika

More information

Towards Intuitive Industrial Human-Robot Collaboration

Towards Intuitive Industrial Human-Robot Collaboration Towards Intuitive Industrial Human-Robot Collaboration System Design and Future Directions Ferdinand Fuhrmann, Wolfgang Weiß, Lucas Paletta, Bernhard Reiterer, Andreas Schlotzhauer, Mathias Brandstötter

More information

HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART

HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART HUMAN-COMPUTER INTERACTION: OVERVIEW ON STATE OF THE ART Author: S. VAISHNAVI Assistant Professor, Sri Krishna Arts and Science College, Coimbatore (TN) INDIA Co-Author: SWETHASRI L. III.B.Com (PA), Sri

More information

Speech Enhancement Based On Spectral Subtraction For Speech Recognition System With Dpcm

Speech Enhancement Based On Spectral Subtraction For Speech Recognition System With Dpcm International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Speech Enhancement Based On Spectral Subtraction For Speech Recognition System With Dpcm A.T. Rajamanickam, N.P.Subiramaniyam, A.Balamurugan*,

More information

Advanced Man-Machine Interaction

Advanced Man-Machine Interaction Signals and Communication Technology Advanced Man-Machine Interaction Fundamentals and Implementation Bearbeitet von Karl-Friedrich Kraiss 1. Auflage 2006. Buch. XIX, 461 S. ISBN 978 3 540 30618 4 Format

More information

Following Dirt Roads at Night-Time

Following Dirt Roads at Night-Time Following Dirt Roads at Night-Time Sensors and Features for Lane Recognition and Tracking Sebastian F. X. Bayerl Thorsten Luettel Hans-Joachim Wuensche Autonomous Systems Technology (TAS) Department of

More information

Lecturers. Alessandro Vinciarelli

Lecturers. Alessandro Vinciarelli Lecturers Alessandro Vinciarelli Alessandro Vinciarelli, lecturer at the University of Glasgow (Department of Computing Science) and senior researcher of the Idiap Research Institute (Martigny, Switzerland.

More information

Understanding the Mechanism of Sonzai-Kan

Understanding the Mechanism of Sonzai-Kan Understanding the Mechanism of Sonzai-Kan ATR Intelligent Robotics and Communication Laboratories Where does the Sonzai-Kan, the feeling of one's presence, such as the atmosphere, the authority, come from?

More information

INTELLIGENT WHEELCHAIRS

INTELLIGENT WHEELCHAIRS INTELLIGENT WHEELCHAIRS Patrick Carrington INTELLWHEELS: MODULAR DEVELOPMENT PLATFORM FOR INTELLIGENT WHEELCHAIRS Rodrigo Braga, Marcelo Petry, Luis Reis, António Moreira INTRODUCTION IntellWheels is a

More information

Contents. Part I: Images. List of contributing authors XIII Preface 1

Contents. Part I: Images. List of contributing authors XIII Preface 1 Contents List of contributing authors XIII Preface 1 Part I: Images Steve Mushkin My robot 5 I Introduction 5 II Generative-research methodology 6 III What children want from technology 6 A Methodology

More information

Wheel Health Monitoring Using Onboard Sensors

Wheel Health Monitoring Using Onboard Sensors Wheel Health Monitoring Using Onboard Sensors Brad M. Hopkins, Ph.D. Project Engineer Condition Monitoring Amsted Rail Company, Inc. 1 Agenda 1. Motivation 2. Overview of Methodology 3. Application: Wheel

More information

Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno. Editors. Intelligent Environments. Methods, Algorithms and Applications.

Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno. Editors. Intelligent Environments. Methods, Algorithms and Applications. Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno Editors Intelligent Environments Methods, Algorithms and Applications ~ Springer Contents Preface............................................................

More information

Sven Wachsmuth Bielefeld University

Sven Wachsmuth Bielefeld University & CITEC Central Lab Facilities Performance Assessment and System Design in Human Robot Interaction Sven Wachsmuth Bielefeld University May, 2011 & CITEC Central Lab Facilities What are the Flops of cognitive

More information

MULTIMODAL EMOTION RECOGNITION FOR ENHANCING HUMAN COMPUTER INTERACTION

MULTIMODAL EMOTION RECOGNITION FOR ENHANCING HUMAN COMPUTER INTERACTION MULTIMODAL EMOTION RECOGNITION FOR ENHANCING HUMAN COMPUTER INTERACTION THE THESIS SUBMITTED TO SVKM S NMIMS (Deemed to be University) FOR THE DEGREE OF DOCTOR OF PHILOSOPHY IN COMPUTER ENGINEERING BY

More information

Multimedia Forensics

Multimedia Forensics Multimedia Forensics Using Mathematics and Machine Learning to Determine an Image's Source and Authenticity Matthew C. Stamm Multimedia & Information Security Lab (MISL) Department of Electrical and Computer

More information

Introduction to Talking Robots

Introduction to Talking Robots Introduction to Talking Robots Graham Wilcock Adjunct Professor, Docent Emeritus University of Helsinki 1/9/2016 1 Speech and Robot Dialogues Graham Wilcock 1/9/2016 2 Speech Recognition: Open or Closed

More information

DIGITAL SIGNAL PROCESSING. Introduction

DIGITAL SIGNAL PROCESSING. Introduction DIGITAL SIGNAL PROCESSING Introduction What is Signal? A SIGNAL is a measurement of a physical quantity of certain medium. Examples of signals: Audio patterns (voice, speech, music) Visual patterns (written

More information

Essential Understandings with Guiding Questions Robotics Engineering

Essential Understandings with Guiding Questions Robotics Engineering Essential Understandings with Guiding Questions Robotics Engineering 1 st Quarter Theme: Orientation to a Successful Laboratory Experience Student Expectations Safety Emergency MSDS Organizational Systems

More information

Intro to AI. AI is a huge field. AI is a huge field 2/19/15. What is AI. One definition:

Intro to AI. AI is a huge field. AI is a huge field 2/19/15. What is AI. One definition: Intro to AI CS30 David Kauchak Spring 2015 http://www.bbspot.com/comics/pc-weenies/2008/02/3248.php Adapted from notes from: Sara Owsley Sood AI is a huge field What is AI AI is a huge field What is AI

More information

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.

Job Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018. Research Intern Director of Research We are seeking a summer intern to support the team to develop prototype 3D sensing systems based on state-of-the-art sensing technologies along with computer vision

More information

interactive IP: Perception platform and modules

interactive IP: Perception platform and modules interactive IP: Perception platform and modules Angelos Amditis, ICCS 19 th ITS-WC-SIS76: Advanced integrated safety applications based on enhanced perception, active interventions and new advanced sensors

More information

AI Frontiers. Dr. Dario Gil Vice President IBM Research

AI Frontiers. Dr. Dario Gil Vice President IBM Research AI Frontiers Dr. Dario Gil Vice President IBM Research 1 AI is the new IT MIT Intro to Machine Learning course: 2013 138 students 2016 302 students 2017 700 students 2 What is AI? Artificial Intelligence

More information

Major Project SSAD. Mentor : Raghudeep SSAD Mentor :Manish Jha Group : Group20 Members : Harshit Daga ( ) Aman Saxena ( )

Major Project SSAD. Mentor : Raghudeep SSAD Mentor :Manish Jha Group : Group20 Members : Harshit Daga ( ) Aman Saxena ( ) Major Project SSAD Advisor : Dr. Kamalakar Karlapalem Mentor : Raghudeep SSAD Mentor :Manish Jha Group : Group20 Members : Harshit Daga (200801028) Aman Saxena (200801010) We were supposed to calculate

More information

Object Category Detection using Audio-visual Cues

Object Category Detection using Audio-visual Cues Object Category Detection using Audio-visual Cues Luo Jie 1,2, Barbara Caputo 1,2, Alon Zweig 3, Jörg-Hendrik Bach 4, and Jörn Anemüller 4 1 IDIAP Research Institute, Centre du Parc, 1920 Martigny, Switzerland

More information

Autonomous Vehicle Speaker Verification System

Autonomous Vehicle Speaker Verification System Autonomous Vehicle Speaker Verification System Functional Requirements List and Performance Specifications Aaron Pfalzgraf Christopher Sullivan Project Advisor: Dr. Jose Sanchez 4 November 2013 AVSVS 2

More information

Mobile Target Tracking Using Radio Sensor Network

Mobile Target Tracking Using Radio Sensor Network Mobile Target Tracking Using Radio Sensor Network Nic Auth Grant Hovey Advisor: Dr. Suruz Miah Department of Electrical and Computer Engineering Bradley University 1501 W. Bradley Avenue Peoria, IL, 61625,

More information

Visual Interpretation of Hand Gestures as a Practical Interface Modality

Visual Interpretation of Hand Gestures as a Practical Interface Modality Visual Interpretation of Hand Gestures as a Practical Interface Modality Frederik C. M. Kjeldsen Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate

More information

Announcements. HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9. to me.

Announcements. HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9.  to me. Announcements HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9. E-mail to me. Quiz 4 : OPTIONAL: Take home quiz, open book. If you re happy with your quiz grades so far, you

More information

CAPACITIES FOR TECHNOLOGY TRANSFER

CAPACITIES FOR TECHNOLOGY TRANSFER CAPACITIES FOR TECHNOLOGY TRANSFER The Institut de Robòtica i Informàtica Industrial (IRI) is a Joint University Research Institute of the Spanish Council for Scientific Research (CSIC) and the Technical

More information

Cognitive Media Processing

Cognitive Media Processing Cognitive Media Processing 2011-11-01 Nobuaki Minematsu Menu of the last lecture Interaction and multimedia User-friendliness and reality Role of multimedia interface Direct interface and indirect (agent)

More information

S&T Stakeholders Conference

S&T Stakeholders Conference S&T Stakeholders Conference May 21-24, 2007 Future Attribute Screening Technology Mobile Module (FAST M 2 ) Innovation/HSARPA HIP Bob Burns Program Manager Office of Innovation/Human Factors Division Science

More information

Prof. Subramanian Ramamoorthy. The University of Edinburgh, Reader at the School of Informatics

Prof. Subramanian Ramamoorthy. The University of Edinburgh, Reader at the School of Informatics Prof. Subramanian Ramamoorthy The University of Edinburgh, Reader at the School of Informatics with Baxter there is a good simulator, a physical robot and easy to access public libraries means it s relatively

More information

Audio data fuzzy fusion for source localization

Audio data fuzzy fusion for source localization International Neural Network Society 13-16 September, 2013, Halkidiki, Greece Audio data fuzzy fusion for source localization M. Malcangi Università degli Studi di Milano Department of Computer Science

More information

Auditory System For a Mobile Robot

Auditory System For a Mobile Robot Auditory System For a Mobile Robot PhD Thesis Jean-Marc Valin Department of Electrical Engineering and Computer Engineering Université de Sherbrooke, Québec, Canada Jean-Marc.Valin@USherbrooke.ca Motivations

More information

Control Design Made Easy By Ryan Gordon

Control Design Made Easy By Ryan Gordon Control Design Made Easy By Ryan Gordon 2014 The MathWorks, Inc. 1 Key Themes You can automatically tune PID controllers in MATLAB from acquired data You can automatically tune PID controllers from dynamic

More information

Keywords Mobile Phones, Accelerometer, Gestures, Hand Writing, Voice Detection, Air Signature, HCI.

Keywords Mobile Phones, Accelerometer, Gestures, Hand Writing, Voice Detection, Air Signature, HCI. Volume 5, Issue 3, March 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Advanced Techniques

More information

A*STAR Unveils Singapore s First Social Robots at Robocup2010

A*STAR Unveils Singapore s First Social Robots at Robocup2010 MEDIA RELEASE Singapore, 21 June 2010 Total: 6 pages A*STAR Unveils Singapore s First Social Robots at Robocup2010 Visit Suntec City to experience the first social robots - OLIVIA and LUCAS that can see,

More information

Lecture 2: Sensors. Zheng-Hua Tan

Lecture 2: Sensors. Zheng-Hua Tan Instrumentation and data acquisition Spring 2010 Lecture 2: Sensors Zheng-Hua Tan Multimedia Information and Signal Processing Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk

More information

Intro to AI. AI is a huge field. AI is a huge field 2/26/16. What is AI (artificial intelligence) What is AI. One definition:

Intro to AI. AI is a huge field. AI is a huge field 2/26/16. What is AI (artificial intelligence) What is AI. One definition: Intro to AI CS30 David Kauchak Spring 2016 http://www.bbspot.com/comics/pc-weenies/2008/02/3248.php Adapted from notes from: Sara Owsley Sood AI is a huge field What is AI (artificial intelligence) AI

More information

Generating Personality Character in a Face Robot through Interaction with Human

Generating Personality Character in a Face Robot through Interaction with Human Generating Personality Character in a Face Robot through Interaction with Human F. Iida, M. Tabata and F. Hara Department of Mechanical Engineering Science University of Tokyo - Kagurazaka, Shinjuku-ku,

More information

Introduction to Haptics

Introduction to Haptics Introduction to Haptics Roope Raisamo Multimodal Interaction Research Group Tampere Unit for Computer Human Interaction (TAUCHI) Department of Computer Sciences University of Tampere, Finland Definition

More information

Dimension Reduction of the Modulation Spectrogram for Speaker Verification

Dimension Reduction of the Modulation Spectrogram for Speaker Verification Dimension Reduction of the Modulation Spectrogram for Speaker Verification Tomi Kinnunen Speech and Image Processing Unit Department of Computer Science University of Joensuu, Finland Kong Aik Lee and

More information

Human Identification from Video: A Summary of Multimodal Approaches

Human Identification from Video: A Summary of Multimodal Approaches June 2010 Human Identification from Video: A Summary of Multimodal Approaches Project Leads Charles Schmitt, PhD, Renaissance Computing Institute Allan Porterfield, PhD, Renaissance Computing Institute

More information

BIOMETRIC IDENTIFICATION USING 3D FACE SCANS

BIOMETRIC IDENTIFICATION USING 3D FACE SCANS BIOMETRIC IDENTIFICATION USING 3D FACE SCANS Chao Li Armando Barreto Craig Chin Jing Zhai Electrical and Computer Engineering Department Florida International University Miami, Florida, 33174, USA ABSTRACT

More information

Microphone Array Design and Beamforming

Microphone Array Design and Beamforming Microphone Array Design and Beamforming Heinrich Löllmann Multimedia Communications and Signal Processing heinrich.loellmann@fau.de with contributions from Vladi Tourbabin and Hendrik Barfuss EUSIPCO Tutorial

More information

Multi-modal Human-Computer Interaction. Attila Fazekas.

Multi-modal Human-Computer Interaction. Attila Fazekas. Multi-modal Human-Computer Interaction Attila Fazekas Attila.Fazekas@inf.unideb.hu Szeged, 12 July 2007 Hungary and Debrecen Multi-modal Human-Computer Interaction - 2 Debrecen Big Church Multi-modal Human-Computer

More information

Deep Learning Overview

Deep Learning Overview Deep Learning Overview Eliu Huerta Gravity Group gravity.ncsa.illinois.edu National Center for Supercomputing Applications Department of Astronomy University of Illinois at Urbana-Champaign Data Visualization

More information

Introduction to Talking Robots. Graham Wilcock Adjunct Professor, Docent Emeritus University of Helsinki

Introduction to Talking Robots. Graham Wilcock Adjunct Professor, Docent Emeritus University of Helsinki Introduction to Talking Robots Graham Wilcock Adjunct Professor, Docent Emeritus University of Helsinki 2/12/2016 1 Robot Speech and Dialogues Graham Wilcock 2/12/2016 2 Speech Recognition: Open or Closed

More information

BRAIN COMPUTER INTERFACE (BCI) RESEARCH CENTER AT SRM UNIVERSITY

BRAIN COMPUTER INTERFACE (BCI) RESEARCH CENTER AT SRM UNIVERSITY BRAIN COMPUTER INTERFACE (BCI) RESEARCH CENTER AT SRM UNIVERSITY INTRODUCTION TO BCI Brain Computer Interfacing has been one of the growing fields of research and development in recent years. An Electroencephalograph

More information

Prof Trivedi ECE253A Notes for Students only

Prof Trivedi ECE253A Notes for Students only ECE 253A: Digital Processing: Course Related Class Website: https://sites.google.com/a/eng.ucsd.edu/ece253fall2017/ Course Graduate Assistants: Nachiket Deo Borhan Vasili Kirill Pirozenko Piazza Grading:

More information

INTRODUCTION TO DEEP LEARNING. Steve Tjoa June 2013

INTRODUCTION TO DEEP LEARNING. Steve Tjoa June 2013 INTRODUCTION TO DEEP LEARNING Steve Tjoa kiemyang@gmail.com June 2013 Acknowledgements http://ufldl.stanford.edu/wiki/index.php/ UFLDL_Tutorial http://youtu.be/ayzoubkuf3m http://youtu.be/zmnoatzigik 2

More information

Reconfigurable ROS-based Resilient Reasoning Robotic Cooperating Systems. D93.62 Industrial exhibition and event

Reconfigurable ROS-based Resilient Reasoning Robotic Cooperating Systems. D93.62 Industrial exhibition and event Reconfigurable ROS-based Resilient Reasoning Robotic Cooperating Systems D93.62 Industrial exhibition and event Lars Dalgaard, DTI Malene Tofveson Nibe, DTI Project Grant agreement no. 621447 Deliverable

More information

Research Seminar. Stefano CARRINO fr.ch

Research Seminar. Stefano CARRINO  fr.ch Research Seminar Stefano CARRINO stefano.carrino@hefr.ch http://aramis.project.eia- fr.ch 26.03.2010 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks

More information

Performance study of Text-independent Speaker identification system using MFCC & IMFCC for Telephone and Microphone Speeches

Performance study of Text-independent Speaker identification system using MFCC & IMFCC for Telephone and Microphone Speeches Performance study of Text-independent Speaker identification system using & I for Telephone and Microphone Speeches Ruchi Chaudhary, National Technical Research Organization Abstract: A state-of-the-art

More information

Feel the beat: using cross-modal rhythm to integrate perception of objects, others, and self

Feel the beat: using cross-modal rhythm to integrate perception of objects, others, and self Feel the beat: using cross-modal rhythm to integrate perception of objects, others, and self Paul Fitzpatrick and Artur M. Arsenio CSAIL, MIT Modal and amodal features Modal and amodal features (following

More information

What s Hot? The M&A and Funding Landscape for Embedded Vision Companies

What s Hot? The M&A and Funding Landscape for Embedded Vision Companies What s Hot? The M&A and Funding Landscape for Embedded Vision Companies Dr. Rudolph Burger May 2018 Copyright 2018 Woodside Capital Partners 1 Questions Addressed 1. How have we segmented the embedded

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

Activity monitoring and summarization for an intelligent meeting room

Activity monitoring and summarization for an intelligent meeting room IEEE Workshop on Human Motion, Austin, Texas, December 2000 Activity monitoring and summarization for an intelligent meeting room Ivana Mikic, Kohsia Huang, Mohan Trivedi Computer Vision and Robotics Research

More information

Finding Lips in Unconstrained Imagery for Improved Automatic Speech Recognition

Finding Lips in Unconstrained Imagery for Improved Automatic Speech Recognition Finding Lips in Unconstrained Imagery for Improved Automatic Speech Recognition Xiaozheng Jane Zhang, Higinio Ariel Montoya, and Brandon Crow Abstract. Lip movement of a speaker conveys important visual

More information

RESEARCH AND DEVELOPMENT OF DSP-BASED FACE RECOGNITION SYSTEM FOR ROBOTIC REHABILITATION NURSING BEDS

RESEARCH AND DEVELOPMENT OF DSP-BASED FACE RECOGNITION SYSTEM FOR ROBOTIC REHABILITATION NURSING BEDS RESEARCH AND DEVELOPMENT OF DSP-BASED FACE RECOGNITION SYSTEM FOR ROBOTIC REHABILITATION NURSING BEDS Ming XING and Wushan CHENG College of Mechanical Engineering, Shanghai University of Engineering Science,

More information

Multimodal Face Recognition using Hybrid Correlation Filters

Multimodal Face Recognition using Hybrid Correlation Filters Multimodal Face Recognition using Hybrid Correlation Filters Anamika Dubey, Abhishek Sharma Electrical Engineering Department, Indian Institute of Technology Roorkee, India {ana.iitr, abhisharayiya}@gmail.com

More information

Associated Emotion and its Expression in an Entertainment Robot QRIO

Associated Emotion and its Expression in an Entertainment Robot QRIO Associated Emotion and its Expression in an Entertainment Robot QRIO Fumihide Tanaka 1. Kuniaki Noda 1. Tsutomu Sawada 2. Masahiro Fujita 1.2. 1. Life Dynamics Laboratory Preparatory Office, Sony Corporation,

More information

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit)

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit) Exhibit R-2 0602308A Advanced Concepts and Simulation ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit) FY 2005 FY 2006 FY 2007 FY 2008 FY 2009 FY 2010 FY 2011 Total Program Element (PE) Cost 22710 27416

More information

Reduction of Musical Residual Noise Using Harmonic- Adapted-Median Filter

Reduction of Musical Residual Noise Using Harmonic- Adapted-Median Filter Reduction of Musical Residual Noise Using Harmonic- Adapted-Median Filter Ching-Ta Lu, Kun-Fu Tseng 2, Chih-Tsung Chen 2 Department of Information Communication, Asia University, Taichung, Taiwan, ROC

More information

Title Goes Here Algorithms for Biometric Authentication

Title Goes Here Algorithms for Biometric Authentication Title Goes Here Algorithms for Biometric Authentication February 2003 Vijayakumar Bhagavatula 1 Outline Motivation Challenges Technology: Correlation filters Example results Summary 2 Motivation Recognizing

More information

Using Gestures to Interact with a Service Robot using Kinect 2

Using Gestures to Interact with a Service Robot using Kinect 2 Using Gestures to Interact with a Service Robot using Kinect 2 Harold Andres Vasquez 1, Hector Simon Vargas 1, and L. Enrique Sucar 2 1 Popular Autonomous University of Puebla, Puebla, Pue., Mexico {haroldandres.vasquez,hectorsimon.vargas}@upaep.edu.mx

More information

Office hrs: QC: Tue, 1:40pm - 2:40pm; GC: Thur: 11:15am-11:45am.or by appointment.

Office hrs: QC: Tue, 1:40pm - 2:40pm; GC: Thur: 11:15am-11:45am.or by appointment. Title: Biometric Security and Privacy Handout for classes: Class schedule: Contact information and office hours: Prof. Bon Sy, Queens College (NSB A104) Phone: 718-997-3477, or 718-997-3566 to leave a

More information

EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION

EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION EFFICIENT ATTENDANCE MANAGEMENT SYSTEM USING FACE DETECTION AND RECOGNITION 1 Arun.A.V, 2 Bhatath.S, 3 Chethan.N, 4 Manmohan.C.M, 5 Hamsaveni M 1,2,3,4,5 Department of Computer Science and Engineering,

More information

ISSN Vol.02,Issue.17, November-2013, Pages:

ISSN Vol.02,Issue.17, November-2013, Pages: www.semargroups.org, www.ijsetr.com ISSN 2319-8885 Vol.02,Issue.17, November-2013, Pages:1973-1977 A Novel Multimodal Biometric Approach of Face and Ear Recognition using DWT & FFT Algorithms K. L. N.

More information

Outline. Tracking with Unreliable Node Sequences. Abstract. Outline. Outline. Abstract 10/20/2009

Outline. Tracking with Unreliable Node Sequences. Abstract. Outline. Outline. Abstract 10/20/2009 Tracking with Unreliable Node Sequences Ziguo Zhong, Ting Zhu, Dan Wang and Tian He Computer Science and Engineering, University of Minnesota Infocom 2009 Presenter: Jing He Abstract This paper proposes

More information

Requirement Definition

Requirement Definition Requirement Definition 1 Objectives Understand the requirements collection Understand requirements and their correspondence to people, process, technology and organisation infrastructure Understand requirements

More information

The MARCS Institute for Brain, Behaviour and Development

The MARCS Institute for Brain, Behaviour and Development The MARCS Institute for Brain, Behaviour and Development The MARCS Institute for Brain, Behaviour and Development At the MARCS Institute for Brain, Behaviour and Development, we study the scientific bases

More information

AI for Autonomous Ships Challenges in Design and Validation

AI for Autonomous Ships Challenges in Design and Validation VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD AI for Autonomous Ships Challenges in Design and Validation ISSAV 2018 Eetu Heikkilä Autonomous ships - activities in VTT Autonomous ship systems Unmanned engine

More information

Model-Based Design for Sensor Systems

Model-Based Design for Sensor Systems 2009 The MathWorks, Inc. Model-Based Design for Sensor Systems Stephanie Kwan Applications Engineer Agenda Sensor Systems Overview System Level Design Challenges Components of Sensor Systems Sensor Characterization

More information

Modeling Software Systems in Experimental Robotics for Improved Reproducibility

Modeling Software Systems in Experimental Robotics for Improved Reproducibility Modeling Software Systems in Experimental Robotics for Improved Reproducibility A Case Study with the icub Humanoid Robot HUMANOIDS November 18-20th 2014. Madrid. Spain Florian Lier, Sven Wachsmuth, Sebastian

More information

CORC 3303 Exploring Robotics. Why Teams?

CORC 3303 Exploring Robotics. Why Teams? Exploring Robotics Lecture F Robot Teams Topics: 1) Teamwork and Its Challenges 2) Coordination, Communication and Control 3) RoboCup Why Teams? It takes two (or more) Such as cooperative transportation:

More information