Research Seminar. Stefano CARRINO fr.ch

Size: px
Start display at page:

Download "Research Seminar. Stefano CARRINO fr.ch"

Transcription

1 Research Seminar Stefano CARRINO fr.ch

2 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks Applications Conclusion 2

3 - based interaction, why? The gestures are a natural way to interact with object, tools and other people As substitution for other forms of communication when other interactions are not possible Impaired people Special context As complement to other types of interaction modalities 3

4 A motion of the limbs or body made to express or help express thought or to emphasize speech. The act of moving the limbs or body as an expression of thought or emphasis. An act or a remark made as a formality or as a sign of intention or attitude. A succession of postures. Own definition (for this seminar): An intentional sign made with the body or limbs to communicate intention or information 4

5 s Vs Gesticulation Also the gesticulation provides information Static Vs Dynamic s Static gestures (aka postures, poses, ) Dynamic gestures: a sequence of postures/positions Multi- dimensional gestures 2D gestures 3D gestures Pointing gesture 5

6 2D gesture 3D gesture Pointing gesture 6

7 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks Applications Conclusion 7

8 Dynamic gesture recognition (through computer vision) can be divided in the following main phases: Detection Tracking segmentation recognition Features extraction Detection Tracking Segmentation Recognition Features Extractions 8

9 Two sub- steps: Image acquisition Preprocessing Detection Tracking Segmentation Features Extractions Recognition 9

10 Image acquisition Mono- camera, multi- camera, stereo- camera, or 3D camera Camera resolution (low Vs high resolution) Frames per second Detection Tracking Segmentation Features Extractions Recognition 10

11 Preprocessing Pixel level segmentation Color segmentation Hand detection Color marker detection Motion segmentation Background subtraction Works good on known background (static background) Cannot detect stationary hands or determine which moving object is the hand Detection Tracking Segmentation Recognition Features Extractions 11

12 Preprocessing Contour detection Not directly depending on skin color and lighting conditions Can be a large number of objects (even in the background) Correlation Problems when objects are rotated or scaled Problem can be avoided with continuously updating the template Detection Tracking Segmentation Recognition Features Extractions 12

13 Frame 1 1 Detection 2 Frame 2 1 Tracking Segmentation Recognition Features Extractions 2 13

14 Approaches Kalman filter Easily computable in real- time Basic form of Kalman filters cannot track objects on unknown background Condensation One of the most used technique for tracking Detect and track contour of moving objects in a cluttered environment CAMshift Fast, real- time It may be possible to improve accuracy by using different color representation There are quite a few parameters System without tracking In controlled environment with a special gesture vocabulary Detection Tracking Segmentation Recognition Features Extractions 14

15 segmentation Initial (final) posture When hands are not moving - > end of gesture decomposition Preparation, stroke and retraction Statistical approach Hidden Markov Model Detection Tracking Segmentation Recognition Features Extractions 15

16 Potential features: Position, acceleration, velocity Spatial temporal width FFT of the position The features can be extracted in three steps of the process chain Post- processing should be done before providing the features to the GR block Detection Tracking Segmentation Recognition Features Extractions 16

17 Classification Algorithms: Hidden Markov Model (HMM) Ergodic HMM, Left- Right HMM, Left- Right Banded Hierarchic HMM, Input- Output HMM, Parametric HMM, etc. etc. etc. Conditional Random Fields (CRF) Hidden CRF, Latent- dynamic Discriminative CRF, etc. Neural Networks (NN), Decision Trees, Support Vector Machine (SVN), KNN, Dynamic time warping (DTW), etc. Boosting Algorithms, etc. Hybrid algorithms Detection Tracking Segmentation Recognition Features Extractions 17

18 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks Applications Conclusion 18

19 Design challenges Lighting conditions Provide a feedback to the user vocabulary (small large, kind of gesture used, etc.) Real- time interaction Wearable gesture interfaces Multimodality Skinput project 19

20 Advantages: Natural way of interaction Space effective interaction modality (compared with keyboard and mouse) Removes the user s dependency on a surface Remote interaction Drawbacks: Tiring (e.g. gorilla arm) User dependent gestures few universal understandable gestures Computationally expensive 20

21 Natal project The Project Natal sensor device Sixthsense G-speak 21

22 Project natal: US/live/projectnatal/ Oblong g- speak: Sixth Sense: Touchless: Wiiremotes (and soon the Play Station Move) 22

23 - based interaction Characterization Recognition Typical approach Design challenges, advantages, drawbacks Applications Conclusion 23

24 based interaction as interface characterization Gesticulation & gesture Dynamic Vs static gesture Multi- dimensional gesture Typical approach Challenges, advantages, and drawback 24

25 25

Stereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays. Habib Abi-Rached Thursday 17 February 2005.

Stereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays. Habib Abi-Rached Thursday 17 February 2005. Stereo-based Hand Gesture Tracking and Recognition in Immersive Stereoscopic Displays Habib Abi-Rached Thursday 17 February 2005. Objective Mission: Facilitate communication: Bandwidth. Intuitiveness.

More information

A SURVEY ON GESTURE RECOGNITION TECHNOLOGY

A SURVEY ON GESTURE RECOGNITION TECHNOLOGY A SURVEY ON GESTURE RECOGNITION TECHNOLOGY Deeba Kazim 1, Mohd Faisal 2 1 MCA Student, Integral University, Lucknow (India) 2 Assistant Professor, Integral University, Lucknow (india) ABSTRACT Gesture

More information

Design a Model and Algorithm for multi Way Gesture Recognition using Motion and Image Comparison

Design a Model and Algorithm for multi Way Gesture Recognition using Motion and Image Comparison e-issn 2455 1392 Volume 2 Issue 10, October 2016 pp. 34 41 Scientific Journal Impact Factor : 3.468 http://www.ijcter.com Design a Model and Algorithm for multi Way Gesture Recognition using Motion and

More information

Applying Vision to Intelligent Human-Computer Interaction

Applying Vision to Intelligent Human-Computer Interaction Applying Vision to Intelligent Human-Computer Interaction Guangqi Ye Department of Computer Science The Johns Hopkins University Baltimore, MD 21218 October 21, 2005 1 Vision for Natural HCI Advantages

More information

Sign Language Recognition using Hidden Markov Model

Sign Language Recognition using Hidden Markov Model Sign Language Recognition using Hidden Markov Model Pooja P. Bhoir 1, Dr. Anil V. Nandyhyhh 2, Dr. D. S. Bormane 3, Prof. Rajashri R. Itkarkar 4 1 M.E.student VLSI and Embedded System,E&TC,JSPM s Rajarshi

More information

Visual Interpretation of Hand Gestures as a Practical Interface Modality

Visual Interpretation of Hand Gestures as a Practical Interface Modality Visual Interpretation of Hand Gestures as a Practical Interface Modality Frederik C. M. Kjeldsen Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate

More information

Hand Gesture Recognition Based on Hidden Markov Models

Hand Gesture Recognition Based on Hidden Markov Models Hand Gesture Recognition Based on Hidden Markov Models Pooja P. Bhoir 1, Prof. Rajashri R. Itkarkar 2, Shilpa Bhople 3 1 M.E. Scholar (VLSI &Embedded System), E&Tc Engg. Dept., JSPM s Rajarshi Shau COE,

More information

Hand & Upper Body Based Hybrid Gesture Recognition

Hand & Upper Body Based Hybrid Gesture Recognition Hand & Upper Body Based Hybrid Gesture Prerna Sharma #1, Naman Sharma *2 # Research Scholor, G. B. P. U. A. & T. Pantnagar, India * Ideal Institue of Technology, Ghaziabad, India Abstract Communication

More information

A SURVEY ON HAND GESTURE RECOGNITION

A SURVEY ON HAND GESTURE RECOGNITION A SURVEY ON HAND GESTURE RECOGNITION U.K. Jaliya 1, Dr. Darshak Thakore 2, Deepali Kawdiya 3 1 Assistant Professor, Department of Computer Engineering, B.V.M, Gujarat, India 2 Assistant Professor, Department

More information

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING SEMINAR REPORT ON GESTURE RECOGNITION SUBMITTED BY PRAKRUTHI.V ( )

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING SEMINAR REPORT ON GESTURE RECOGNITION SUBMITTED BY PRAKRUTHI.V ( ) DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING PONDICHERRY ENGINEERING COLLEGE SEMINAR REPORT ON GESTURE RECOGNITION SUBMITTED BY PRAKRUTHI.V (283175132) PRATHIBHA ANNAPURNA.P (283175135) SARANYA.S (283175174)

More information

Wearable Gestural Interface

Wearable Gestural Interface Report Wearable Gestural Interface Master thesis July 2009 - December 2009 Matthias Schwaller Professors: Elena Mugellini (EIA - FR) Omar Abou Khaled (EIA - FR) Rolf Ingold (UNIFR) Abstract: This report

More information

COMPARATIVE PERFORMANCE ANALYSIS OF HAND GESTURE RECOGNITION TECHNIQUES

COMPARATIVE PERFORMANCE ANALYSIS OF HAND GESTURE RECOGNITION TECHNIQUES International Journal of Advanced Research in Engineering and Technology (IJARET) Volume 9, Issue 3, May - June 2018, pp. 177 185, Article ID: IJARET_09_03_023 Available online at http://www.iaeme.com/ijaret/issues.asp?jtype=ijaret&vtype=9&itype=3

More information

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster)

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster) Lessons from Collecting a Million Biometric Samples 109 Expression Robust 3D Face Recognition by Matching Multi-component Local Shape Descriptors on the Nasal and Adjoining Cheek Regions 177 Shared Representation

More information

Volume 3, Issue 5, May 2015 International Journal of Advance Research in Computer Science and Management Studies

Volume 3, Issue 5, May 2015 International Journal of Advance Research in Computer Science and Management Studies Volume 3, Issue 5, May 2015 International Journal of Advance Research in Computer Science and Management Studies Research Article / Survey Paper / Case Study Available online at: www.ijarcsms.com A Survey

More information

VICs: A Modular Vision-Based HCI Framework

VICs: A Modular Vision-Based HCI Framework VICs: A Modular Vision-Based HCI Framework The Visual Interaction Cues Project Guangqi Ye, Jason Corso Darius Burschka, & Greg Hager CIRL, 1 Today, I ll be presenting work that is part of an ongoing project

More information

Advanced Techniques for Mobile Robotics Location-Based Activity Recognition

Advanced Techniques for Mobile Robotics Location-Based Activity Recognition Advanced Techniques for Mobile Robotics Location-Based Activity Recognition Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Activity Recognition Based on L. Liao, D. J. Patterson, D. Fox,

More information

Service Robots in an Intelligent House

Service Robots in an Intelligent House Service Robots in an Intelligent House Jesus Savage Bio-Robotics Laboratory biorobotics.fi-p.unam.mx School of Engineering Autonomous National University of Mexico UNAM 2017 OUTLINE Introduction A System

More information

International Journal of Research in Computer and Communication Technology, Vol 2, Issue 12, December- 2013

International Journal of Research in Computer and Communication Technology, Vol 2, Issue 12, December- 2013 Design Of Virtual Sense Technology For System Interface Mr. Chetan Dhule, Prof.T.H.Nagrare Computer Science & Engineering Department, G.H Raisoni College Of Engineering. ABSTRACT A gesture-based human

More information

The Control of Avatar Motion Using Hand Gesture

The Control of Avatar Motion Using Hand Gesture The Control of Avatar Motion Using Hand Gesture ChanSu Lee, SangWon Ghyme, ChanJong Park Human Computing Dept. VR Team Electronics and Telecommunications Research Institute 305-350, 161 Kajang-dong, Yusong-gu,

More information

COMPARATIVE STUDY AND ANALYSIS FOR GESTURE RECOGNITION METHODOLOGIES

COMPARATIVE STUDY AND ANALYSIS FOR GESTURE RECOGNITION METHODOLOGIES http:// COMPARATIVE STUDY AND ANALYSIS FOR GESTURE RECOGNITION METHODOLOGIES Rafiqul Z. Khan 1, Noor A. Ibraheem 2 1 Department of Computer Science, A.M.U. Aligarh, India 2 Department of Computer Science,

More information

AN ANALYSIS OF SPEECH RECOGNITION PERFORMANCE BASED UPON NETWORK LAYERS AND TRANSFER FUNCTIONS

AN ANALYSIS OF SPEECH RECOGNITION PERFORMANCE BASED UPON NETWORK LAYERS AND TRANSFER FUNCTIONS AN ANALYSIS OF SPEECH RECOGNITION PERFORMANCE BASED UPON NETWORK LAYERS AND TRANSFER FUNCTIONS Kuldeep Kumar 1, R. K. Aggarwal 1 and Ankita Jain 2 1 Department of Computer Engineering, National Institute

More information

Gesture Recognition Technology: A Review

Gesture Recognition Technology: A Review Gesture Recognition Technology: A Review PALLAVI HALARNKAR pallavi.halarnkar@nmims.edu SAHIL SHAH sahil0591@gmail.com HARSH SHAH harsh1506@hotmail.com HARDIK SHAH hardikshah2711@gmail.com JAY SHAH jay.shah309@gmail.com

More information

Contents 1 Introduction Optical Character Recognition Systems Soft Computing Techniques for Optical Character Recognition Systems

Contents 1 Introduction Optical Character Recognition Systems Soft Computing Techniques for Optical Character Recognition Systems Contents 1 Introduction.... 1 1.1 Organization of the Monograph.... 1 1.2 Notation.... 3 1.3 State of Art.... 4 1.4 Research Issues and Challenges.... 5 1.5 Figures.... 5 1.6 MATLAB OCR Toolbox.... 5 References....

More information

The Automatic Classification Problem. Perceptrons, SVMs, and Friends: Some Discriminative Models for Classification

The Automatic Classification Problem. Perceptrons, SVMs, and Friends: Some Discriminative Models for Classification Perceptrons, SVMs, and Friends: Some Discriminative Models for Classification Parallel to AIMA 8., 8., 8.6.3, 8.9 The Automatic Classification Problem Assign object/event or sequence of objects/events

More information

Advanced Man-Machine Interaction

Advanced Man-Machine Interaction Signals and Communication Technology Advanced Man-Machine Interaction Fundamentals and Implementation Bearbeitet von Karl-Friedrich Kraiss 1. Auflage 2006. Buch. XIX, 461 S. ISBN 978 3 540 30618 4 Format

More information

FACE AND HAND GESTURE RECOGNITION FOR PHYSICAL IMPAIRMENT PEOPLE USING NN-CLASSIFICATION

FACE AND HAND GESTURE RECOGNITION FOR PHYSICAL IMPAIRMENT PEOPLE USING NN-CLASSIFICATION International Journal of Computer Engineering and Applications, Volume XI, Issue VII, July 17, www.ijcea.com ISSN 2321-3469 FACE AND HAND GESTURE RECOGNITION FOR PHYSICAL IMPAIRMENT PEOPLE USING NN-CLASSIFICATION

More information

UUIs Ubiquitous User Interfaces

UUIs Ubiquitous User Interfaces UUIs Ubiquitous User Interfaces Alexander Nelson April 16th, 2018 University of Arkansas - Department of Computer Science and Computer Engineering The Problem As more and more computation is woven into

More information

What was the first gestural interface?

What was the first gestural interface? stanford hci group / cs247 Human-Computer Interaction Design Studio What was the first gestural interface? 15 January 2013 http://cs247.stanford.edu Theremin Myron Krueger 1 Myron Krueger There were things

More information

FACE RECOGNITION USING NEURAL NETWORKS

FACE RECOGNITION USING NEURAL NETWORKS Int. J. Elec&Electr.Eng&Telecoms. 2014 Vinoda Yaragatti and Bhaskar B, 2014 Research Paper ISSN 2319 2518 www.ijeetc.com Vol. 3, No. 3, July 2014 2014 IJEETC. All Rights Reserved FACE RECOGNITION USING

More information

Touch & Gesture. HCID 520 User Interface Software & Technology

Touch & Gesture. HCID 520 User Interface Software & Technology Touch & Gesture HCID 520 User Interface Software & Technology Natural User Interfaces What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger

More information

Static Hand Gesture Recognition based on DWT Feature Extraction Technique

Static Hand Gesture Recognition based on DWT Feature Extraction Technique IJIRST International Journal for Innovative Research in Science & Technology Volume 2 Issue 05 October 2015 ISSN (online): 2349-6010 Static Hand Gesture Recognition based on DWT Feature Extraction Technique

More information

Touch & Gesture. HCID 520 User Interface Software & Technology

Touch & Gesture. HCID 520 User Interface Software & Technology Touch & Gesture HCID 520 User Interface Software & Technology What was the first gestural interface? Myron Krueger There were things I resented about computers. Myron Krueger There were things I resented

More information

Object Recognition + Gesture Recognition

Object Recognition + Gesture Recognition Object Recognition + Gesture Recognition Matt Loper CS148 Nov 1st, 2007 Motivation Consider the robot control loop Compare it to a human Decision Making Actuators World Perception Sensors Motivation Consider

More information

Background Pixel Classification for Motion Detection in Video Image Sequences

Background Pixel Classification for Motion Detection in Video Image Sequences Background Pixel Classification for Motion Detection in Video Image Sequences P. Gil-Jiménez, S. Maldonado-Bascón, R. Gil-Pita, and H. Gómez-Moreno Dpto. de Teoría de la señal y Comunicaciones. Universidad

More information

ROBOT CONTROL VIA DIALOGUE. Arkady Yuschenko

ROBOT CONTROL VIA DIALOGUE. Arkady Yuschenko 158 No:13 Intelligent Information and Engineering Systems ROBOT CONTROL VIA DIALOGUE Arkady Yuschenko Abstract: The most rational mode of communication between intelligent robot and human-operator is bilateral

More information

SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System

SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System Zhenyao Mo +1 213 740 4250 zmo@graphics.usc.edu J. P. Lewis +1 213 740 9619 zilla@computer.org Ulrich Neumann +1 213 740 0877 uneumann@usc.edu

More information

Live Hand Gesture Recognition using an Android Device

Live Hand Gesture Recognition using an Android Device Live Hand Gesture Recognition using an Android Device Mr. Yogesh B. Dongare Department of Computer Engineering. G.H.Raisoni College of Engineering and Management, Ahmednagar. Email- yogesh.dongare05@gmail.com

More information

Static Signature Verification and Recognition using Neural Network Approach-A Survey

Static Signature Verification and Recognition using Neural Network Approach-A Survey Available online www.ejaet.com European Journal of Advances in Engineering and Technology, 2015, 2(4): 46-50 Review Article ISSN: 2394-658X Static Signature Verification and Recognition using Neural Network

More information

Vision Based Hand Gesture Recognition

Vision Based Hand Gesture Recognition Vision Based Hand Gesture Recognition Yanmin Zhu 1, Zhibo Yang 2, Bo Yuan 3 Intelligent Computing Lab, Division of Informatics Graduate School at Shenzhen, Tsinghua University Shenzhen 518055, P. R. China

More information

Gesture Recognition with Real World Environment using Kinect: A Review

Gesture Recognition with Real World Environment using Kinect: A Review Gesture Recognition with Real World Environment using Kinect: A Review Prakash S. Sawai 1, Prof. V. K. Shandilya 2 P.G. Student, Department of Computer Science & Engineering, Sipna COET, Amravati, Maharashtra,

More information

Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno. Editors. Intelligent Environments. Methods, Algorithms and Applications.

Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno. Editors. Intelligent Environments. Methods, Algorithms and Applications. Dorothy Monekosso. Paolo Remagnino Yoshinori Kuno Editors Intelligent Environments Methods, Algorithms and Applications ~ Springer Contents Preface............................................................

More information

Analysis of Various Methodology of Hand Gesture Recognition System using MATLAB

Analysis of Various Methodology of Hand Gesture Recognition System using MATLAB Analysis of Various Methodology of Hand Gesture Recognition System using MATLAB Komal Hasija 1, Rajani Mehta 2 Abstract Recognition is a very effective area of research in regard of security with the involvement

More information

Input devices and interaction. Ruth Aylett

Input devices and interaction. Ruth Aylett Input devices and interaction Ruth Aylett Contents Tracking What is available Devices Gloves, 6 DOF mouse, WiiMote Why is it important? Interaction is basic to VEs We defined them as interactive in real-time

More information

Virtual Grasping Using a Data Glove

Virtual Grasping Using a Data Glove Virtual Grasping Using a Data Glove By: Rachel Smith Supervised By: Dr. Kay Robbins 3/25/2005 University of Texas at San Antonio Motivation Navigation in 3D worlds is awkward using traditional mouse Direct

More information

Multi-modal Human-computer Interaction

Multi-modal Human-computer Interaction Multi-modal Human-computer Interaction Attila Fazekas Attila.Fazekas@inf.unideb.hu SSIP 2008, 9 July 2008 Hungary and Debrecen Multi-modal Human-computer Interaction - 2 Debrecen Big Church Multi-modal

More information

Physiological signal(bio-signals) Method, Application, Proposal

Physiological signal(bio-signals) Method, Application, Proposal Physiological signal(bio-signals) Method, Application, Proposal Bio-Signals 1. Electrical signals ECG,EMG,EEG etc 2. Non-electrical signals Breathing, ph, movement etc General Procedure of bio-signal recognition

More information

Image Extraction using Image Mining Technique

Image Extraction using Image Mining Technique IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719 Vol. 3, Issue 9 (September. 2013), V2 PP 36-42 Image Extraction using Image Mining Technique Prof. Samir Kumar Bandyopadhyay,

More information

Robustness (cont.); End-to-end systems

Robustness (cont.); End-to-end systems Robustness (cont.); End-to-end systems Steve Renals Automatic Speech Recognition ASR Lecture 18 27 March 2017 ASR Lecture 18 Robustness (cont.); End-to-end systems 1 Robust Speech Recognition ASR Lecture

More information

Challenging areas:- Hand gesture recognition is a growing very fast and it is I. INTRODUCTION

Challenging areas:- Hand gesture recognition is a growing very fast and it is I. INTRODUCTION Hand gesture recognition for vehicle control Bhagyashri B.Jakhade, Neha A. Kulkarni, Sadanand. Patil Abstract: - The rapid evolution in technology has made electronic gadgets inseparable part of our life.

More information

ECC419 IMAGE PROCESSING

ECC419 IMAGE PROCESSING ECC419 IMAGE PROCESSING INTRODUCTION Image Processing Image processing is a subclass of signal processing concerned specifically with pictures. Digital Image Processing, process digital images by means

More information

A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung,

A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung, IJCSNS International Journal of Computer Science and Network Security, VOL.11 No.9, September 2011 55 A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang,

More information

Human Motion Analysis with the Help of Video Surveillance: A Review

Human Motion Analysis with the Help of Video Surveillance: A Review Human Motion Analysis with the Help of Video Surveillance: A Review Kavita V. Bhaltilak, Harleen Kaur, Cherry Khosla Department of Computer Science and Engineering, Lovely Professional University, Phagwara,

More information

High-speed Noise Cancellation with Microphone Array

High-speed Noise Cancellation with Microphone Array Noise Cancellation a Posteriori Probability, Maximum Criteria Independent Component Analysis High-speed Noise Cancellation with Microphone Array We propose the use of a microphone array based on independent

More information

Booklet of teaching units

Booklet of teaching units International Master Program in Mechatronic Systems for Rehabilitation Booklet of teaching units Third semester (M2 S1) Master Sciences de l Ingénieur Université Pierre et Marie Curie Paris 6 Boite 164,

More information

Independent Component Analysis- Based Background Subtraction for Indoor Surveillance

Independent Component Analysis- Based Background Subtraction for Indoor Surveillance Independent Component Analysis- Based Background Subtraction for Indoor Surveillance Du-Ming Tsai, Shia-Chih Lai IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 18, NO. 1, pp. 158 167, JANUARY 2009 Presenter

More information

Voice Activity Detection

Voice Activity Detection Voice Activity Detection Speech Processing Tom Bäckström Aalto University October 2015 Introduction Voice activity detection (VAD) (or speech activity detection, or speech detection) refers to a class

More information

THE Touchless SDK released by Microsoft provides the

THE Touchless SDK released by Microsoft provides the 1 Touchless Writer: Object Tracking & Neural Network Recognition Yang Wu & Lu Yu The Milton W. Holcombe Department of Electrical and Computer Engineering Clemson University, Clemson, SC 29631 E-mail {wuyang,

More information

R (2) Controlling System Application with hands by identifying movements through Camera

R (2) Controlling System Application with hands by identifying movements through Camera R (2) N (5) Oral (3) Total (10) Dated Sign Assignment Group: C Problem Definition: Controlling System Application with hands by identifying movements through Camera Prerequisite: 1. Web Cam Connectivity

More information

Chapter 4 SPEECH ENHANCEMENT

Chapter 4 SPEECH ENHANCEMENT 44 Chapter 4 SPEECH ENHANCEMENT 4.1 INTRODUCTION: Enhancement is defined as improvement in the value or Quality of something. Speech enhancement is defined as the improvement in intelligibility and/or

More information

Haptic presentation of 3D objects in virtual reality for the visually disabled

Haptic presentation of 3D objects in virtual reality for the visually disabled Haptic presentation of 3D objects in virtual reality for the visually disabled M Moranski, A Materka Institute of Electronics, Technical University of Lodz, Wolczanska 211/215, Lodz, POLAND marcin.moranski@p.lodz.pl,

More information

Image Processing Based Vehicle Detection And Tracking System

Image Processing Based Vehicle Detection And Tracking System Image Processing Based Vehicle Detection And Tracking System Poonam A. Kandalkar 1, Gajanan P. Dhok 2 ME, Scholar, Electronics and Telecommunication Engineering, Sipna College of Engineering and Technology,

More information

MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device

MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device Enkhbat Davaasuren and Jiro Tanaka 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577 Japan {enkhee,jiro}@iplab.cs.tsukuba.ac.jp Abstract.

More information

Dance Movement Patterns Recognition (Part II)

Dance Movement Patterns Recognition (Part II) Dance Movement Patterns Recognition (Part II) Jesús Sánchez Morales Contents Goals HMM Recognizing Simple Steps Recognizing Complex Patterns Auto Generation of Complex Patterns Graphs Test Bench Conclusions

More information

Recent Progress on Wearable Augmented Interaction at AIST

Recent Progress on Wearable Augmented Interaction at AIST Recent Progress on Wearable Augmented Interaction at AIST Takeshi Kurata 12 1 Human Interface Technology Lab University of Washington 2 AIST, Japan kurata@ieee.org Weavy The goal of the Weavy project team

More information

Collaborative Classification of Multiple Ground Vehicles in Wireless Sensor Networks Based on Acoustic Signals

Collaborative Classification of Multiple Ground Vehicles in Wireless Sensor Networks Based on Acoustic Signals Western Michigan University ScholarWorks at WMU Dissertations Graduate College 1-1-2011 Collaborative Classification of Multiple Ground Vehicles in Wireless Sensor Networks Based on Acoustic Signals Ahmad

More information

INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction

INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction INTAIRACT: Joint Hand Gesture and Fingertip Classification for Touchless Interaction Xavier Suau 1,MarcelAlcoverro 2, Adolfo Lopez-Mendez 3, Javier Ruiz-Hidalgo 2,andJosepCasas 3 1 Universitat Politécnica

More information

Applications of Music Processing

Applications of Music Processing Lecture Music Processing Applications of Music Processing Christian Dittmar International Audio Laboratories Erlangen christian.dittmar@audiolabs-erlangen.de Singing Voice Detection Important pre-requisite

More information

Challenges and Potential Research Areas In Biometrics

Challenges and Potential Research Areas In Biometrics Challenges and Potential Research Areas In Biometrics Defence Research and Development Canada Qinghan Xiao and Karim Dahel Defence R&D Canada - Ottawa October 18, 2004 Recherche et développement pour la

More information

A Method for Temporal Hand Gesture Recognition

A Method for Temporal Hand Gesture Recognition A Method for Temporal Hand Gesture Recognition Joshua R. New Knowledge Systems Laboratory Jacksonville State University Jacksonville, AL 36265 (256) 782-5103 newj@ksl.jsu.edu ABSTRACT Ongoing efforts at

More information

GESTURE RECOGNITION FRAMEWORK FOR MULTIMEDIA CONTENT VIEWER CONTROLLING

GESTURE RECOGNITION FRAMEWORK FOR MULTIMEDIA CONTENT VIEWER CONTROLLING GESTURE RECOGNITION FRAMEWORK FOR MULTIMEDIA CONTENT VIEWER CONTROLLING Michal Lech, Bozena Kostek, Andrzej Czyzewski, Piotr Odya Gdansk University of Technology, Multimedia Systems Dept., Gdansk, Poland

More information

Comparison of Head Movement Recognition Algorithms in Immersive Virtual Reality Using Educative Mobile Application

Comparison of Head Movement Recognition Algorithms in Immersive Virtual Reality Using Educative Mobile Application Comparison of Head Recognition Algorithms in Immersive Virtual Reality Using Educative Mobile Application Nehemia Sugianto 1 and Elizabeth Irenne Yuwono 2 Ciputra University, Indonesia 1 nsugianto@ciputra.ac.id

More information

II. LITERATURE SURVEY

II. LITERATURE SURVEY Hand Gesture Recognition Using Operating System Mr. Anap Avinash 1 Bhalerao Sushmita 2, Lambrud Aishwarya 3, Shelke Priyanka 4, Nirmal Mohini 5 12345 Computer Department, P.Dr.V.V.P. Polytechnic, Loni

More information

Wadehra Kartik, Kathpalia Mukul, Bahl Vasudha, International Journal of Advance Research, Ideas and Innovations in Technology

Wadehra Kartik, Kathpalia Mukul, Bahl Vasudha, International Journal of Advance Research, Ideas and Innovations in Technology ISSN: 2454-132X Impact factor: 4.295 (Volume 4, Issue 1) Available online at www.ijariit.com Hand Detection and Gesture Recognition in Real-Time Using Haar-Classification and Convolutional Neural Networks

More information

SSB Debate: Model-based Inference vs. Machine Learning

SSB Debate: Model-based Inference vs. Machine Learning SSB Debate: Model-based nference vs. Machine Learning June 3, 2018 SSB 2018 June 3, 2018 1 / 20 Machine learning in the biological sciences SSB 2018 June 3, 2018 2 / 20 Machine learning in the biological

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY Ashwini Parate,, 2013; Volume 1(8): 754-761 INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK ROBOT AND HOME APPLIANCES CONTROL USING

More information

Multiresolution Color Image Segmentation Applied to Background Extraction in Outdoor Images

Multiresolution Color Image Segmentation Applied to Background Extraction in Outdoor Images Multiresolution Color Image Segmentation Applied to Background Extraction in Outdoor Images Sébastien LEFEVRE 1,2, Loïc MERCIER 1, Vincent TIBERGHIEN 1, Nicole VINCENT 1 1 Laboratoire d Informatique, Université

More information

Real-Time Face Detection and Tracking for High Resolution Smart Camera System

Real-Time Face Detection and Tracking for High Resolution Smart Camera System Digital Image Computing Techniques and Applications Real-Time Face Detection and Tracking for High Resolution Smart Camera System Y. M. Mustafah a,b, T. Shan a, A. W. Azman a,b, A. Bigdeli a, B. C. Lovell

More information

Efficient Target Detection from Hyperspectral Images Based On Removal of Signal Independent and Signal Dependent Noise

Efficient Target Detection from Hyperspectral Images Based On Removal of Signal Independent and Signal Dependent Noise IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 9, Issue 6, Ver. III (Nov - Dec. 2014), PP 45-49 Efficient Target Detection from Hyperspectral

More information

SONG RETRIEVAL SYSTEM USING HIDDEN MARKOV MODELS

SONG RETRIEVAL SYSTEM USING HIDDEN MARKOV MODELS SONG RETRIEVAL SYSTEM USING HIDDEN MARKOV MODELS AKSHAY CHANDRASHEKARAN ANOOP RAMAKRISHNA akshayc@cmu.edu anoopr@andrew.cmu.edu ABHISHEK JAIN GE YANG ajain2@andrew.cmu.edu younger@cmu.edu NIDHI KOHLI R

More information

GestureCommander: Continuous Touch-based Gesture Prediction

GestureCommander: Continuous Touch-based Gesture Prediction GestureCommander: Continuous Touch-based Gesture Prediction George Lucchese george lucchese@tamu.edu Jimmy Ho jimmyho@tamu.edu Tracy Hammond hammond@cs.tamu.edu Martin Field martin.field@gmail.com Ricardo

More information

ROBOT VISION. Dr.M.Madhavi, MED, MVSREC

ROBOT VISION. Dr.M.Madhavi, MED, MVSREC ROBOT VISION Dr.M.Madhavi, MED, MVSREC Robotic vision may be defined as the process of acquiring and extracting information from images of 3-D world. Robotic vision is primarily targeted at manipulation

More information

International Journal of Innovative Research in Engineering Science and Technology APRIL 2018 ISSN X

International Journal of Innovative Research in Engineering Science and Technology APRIL 2018 ISSN X HIGH DYNAMIC RANGE OF MULTISPECTRAL ACQUISITION USING SPATIAL IMAGES 1 M.Kavitha, M.Tech., 2 N.Kannan, M.E., and 3 S.Dharanya, M.E., 1 Assistant Professor/ CSE, Dhirajlal Gandhi College of Technology,

More information

DYNAMIC MEDIA INSTITUTE MFA: DESIGN COURSES

DYNAMIC MEDIA INSTITUTE MFA: DESIGN COURSES DYNAMIC MEDIA INSTITUTE MFA: DESIGN COURSES These are some sample courses offered within the Dynamic Media Institute. With approval of an advisor, students may also choose electives from the Professional

More information

Imaging with hyperspectral sensors: the right design for your application

Imaging with hyperspectral sensors: the right design for your application Imaging with hyperspectral sensors: the right design for your application Frederik Schönebeck Framos GmbH f.schoenebeck@framos.com June 29, 2017 Abstract In many vision applications the relevant information

More information

Convenient Structural Modal Analysis Using Noncontact Vision-Based Displacement Sensor

Convenient Structural Modal Analysis Using Noncontact Vision-Based Displacement Sensor 8th European Workshop On Structural Health Monitoring (EWSHM 2016), 5-8 July 2016, Spain, Bilbao www.ndt.net/app.ewshm2016 Convenient Structural Modal Analysis Using Noncontact Vision-Based Displacement

More information

Announcements. HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9. to me.

Announcements. HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9.  to me. Announcements HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9. E-mail to me. Quiz 4 : OPTIONAL: Take home quiz, open book. If you re happy with your quiz grades so far, you

More information

Different Hand Gesture Recognition Techniques Using Perceptron Network

Different Hand Gesture Recognition Techniques Using Perceptron Network Different Hand Gesture Recognition Techniques Using Perceptron Network Nidhi Chauhan Department of Computer Science & Engg. Suresh Gyan Vihar University, Jaipur(Raj.) Email: nidhi99.chauhan@gmail.com Abstract

More information

Advancements in Gesture Recognition Technology

Advancements in Gesture Recognition Technology IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 4, Issue 4, Ver. I (Jul-Aug. 2014), PP 01-07 e-issn: 2319 4200, p-issn No. : 2319 4197 Advancements in Gesture Recognition Technology 1 Poluka

More information

Advanced Data Analysis Pattern Recognition & Neural Networks Software for Acoustic Emission Applications. Topic: Waveforms in Noesis

Advanced Data Analysis Pattern Recognition & Neural Networks Software for Acoustic Emission Applications. Topic: Waveforms in Noesis Advanced Data Analysis Pattern Recognition & Neural Networks Software for Acoustic Emission Applications Topic: Waveforms in Noesis 1 Noesis Waveforms Capabilities Noesis main features relating to Waveforms:

More information

3D-Position Estimation for Hand Gesture Interface Using a Single Camera

3D-Position Estimation for Hand Gesture Interface Using a Single Camera 3D-Position Estimation for Hand Gesture Interface Using a Single Camera Seung-Hwan Choi, Ji-Hyeong Han, and Jong-Hwan Kim Department of Electrical Engineering, KAIST, Gusung-Dong, Yusung-Gu, Daejeon, Republic

More information

A Kinect-based 3D hand-gesture interface for 3D databases

A Kinect-based 3D hand-gesture interface for 3D databases A Kinect-based 3D hand-gesture interface for 3D databases Abstract. The use of natural interfaces improves significantly aspects related to human-computer interaction and consequently the productivity

More information

Study on Hand Gesture Recognition

Study on Hand Gesture Recognition Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 1, January 2015,

More information

ENHANCHED PALM PRINT IMAGES FOR PERSONAL ACCURATE IDENTIFICATION

ENHANCHED PALM PRINT IMAGES FOR PERSONAL ACCURATE IDENTIFICATION ENHANCHED PALM PRINT IMAGES FOR PERSONAL ACCURATE IDENTIFICATION Prof. Rahul Sathawane 1, Aishwarya Shende 2, Pooja Tete 3, Naina Chandravanshi 4, Nisha Surjuse 5 1 Prof. Rahul Sathawane, Information Technology,

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK ~ W I lilteubner L E Y A Partnership between

More information

Vision-based User-interfaces for Pervasive Computing. CHI 2003 Tutorial Notes. Trevor Darrell Vision Interface Group MIT AI Lab

Vision-based User-interfaces for Pervasive Computing. CHI 2003 Tutorial Notes. Trevor Darrell Vision Interface Group MIT AI Lab Vision-based User-interfaces for Pervasive Computing Tutorial Notes Vision Interface Group MIT AI Lab Table of contents Biographical sketch..ii Agenda..iii Objectives.. iv Abstract..v Introduction....1

More information

Computer Vision, Lecture 3

Computer Vision, Lecture 3 Computer Vision, Lecture 3 Professor Hager http://www.cs.jhu.edu/~hager /4/200 CS 46, Copyright G.D. Hager Outline for Today Image noise Filtering by Convolution Properties of Convolution /4/200 CS 46,

More information

Affordable Real-Time Vision Guidance for Robot Motion Control

Affordable Real-Time Vision Guidance for Robot Motion Control Affordable Real-Time Vision Guidance for Robot Motion Control Cong Wang Assistant Professor ECE and MIE Departments New Jersey Institute of Technology Mobile: (510)529-6691 Office: (973)596-5744 Advanced

More information

Automatic Vehicles Detection from High Resolution Satellite Imagery Using Morphological Neural Networks

Automatic Vehicles Detection from High Resolution Satellite Imagery Using Morphological Neural Networks Automatic Vehicles Detection from High Resolution Satellite Imagery Using Morphological Neural Networks HONG ZHENG Research Center for Intelligent Image Processing and Analysis School of Electronic Information

More information

Online handwritten signature verification system: A Review

Online handwritten signature verification system: A Review Online handwritten signature verification system: A Review Abstract: Online handwritten signature verification system is one of the most reliable, fast and cost effective tool for user authentication.

More information

Automated Real-time Gesture Recognition using Hand Motion Trajectory

Automated Real-time Gesture Recognition using Hand Motion Trajectory Automated Real-time Gesture Recognition using Hand Motion Trajectory Sweta Swami 1, Yusuf Parvez 2, Nathi Ram Chauhan 3 1*2 3 Department of Mechanical and Automation Engineering, Indira Gandhi Delhi Technical

More information