Ensuring the Safety of an Autonomous Robot in Interaction with Children

Size: px
Start display at page:

Download "Ensuring the Safety of an Autonomous Robot in Interaction with Children"

Transcription

1 Machine Learning in Robot Assisted Therapy Ensuring the Safety of an Autonomous Robot in Interaction with Children Challenges and Considerations Stefan Walke SS 2018

2 Overview Physical Safety Mental Unharmedness Proposed Guidelines Future Work 1

3 Assessment Therapy Success Chair of Robotics, Artificial Intelligence and Embedded Systems Pushing the lower boundary Many talks on how to improve therapy: Add features Improve therapy logic and reactions Pushing the upper limit of success Safety Considerations: Remove or hold back new features Decrease chance of physical or mental harm Improving the lower boundary Time Problem: When is a system safe? Danger + - Minimizing False Negatives + True Positive False Positive - False Negative True Negative 2

4 Ensuring Physical Safety Source: Interaction Design Foundation

5 Ensuring Physical Safety We can use general human robot interaction as a baseline Adjusting for: Decreased experience of cause-effect chains Increased curiosity Lower pain threshold Different reaction to unforeseen situation Increased possibility of permanent trauma 4

6 Compliant Robots A compliant actuator allows deviations from its equilibrium position, depending applied external forces: Spring-type actuators Hydraulic-type actuators Tendon-type actuators Example: Variable Stiffness Actuator [1] Real-time control of reference position and mechanical impedance Two motors that run in opposite directions vary the tension Main shaft experiences different dampening Perspective Practical Implementation view of the Variable of the Stiffness Actuator. variation [1] The transmission belt 1 connects the DC Motors pulleys 2-3 to the joint shaft 4, and it is tensioned by passive elastic elements [1] 5

7 Soft Tissue & Artificial Skin The Idea of wrapping the robot skeleton in soft material This has multiple advantages: More life-like feel Dampen contact force Include sensors to stop movement in case of contact Other sensors (heart rate, pulse oximeter, etc) Source: TUM 2015 Soft material allows covering up joints in contrast to stiff material Source: Carnegie Mellon University, Soft Robotics and Bionics Lab 6

8 An atlas of physical human robot interaction [2] A map of robotics for anthropic domains: main issues and superposition for phri [2] 7

9 An atlas of physical human robot interaction [2] Problems in the approach: Current Research is separated in two areas (CS and ME) Often no interaction (feed forward control) Danger of false mental Model (especially with children) Difficulty of defining Injury Guidelines in High DoF Systems General/Basic Safety Rules: No sharp edges to reduce risk of lacerations Lightweight but stiff materials to reduce inertia Visco-elastic coatings or compliant actuators to dampen impacts 8

10 An atlas of physical human robot interaction [2] Injury* is not a good metric for safe interaction: Actuators: Do not allow active Impact by monitoring space Speed and precision vs Safety Trade-off Variable-impedance actuation and Distributed macro-mini actuation AIS score Severity Type 0 None None 1 Minor Superficial 2 Moderate Recoverable 3 Serious Possibly recoverable Control: Unstructured anthropic domains no detailed description of the environment Real-time motion planning Impedance control *There is some research into pain tolerance, but as that varies widely from person to person and especially children it is not easy to define [3] 9

11 Mental Unharmedness Source: AI won't just make us better at our jobs - they'll make us better humans, too. (Reuters/Francois Lenoir) 10

12 The Problem with Mental Unharmedness Hard to measure how well child is responding Reduce features: Not concerned about disinterest or distraction Focus on fear, stress and wish to stop Often the first indicators are very subtle and might not be notice Very difficult topic, therefore we pick one special case: Automated detection and classification of positive vs negative robot interactions with children with autism using distance based features [4] 11

13 Experiment Setup Participants: 8 children with ASD from 5 families 5-10 years of age (min. 2 years on communication subscale) In a room with robot and a parent for 3 x 5min Learning phase (get all functions explained) No protocol, child can do what it wants Room has one camera, Robot has IR emitters for orientation The humanoid robot used in the experiment [4] Background subtraction used to find child and parent (differentiate by shirt color) 12

14 Robot Behaviour & Child State Classes Robot (one contingent behaviour session and one random behaviour session) Child approaches/retreats happy/sad (will approach child if further than 1m away) Button pushed or child talks blow bubbles and spin Will try to face child, except if child is behind ignore Parent is only an obstacle Child Avoiding/Retreating Interaction with robot or bubbles Still (not near parent or wall) Near parent (not interacting) Near wall Capture of the camera with participant and robot marked by algorithm [4] 13

15 Positive vs. Negative Robot Interactions Expert classification of states and overall positivity Previous approach used a heuristic measure to determine state Only about 85% accuracy Percentage of session time spent in each interaction state [4] 14

16 Results Classifier with 8-dimensional feature vector: v = (d r c, d p c, d w c, φ r c, v c, v r c, v w c, φ r c v r c ) Trained with human labeled data A Gaussian Mixture Model was used as a Classifier Overall 91.4% accuracy in state recognition Real-time feasible (classification time below camera framerate) avoidance interaction parent wall avoidance interaction parent wall

17 How to build a safe system Proposal Build Systems Bottom up: Add one feature ( hardware or software ) at a time Minimize error before expanding This reduces error propagation and eliminates unforeseen interactions Guidelines for features: Needs graceful exit Needs to be adaptable and online learning enabled Should have provable functionality ( see functional programming) 16

18 The Data Problem Future Work Huge problem of getting enough data with (autistic) children Main hindrance are ethical and medical concerns, unlikely to decrease Problem will probably persist for quite a while Potential Fix: Simulation Simulating physical interaction is easy in principle For emotional interactions there are large amount of classifiers Use classifiers as generators Develop a framework that can simulate emotional states and corresponding gesture 17

19 Questions? 18

20 Sources [1] Design and Control of a Variable Stiffness Actuator for Safe and Fast Physical Human/Robot Interaction G. Tonietti, R. Schiavi, A. Bicchi [2] An atlas of physical human-robot interaction A. De Santis, et al [3] A Failure-to-Safety Kyozon System with Simple Contact Detection and Stop Capabilities for Safe Human-Autonomous Robot Coexistence K. Suita, H. Ikeda, et al [4] Automated detection and classification of positive vs negative robot interactions with children with autism using distance based features D. Feil-Seifer, M. J. Matari c

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many Preface The jubilee 25th International Conference on Robotics in Alpe-Adria-Danube Region, RAAD 2016 was held in the conference centre of the Best Western Hotel M, Belgrade, Serbia, from 30 June to 2 July

More information

Real-Time Safety for Human Robot Interaction

Real-Time Safety for Human Robot Interaction Real-Time Safety for Human Robot Interaction ana Kulić and Elizabeth A. Croft Abstract This paper presents a strategy for ensuring safety during human-robot interaction in real time. A measure of danger

More information

Computer Vision Based Chess Playing Capabilities for the Baxter Humanoid Robot

Computer Vision Based Chess Playing Capabilities for the Baxter Humanoid Robot International Conference on Control, Robotics, and Automation 2016 Computer Vision Based Chess Playing Capabilities for the Baxter Humanoid Robot Andrew Tzer-Yeu Chen, Kevin I-Kai Wang {andrew.chen, kevin.wang}@auckland.ac.nz

More information

CS295-1 Final Project : AIBO

CS295-1 Final Project : AIBO CS295-1 Final Project : AIBO Mert Akdere, Ethan F. Leland December 20, 2005 Abstract This document is the final report for our CS295-1 Sensor Data Management Course Final Project: Project AIBO. The main

More information

Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks. Luka Peternel and Arash Ajoudani Presented by Halishia Chugani

Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks. Luka Peternel and Arash Ajoudani Presented by Halishia Chugani Robots Learning from Robots: A proof of Concept Study for Co-Manipulation Tasks Luka Peternel and Arash Ajoudani Presented by Halishia Chugani Robots learning from humans 1. Robots learn from humans 2.

More information

Theme 2: The new paradigm in robotics safety

Theme 2: The new paradigm in robotics safety Competitiveness in Emerging Robot Technologies (CEROBOT) The opportunities in safety and robots for SMEs Theme 2: The new paradigm in robotics safety Colin Blackman Simon Forge SCF Associates Ltd Safety

More information

ACTUATORS AND SENSORS. Joint actuating system. Servomotors. Sensors

ACTUATORS AND SENSORS. Joint actuating system. Servomotors. Sensors ACTUATORS AND SENSORS Joint actuating system Servomotors Sensors JOINT ACTUATING SYSTEM Transmissions Joint motion low speeds high torques Spur gears change axis of rotation and/or translate application

More information

Strategies for Safety in Human Robot Interaction

Strategies for Safety in Human Robot Interaction Strategies for Safety in Human Robot Interaction D. Kulić E. A. Croft Department of Mechanical Engineering University of British Columbia 2324 Main Mall Vancouver, BC, V6T 1Z4, Canada Abstract This paper

More information

ES 492: SCIENCE IN THE MOVIES

ES 492: SCIENCE IN THE MOVIES UNIVERSITY OF SOUTH ALABAMA ES 492: SCIENCE IN THE MOVIES LECTURE 5: ROBOTICS AND AI PRESENTER: HANNAH BECTON TODAY'S AGENDA 1. Robotics and Real-Time Systems 2. Reacting to the environment around them

More information

Session 11 Introduction to Robotics and Programming mbot. >_ {Code4Loop}; Roochir Purani

Session 11 Introduction to Robotics and Programming mbot. >_ {Code4Loop}; Roochir Purani Session 11 Introduction to Robotics and Programming mbot >_ {Code4Loop}; Roochir Purani RECAP from last 2 sessions 3D Programming with Events and Messages Homework Review /Questions Understanding 3D Programming

More information

Learning and Using Models of Kicking Motions for Legged Robots

Learning and Using Models of Kicking Motions for Legged Robots Learning and Using Models of Kicking Motions for Legged Robots Sonia Chernova and Manuela Veloso Computer Science Department Carnegie Mellon University Pittsburgh, PA 15213 {soniac, mmv}@cs.cmu.edu Abstract

More information

ARTIFICIAL INTELLIGENCE - ROBOTICS

ARTIFICIAL INTELLIGENCE - ROBOTICS ARTIFICIAL INTELLIGENCE - ROBOTICS http://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_robotics.htm Copyright tutorialspoint.com Robotics is a domain in artificial intelligence

More information

Sample Test Project District / Zonal Skill Competitions Skill- Mobile Robotic Category: Manufacturing & Engineering Technology

Sample Test Project District / Zonal Skill Competitions Skill- Mobile Robotic Category: Manufacturing & Engineering Technology Sample Test Project District / Zonal Skill Competitions Skill- Mobile Robotic Category: Manufacturing & Engineering Technology Version 1 Dec 2017 Skill- Mobile Robotic 1 Table of Contents A. Preface...

More information

Service Robots in an Intelligent House

Service Robots in an Intelligent House Service Robots in an Intelligent House Jesus Savage Bio-Robotics Laboratory biorobotics.fi-p.unam.mx School of Engineering Autonomous National University of Mexico UNAM 2017 OUTLINE Introduction A System

More information

Non-Invasive Brain-Actuated Control of a Mobile Robot

Non-Invasive Brain-Actuated Control of a Mobile Robot Non-Invasive Brain-Actuated Control of a Mobile Robot Jose del R. Millan, Frederic Renkens, Josep Mourino, Wulfram Gerstner 5/3/06 Josh Storz CSE 599E BCI Introduction (paper perspective) BCIs BCI = Brain

More information

Dipartimento di Elettronica Informazione e Bioingegneria Robotics

Dipartimento di Elettronica Informazione e Bioingegneria Robotics Dipartimento di Elettronica Informazione e Bioingegneria Robotics Behavioral robotics @ 2014 Behaviorism behave is what organisms do Behaviorism is built on this assumption, and its goal is to promote

More information

Human-Robot Interaction. Aaron Steinfeld Robotics Institute Carnegie Mellon University

Human-Robot Interaction. Aaron Steinfeld Robotics Institute Carnegie Mellon University Human-Robot Interaction Aaron Steinfeld Robotics Institute Carnegie Mellon University Human-Robot Interface Sandstorm, www.redteamracing.org Typical Questions: Why is field robotics hard? Why isn t machine

More information

Introduction to Robotics

Introduction to Robotics Artificial Intelligence & Neuro Cognitive Systems Fakultät für Informatik Introduction to Robotics Dr.-Ing. John Nassour 11.10.2016 Suggested literature General Information Prerequisites: Basic knowledge

More information

This article was published in an Elsevier journal. The attached copy is furnished to the author for non-commercial research and education use, including for instruction at the author s institution, sharing

More information

Vishnu Nath. Usage of computer vision and humanoid robotics to create autonomous robots. (Ximea Currera RL04C Camera Kit)

Vishnu Nath. Usage of computer vision and humanoid robotics to create autonomous robots. (Ximea Currera RL04C Camera Kit) Vishnu Nath Usage of computer vision and humanoid robotics to create autonomous robots (Ximea Currera RL04C Camera Kit) Acknowledgements Firstly, I would like to thank Ivan Klimkovic of Ximea Corporation,

More information

Dynamic analysis and control of a Hybrid serial/cable driven robot for lower-limb rehabilitation

Dynamic analysis and control of a Hybrid serial/cable driven robot for lower-limb rehabilitation Dynamic analysis and control of a Hybrid serial/cable driven robot for lower-limb rehabilitation M. Ismail 1, S. Lahouar 2 and L. Romdhane 1,3 1 Mechanical Laboratory of Sousse (LMS), National Engineering

More information

Robotics II DESCRIPTION. EXAM INFORMATION Items

Robotics II DESCRIPTION. EXAM INFORMATION Items EXAM INFORMATION Items 37 Points 49 Prerequisites NONE Grade Level 10-12 Course Length ONE SEMESTER Career Cluster MANUFACTURING SCIENCE, TECHNOLOGY, ENGINEERING, AND MATHEMATICS Performance Standards

More information

Interaction Learning

Interaction Learning Interaction Learning Johann Isaak Intelligent Autonomous Systems, TU Darmstadt Johann.Isaak_5@gmx.de Abstract The robot is becoming more and more part of the normal life that emerged some conflicts, like:

More information

KINECT CONTROLLED HUMANOID AND HELICOPTER

KINECT CONTROLLED HUMANOID AND HELICOPTER KINECT CONTROLLED HUMANOID AND HELICOPTER Muffakham Jah College of Engineering & Technology Presented by : MOHAMMED KHAJA ILIAS PASHA ZESHAN ABDUL MAJEED AZMI SYED ABRAR MOHAMMED ISHRAQ SARID MOHAMMED

More information

15: Ethics in Machine Learning, plus Artificial General Intelligence and some old Science Fiction

15: Ethics in Machine Learning, plus Artificial General Intelligence and some old Science Fiction 15: Ethics in Machine Learning, plus Artificial General Intelligence and some old Science Fiction Machine Learning and Real-world Data Ann Copestake and Simone Teufel Computer Laboratory University of

More information

Jim Mangione June, 2017

Jim Mangione June, 2017 Jim Mangione 22-23 June, 2017 Placeholder for Cholesterol VR Video https://vimeo.com/208537130 PLAY VIDEO FROM: 00:35 01:42 2 This presentation outlines a general technology direction. Pfizer Inc. has

More information

Baxter Safety and Compliance Overview

Baxter Safety and Compliance Overview Baxter Safety and Compliance Overview How this unique collaborative robot safely manages operational risks Unlike typical industrial robots that operate behind safeguarding, Baxter, the collaborative robot

More information

Built-in soft-start feature. Up-Slope and Down-Slope. Power-Up safe start feature. Motor will only start if pulse of 1.5ms is detected.

Built-in soft-start feature. Up-Slope and Down-Slope. Power-Up safe start feature. Motor will only start if pulse of 1.5ms is detected. Thank You for purchasing our TRI-Mode programmable DC Motor Controller. Our DC Motor Controller is the most flexible controller you will find. It is user-programmable and covers most applications. This

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

Soft Bionics Hands with a Sense of Touch Through an Electronic Skin

Soft Bionics Hands with a Sense of Touch Through an Electronic Skin Soft Bionics Hands with a Sense of Touch Through an Electronic Skin Mahmoud Tavakoli, Rui Pedro Rocha, João Lourenço, Tong Lu and Carmel Majidi Abstract Integration of compliance into the Robotics hands

More information

HeroX - Untethered VR Training in Sync'ed Physical Spaces

HeroX - Untethered VR Training in Sync'ed Physical Spaces Page 1 of 6 HeroX - Untethered VR Training in Sync'ed Physical Spaces Above and Beyond - Integrating Robotics In previous research work I experimented with multiple robots remotely controlled by people

More information

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview April, 2017

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview April, 2017 The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems Overview April, 2017 @johnchavens 3 IEEE Standards Association IEEE s Technology Ethics Landscape

More information

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview June, 2017

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview June, 2017 The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems Overview June, 2017 @johnchavens Ethically Aligned Design A Vision for Prioritizing Human Wellbeing

More information

Humanoid robot. Honda's ASIMO, an example of a humanoid robot

Humanoid robot. Honda's ASIMO, an example of a humanoid robot Humanoid robot Honda's ASIMO, an example of a humanoid robot A humanoid robot is a robot with its overall appearance based on that of the human body, allowing interaction with made-for-human tools or environments.

More information

MEASURING AND ANALYZING FINE MOTOR SKILLS

MEASURING AND ANALYZING FINE MOTOR SKILLS MEASURING AND ANALYZING FINE MOTOR SKILLS PART 1: MOTION TRACKING AND EMG OF FINE MOVEMENTS PART 2: HIGH-FIDELITY CAPTURE OF HAND AND FINGER BIOMECHANICS Abstract This white paper discusses an example

More information

Outline. Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types

Outline. Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Intelligent Agents Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Agents An agent is anything that can be viewed as

More information

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003

More information

DEVELOPMENT OF THE HUMANOID ROBOT HUBO-FX-1

DEVELOPMENT OF THE HUMANOID ROBOT HUBO-FX-1 DEVELOPMENT OF THE HUMANOID ROBOT HUBO-FX-1 Jungho Lee, KAIST, Republic of Korea, jungho77@kaist.ac.kr Jung-Yup Kim, KAIST, Republic of Korea, kirk1@mclab3.kaist.ac.kr Ill-Woo Park, KAIST, Republic of

More information

On the Role Duality and Switching in Human-Robot Cooperation: An adaptive approach

On the Role Duality and Switching in Human-Robot Cooperation: An adaptive approach 2015 IEEE International Conference on Robotics and Automation (ICRA) Washington State Convention Center Seattle, Washington, May 26-30, 2015 On the Role Duality and Switching in Human-Robot Cooperation:

More information

The Cricket Indoor Location System

The Cricket Indoor Location System The Cricket Indoor Location System Hari Balakrishnan Cricket Project MIT Computer Science and Artificial Intelligence Lab http://nms.csail.mit.edu/~hari http://cricket.csail.mit.edu Joint work with Bodhi

More information

Artificial Neural Network based Mobile Robot Navigation

Artificial Neural Network based Mobile Robot Navigation Artificial Neural Network based Mobile Robot Navigation István Engedy Budapest University of Technology and Economics, Department of Measurement and Information Systems, Magyar tudósok körútja 2. H-1117,

More information

Building Perceptive Robots with INTEL Euclid Development kit

Building Perceptive Robots with INTEL Euclid Development kit Building Perceptive Robots with INTEL Euclid Development kit Amit Moran Perceptual Computing Systems Innovation 2 2 3 A modern robot should Perform a task Find its way in our world and move safely Understand

More information

Unit 12: Artificial Intelligence CS 101, Fall 2018

Unit 12: Artificial Intelligence CS 101, Fall 2018 Unit 12: Artificial Intelligence CS 101, Fall 2018 Learning Objectives After completing this unit, you should be able to: Explain the difference between procedural and declarative knowledge. Describe the

More information

Robot Hands: Mechanics, Contact Constraints, and Design for Open-loop Performance

Robot Hands: Mechanics, Contact Constraints, and Design for Open-loop Performance Robot Hands: Mechanics, Contact Constraints, and Design for Open-loop Performance Aaron M. Dollar John J. Lee Associate Professor of Mechanical Engineering and Materials Science Aerial Robotics Yale GRAB

More information

Abstract. 1. Introduction

Abstract. 1. Introduction Trans Am: An Experiment in Autonomous Navigation Jason W. Grzywna, Dr. A. Antonio Arroyo Machine Intelligence Laboratory Dept. of Electrical Engineering University of Florida, USA Tel. (352) 392-6605 Email:

More information

Motion Control of a Three Active Wheeled Mobile Robot and Collision-Free Human Following Navigation in Outdoor Environment

Motion Control of a Three Active Wheeled Mobile Robot and Collision-Free Human Following Navigation in Outdoor Environment Proceedings of the International MultiConference of Engineers and Computer Scientists 2016 Vol I,, March 16-18, 2016, Hong Kong Motion Control of a Three Active Wheeled Mobile Robot and Collision-Free

More information

NCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects

NCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects NCCT Promise for the Best Projects IEEE PROJECTS in various Domains Latest Projects, 2009-2010 ADVANCED ROBOTICS SOLUTIONS EMBEDDED SYSTEM PROJECTS Microcontrollers VLSI DSP Matlab Robotics ADVANCED ROBOTICS

More information

Wireless robotics: issues and the need for standardization

Wireless robotics: issues and the need for standardization Wireless robotics: issues and the need for standardization Alois Knoll fortiss ggmbh & Chair Robotics and Embedded Systems at TUM 19-Apr-2010 Robots have to operate in diverse environments ( BLG LOGISTICS)

More information

Why Humanoid Robots?*

Why Humanoid Robots?* Why Humanoid Robots?* AJLONTECH * Largely adapted from Carlos Balaguer s talk in IURS 06 Outline Motivation What is a Humanoid Anyway? History of Humanoid Robots Why Develop Humanoids? Challenges in Humanoids

More information

Swarm Robotics. Clustering and Sorting

Swarm Robotics. Clustering and Sorting Swarm Robotics Clustering and Sorting By Andrew Vardy Associate Professor Computer Science / Engineering Memorial University of Newfoundland St. John s, Canada Deneubourg JL, Goss S, Franks N, Sendova-Franks

More information

MEM380 Applied Autonomous Robots I Winter Feedback Control USARSim

MEM380 Applied Autonomous Robots I Winter Feedback Control USARSim MEM380 Applied Autonomous Robots I Winter 2011 Feedback Control USARSim Transforming Accelerations into Position Estimates In a perfect world It s not a perfect world. We have noise and bias in our acceleration

More information

CONTACT: , ROBOTIC BASED PROJECTS

CONTACT: , ROBOTIC BASED PROJECTS ROBOTIC BASED PROJECTS 1. ADVANCED ROBOTIC PICK AND PLACE ARM AND HAND SYSTEM 2. AN ARTIFICIAL LAND MARK DESIGN BASED ON MOBILE ROBOT LOCALIZATION AND NAVIGATION 3. ANDROID PHONE ACCELEROMETER SENSOR BASED

More information

Technical Cognitive Systems

Technical Cognitive Systems Part XII Actuators 3 Outline Robot Bases Hardware Components Robot Arms 4 Outline Robot Bases Hardware Components Robot Arms 5 (Wheeled) Locomotion Goal: Bring the robot to a desired pose (x, y, θ): (position

More information

Behaviour-Based Control. IAR Lecture 5 Barbara Webb

Behaviour-Based Control. IAR Lecture 5 Barbara Webb Behaviour-Based Control IAR Lecture 5 Barbara Webb Traditional sense-plan-act approach suggests a vertical (serial) task decomposition Sensors Actuators perception modelling planning task execution motor

More information

Panel on Adaptive, Autonomous and Machine Learning: Applications, Challenges and Risks - Introduction

Panel on Adaptive, Autonomous and Machine Learning: Applications, Challenges and Risks - Introduction Panel on Adaptive, Autonomous and Machine Learning: Applications, Challenges and Risks - Introduction Prof. Dr. Andreas Rausch Februar 2018 Clausthal University of Technology Institute for Informatics

More information

Interaction rule learning with a human partner based on an imitation faculty with a simple visuo-motor mapping

Interaction rule learning with a human partner based on an imitation faculty with a simple visuo-motor mapping Robotics and Autonomous Systems 54 (2006) 414 418 www.elsevier.com/locate/robot Interaction rule learning with a human partner based on an imitation faculty with a simple visuo-motor mapping Masaki Ogino

More information

Learning and Using Models of Kicking Motions for Legged Robots

Learning and Using Models of Kicking Motions for Legged Robots Learning and Using Models of Kicking Motions for Legged Robots Sonia Chernova and Manuela Veloso Computer Science Department Carnegie Mellon University Pittsburgh, PA 15213 {soniac, mmv}@cs.cmu.edu Abstract

More information

Machine Learning in Robot Assisted Therapy (RAT)

Machine Learning in Robot Assisted Therapy (RAT) MasterSeminar Machine Learning in Robot Assisted Therapy (RAT) M.Sc. Sina Shafaei http://www6.in.tum.de/ Shafaei@in.tum.de Office 03.07.057 SS 2018 Chair of Robotics, Artificial Intelligence and Embedded

More information

Intelligent Robotics Sensors and Actuators

Intelligent Robotics Sensors and Actuators Intelligent Robotics Sensors and Actuators Luís Paulo Reis (University of Porto) Nuno Lau (University of Aveiro) The Perception Problem Do we need perception? Complexity Uncertainty Dynamic World Detection/Correction

More information

* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged

* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged ADVANCED ROBOTICS SOLUTIONS * Intelli Mobile Robot for Multi Specialty Operations * Advanced Robotic Pick and Place Arm and Hand System * Automatic Color Sensing Robot using PC * AI Based Image Capturing

More information

Real-Time Face Detection and Tracking for High Resolution Smart Camera System

Real-Time Face Detection and Tracking for High Resolution Smart Camera System Digital Image Computing Techniques and Applications Real-Time Face Detection and Tracking for High Resolution Smart Camera System Y. M. Mustafah a,b, T. Shan a, A. W. Azman a,b, A. Bigdeli a, B. C. Lovell

More information

CS277 - Experimental Haptics Lecture 2. Haptic Rendering

CS277 - Experimental Haptics Lecture 2. Haptic Rendering CS277 - Experimental Haptics Lecture 2 Haptic Rendering Outline Announcements Human haptic perception Anatomy of a visual-haptic simulation Virtual wall and potential field rendering A note on timing...

More information

Wearable Robotics Funding Opportunities and Commercialization of Robotics and Mobility Systems Bruce Floersheim, Ph.D., P.E.

Wearable Robotics Funding Opportunities and Commercialization of Robotics and Mobility Systems Bruce Floersheim, Ph.D., P.E. Wearable Robotics Funding Opportunities and Commercialization of Robotics and Mobility Systems Bruce Floersheim, Ph.D., P.E. www.wearablerobotics.com Help shape a global future leveraging technology in

More information

Human-Robot Interaction

Human-Robot Interaction Human-Robot Interaction 91.451 Robotics II Prof. Yanco Spring 2005 Prof. Yanco 91.451 Robotics II, Spring 2005 HRI Lecture, Slide 1 What is Human-Robot Interaction (HRI)? Prof. Yanco 91.451 Robotics II,

More information

Robot: icub This humanoid helps us study the brain

Robot: icub This humanoid helps us study the brain ProfileArticle Robot: icub This humanoid helps us study the brain For the complete profile with media resources, visit: http://education.nationalgeographic.org/news/robot-icub/ Program By Robohub Tuesday,

More information

Physical Human Robot Interaction

Physical Human Robot Interaction MIN Faculty Department of Informatics Physical Human Robot Interaction Intelligent Robotics Seminar Ilay Köksal University of Hamburg Faculty of Mathematics, Informatics and Natural Sciences Department

More information

Challenges to human dignity from developments in AI

Challenges to human dignity from developments in AI Challenges to human dignity from developments in AI Thomas G. Dietterich Distinguished Professor (Emeritus) Oregon State University Corvallis, OR USA Outline What is Artificial Intelligence? Near-Term

More information

Essential Understandings with Guiding Questions Robotics Engineering

Essential Understandings with Guiding Questions Robotics Engineering Essential Understandings with Guiding Questions Robotics Engineering 1 st Quarter Theme: Orientation to a Successful Laboratory Experience Student Expectations Safety Emergency MSDS Organizational Systems

More information

Journal of Theoretical and Applied Mechanics, Sofia, 2014, vol. 44, No. 1, pp ROBONAUT 2: MISSION, TECHNOLOGIES, PERSPECTIVES

Journal of Theoretical and Applied Mechanics, Sofia, 2014, vol. 44, No. 1, pp ROBONAUT 2: MISSION, TECHNOLOGIES, PERSPECTIVES Journal of Theoretical and Applied Mechanics, Sofia, 2014, vol. 44, No. 1, pp. 97 102 SCIENTIFIC LIFE DOI: 10.2478/jtam-2014-0006 ROBONAUT 2: MISSION, TECHNOLOGIES, PERSPECTIVES Galia V. Tzvetkova Institute

More information

PICK AND PLACE HUMANOID ROBOT USING RASPBERRY PI AND ARDUINO FOR INDUSTRIAL APPLICATIONS

PICK AND PLACE HUMANOID ROBOT USING RASPBERRY PI AND ARDUINO FOR INDUSTRIAL APPLICATIONS PICK AND PLACE HUMANOID ROBOT USING RASPBERRY PI AND ARDUINO FOR INDUSTRIAL APPLICATIONS Bernard Franklin 1, Sachin.P 2, Jagadish.S 3, Shaista Noor 4, Rajashekhar C. Biradar 5 1,2,3,4,5 School of Electronics

More information

HAND-SHAPED INTERFACE FOR INTUITIVE HUMAN- ROBOT COMMUNICATION THROUGH HAPTIC MEDIA

HAND-SHAPED INTERFACE FOR INTUITIVE HUMAN- ROBOT COMMUNICATION THROUGH HAPTIC MEDIA HAND-SHAPED INTERFACE FOR INTUITIVE HUMAN- ROBOT COMMUNICATION THROUGH HAPTIC MEDIA RIKU HIKIJI AND SHUJI HASHIMOTO Department of Applied Physics, School of Science and Engineering, Waseda University 3-4-1

More information

Stabilize humanoid robot teleoperated by a RGB-D sensor

Stabilize humanoid robot teleoperated by a RGB-D sensor Stabilize humanoid robot teleoperated by a RGB-D sensor Andrea Bisson, Andrea Busatto, Stefano Michieletto, and Emanuele Menegatti Intelligent Autonomous Systems Lab (IAS-Lab) Department of Information

More information

Mechatronics Engineering and Automation Faculty of Engineering, Ain Shams University MCT-151, Spring 2015 Lab-4: Electric Actuators

Mechatronics Engineering and Automation Faculty of Engineering, Ain Shams University MCT-151, Spring 2015 Lab-4: Electric Actuators Mechatronics Engineering and Automation Faculty of Engineering, Ain Shams University MCT-151, Spring 2015 Lab-4: Electric Actuators Ahmed Okasha, Assistant Lecturer okasha1st@gmail.com Objective Have a

More information

Learning with Confidence: Theory and Practice of Information Geometric Learning from High-dim Sensory Data

Learning with Confidence: Theory and Practice of Information Geometric Learning from High-dim Sensory Data Learning with Confidence: Theory and Practice of Information Geometric Learning from High-dim Sensory Data Professor Lin Zhang Department of Electronic Engineering, Tsinghua University Co-director, Tsinghua-Berkeley

More information

What is a robot. Robots (seen as artificial beings) appeared in books and movies long before real applications. Basilio Bona ROBOTICS 01PEEQW

What is a robot. Robots (seen as artificial beings) appeared in books and movies long before real applications. Basilio Bona ROBOTICS 01PEEQW ROBOTICS 01PEEQW An Introduction Basilio Bona DAUIN Politecnico di Torino What is a robot According to the Robot Institute of America (1979) a robot is: A reprogrammable, multifunctional manipulator designed

More information

Visual Interpretation of Hand Gestures as a Practical Interface Modality

Visual Interpretation of Hand Gestures as a Practical Interface Modality Visual Interpretation of Hand Gestures as a Practical Interface Modality Frederik C. M. Kjeldsen Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate

More information

Actuators, sensors and control architecture

Actuators, sensors and control architecture Actuators, sensors and control architecture a robot is composed of three fundamental parts actuators besides motors and transmissions, they constitute the locomotion apparatus (wheels, crawlers, mechanical

More information

Development of a Laboratory Kit for Robotics Engineering Education

Development of a Laboratory Kit for Robotics Engineering Education Development of a Laboratory Kit for Robotics Engineering Education Taskin Padir, William Michalson, Greg Fischer, Gary Pollice Worcester Polytechnic Institute Robotics Engineering Program tpadir@wpi.edu

More information

BioRob-Arm: A Quickly Deployable and Intrinsically Safe, Light- Weight Robot Arm for Service Robotics Applications.

BioRob-Arm: A Quickly Deployable and Intrinsically Safe, Light- Weight Robot Arm for Service Robotics Applications. BioRob-Arm: A Quickly Deployable and Intrinsically Safe, Light- Weight Robot Arm for Service Robotics Applications. Thomas Lens, Jürgen Kunz, Oskar von Stryk Simulation, Systems Optimization and Robotics

More information

Mechatronics-Level 1

Mechatronics-Level 1 Measuring What Matters in Job Ready Assessment Blueprint Mechatronics-Level 1 Test Code: 2040 / Version: 01 Copyright 2012 General Assessment Information General Assessment Information Written Assessment

More information

Fibratus tactile sensor using reflection image

Fibratus tactile sensor using reflection image Fibratus tactile sensor using reflection image The requirements of fibratus tactile sensor Satoshi Saga Tohoku University Shinobu Kuroki Univ. of Tokyo Susumu Tachi Univ. of Tokyo Abstract In recent years,

More information

ARTIFICIAL INTELLIGENCE (CS 370D)

ARTIFICIAL INTELLIGENCE (CS 370D) Princess Nora University Faculty of Computer & Information Systems ARTIFICIAL INTELLIGENCE (CS 370D) (CHAPTER-5) ADVERSARIAL SEARCH ADVERSARIAL SEARCH Optimal decisions Min algorithm α-β pruning Imperfect,

More information

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute

Jane Li. Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Jane Li Assistant Professor Mechanical Engineering Department, Robotic Engineering Program Worcester Polytechnic Institute Use an example to explain what is admittance control? You may refer to exoskeleton

More information

Research of an Algorithm on Face Detection

Research of an Algorithm on Face Detection , pp.217-222 http://dx.doi.org/10.14257/astl.2016.141.47 Research of an Algorithm on Face Detection Gong Liheng, Yang Jingjing, Zhang Xiao School of Information Science and Engineering, Hebei North University,

More information

Behaviour Patterns Evolution on Individual and Group Level. Stanislav Slušný, Roman Neruda, Petra Vidnerová. CIMMACS 07, December 14, Tenerife

Behaviour Patterns Evolution on Individual and Group Level. Stanislav Slušný, Roman Neruda, Petra Vidnerová. CIMMACS 07, December 14, Tenerife Behaviour Patterns Evolution on Individual and Group Level Stanislav Slušný, Roman Neruda, Petra Vidnerová Department of Theoretical Computer Science Institute of Computer Science Academy of Science of

More information

Optic Flow Based Skill Learning for A Humanoid to Trap, Approach to, and Pass a Ball

Optic Flow Based Skill Learning for A Humanoid to Trap, Approach to, and Pass a Ball Optic Flow Based Skill Learning for A Humanoid to Trap, Approach to, and Pass a Ball Masaki Ogino 1, Masaaki Kikuchi 1, Jun ichiro Ooga 1, Masahiro Aono 1 and Minoru Asada 1,2 1 Dept. of Adaptive Machine

More information

Booklet of teaching units

Booklet of teaching units International Master Program in Mechatronic Systems for Rehabilitation Booklet of teaching units Third semester (M2 S1) Master Sciences de l Ingénieur Université Pierre et Marie Curie Paris 6 Boite 164,

More information

GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL

GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL GESTURE RECOGNITION SOLUTION FOR PRESENTATION CONTROL Darko Martinovikj Nevena Ackovska Faculty of Computer Science and Engineering Skopje, R. Macedonia ABSTRACT Despite the fact that there are different

More information

CS686: High-level Motion/Path Planning Applications

CS686: High-level Motion/Path Planning Applications CS686: High-level Motion/Path Planning Applications Sung-Eui Yoon ( 윤성의 ) Course URL: http://sglab.kaist.ac.kr/~sungeui/mpa Class Objectives Discuss my general research view on motion planning Discuss

More information

National Aeronautics and Space Administration

National Aeronautics and Space Administration National Aeronautics and Space Administration 2013 Spinoff (spin ôf ) -noun. 1. A commercialized product incorporating NASA technology or expertise that benefits the public. These include products or processes

More information

Chapter 2 Mechatronics Disrupted

Chapter 2 Mechatronics Disrupted Chapter 2 Mechatronics Disrupted Maarten Steinbuch 2.1 How It Started The field of mechatronics started in the 1970s when mechanical systems needed more accurate controlled motions. This forced both industry

More information

ROMEO Humanoid for Action and Communication. Rodolphe GELIN Aldebaran Robotics

ROMEO Humanoid for Action and Communication. Rodolphe GELIN Aldebaran Robotics ROMEO Humanoid for Action and Communication Rodolphe GELIN Aldebaran Robotics 7 th workshop on Humanoid November Soccer 2012 Robots Osaka, November 2012 Overview French National Project labeled by Cluster

More information

Mobile Robot Navigation Contest for Undergraduate Design and K-12 Outreach

Mobile Robot Navigation Contest for Undergraduate Design and K-12 Outreach Session 1520 Mobile Robot Navigation Contest for Undergraduate Design and K-12 Outreach Robert Avanzato Penn State Abington Abstract Penn State Abington has developed an autonomous mobile robotics competition

More information

Sokoban: Reversed Solving

Sokoban: Reversed Solving Sokoban: Reversed Solving Frank Takes (ftakes@liacs.nl) Leiden Institute of Advanced Computer Science (LIACS), Leiden University June 20, 2008 Abstract This article describes a new method for attempting

More information

Term Paper: Robot Arm Modeling

Term Paper: Robot Arm Modeling Term Paper: Robot Arm Modeling Akul Penugonda December 10, 2014 1 Abstract This project attempts to model and verify the motion of a robot arm. The two joints used in robot arms - prismatic and rotational.

More information

School of Engineering SUMMER CAMPS PROGRAMMING : STEP BY STEP ROBOTICS & BASICS OF PROGRAMMING. INTERNET OF THINGS IoT, SMARTPHONE APPLICATIONS

School of Engineering SUMMER CAMPS PROGRAMMING : STEP BY STEP ROBOTICS & BASICS OF PROGRAMMING. INTERNET OF THINGS IoT, SMARTPHONE APPLICATIONS School of Engineering SUMMER CAMPS 20 18 PROGRAMMING : STEP BY STEP June 4 - July 24 ROBOTICS & BASICS OF PROGRAMMING INTERNET OF THINGS IoT, SMARTPHONE APPLICATIONS PROGRAMMING & BIOMEDICAL APPLICATIONS

More information

Robotics 2 Collision detection and robot reaction

Robotics 2 Collision detection and robot reaction Robotics 2 Collision detection and robot reaction Prof. Alessandro De Luca Handling of robot collisions! safety in physical Human-Robot Interaction (phri)! robot dependability (i.e., beyond reliability)!

More information

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster)

Session 2: 10 Year Vision session (11:00-12:20) - Tuesday. Session 3: Poster Highlights A (14:00-15:00) - Tuesday 20 posters (3minutes per poster) Lessons from Collecting a Million Biometric Samples 109 Expression Robust 3D Face Recognition by Matching Multi-component Local Shape Descriptors on the Nasal and Adjoining Cheek Regions 177 Shared Representation

More information

Why we need to know what AI is. Overview. Artificial Intelligence is it finally arriving?

Why we need to know what AI is. Overview. Artificial Intelligence is it finally arriving? Artificial Intelligence is it finally arriving? Artificial Intelligence is it finally arriving? Are we nearly there yet? Leslie Smith Computing Science and Mathematics University of Stirling May 2 2013.

More information