Natural Interaction with Social Robots

Similar documents
ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

Essay on A Survey of Socially Interactive Robots Authors: Terrence Fong, Illah Nourbakhsh, Kerstin Dautenhahn Summarized by: Mehwish Alam

A SURVEY OF SOCIALLY INTERACTIVE ROBOTS

SECOND YEAR PROJECT SUMMARY

Assess how research on the construction of cognitive functions in robotic systems is undertaken in Japan, China, and Korea

SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The

An interdisciplinary collaboration of Theatre Arts and Social Robotics: The creation of empathy and embodiment in social robotics

Personalized short-term multi-modal interaction for social robots assisting users in shopping malls

Perception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision

Humanoid Robots. by Julie Chambon

Sven Wachsmuth Bielefeld University

What topic do you want to hear about? A bilingual talking robot using English and Japanese Wikipedias

MIN-Fakultät Fachbereich Informatik. Universität Hamburg. Socially interactive robots. Christine Upadek. 29 November Christine Upadek 1

Context-Aware Interaction in a Mobile Environment

Understanding the Mechanism of Sonzai-Kan

1 Publishable summary

Applying the Wizard-of-Oz Framework to Cooperative Service Discovery and Configuration

FP7 ICT Call 6: Cognitive Systems and Robotics

The effect of gaze behavior on the attitude towards humanoid robots

Designing the user experience of a multi-bot conversational system

Context-sensitive speech recognition for human-robot interaction

Towards Intuitive Industrial Human-Robot Collaboration

Cognitive Media Processing

Cognitive Systems and Robotics: opportunities in FP7

ROMEO Humanoid for Action and Communication. Rodolphe GELIN Aldebaran Robotics

Contents. Part I: Images. List of contributing authors XIII Preface 1

Drumming with a Humanoid Robot: Lessons Learnt from Designing and Analysing Human-Robot Interaction Studies

Assignment 1 IN5480: interaction with AI s

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera

Topic Paper HRI Theory and Evaluation

Design and evaluation of a telepresence robot for interpersonal communication with older adults

University of Toronto. Companion Robot Security. ECE1778 Winter Wei Hao Chang Apper Alexander Hong Programmer

Multi-Modal User Interaction

Robot Autonomy the future of intelligent autonomous systems?

INTERACTIONS WITH ROBOTS:

Children and Social Robots: An integrative framework

Vishnu Nath. Usage of computer vision and humanoid robotics to create autonomous robots. (Ximea Currera RL04C Camera Kit)

Informing a User of Robot s Mind by Motion

Benchmarking Intelligent Service Robots through Scientific Competitions: the approach. Luca Iocchi. Sapienza University of Rome, Italy

Prospective Teleautonomy For EOD Operations

Building Perceptive Robots with INTEL Euclid Development kit

Proceedings of th IEEE-RAS International Conference on Humanoid Robots ! # Adaptive Systems Research Group, School of Computer Science

Introduction to Talking Robots. Graham Wilcock Adjunct Professor, Docent Emeritus University of Helsinki

Booklet of teaching units

Effect of Cognitive Biases on Human-Robot Interaction: A Case Study of Robot's Misattribution

Does the Appearance of a Robot Affect Users Ways of Giving Commands and Feedback?

Prof. Subramanian Ramamoorthy. The University of Edinburgh, Reader at the School of Informatics

With a New Helper Comes New Tasks

What will the robot do during the final demonstration?

HUMAN-ROBOT COLLABORATION TNO, THE NETHERLANDS. 6 th SAF RA Symposium Sustainable Safety 2030 June 14, 2018 Mr. Johan van Middelaar

Controlling Humanoid Robot Using Head Movements

Safe and Efficient Autonomous Navigation in the Presence of Humans at Control Level

Benchmarking Intelligent Service Robots through Scientific Competitions. Luca Iocchi. Sapienza University of Rome, Italy

VIP I-Natural Team. Report Submitted for VIP Innovation Competition April 26, Name Major Year Semesters. Justin Devenish EE Senior First

This is a repository copy of Designing robot personalities for human-robot symbiotic interaction in an educational context.

Research Issues for Designing Robot Companions: BIRON as a Case Study

Empathy Objects: Robotic Devices as Conversation Companions

BODILY NON-VERBAL INTERACTION WITH VIRTUAL CHARACTERS

Interaction Design -ID. Unit 6

Transer Learning : Super Intelligence

Human-Robot Interaction. Aaron Steinfeld Robotics Institute Carnegie Mellon University

On Intelligence Jeff Hawkins

Meet Pepper. Because of this, Pepper will truly change the way we live our lives.

CORC 3303 Exploring Robotics. Why Teams?

Improving long-term Persuasion for Energy Consumption Behavior: User-centered Development of an Ambient Persuasive Display for private Households

A Robust Neural Robot Navigation Using a Combination of Deliberative and Reactive Control Architectures

Some essential skills and their combination in an architecture for a cognitive and interactive robot.

Associated Emotion and its Expression in an Entertainment Robot QRIO

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many

OASIS concept. Evangelos Bekiaris CERTH/HIT OASIS ISWC2011, 24 October, Bonn

Joining Forces University of Art and Design Helsinki September 22-24, 2005

Dipartimento di Elettronica Informazione e Bioingegneria Robotics

SMART EXPOSITION ROOMS: THE AMBIENT INTELLIGENCE VIEW 1

Intro to AI. AI is a huge field. AI is a huge field 2/19/15. What is AI. One definition:

Human-Robot Interaction: A first overview

Towards an Imperfect Robot for Long-term Companionship: Case Studies Using Cognitive Biases

Robotic Applications Industrial/logistics/medical robots

Interactive Tables. ~Avishek Anand Supervised by: Michael Kipp Chair: Vitaly Friedman

Being natural: On the use of multimodal interaction concepts in smart homes

Appendices master s degree programme Human Machine Communication

Definitions and Application Areas

Autonomous Robotic (Cyber) Weapons?

A Practical Approach to Understanding Robot Consciousness

B Serena Ivaldi Experiments with the icub humanoid. 1 Introduction

Announcements. HW 6: Written (not programming) assignment. Assigned today; Due Friday, Dec. 9. to me.

Hey, I m over here How can a robot attract people s attention?

Contents. Mental Commit Robot (Mental Calming Robot) Industrial Robots. In What Way are These Robots Intelligent. Video: Mental Commit Robots

Towards affordance based human-system interaction based on cyber-physical systems

Effects of Gesture on the Perception of Psychological Anthropomorphism: A Case Study with a Humanoid Robot

Humanoids. Lecture Outline. RSS 2010 Lecture # 19 Una-May O Reilly. Definition and motivation. Locomotion. Why humanoids? What are humanoids?

Touch Perception and Emotional Appraisal for a Virtual Agent

Spatial Sounds (100dB at 100km/h) in the Context of Human Robot Personal Relationships

Robot: icub This humanoid helps us study the brain

, Kerstin Dautenhahn a, Ester Ferrari a, Gernot Kronreif b, Barbara Prazak-Aram c,

Android (Child android)

- Basics of informatics - Computer network - Software engineering - Intelligent media processing - Human interface. Professor. Professor.

RV - AULA 05 - PSI3502/2018. User Experience, Human Computer Interaction and UI

Human-Robot Companionships. Mark Neerincx

HUMAN ROBOT INTERACTION (HRI) is a newly

Perceptual Interfaces. Matthew Turk s (UCSB) and George G. Robertson s (Microsoft Research) slides on perceptual p interfaces

Transcription:

Workshop: Natural Interaction with Social Robots Part of the Topig Group with the same name. http://homepages.stca.herts.ac.uk/~comqkd/tg-naturalinteractionwithsocialrobots.html organized by Kerstin Dautenhahn, Mohamed Chetouani, and Vanesssa Evers 14 March 2014, Rovereto, Italy part of the European Robotics Forum (ERF), 8:30-10:30. A) Summary of presentations Emilia Barakova, Eindhoven University of Technology, the Netherlands Long-term relationships with robots The talk discussed long-term relationships with robots in the framework of experiments in behavioral training of children with autism with a NAO robot. The talk featured the lessons learned from 3 longerterm experiments with robots (long-term from the point of view of robotics research, the experiments were 4-5 months each, but the work with the robot 2-3 months, the rest was pre- and postintervention). It is based on the Wikitherapist and ZonMW funded projects, Wikitherapist is at: http://www.idemployee.id.tue.nl/e.i.barakova/. The talk summarized the challenges for long-term interactions with robots and the effects of habituation to the robot came as a major issue. The talk concluded that in a 1-1 scenario (robot -child) this habituation did not occur, maybe also because the design of the interaction scenarios was more focused on the engagement of the child with the robot. In using the child as a mediator of a Lego game the designer put more efforts in promoting child-to-child interaction, and also the behaviors of the robot were less autonomous, physical, and surprising; so the children at certain point could very well predict what the robot will do and focused on interacting with each other, taking pieces from the robot when necessary. Overall conclusion - more natural and highly autonomous interaction is necessary. The social robots should have intelligent/ autonomous behaviors. Speech interaction is crucial in the interaction with a humanoid robot.

Laurence Devillers, Paris-Sorbonne IV/Researcher at LIMSI-CNRS, France Affective and social dimensions of spoken interactions between human and robot The talk discussed social robot interactions based on emotion, intention, and social behavior detection. Two projects were presented: 1) French ROMEO 2007-11 and ROMEO2 2012-15 : Social interaction with Robot: application for dependent people and elderly, but also children 2) EU CHISTERA JOKER 2014-17 : Explore advanced dialogue involving complex social behaviors such as humor in order to provide a robot with the ability to create and maintain a long-term social relationship through verbal & non verbal language interaction 1) Project ROMEO and ROMEO2 with Aldebaran Robotics: http://www.projetromeo.com/ demo: Living with robots (LIMSI project ROMEO): https://www.youtube.com/watch?v=p1id-gvunws Emotion and speaker detection with audio channel only (no ASR) User profile modeling (emotional and interactional dimensions) and selection of behavioral strategies of the robot In Romeo2, induction techniques were used (Wizard of OZ) to explore the interactions between elderly people and robot in order to build perceptive and cognitive models. 0bjectives: Get a first feedback of elderly people Validate and enhance the envisaged scenarios Getting a corpus for future research in interaction 2) JOKER: JOKe and Empathy of a Robot - http://www.chistera.eu/projects/joker The aims of JOKER are to create a generic intelligent user interface providing a multimodal dialogue system with social communication skills including humor, empathy, compassion and other informal sociallyoriented behavior. fuse the verbal and non verbal cues (audio, eye-gaze, gestures) including affect bursts for social and emotional processes both in perception and generation

build rich user profiles taking into account user s personality, interactional behavior explore advanced dialogues involving complex social behaviors in order to create a long-term social relationship react in real-time The main challenges are: JOKER will investigate humor in human-machine interaction. Humor can trigger surprise, amusement, or irritation if it doesn't match the user's expectations. Social interactions require social intelligence and understanding for dealing with news circumstances by anticipating the mental state of another person. JOKER will explore two social behaviors: expressing empathy and exchanging chat with the interlocutor as a way to build a deeper (long-term) relationship. Anna Esposito, Seconda Università di Napoli, Department of Psychology, Caserta, and IIASS, Italy Socially Believable Behaving Systems: Needs and challenges in processing social information The main challenges identified were: a) The modeling and understanding of: context effects dynamics of signal exchanges in terms of shared meanings emotional states cultural differences b)the integration of cognitive theories, knowledge representation models and algorithms in a computational framework c) The development of novel machine learning techniques for processing, analyze, recognize and synthesize socially situated multimodal streams of communicative signals Kerstin Dautenhahn, Adaptive Systems Research Group, University of Hertfordshire, UK, Natural Interaction with Social Robots? The talk described some challenges concerning human-robot interaction, arguing that our reference point of what robots are and how they are supposed to behave constantly changes, and people s perceptions and reactions to robots change, too. Robots are not people or other animals, they are artifacts that are programmed one can look inside the box. The talk also discussed how people s views

of robots are influenced by media, culture, individual likes, dislikes, and expectations of users, prior experience with technology etc. (so there is no such thing as a truly naïve participant in an HRI study). All these issues make the design of natural interaction highly complex, in particular given the huge design space of robots in terms of appearance and behavior. The talk suggested that often too much focus is directed to humanoid robots, while non-humanoid robots can be very efficient for interaction, too. An example of a non-humanoid robot was given that successfully exploited cues studied in ethological research on dogs. The talk concludes with introducing the concept of companion robots, as it has been used over the past 10 years in projects such as Cogniron, LIREC, and Accompany. Rachid Alami, LAAS, CNRS, Toulouse, France Summary of presentation: The talk discussed social abilities of robots based on Human-Aware Planning Abilities A shift was pointed out in the perspective in several robotic domains from a single (isolated) robot applications to human-robot teams Robots will have to plan (and adapt) their activities with us or simply in our presence In order to achieve this, robots will need models and algorithms: models of us, hulas, and algorithms to synthesise or adapt their behaviours to people. Future planners will have to produce not only safe and efficient but also acceptable and intentionally legible plans. B) Summarising notes by Astrid Weiss (Vienna University of Technology, Austria): Legibility and predictability might improve natural HRI and make HRI more intuitive and acceptable Predictability might differ between user groups (older adults vs. adults), adaptation in robot motion based on user behavior Open issues: Impact of behavior dynamics (robot motion) on sociality? What is more important: motion, affordance, speech? How does it affect and interplay? Language constructs sociality; emotional speech is universal over cultures. Open issues: How can we use speech to shape the sociality of the robot? How does the utility (functionality) of a robot interact with its sociality (dialogue type, emotional speech, etc.)? Recovering behavior: How can we support the user that he/she can recover from errors without the help of a

technician? Error messages need to be expressed "naturally" by the robot; it needs to precisely indicate the problem, and constructively suggest solutions --> this would lead to more stable long-term interaction and would be very natural as users want to have the feeling of control over a system. How can we minimize the user's memory load to remember what to do (and how to do it) with the robot by making interaction options "visible". Robot usage options need to be visible or easily retrievable whenever appropriate. What could be possible breakthroughs, step changes? better sense-making for robots; e.g. through semantic segmentation: "Robot knows the household of the user" more robust technology with better battery endurance: Let the robot run in a household and really observe over time how people react better speech recognition also to distinguish between users and allowing more complex grammar (we need to get rid of commanding robots) actually doing household chores (assuming if a service robot provides the expected functionality, such as making the bed, cleaning windows etc. functional acceptance would increase and subsequently social interaction increases) smaller and faster robots with lower motor noise are crucial for functional acceptance