The role of testing in verification and certification Kerstin Eder

Size: px
Start display at page:

Download "The role of testing in verification and certification Kerstin Eder"

Transcription

1 The role of testing in verification and certification Kerstin Eder Design Automation and Verification, Microelectronics [and Trustworthy Systems Laboratory] Verification and Validation for Safety in Robots, Bristol Robotics Laboratory

2 M. Webster, D. Western, D. Araiza-Illan, C. Dixon, K. Eder, M. Fisher, A.G. Pipe. An Assurance-based Approach to Verification and Validation of Human-Robot Teams. arxiv:

3 M. Webster, D. Western, D. Araiza-Illan, C. Dixon, K. Eder, M. Fisher, A.G. Pipe. An Assurance-based Approach to Verification and Validation of Human-Robot Teams. arxiv:

4 What can be done to increase the productivity of simulation-based testing? D. Araiza-Illan, D. Western, A. Pipe, and K. Eder, Coverage-Driven Verification: An Approach to Verify Code for Robots that Directly Interact with Humans, in Haifa Verification Conference, Haifa, Israel, D. Araiza-Illan, D. Western, A. G. Pipe, and K. Eder, Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions, in Towards Autonomous Robotic Systems (TAROS), Jun D. Araiza-Illan, A. G. Pipe, and K. Eder, Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions, in Third Workshop on Model-Driven Robot Software Engineering (MORSE), Dresden, Germany,

5 HRI Verification Challenges System complexity HW SW People Concurrency Experiments in labs Expensive Unsafe 5

6 We are investigating Testing in simulation Techniques well established in microelectronics design verification Coverage-Driven Verification to verify code that controls robots in HRI. 6

7 Agency for Intelligent Testing Robotic assistants need to be both powerful and smart. AI and learning are increasingly used in robotics We need intelligent testing. No matter how clever your robot, the testing environment needs to reflect the agency your robot will meet in its target environment. 7

8 CDV to automate simulation-based testing Why and how? Dejanira Araiza-Illan, David Western, Anthony Pipe and Kerstin Eder. Coverage-Driven Verification An Approach to Verify Code for Robots that Directly Interact with Humans. In Hardware and Software: Verification and Testing, pp Lecture Notes in Computer Science Springer, November (DOI / _5) Dejanira Araiza-Illan, David Western, Anthony Pipe and Kerstin Eder. Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions. 17th Annual Conference Towards Autonomous Robotic Systems (TAROS 2016), pp Lecture Notes in Artificial Intelligence Springer, June (DOI / _3)

9 Coverage-Driven Verification SUT 9

10 Robotic Code J. Boren and S. Cousins, The SMACH High-Level Executive IEEE Robotics & Automation Magazine, vol. 17, no. 4, pp ,

11 Coverage-Driven Verification Test SUT Response 11

12 Coverage-Driven Verification Test Generator Test SUT Response 12

13 Test Generator Effective tests: - legal tests - meaningful events - interesting events - while exploring the system - typical vs extreme values Efficient tests: - minimal set of tests (regression) Strategies: - Pseudorandom (repeatability) 13

14 Test Generator Effective tests: - legal tests - meaningful events - interesting events - while exploring the system - typical vs extreme values Efficient tests: - minimal set of tests (regression) Strategies: - Pseudorandom (repeatability) - Constrained pseudorandom 14

15 Test Generator Effective tests: - legal tests - meaningful events - interesting events - while exploring the system - typical vs extreme values Efficient tests: - minimal set of tests (regression) Strategies: - Pseudorandom (repeatability) - Constrained pseudorandom - Model-based to target specific scenarios 15

16 16

17 17

18 Model-based Test Generation 19

19 Model-based Test Generation 20

20 Model-based test generation Formal model Traces from model checking Test template Test components: - High-level actions - Parameter instantiation System + environment Environment to drive system 21

21 Coverage-Driven Verification Checker Test Generator Test SUT Response 22

22 Checker Requirements as assertion monitors: - if [precondition], check [postcondition] If the robot decides the human is not ready, then the robot never releases an object. - Implemented as automata Continuous monitoring at runtime, self-checking High-level requirements Lower-level requirements depending on the simulation's detail (e.g., path planning, collision avoidance). assert {! (robot_3d_position == human_3d_position)} 23

23 Coverage-Driven Verification Checker Test Generator Test SUT Response 24

24 Coverage-Driven Verification Checker Test Generator Test SUT Response Coverage Collector 25

25 Coverage Collector Coverage models: - Code coverage - Structural coverage - Functional coverage - Requirements coverage 28

26 HRI Handover Scenario Requirements: Functional and safety (ISO 13482:2014, ISO ) 29

27 Requirements based on ISO and ISO

28 Requirements based on ISO and ISO

29 Requirements based on ISO and ISO

30 Coverage Collector Coverage models: - Code coverage - Structural coverage - Functional coverage - Requirements coverage - Cross-product functional coverage - Cartesian product of environment actions, sensor states and robot actions [O Lachish, E Marcus, S Ur and A Ziv. Hole Analysis for Functional Coverage Data. Design Automation Conference (DAC), June 10-14, 2002] 33

31 Situation Coverage [2015]

32 Functional Coverage 37

33 HRI Handover Scenario Coverage models: Code statement (robot high-level control) Requirements in the form of Assertions Cross-product functional coverage 38

34 Coverage Results

35 Code Coverage Results Pseudorandom Constrained Model-based Coverage Hole 40

36 Assertion Coverage Results 100 pseudorandomly generated tests 100 constrained pseudorandomly generated tests 4 model-based tests 41

37 Functional Coverage Results 100 pseudorandomly generated tests 160 model-based tests 180 model-based constrained tests 440 tests in total

38 Coverage-Driven Verification Coverage analysis enables feedback to test generation Checker Test Generator Test SUT Response Coverage Collector 43

39 CDV for Human-Robot Interaction Dejanira Araiza-Illan, David Western, Anthony Pipe and Kerstin Eder. Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions. 17th Annual Conference Towards Autonomous Robotic Systems (TAROS 2016), pp Lecture Notes in Artificial Intelligence Springer, June 2016.

40 46

41 47

42 Coverage-Directed Verification systematic, goal directed verification method high level of automation capable of exploring systems of realistic detail under a broad range of environment conditions focus on test generation and coverage constraining test generation requires significant engineering skill and SUT knowledge model-based test generation allows targeting requirements and cross-product coverage more effectively than pseudorandom test generation

43 Dejanira Araiza-Illan, David Western, Anthony Pipe and Kerstin Eder. Coverage-Driven Verification An Approach to Verify Code for Robots that Directly Interact with Humans. In Hardware and Software: Verification and Testing, pp Lecture Notes in Computer Science Springer, November (DOI: / _5) Dejanira Araiza-Illan, David Western, Anthony Pipe and Kerstin Eder. Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions. 17th Annual Conference Towards Autonomous Robotic Systems (TAROS 2016), pp Lecture Notes in Artificial Intelligence Springer, June (DOI: / _3) 49

44 CDV provides automation What about agency? 50

45

46 Belief-Desire-Intention Agents Desires: goals to fulfil Beliefs: knowledge about the world Intentions: chosen plans, according to current beliefs and goals New beliefs New goals Guards for plans From executing plans 52

47 CDV testbench components BDI Agents Intelligent testing is harnessing the power of BDI models to introduce agency into test environments. 54

48 Research Questions Are Belief-Desire-Intention agents suitable to model HRI? How can we exploit BDI agent models for test generation? Can machine learning be used to automate test generation in this setting? How do BDI agent models compare to automata-based techniques for model-based test generation? 55

49 Interacting Agents BDI can model agency in HRI Interactions between agents create realistic action sequences that serve as test patterns Agent for Simulated Human beliefs beliefs Robot s Code Agent Agents for Simulated Sensors beliefs 56

50 Interacting Agents BDI can model agency in HRI Interactions between agents create realistic action sequences that serve as test patterns Agent for Simulated Human beliefs beliefs Robot s Code Agent Agents for Simulated Sensors beliefs 57

51 Verification Agents Meta agents can influence beliefs This allows biasing/directing the interactions (Meta Agent) Verification Agent beliefs beliefs Agent for Simulated Human beliefs beliefs beliefs Agents for Simulated Sensors beliefs Robot s Code Agent 58

52 Which beliefs are effective? belief subsets Manual belief selection (Meta Agent) Verification Agent beliefs beliefs Agent for Simulated Human beliefs beliefs beliefs Agents for Simulated Sensors beliefs Robot s Code Agent 59

53 Which beliefs are effective? belief subsets Manual belief selection Random belief selection (Meta Agent) Verification Agent beliefs beliefs Agent for Simulated Human beliefs beliefs beliefs Agents for Simulated Sensors beliefs Robot s Code Agent 60

54 Which beliefs are effective? belief subsets Optimal belief sets determined through RL (Meta Agent) Verification Agent beliefs beliefs Agent for Simulated Human beliefs plan coverage beliefs beliefs Agents for Simulated Sensors beliefs Robot s Code Agent 61

55 Code coverdge (%) AccuPulDted code coverdge (%) PseudorDndoP 0odel checking 7A %DI Dgents est nupber Results How effective are BDI agents for test generation? How do they compare to model checking timed automata? D. Araiza-Illan, A.G. Pipe, K. Eder. Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions. (Proceedings of MORSE 2016, ACM, July 2016) (arxiv: ) D. Araiza-Illan, A.G. Pipe, K. Eder Model-based Test Generation for Robotic Software: Automata versus Belief-Desire- Intention Agents. (under review, preprint available at arxiv: )

56 The cost of learning belief sets Convergence in <300 iterations, < 3 hours The cost of learning a good belief set needs to be considered when assessing the different BDI-based test generation approaches. 64

57 Code Coverage Results 65

58 BDI-agents vs timed automata AccuPulDted code coverdge (%) Code coverdge (%) PseudorDndoP 0odel checking 7A %DI Dgents est nupber Code coverdge (%) AccuPulDted code coverdge (%) seudorDndoP 0odel checking 7A %DI Dgents est nupber Effectiveness: high-coverage tests are generated quickly 67

59 BDI-agents vs timed automata 68

60 Back to our Research Questions Belief-Desire-Intention agents are suitable to model HRI Traces of interactions between BDI agent models provide test templates Machine learning (RL) can be used to automate the selection of belief sets so that test generation can be biased towards maximizing coverage Compared to traditional model-based test generation (model checking timed automata), BDI models are: more intuitive to write, they naturally express agency, smaller in terms of model size, more predictable to explore and equal if not better wrt coverage. 69

61 D. Araiza Illan, D. Western, A. Pipe, K. Eder. Coverage-Driven Verification - An approach to verify code for robots that directly interact with humans. (Proceedings of HVC 2015, Springer, November 2015) D. Araiza Illan, D. Western, A. Pipe, K. Eder. Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions. (Proceedings of TAROS 2016, Springer, June 2016) D. Araiza-Illan, A.G. Pipe, K. Eder. Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions. (Proceedings of MORSE 2016, ACM, July 2016) (arxiv: ) D. Araiza-Illan, A.G. Pipe, K. Eder Model-based Test Generation for Robotic Software: Automata versus Belief-Desire- Intention Agents. (under review, preprint available at arxiv: ) 70

62 Thank you Special thanks to Dejanira Araiza Illan, Jeremy Morse, David Western, Arthur Richards, Jonathan Lawry, Trevor Martin, Piotr Trojanek, Yoav Hollander, Yaron Kashai, Mike Bartley, Tony Pipe and Chris Melhuish for their collaboration, contributions, inspiration and the many productive discussions we have had.

63

Verification and Validation for Safety in Robots Kerstin Eder

Verification and Validation for Safety in Robots Kerstin Eder Verification and Validation for Safety in Robots Kerstin Eder Design Automation and Verification Trustworthy Systems Laboratory Verification and Validation for Safety in Robots, Bristol Robotics Laboratory

More information

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): / Araiza Illan, D., Pipe, A. G., & Eder, K. I. (2016). Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions. In U. Aßmann, D. Brugali, & C. Piechnick (Eds.), Proceedings

More information

arxiv: v3 [cs.ro] 13 Jul 2016

arxiv: v3 [cs.ro] 13 Jul 2016 Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions Dejanira Araiza-Illan, Anthony G. Pipe and Kerstin Eder arxiv:1604.05508v3 [cs.ro] 13 Jul 2016 Abstract The

More information

arxiv: v2 [cs.ro] 25 Jun 2016

arxiv: v2 [cs.ro] 25 Jun 2016 Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions Dejanira Araiza-Illan, Anthony G. Pipe and Kerstin Eder arxiv:1604.05508v2 [cs.ro] 25 Jun 2016 Abstract The

More information

Verification and Validation of Robot Assistants

Verification and Validation of Robot Assistants Verification and Validation of Robot Assistants Clare Dixon Department of Computer Science University of Liverpool 1 University of Liverpool (UoL) 2 University of Hertfordshire (UoH) 3 Bristol Robotics

More information

Verifiable Autonomy. Michael Fisher. University of Liverpool, 11th September 2015

Verifiable Autonomy. Michael Fisher. University of Liverpool, 11th September 2015 Verifiable Autonomy Michael Fisher University of Liverpool, 11th September 2015 Motivation: Autonomy Everywhere! rtc.nagoya.riken.jp/ri-man www.volvo.com Motivation: Autonomous Systems Architectures Many

More information

Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF

Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Konstantin Dmitriev The MathWorks, Inc. Certification and Standards Group 2018 The MathWorks, Inc. 1 Agenda Use of simulation

More information

Stanford Center for AI Safety

Stanford Center for AI Safety Stanford Center for AI Safety Clark Barrett, David L. Dill, Mykel J. Kochenderfer, Dorsa Sadigh 1 Introduction Software-based systems play important roles in many areas of modern life, including manufacturing,

More information

Workshop on the Future of Nuclear Robotics Safety Cases

Workshop on the Future of Nuclear Robotics Safety Cases Workshop on the Future of Nuclear Robotics Safety Cases 11th September 2018 Manchester Organised by EPSRC RAIN Hub, Office for Nuclear Regulation, Assuring Autonomy International Programme, and EPSRC Verification

More information

Improved Model Generation of AMS Circuits for Formal Verification

Improved Model Generation of AMS Circuits for Formal Verification Improved Generation of AMS Circuits for Formal Verification Dhanashree Kulkarni, Satish Batchu, Chris Myers University of Utah Abstract Recently, formal verification has had success in rigorously checking

More information

SAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL,

SAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL, SAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL, 17.02.2017 The need for safety cases Interaction and Security is becoming more than what happens when things break functional

More information

Component Based Mechatronics Modelling Methodology

Component Based Mechatronics Modelling Methodology Component Based Mechatronics Modelling Methodology R.Sell, M.Tamre Department of Mechatronics, Tallinn Technical University, Tallinn, Estonia ABSTRACT There is long history of developing modelling systems

More information

Model checking in the cloud VIGYAN SINGHAL OSKI TECHNOLOGY

Model checking in the cloud VIGYAN SINGHAL OSKI TECHNOLOGY Model checking in the cloud VIGYAN SINGHAL OSKI TECHNOLOGY Views are biased by Oski experience Service provider, only doing model checking Using off-the-shelf tools (Cadence, Jasper, Mentor, OneSpin Synopsys)

More information

Automated Testing of Autonomous Driving Assistance Systems

Automated Testing of Autonomous Driving Assistance Systems Automated Testing of Autonomous Driving Assistance Systems Lionel Briand Vector Testing Symposium, Stuttgart, 2018 SnT Centre Top level research in Information & Communication Technologies Created to fuel

More information

TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP

TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP Yue Wang, Ph.D. Warren H. Owen - Duke Energy Assistant Professor of Engineering Interdisciplinary & Intelligent

More information

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview June, 2017

The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems. Overview June, 2017 The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems Overview June, 2017 @johnchavens Ethically Aligned Design A Vision for Prioritizing Human Wellbeing

More information

Notes S5 breakout session - Hybrid Automata Verification S5 Conference June 2015

Notes S5 breakout session - Hybrid Automata Verification S5 Conference June 2015 Notes S5 breakout session - Hybrid Automata Verification S5 Conference June 2015 Introduction - What is the definition of nondeterminism we are considering? Certification nondeterminism? Usually there

More information

Towards Intuitive Industrial Human-Robot Collaboration

Towards Intuitive Industrial Human-Robot Collaboration Towards Intuitive Industrial Human-Robot Collaboration System Design and Future Directions Ferdinand Fuhrmann, Wolfgang Weiß, Lucas Paletta, Bernhard Reiterer, Andreas Schlotzhauer, Mathias Brandstötter

More information

Elena Corina Grigore

Elena Corina Grigore Elena Corina Grigore Yale University, Department of Computer Science Ph.D. Candidate, Yale University 51 Prospect Street, Office 505 elena.corina.grigore@yale.edu New Haven, CT, 06511 USA elenacorinagrigore.com

More information

Swarm Intelligence W7: Application of Machine- Learning Techniques to Automatic Control Design and Optimization

Swarm Intelligence W7: Application of Machine- Learning Techniques to Automatic Control Design and Optimization Swarm Intelligence W7: Application of Machine- Learning Techniques to Automatic Control Design and Optimization Learning to avoid obstacles Outline Problem encoding using GA and ANN Floreano and Mondada

More information

On the use of the Goal-Oriented Paradigm for System Design and Law Compliance Reasoning

On the use of the Goal-Oriented Paradigm for System Design and Law Compliance Reasoning On the use of the Goal-Oriented Paradigm for System Design and Law Compliance Reasoning Mirko Morandini 1, Luca Sabatucci 1, Alberto Siena 1, John Mylopoulos 2, Loris Penserini 1, Anna Perini 1, and Angelo

More information

The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. FairWare2018, 29 May 2018

The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. FairWare2018, 29 May 2018 The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems FairWare2018, 29 May 2018 The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems Overview of The IEEE Global

More information

Autonomous and Autonomic Systems: With Applications to NASA Intelligent Spacecraft Operations and Exploration Systems

Autonomous and Autonomic Systems: With Applications to NASA Intelligent Spacecraft Operations and Exploration Systems Walt Truszkowski, Harold L. Hallock, Christopher Rouff, Jay Karlin, James Rash, Mike Hinchey, and Roy Sterritt Autonomous and Autonomic Systems: With Applications to NASA Intelligent Spacecraft Operations

More information

Life Isn t Fair, So Use Formal by Roger Sabbagh, Mentor Graphics

Life Isn t Fair, So Use Formal by Roger Sabbagh, Mentor Graphics Life Isn t Fair, So Use Formal by Roger Sabbagh, Mentor Graphics Most things in life are not evenly distributed. Consider for example, the sun and the rain. The city of Portland, Oregon gets much more

More information

EU regulatory system for robots

EU regulatory system for robots EU regulatory system for robots CE marking of robots today and in the future Felicia Stoica DG GROW Summary Access to the EU market - marking for robots EU safety laws for robots and role of EN standards

More information

Robot Task-Level Programming Language and Simulation

Robot Task-Level Programming Language and Simulation Robot Task-Level Programming Language and Simulation M. Samaka Abstract This paper presents the development of a software application for Off-line robot task programming and simulation. Such application

More information

Pervasive Services Engineering for SOAs

Pervasive Services Engineering for SOAs Pervasive Services Engineering for SOAs Dhaminda Abeywickrama (supervised by Sita Ramakrishnan) Clayton School of Information Technology, Monash University, Australia dhaminda.abeywickrama@infotech.monash.edu.au

More information

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many

Cognitive robots and emotional intelligence Cloud robotics Ethical, legal and social issues of robotic Construction robots Human activities in many Preface The jubilee 25th International Conference on Robotics in Alpe-Adria-Danube Region, RAAD 2016 was held in the conference centre of the Best Western Hotel M, Belgrade, Serbia, from 30 June to 2 July

More information

Ubiquitous Home Simulation Using Augmented Reality

Ubiquitous Home Simulation Using Augmented Reality Proceedings of the 2007 WSEAS International Conference on Computer Engineering and Applications, Gold Coast, Australia, January 17-19, 2007 112 Ubiquitous Home Simulation Using Augmented Reality JAE YEOL

More information

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS Eva Cipi, PhD in Computer Engineering University of Vlora, Albania Abstract This paper is focused on presenting

More information

AOSE Agent-Oriented Software Engineering: A Review and Application Example TNE 2009/2010. António Castro

AOSE Agent-Oriented Software Engineering: A Review and Application Example TNE 2009/2010. António Castro AOSE Agent-Oriented Software Engineering: A Review and Application Example TNE 2009/2010 António Castro NIAD&R Distributed Artificial Intelligence and Robotics Group 1 Contents Part 1: Software Engineering

More information

Autonomous Robotic (Cyber) Weapons?

Autonomous Robotic (Cyber) Weapons? Autonomous Robotic (Cyber) Weapons? Giovanni Sartor EUI - European University Institute of Florence CIRSFID - Faculty of law, University of Bologna Rome, November 24, 2013 G. Sartor (EUI-CIRSFID) Autonomous

More information

Design of intelligent surveillance systems: a game theoretic case. Nicola Basilico Department of Computer Science University of Milan

Design of intelligent surveillance systems: a game theoretic case. Nicola Basilico Department of Computer Science University of Milan Design of intelligent surveillance systems: a game theoretic case Nicola Basilico Department of Computer Science University of Milan Outline Introduction to Game Theory and solution concepts Game definition

More information

Using Dynamic Capability Evaluation to Organize a Team of Cooperative, Autonomous Robots

Using Dynamic Capability Evaluation to Organize a Team of Cooperative, Autonomous Robots Using Dynamic Capability Evaluation to Organize a Team of Cooperative, Autonomous Robots Eric Matson Scott DeLoach Multi-agent and Cooperative Robotics Laboratory Department of Computing and Information

More information

Tutorial of Reinforcement: A Special Focus on Q-Learning

Tutorial of Reinforcement: A Special Focus on Q-Learning Tutorial of Reinforcement: A Special Focus on Q-Learning TINGWU WANG, MACHINE LEARNING GROUP, UNIVERSITY OF TORONTO Contents 1. Introduction 1. Discrete Domain vs. Continous Domain 2. Model Based vs. Model

More information

An Unreal Based Platform for Developing Intelligent Virtual Agents

An Unreal Based Platform for Developing Intelligent Virtual Agents An Unreal Based Platform for Developing Intelligent Virtual Agents N. AVRADINIS, S. VOSINAKIS, T. PANAYIOTOPOULOS, A. BELESIOTIS, I. GIANNAKAS, R. KOUTSIAMANIS, K. TILELIS Knowledge Engineering Lab, Department

More information

Development of an Intelligent Agent based Manufacturing System

Development of an Intelligent Agent based Manufacturing System Development of an Intelligent Agent based Manufacturing System Hong-Seok Park 1 and Ngoc-Hien Tran 2 1 School of Mechanical and Automotive Engineering, University of Ulsan, Ulsan 680-749, South Korea 2

More information

Towards Application Driven Sensor Network Control. Nael Abu-Ghazaleh SUNY Binghamton

Towards Application Driven Sensor Network Control. Nael Abu-Ghazaleh SUNY Binghamton Towards Application Driven Sensor Network Control Nael Abu-Ghazaleh SUNY Binghamton nael@cs.binghamton.edu Scenario Observer wants to observe something about the phenomenon Track all the lions in this

More information

Robot Autonomy the future of intelligent autonomous systems?

Robot Autonomy the future of intelligent autonomous systems? Robot Autonomy the future of intelligent autonomous systems? Alan FT Winfield Alan.Winfield@uwe.ac.uk Bristol Robotics Laboratories http://www.brl.ac.uk/ Royal Institution 12 March 2012 This talk About

More information

On-demand printable robots

On-demand printable robots On-demand printable robots Ankur Mehta Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology 3 Computational problem? 4 Physical problem? There s a robot for that.

More information

MULTI-AGENT BASED SOFTWARE ENGINEERING MODELS: A REVIEW

MULTI-AGENT BASED SOFTWARE ENGINEERING MODELS: A REVIEW MULTI-AGENT BASED SOFTWARE ENGINEERING MODELS: A REVIEW 1 Okoye, C. I, 2 John-Otumu Adetokunbo M, and 3 Ojieabu Clement E. 1,2 Department of Computer Science, Ebonyi State University, Abakaliki, Nigeria

More information

A Multi-Agent Based Autonomous Traffic Lights Control System Using Fuzzy Control

A Multi-Agent Based Autonomous Traffic Lights Control System Using Fuzzy Control International Journal of Scientific & Engineering Research Volume 2, Issue 6, June-2011 1 A Multi-Agent Based Autonomous Traffic Lights Control System Using Fuzzy Control Yousaf Saeed, M. Saleem Khan,

More information

Industrial Applications and Challenges for Verifying Reactive Embedded Software. Tom Bienmüller, SC 2 Summer School, MPI Saarbrücken, August 2017

Industrial Applications and Challenges for Verifying Reactive Embedded Software. Tom Bienmüller, SC 2 Summer School, MPI Saarbrücken, August 2017 Industrial Applications and Challenges for Verifying Reactive Embedded Software Tom Bienmüller, SC 2 Summer School, MPI Saarbrücken, August 2017 Agenda 2 Who am I? Who is BTC Embedded Systems? Formal Methods

More information

Neural Models for Multi-Sensor Integration in Robotics

Neural Models for Multi-Sensor Integration in Robotics Department of Informatics Intelligent Robotics WS 2016/17 Neural Models for Multi-Sensor Integration in Robotics Josip Josifovski 4josifov@informatik.uni-hamburg.de Outline Multi-sensor Integration: Neurally

More information

Human-Swarm Interaction

Human-Swarm Interaction Human-Swarm Interaction a brief primer Andreas Kolling irobot Corp. Pasadena, CA Swarm Properties - simple and distributed - from the operator s perspective - distributed algorithms and information processing

More information

Proposers Day Workshop

Proposers Day Workshop Proposers Day Workshop Monday, January 23, 2017 @srcjump, #JUMPpdw Cognitive Computing Vertical Research Center Mandy Pant Academic Research Director Intel Corporation Center Motivation Today s deep learning

More information

A Winning Combination

A Winning Combination A Winning Combination Risk factors Statements in this presentation that refer to future plans and expectations are forward-looking statements that involve a number of risks and uncertainties. Words such

More information

Journal Title ISSN 5. MIS QUARTERLY BRIEFINGS IN BIOINFORMATICS

Journal Title ISSN 5. MIS QUARTERLY BRIEFINGS IN BIOINFORMATICS List of Journals with impact factors Date retrieved: 1 August 2009 Journal Title ISSN Impact Factor 5-Year Impact Factor 1. ACM SURVEYS 0360-0300 9.920 14.672 2. VLDB JOURNAL 1066-8888 6.800 9.164 3. IEEE

More information

CPS331 Lecture: Agents and Robots last revised April 27, 2012

CPS331 Lecture: Agents and Robots last revised April 27, 2012 CPS331 Lecture: Agents and Robots last revised April 27, 2012 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture

More information

Korean Robot Standardization

Korean Robot Standardization , JAPAN Korean Robot Standardization 마스터 Activities 제목 and 스타일 Issues 편집 마스터부제목스타일편집 2007. 3. 13 Yun Koo Chung 1 Contents Standard Issues Aspect of Standardization Relationship Structure of Standard Org.

More information

Overview: Emerging Technologies and Issues

Overview: Emerging Technologies and Issues Overview: Emerging Technologies and Issues Marie Sicat Introduction to the Course on Digital Commerce and Emerging Technologies DiploFoundation, UNCTAD, CUTS, ITC, GIP UNCTAD E-commerce Week (18 April

More information

Multi-Platform Soccer Robot Development System

Multi-Platform Soccer Robot Development System Multi-Platform Soccer Robot Development System Hui Wang, Han Wang, Chunmiao Wang, William Y. C. Soh Division of Control & Instrumentation, School of EEE Nanyang Technological University Nanyang Avenue,

More information

Indiana K-12 Computer Science Standards

Indiana K-12 Computer Science Standards Indiana K-12 Computer Science Standards What is Computer Science? Computer science is the study of computers and algorithmic processes, including their principles, their hardware and software designs,

More information

A review of Reasoning About Rational Agents by Michael Wooldridge, MIT Press Gordon Beavers and Henry Hexmoor

A review of Reasoning About Rational Agents by Michael Wooldridge, MIT Press Gordon Beavers and Henry Hexmoor A review of Reasoning About Rational Agents by Michael Wooldridge, MIT Press 2000 Gordon Beavers and Henry Hexmoor Reasoning About Rational Agents is concerned with developing practical reasoning (as contrasted

More information

Requirements Gathering using Object- Oriented Models

Requirements Gathering using Object- Oriented Models Requirements Gathering using Object- Oriented Models Cycle de vie d un logiciel Software Life Cycle The "software lifecycle" refers to all stages of software development from design to disappearance. The

More information

Model-Based Systems Engineering Methodologies. J. Bermejo Autonomous Systems Laboratory (ASLab)

Model-Based Systems Engineering Methodologies. J. Bermejo Autonomous Systems Laboratory (ASLab) Model-Based Systems Engineering Methodologies J. Bermejo Autonomous Systems Laboratory (ASLab) Contents Introduction Methodologies IBM Rational Telelogic Harmony SE (Harmony SE) IBM Rational Unified Process

More information

CISC 1600 Lecture 3.4 Agent-based programming

CISC 1600 Lecture 3.4 Agent-based programming CISC 1600 Lecture 3.4 Agent-based programming Topics: Agents and environments Rationality Performance, Environment, Actuators, Sensors Four basic types of agents Multi-agent systems NetLogo Agents interact

More information

SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The

SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The SIGVerse - A Simulation Platform for Human-Robot Interaction Jeffrey Too Chuan TAN and Tetsunari INAMURA National Institute of Informatics, Japan The 29 th Annual Conference of The Robotics Society of

More information

To the Front Lines of Digital Transformation

To the Front Lines of Digital Transformation To the Front Lines of Digital Transformation Seeing the Heretofore Unseen Future Tips for Digital Transformation The Fujitsu Digital Transformation Center (DTC) is a co-creation workshop space that empowers

More information

To the Front Lines of Digital Transformation

To the Front Lines of Digital Transformation To the Front Lines of Digital Transformation Concept Seeing the Heretofore Unseen Future- Tips for Digital Transformation The Fujitsu Digital Transformation Center (DTC) is a co-creation workshop space

More information

Are we ready for computer assisted living?

Are we ready for computer assisted living? Are we ready for computer assisted living? http://d3s.mff.cuni.cz Tomáš Bureš bures@d3s.mff.cuni.cz CHARLES UNIVERSITY IN PRAGUE faculty of mathematics and physics Context Example: Road Trains Autovlak,

More information

FP7 ICT Call 6: Cognitive Systems and Robotics

FP7 ICT Call 6: Cognitive Systems and Robotics FP7 ICT Call 6: Cognitive Systems and Robotics Information day Luxembourg, January 14, 2010 Libor Král, Head of Unit Unit E5 - Cognitive Systems, Interaction, Robotics DG Information Society and Media

More information

Transactions on Information and Communications Technologies vol 6, 1994 WIT Press, ISSN

Transactions on Information and Communications Technologies vol 6, 1994 WIT Press,   ISSN Application of artificial neural networks to the robot path planning problem P. Martin & A.P. del Pobil Department of Computer Science, Jaume I University, Campus de Penyeta Roja, 207 Castellon, Spain

More information

Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules.

Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules. Electrical and Automation Engineering, Fall 2018 Spring 2019, modules and courses inside modules. Period 1: 27.8.2018 26.10.2018 MODULE INTRODUCTION TO AUTOMATION ENGINEERING This module introduces the

More information

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003

More information

Enterprise ISEA of the Future a Technology Vision for Fleet Support

Enterprise ISEA of the Future a Technology Vision for Fleet Support N A V S E A N WA VA SR EF A RWE A CR EF NA RT E R CS E N T E R S Enterprise ISEA of the Future a Technology Vision for Fleet Support Paul D. Mann, SES NSWC PHD Division Technical Director April 10, 2018

More information

HUMAN-ROBOT COLLABORATION TNO, THE NETHERLANDS. 6 th SAF RA Symposium Sustainable Safety 2030 June 14, 2018 Mr. Johan van Middelaar

HUMAN-ROBOT COLLABORATION TNO, THE NETHERLANDS. 6 th SAF RA Symposium Sustainable Safety 2030 June 14, 2018 Mr. Johan van Middelaar HUMAN-ROBOT COLLABORATION TNO, THE NETHERLANDS 6 th SAF RA Symposium Sustainable Safety 2030 June 14, 2018 Mr. Johan van Middelaar CONTENTS TNO & Robotics Robots and workplace safety: Human-Robot Collaboration,

More information

Playware Research Methodological Considerations

Playware Research Methodological Considerations Journal of Robotics, Networks and Artificial Life, Vol. 1, No. 1 (June 2014), 23-27 Playware Research Methodological Considerations Henrik Hautop Lund Centre for Playware, Technical University of Denmark,

More information

This list supersedes the one published in the November 2002 issue of CR.

This list supersedes the one published in the November 2002 issue of CR. PERIODICALS RECEIVED This is the current list of periodicals received for review in Reviews. International standard serial numbers (ISSNs) are provided to facilitate obtaining copies of articles or subscriptions.

More information

TRB Innovations in Travel Modeling Atlanta, June 25, 2018

TRB Innovations in Travel Modeling Atlanta, June 25, 2018 Using an Activity-Based Model with Dynamic Traffic Simulation to Explore Scenarios for Private and Shared Autonomous Vehicle Use in Jacksonville with TRB Innovations in Travel Modeling Atlanta, June 25,

More information

Human Autonomous Vehicles Interactions: An Interdisciplinary Approach

Human Autonomous Vehicles Interactions: An Interdisciplinary Approach Human Autonomous Vehicles Interactions: An Interdisciplinary Approach X. Jessie Yang xijyang@umich.edu Dawn Tilbury tilbury@umich.edu Anuj K. Pradhan Transportation Research Institute anujkp@umich.edu

More information

Meeting the Challenges of Formal Verification

Meeting the Challenges of Formal Verification Meeting the Challenges of Formal Verification Doug Fisher Synopsys Jean-Marc Forey - Synopsys 23rd May 2013 Synopsys 2013 1 In the next 30 minutes... Benefits and Challenges of Formal Verification Meeting

More information

Obstacle Avoidance in Collective Robotic Search Using Particle Swarm Optimization

Obstacle Avoidance in Collective Robotic Search Using Particle Swarm Optimization Avoidance in Collective Robotic Search Using Particle Swarm Optimization Lisa L. Smith, Student Member, IEEE, Ganesh K. Venayagamoorthy, Senior Member, IEEE, Phillip G. Holloway Real-Time Power and Intelligent

More information

The Privacy Case. Matching Privacy-Protection Goals to Human and Organizational Privacy Concerns. Tudor B. Ionescu, Gerhard Engelbrecht SIEMENS AG

The Privacy Case. Matching Privacy-Protection Goals to Human and Organizational Privacy Concerns. Tudor B. Ionescu, Gerhard Engelbrecht SIEMENS AG The Privacy Case Matching Privacy-Protection Goals to Human and Organizational Privacy Concerns Tudor B. Ionescu, Gerhard Engelbrecht SIEMENS AG Agenda Introduction Defining the privacy case Privacy-relevant

More information

A Systematic Testing Approach for Autonomous Mobile Robots Using Domain-Specific Languages

A Systematic Testing Approach for Autonomous Mobile Robots Using Domain-Specific Languages A Systematic Testing Approach for Autonomous Mobile Robots Using Domain-Specific Languages Martin Proetzsch 1, Fabian Zimmermann 2, Robert Eschbach 2, Johannes Kloos 2, and Karsten Berns 1 1 Robotics Research

More information

Prototyping Future Smart City Forms

Prototyping Future Smart City Forms Combining Sensory Technology and BIM Visualize Environmental Impact Source: Perkins + Will By: Dr. Zaki Mallasi, Assistant Professor, Director of Design Computation Lab, Effat University, Saudi Arabia

More information

Real-time Adaptive Robot Motion Planning in Unknown and Unpredictable Environments

Real-time Adaptive Robot Motion Planning in Unknown and Unpredictable Environments Real-time Adaptive Robot Motion Planning in Unknown and Unpredictable Environments IMI Lab, Dept. of Computer Science University of North Carolina Charlotte Outline Problem and Context Basic RAMP Framework

More information

CSE-571 AI-based Mobile Robotics

CSE-571 AI-based Mobile Robotics CSE-571 AI-based Mobile Robotics Approximation of POMDPs: Active Localization Localization so far: passive integration of sensor information Active Sensing and Reinforcement Learning 19 m 26.5 m Active

More information

A SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS

A SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS Tools and methodologies for ITS design and drivers awareness A SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS Jan Gačnik, Oliver Häger, Marco Hannibal

More information

AGENT PLATFORM FOR ROBOT CONTROL IN REAL-TIME DYNAMIC ENVIRONMENTS. Nuno Sousa Eugénio Oliveira

AGENT PLATFORM FOR ROBOT CONTROL IN REAL-TIME DYNAMIC ENVIRONMENTS. Nuno Sousa Eugénio Oliveira AGENT PLATFORM FOR ROBOT CONTROL IN REAL-TIME DYNAMIC ENVIRONMENTS Nuno Sousa Eugénio Oliveira Faculdade de Egenharia da Universidade do Porto, Portugal Abstract: This paper describes a platform that enables

More information

FROM AI TO IA AI: Artificial Intelligence IA: Intelligence Amplification Mieke De Ketelaere, SAS NEMEA

FROM AI TO IA AI: Artificial Intelligence IA: Intelligence Amplification Mieke De Ketelaere, SAS NEMEA FROM AI TO IA AI: Artificial Intelligence IA: Intelligence Amplification Mieke De Ketelaere, AI/CI @ SAS NEMEA About myself G.M. De Ketelaere University of Stuttgart, DE G.M. De Ketelaere and H.W. Guesgen

More information

CPS Engineering Labs A Network of Design Centres Expediting and accelerating the realisation of trustworthy CPS Holger Pfeifer CPSE Labs co-ordinator fortiss, Munich, Germany Funded by the European Union

More information

Important Tools and Perspectives for the Future of AI

Important Tools and Perspectives for the Future of AI Important Tools and Perspectives for the Future of AI The Norwegian University of Science and Technology (NTNU) Trondheim, Norway keithd@idi.ntnu.no April 1, 2011 Outline 1 Artificial Life 2 Cognitive

More information

Using Agent-Based Methodologies in Healthcare Information Systems

Using Agent-Based Methodologies in Healthcare Information Systems BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 18, No 2 Sofia 2018 Print ISSN: 1311-9702; Online ISSN: 1314-4081 DOI: 10.2478/cait-2018-0033 Using Agent-Based Methodologies

More information

SECOND YEAR PROJECT SUMMARY

SECOND YEAR PROJECT SUMMARY SECOND YEAR PROJECT SUMMARY Grant Agreement number: 215805 Project acronym: Project title: CHRIS Cooperative Human Robot Interaction Systems Period covered: from 01 March 2009 to 28 Feb 2010 Contact Details

More information

CPS331 Lecture: Agents and Robots last revised November 18, 2016

CPS331 Lecture: Agents and Robots last revised November 18, 2016 CPS331 Lecture: Agents and Robots last revised November 18, 2016 Objectives: 1. To introduce the basic notion of an agent 2. To discuss various types of agents 3. To introduce the subsumption architecture

More information

Physics Based Sensor simulation

Physics Based Sensor simulation Physics Based Sensor simulation Jordan Gorrochotegui - Product Manager Software and Services Mike Phillips Software Engineer Restricted Siemens AG 2017 Realize innovation. Siemens offers solutions across

More information

Software verification

Software verification Software verification Will it ever work? Ofer Strichman, Technion 1 Testing: does the program behave as expected for a given set of inputs? Formal Verification: does the program behave as specified for

More information

Introduction to co-simulation. What is HW-SW co-simulation?

Introduction to co-simulation. What is HW-SW co-simulation? Introduction to co-simulation CPSC489-501 Hardware-Software Codesign of Embedded Systems Mahapatra-TexasA&M-Fall 00 1 What is HW-SW co-simulation? A basic definition: Manipulating simulated hardware with

More information

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera

GESTURE BASED HUMAN MULTI-ROBOT INTERACTION. Gerard Canal, Cecilio Angulo, and Sergio Escalera GESTURE BASED HUMAN MULTI-ROBOT INTERACTION Gerard Canal, Cecilio Angulo, and Sergio Escalera Gesture based Human Multi-Robot Interaction Gerard Canal Camprodon 2/27 Introduction Nowadays robots are able

More information

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS

EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS ACCENTURE LABS DUBLIN Artificial Intelligence Security SILICON VALLEY Digital Experiences Artificial Intelligence

More information

Towards a Software Engineering Research Framework: Extending Design Science Research

Towards a Software Engineering Research Framework: Extending Design Science Research Towards a Software Engineering Research Framework: Extending Design Science Research Murat Pasa Uysal 1 1Department of Management Information Systems, Ufuk University, Ankara, Turkey ---------------------------------------------------------------------***---------------------------------------------------------------------

More information

Anca ANDREICA Producția științifică

Anca ANDREICA Producția științifică Anca ANDREICA Producția științifică Lucrări categoriile A, B și C Lucrări categoriile A și B puncte 9 puncte Lucrări categoria A A. Agapie, A. Andreica, M. Giuclea, Probabilistic Cellular Automata, Journal

More information

Issues and Challenges in Coupling Tropos with User-Centred Design

Issues and Challenges in Coupling Tropos with User-Centred Design Issues and Challenges in Coupling Tropos with User-Centred Design L. Sabatucci, C. Leonardi, A. Susi, and M. Zancanaro Fondazione Bruno Kessler - IRST CIT sabatucci,cleonardi,susi,zancana@fbk.eu Abstract.

More information

Introducing Functional Qualification

Introducing Functional Qualification Introducing Functional Qualification Certess Inc 2007 1 Table of contents Introduction _ 3 Functional verification quality 4 Mutation based testing _ 7 Certitude: Leading functional qualification 8 Bibliography

More information

Gameplay as On-Line Mediation Search

Gameplay as On-Line Mediation Search Gameplay as On-Line Mediation Search Justus Robertson and R. Michael Young Liquid Narrative Group Department of Computer Science North Carolina State University Raleigh, NC 27695 jjrobert@ncsu.edu, young@csc.ncsu.edu

More information

Computer Science and Philosophy Information Sheet for entry in 2018

Computer Science and Philosophy Information Sheet for entry in 2018 Computer Science and Philosophy Information Sheet for entry in 2018 Artificial intelligence (AI), logic, robotics, virtual reality: fascinating areas where Computer Science and Philosophy meet. There are

More information

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction.

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction. On the Creation of Standards for Interaction Between Robots and Virtual Worlds By Alex Juarez, Christoph Bartneck and Lou Feijs Eindhoven University of Technology Abstract Research on virtual worlds and

More information

Behaviour-Based Control. IAR Lecture 5 Barbara Webb

Behaviour-Based Control. IAR Lecture 5 Barbara Webb Behaviour-Based Control IAR Lecture 5 Barbara Webb Traditional sense-plan-act approach suggests a vertical (serial) task decomposition Sensors Actuators perception modelling planning task execution motor

More information

Chapter 31. Intelligent System Architectures

Chapter 31. Intelligent System Architectures Chapter 31. Intelligent System Architectures The Quest for Artificial Intelligence, Nilsson, N. J., 2009. Lecture Notes on Artificial Intelligence, Spring 2012 Summarized by Jang, Ha-Young and Lee, Chung-Yeon

More information