Synthesis and Robotics Hadas Kress-Gazit Sibley School of Mechanical and Aerospace Engineering Cornell University

Size: px
Start display at page:

Download "Synthesis and Robotics Hadas Kress-Gazit Sibley School of Mechanical and Aerospace Engineering Cornell University"

Transcription

1 Synthesis and Robotics Hadas Kress-Gazit Sibley School of Mechanical and Aerospace Engineering Cornell University Joint work (this talk) with: Jim Jing, Ben Johnson, Cameron Finucane, Nir Piterman and Vasu Raman

2 Drive around the city and obey traffic laws. Do not hurt anyone or anything Teams of engineers from industry and academia and DUC highlights Jalopnik.com TerraMax at DUC from flickr (kwc)

3 Go fetch me a beer Willow garage blog Week long hackathon at Willow Garage

4 Now Specifications ( What ) Implementation ( How ) Testing ( Works? ) Control (probably works)

5 In the (near) future Specifications ( What ) Implementation ( How ) Automatic Correct-by-construction Testing synthesis ( Works? ) Control (works!)

6 Jing, Finucane, Raman and KG, ICRA 2012

7 Continuous task (motion and action of a robot) Automatic Provably correct Sensing and Control for the robot

8 Continuous task (motion and action of a robot) Discrete Abstraction Discrete specification and model Synthesize provably correct solution Continuous implementation of solution Sensing and Control for the robot

9 Continuous task (motion and action of a robot) Reactive to the environment Discrete Abstraction Discrete specification and model Synthesize provably correct solution Continuous implementation of solution Sensing and Control for the robot

10 Continuous task (motion and action of a robot) Reactive to the environment Discrete Abstraction Sensor abstraction, atomic controllers Discrete specification and model Synthesize provably correct solution Continuous implementation of solution Sensing and Control for the robot

11 Continuous task (motion and action of a robot) Reactive to the environment Discrete Abstraction Sensor abstraction, atomic controllers Discrete specification and model Linear Temporal Logic, (Structured) language Synthesize provably correct solution Continuous implementation of solution Sensing and Control for the robot

12 Structured English Grammar KG, Fainekos and Pappas, Advanced Robotics 2008, KG and Pappas ICRA 2010

13 Continuous task (motion and action of a robot) Reactive to the environment Discrete Abstraction Sensor abstraction, atomic controllers Discrete specification and model Linear Temporal Logic, (Structured) language Synthesize provably correct solution LTL synthesis, probabilistic model checking Continuous implementation of solution Hybrid controller Sensing and Control for the robot

14 (Partial) Related work Robot Control from Temporal Logic specifications: Kavraki and Vardi, Belta, Karaman and frazzoli, Fainekos, Wongpiromsarm Topcu and Murray,, Symbolic control, languages and grammars for control: Egerstedt, Frazzoli and Dahleh, Klavins, Stilman, Tanner, Hybrid systems Formal methods synthesis Planning community

15 Human controlling a robot Raman and KG: CAV 2011, ICRA 2012, IEEE TRO

16 Human controlling a robot Specification Unsatisfiable: Start in Deck. Always stay there. go to kitchen. Specification Unrealizable: Start in Deck. If you see a person stay there. go to kitchen. Trivial solution: Always person and not person. Raman and KG: CAV 2011, ICRA 2012, IEEE TRO

17 Human controlling a robot Raman and KG: CAV 2011, ICRA 2012, IEEE TRO

18 Human controlling a robot Raman and KG: CAV 2011, ICRA 2012, IEEE TRO

19 Human controlling a robot High-Level Tasks Environment Model Robot Abstraction Correct Controller Correct? Behavior Imperfect Perfect Sensors Environment Johnson and KG, RSS 2011, Johnson, Havlak, Campbell and KG, ICRA 2012

20 Human controlling a robot Φ X Y Controller Synthesis R s.t. E R Φ DTMC Construction E, E Probabilistic Model Checker Φ P( E R Φ) Johnson and KG, RSS 2011, Johnson, Havlak, Campbell and KG, ICRA 2012

21 Human controlling a robot Johnson and KG, RSS 2011, Johnson, Havlak, Campbell and KG, ICRA 2012

22 Human controlling a robot Johnson and KG, RSS 2011, Johnson, Havlak, Campbell and KG, ICRA 2012

23 Human controlling a robot Raman, Finucane and KG, IROS 2012, Raman, Piterman and KG, ICRA 2013 (To appear)

24 Human controlling a robot Raman, Finucane and KG, IROS 2012, Raman, Piterman and KG, ICRA 2013 (To appear)

25 Human controlling a robot Option 1: Actions end together Raman, Finucane and KG, IROS 2012, Raman, Piterman and KG, ICRA 2013 (To appear)

26 Human controlling a robot Option 2: Actions start together Raman, Finucane and KG, IROS 2012

27 Human controlling a robot Option 3: Model activation and completion of Actions Raman, Piterman and KG, ICRA 2013 (To appear)

28 LTLMoP Linear Temporal Logic MissiOn Planner Use structured English to control a robot Python-based Modular Integrates with simulators (Gazebo) and physical robots

29 Robot waiter scenario hot off the press

Avoiding Forgetfulness: Structured English Specifications for High-Level Robot Control with Implicit Memory

Avoiding Forgetfulness: Structured English Specifications for High-Level Robot Control with Implicit Memory Avoiding Forgetfulness: Structured English Specifications for High-Level Robot Control with Implicit Memory Vasumathi Raman 1, Bingxin Xu and Hadas Kress-Gazit 2 Abstract This paper addresses the challenge

More information

Synthesis for Robotics

Synthesis for Robotics Synthesis for Robotics Contributors: Lydia Kavraki, Hadas Kress-Gazit, Stéphane Lafortune, George Pappas, Sanjit A. Seshia, Paulo Tabuada, Moshe Vardi, Ayca Balkan, Jonathan DeCastro, Rüdiger Ehlers, Gangyuan

More information

An End-to-End System for Accomplishing Tasks with Modular Robots: Perspectives for the AI Community

An End-to-End System for Accomplishing Tasks with Modular Robots: Perspectives for the AI Community Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI-7) An End-to-End System for Accomplishing Tasks with Modular Robots: Perspectives for the AI Community Gangyuan

More information

Mitigating the State Explosion Problem of Temporal Logic Synthesis

Mitigating the State Explosion Problem of Temporal Logic Synthesis INGRAM PUBLISHING Mitigating the State Explosion Problem of Temporal Logic Synthesis R obots these days feature a tight interplay level physics and actuation limitations that constrain their between computational

More information

Reactive Synthesis for Robotics Applications

Reactive Synthesis for Robotics Applications Reactive Synthesis for Robotics Applications Contributors: Lydia Kavraki, Hadas Kress-Gazit, Stéphane Lafortune, George Pappas, Sanjit A. Seshia, Paulo Tabuada, Moshe Vardi, Ayca Balkan, Jonathan DeCastro,

More information

Automatically synthesizing a planning and control subsystem for the DARPA urban challenge

Automatically synthesizing a planning and control subsystem for the DARPA urban challenge University of Pennsylvania ScholarlyCommons Departmental Papers (ESE) Department of Electrical & Systems Engineering 8-23-2008 Automatically synthesizing a planning and control subsystem for the DARPA

More information

Where s Waldo? Sensor-Based Temporal Logic Motion Planning

Where s Waldo? Sensor-Based Temporal Logic Motion Planning Where s Waldo? Sensor-Based Temporal Logic Motion Planning Hadas Kress-Gazit, Georgios E. Fainekos and George J. Pappas GRASP Laboratory, University of Pennsylvania Philadelphia, PA 19104, USA {hadaskg,fainekos,pappasg}@grasp.upenn.edu

More information

From Structured English to Robot Motion

From Structured English to Robot Motion From Structured English to Robot Motion Hadas Kress-Gazit, Georgios E. Fainekos and George J. Pappas GRASP Laboratory, University of Pennsylvania Philadelphia, PA 1910, USA {hadaskg,fainekos,pappasg}@grasp.upenn.edu

More information

Translating Structured English to Robot Controllers

Translating Structured English to Robot Controllers Advanced Robotics 22 (2008) 1343 1359 www.brill.nl/ar Full paper Translating Structured English to Robot Controllers Hadas Kress-Gazit, Georgios E. Fainekos and George J. Pappas GRASP Laboratory, University

More information

Task and Motion Policy Synthesis as Liveness Games

Task and Motion Policy Synthesis as Liveness Games Task and Motion Policy Synthesis as Liveness Games Yue Wang Department of Computer Science Rice University May 9, 2016 Joint work with Neil T. Dantam, Swarat Chaudhuri, and Lydia E. Kavraki 1 Motivation

More information

Correct, Reactive Robot Control from Abstraction and Temporal Logic Specifications

Correct, Reactive Robot Control from Abstraction and Temporal Logic Specifications IEEE RAM 1 Correct, Reactive Robot Control from Abstraction and Temporal Logic Specifications Hadas KressGazit, Member, IEEE, Tichakorn Wongpiromsarn, and Ufuk Topcu, Member, IEEE Abstract We describe

More information

Kavraki. Expeditions in Computer Augmented Program Engineering

Kavraki. Expeditions in Computer Augmented Program Engineering Foster Hartmann Lafortune Kavraki Kress-Gazit Loo Madhusudan Bodik Expeditions in Computer Augmented Program Engineering http://excape.cis.upenn.edu/ Martin Alur Cornell, Maryland, Michigan, MIT, Penn,

More information

Experimental Cooperative Control of Fixed-Wing Unmanned Aerial Vehicles

Experimental Cooperative Control of Fixed-Wing Unmanned Aerial Vehicles Experimental Cooperative Control of Fixed-Wing Unmanned Aerial Vehicles Selcuk Bayraktar, Georgios E. Fainekos, and George J. Pappas GRASP Laboratory Departments of ESE and CIS University of Pennsylvania

More information

Controlling Wild Mobile Robots Using Virtual Gates and Discrete Transitions

Controlling Wild Mobile Robots Using Virtual Gates and Discrete Transitions Controlling Wild Mobile Robots Using Virtual Gates and Discrete Transitions Leonardo Bobadilla Fredy Martinez Eric Gobst bobadil1@uiuc.edu fredymar@uiuc.edu gobst1@uiuc.edu Katrina Gossman Steven M. LaValle

More information

ExCAPE. Rajeev Alur, Ras Bodik, Jeff Foster, Bjorn Hartmann, Lydia Kavraki,

ExCAPE. Rajeev Alur, Ras Bodik, Jeff Foster, Bjorn Hartmann, Lydia Kavraki, ExCAPE Expeditions in Computer Augmented Program Engineering Rajeev Alur, Ras Bodik, Jeff Foster, Bjorn Hartmann, Lydia Kavraki, Hadas Kress-Gazit, Stephane Lafortune, Boon Loo, P. Madhusudan, d Milo Martin,

More information

Op#mal Control of Non- determinis#c Systems for a Fragment of Temporal Logic

Op#mal Control of Non- determinis#c Systems for a Fragment of Temporal Logic Op#mal Control of Non- determinis#c Systems for a Fragment of Temporal Logic Eric M. Wolff 1 Ufuk Topcu 2 and Richard M. Murray 1 1 Caltech and 2 UPenn SYNT July 13, 2013 Autonomous Systems in the Field

More information

HIGH-LEVEL CONTROL OF MODULAR ROBOTS

HIGH-LEVEL CONTROL OF MODULAR ROBOTS HIGH-LEVEL CONTROL OF MODULAR ROBOTS A Thesis Presented to the Faculty of the Graduate School of Cornell University in Partial Fulfillment of the Requirements for the Degree of Master of Science by Sebastian

More information

Make It So: Continuous, Flexible Natural Language Interaction with an Autonomous Robot

Make It So: Continuous, Flexible Natural Language Interaction with an Autonomous Robot Grounding Language for Physical Systems AAAI Technical Report WS-12-07 Make It So: Continuous, Flexible Natural Language Interaction with an Autonomous Robot Daniel J. Brooks 1, Constantine Lignos 2, Cameron

More information

THE move from conventional to more-electric aircraft

THE move from conventional to more-electric aircraft 1 Specification and Synthesis of Reactive Protocols for Aircraft Electric Power Distribution Huan Xu 1, Ufuk Topcu 2, and Richard M. Murray 3 Abstract The increasing complexity of electric power systems

More information

Distributed Synthesis of Control Protocols for Smart Camera Networks

Distributed Synthesis of Control Protocols for Smart Camera Networks Distributed Synthesis of Control Protocols for Smart Camera Networks Necmiye Ozay, Ufuk Topcu, Tichakorn Wongpiromsarn and Richard M Murray Abstract We considered the problem of designing control protocols

More information

An integrated system for perception-driven autonomy with modular robots

An integrated system for perception-driven autonomy with modular robots COLLECTIVE BEHAVIOR An integrated system for perception-driven autonomy with modular robots Jonathan Daudelin 1 *, Gangyuan Jing 1 *, Tarik Tosun 2 *, Mark Yim 2, Hadas Kress-Gazit 1, Mark Campbell 1 Copyright

More information

On-demand printable robots

On-demand printable robots On-demand printable robots Ankur Mehta Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology 3 Computational problem? 4 Physical problem? There s a robot for that.

More information

Performance Guarantees for C-WMD Robot Missions

Performance Guarantees for C-WMD Robot Missions Performance Guarantees for C-WMD Robot Missions Shu Jiang, Ronald C. Arkin School of Interactive Computing Georgia Institute of Technology Atlanta, GA, USA Damian M. Lyons, Tsung-Ming Liu, Dagan Harrington

More information

Distributed Synthesis of Control Protocols for Smart Camera Networks

Distributed Synthesis of Control Protocols for Smart Camera Networks Distributed Synthesis of Control Protocols for Smart Camera Networks Necmiye Ozay, Ufuk Topcu, Tichakorn Wongpiromsarn and Richard M Murray last updated on March 10, 2011 Abstract We considered the problem

More information

Distributed Power Allocation for Vehicle Management Systems

Distributed Power Allocation for Vehicle Management Systems 2011 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC) Orlando, FL, USA, December 12-15, 2011 Distributed Power Allocation for Vehicle Management Systems Necmiye Ozay

More information

Distributed Synthesis of Control Protocols for Smart Camera Networks

Distributed Synthesis of Control Protocols for Smart Camera Networks To appear, 011 International Conference on Cyber-Physical Systems ICCPS) http://wwwcdscaltechedu/~murray/papers/otwm11-iccpshtml Distributed Synthesis of Control Protocols for Smart Camera Networks Necmiye

More information

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty

CS123. Programming Your Personal Robot. Part 3: Reasoning Under Uncertainty CS123 Programming Your Personal Robot Part 3: Reasoning Under Uncertainty Topics For Part 3 3.1 The Robot Programming Problem What is robot programming Challenges Real World vs. Virtual World Mapping and

More information

Path Planning in Dynamic Environments Using Time Warps. S. Farzan and G. N. DeSouza

Path Planning in Dynamic Environments Using Time Warps. S. Farzan and G. N. DeSouza Path Planning in Dynamic Environments Using Time Warps S. Farzan and G. N. DeSouza Outline Introduction Harmonic Potential Fields Rubber Band Model Time Warps Kalman Filtering Experimental Results 2 Introduction

More information

Project demonstration in class: November 16, 2006 Project writeups due: November 18, 2006, electronic handin by 10pm

Project demonstration in class: November 16, 2006 Project writeups due: November 18, 2006, electronic handin by 10pm 1 Dates Project demonstration in class: November 16, 2006 Project writeups due: November 18, 2006, electronic handin by 10pm 2 Introduction The purpose of this project is to implement a deliberative control

More information

CS 730/830: Intro AI. Prof. Wheeler Ruml. TA Bence Cserna. Thinking inside the box. 5 handouts: course info, project info, schedule, slides, asst 1

CS 730/830: Intro AI. Prof. Wheeler Ruml. TA Bence Cserna. Thinking inside the box. 5 handouts: course info, project info, schedule, slides, asst 1 CS 730/830: Intro AI Prof. Wheeler Ruml TA Bence Cserna Thinking inside the box. 5 handouts: course info, project info, schedule, slides, asst 1 Wheeler Ruml (UNH) Lecture 1, CS 730 1 / 23 My Definition

More information

NEXT-GENERATION aircraft are moving away from hydraulically and pneumatically powered systems into electrically powered systems

NEXT-GENERATION aircraft are moving away from hydraulically and pneumatically powered systems into electrically powered systems JOURNAL OF AEROSPE INFORMATION SYSTEMS Vol. 11, No. 10, October 2014 Control Software Synthesis and Validation for a Vehicular Electric Power Distribution Testbed Robert Rogersten KTH Royal Institute of

More information

Physics-Based Manipulation in Human Environments

Physics-Based Manipulation in Human Environments Vol. 31 No. 4, pp.353 357, 2013 353 Physics-Based Manipulation in Human Environments Mehmet R. Dogar Siddhartha S. Srinivasa The Robotics Institute, School of Computer Science, Carnegie Mellon University

More information

A game-based model for human-robots interaction

A game-based model for human-robots interaction A game-based model for human-robots interaction Aniello Murano and Loredana Sorrentino Dipartimento di Ingegneria Elettrica e Tecnologie dell Informazione Università degli Studi di Napoli Federico II,

More information

Robotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center

Robotic System Simulation and Modeling Stefan Jörg Robotic and Mechatronic Center Robotic System Simulation and ing Stefan Jörg Robotic and Mechatronic Center Outline Introduction The SAFROS Robotic System Simulator Robotic System ing Conclusions Folie 2 DLR s Mirosurge: A versatile

More information

Lecture 8 Receding Horizon Temporal Logic Planning & Compositional Protocol Synthesis

Lecture 8 Receding Horizon Temporal Logic Planning & Compositional Protocol Synthesis Lecture 8 Receding Horizon Temporal Logic Planning & Compositional Protocol Synthesis Ufuk Topcu Nok Wongpiromsarn Richard M. Murray EECI, 18 May 2012 Outline: Receding horizon temporal logic planning

More information

A Probabilistic Method for Planning Collision-free Trajectories of Multiple Mobile Robots

A Probabilistic Method for Planning Collision-free Trajectories of Multiple Mobile Robots A Probabilistic Method for Planning Collision-free Trajectories of Multiple Mobile Robots Maren Bennewitz Wolfram Burgard Department of Computer Science, University of Freiburg, 7911 Freiburg, Germany

More information

Verifiable Autonomy. Michael Fisher. University of Liverpool, 11th September 2015

Verifiable Autonomy. Michael Fisher. University of Liverpool, 11th September 2015 Verifiable Autonomy Michael Fisher University of Liverpool, 11th September 2015 Motivation: Autonomy Everywhere! rtc.nagoya.riken.jp/ri-man www.volvo.com Motivation: Autonomous Systems Architectures Many

More information

Stanford Center for AI Safety

Stanford Center for AI Safety Stanford Center for AI Safety Clark Barrett, David L. Dill, Mykel J. Kochenderfer, Dorsa Sadigh 1 Introduction Software-based systems play important roles in many areas of modern life, including manufacturing,

More information

Outline. Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types

Outline. Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Intelligent Agents Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types Agent types Agents An agent is anything that can be viewed as

More information

Industrial Cyber-Physical Systems icyphy

Industrial Cyber-Physical Systems icyphy Industrial Cyber-Physical Systems icyphy Amit Fisher, Clas A. Jacobson, Edward A. Lee, Richard M. Murray, Alberto Sangiovanni-Vincentelli, and Eelco Scholte Abstract ICyPhy is a pre-competitive industry-academic

More information

Subsumption Architecture in Swarm Robotics. Cuong Nguyen Viet 16/11/2015

Subsumption Architecture in Swarm Robotics. Cuong Nguyen Viet 16/11/2015 Subsumption Architecture in Swarm Robotics Cuong Nguyen Viet 16/11/2015 1 Table of content Motivation Subsumption Architecture Background Architecture decomposition Implementation Swarm robotics Swarm

More information

[31] S. Koenig, C. Tovey, and W. Halliburton. Greedy mapping of terrain.

[31] S. Koenig, C. Tovey, and W. Halliburton. Greedy mapping of terrain. References [1] R. Arkin. Motor schema based navigation for a mobile robot: An approach to programming by behavior. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA),

More information

CS343 Artificial Intelligence

CS343 Artificial Intelligence CS343 Artificial Intelligence Prof: Department of Computer Science The University of Texas at Austin Good Morning, Colleagues Good Morning, Colleagues Are there any questions? Logistics Questions about

More information

ADVANCES in electronics technology have made the transition

ADVANCES in electronics technology have made the transition JOURNAL OF L A TEX CLASS FILES 1 Specification and Synthesis of Reactive Protocols for Aircraft Electric Power Distribution Huan Xu 1, Ufuk Topcu 2, and Richard M. Murray 1 Abstract The increasing complexity

More information

Research Statement MAXIM LIKHACHEV

Research Statement MAXIM LIKHACHEV Research Statement MAXIM LIKHACHEV My long-term research goal is to develop a methodology for robust real-time decision-making in autonomous systems. To achieve this goal, my students and I research novel

More information

CS686: High-level Motion/Path Planning Applications

CS686: High-level Motion/Path Planning Applications CS686: High-level Motion/Path Planning Applications Sung-Eui Yoon ( 윤성의 ) Course URL: http://sglab.kaist.ac.kr/~sungeui/mpa Class Objectives Discuss my general research view on motion planning Discuss

More information

Intro to Intelligent Robotics EXAM Spring 2008, Page 1 of 9

Intro to Intelligent Robotics EXAM Spring 2008, Page 1 of 9 Intro to Intelligent Robotics EXAM Spring 2008, Page 1 of 9 Student Name: Student ID # UOSA Statement of Academic Integrity On my honor I affirm that I have neither given nor received inappropriate aid

More information

Teaching Embedded Systems to Berkeley Undergraduates

Teaching Embedded Systems to Berkeley Undergraduates Teaching Embedded Systems to Berkeley Undergraduates EECS124 at UC Berkeley co-developed by Edward A. Lee Sanjit A. Seshia Claire J. Tomlin http://chess.eecs.berkeley.edu/eecs124 CPSWeek CHESS Workshop

More information

DisCoF: Cooperative Pathfinding in Distributed Systems with Limited Sensing and Communication Range

DisCoF: Cooperative Pathfinding in Distributed Systems with Limited Sensing and Communication Range DisCoF: Cooperative Pathfinding in Distributed Systems with Limited Sensing and Communication Range Yu Zhang, Kangjin Kim and Georgios Fainekos Abstract Cooperative pathfinding is often addressed in one

More information

Introduction To Cognitive Robots

Introduction To Cognitive Robots Introduction To Cognitive Robots Prof. Brian Williams Rm 33-418 Wednesday, February 2 nd, 2004 Outline Examples of Robots as Explorers Course Objectives Student Introductions and Goals Introduction to

More information

Obstacle Displacement Prediction for Robot Motion Planning and Velocity Changes

Obstacle Displacement Prediction for Robot Motion Planning and Velocity Changes International Journal of Information and Electronics Engineering, Vol. 3, No. 3, May 13 Obstacle Displacement Prediction for Robot Motion Planning and Velocity Changes Soheila Dadelahi, Mohammad Reza Jahed

More information

Design Concept of State-Chart Method Application through Robot Motion Equipped With Webcam Features as E-Learning Media for Children

Design Concept of State-Chart Method Application through Robot Motion Equipped With Webcam Features as E-Learning Media for Children Design Concept of State-Chart Method Application through Robot Motion Equipped With Webcam Features as E-Learning Media for Children Rossi Passarella, Astri Agustina, Sutarno, Kemahyanto Exaudi, and Junkani

More information

Verification of Generic Ubiquitous Middleware for Smart Home Using Coloured Petri Nets

Verification of Generic Ubiquitous Middleware for Smart Home Using Coloured Petri Nets I.J. Information Technology and Computer Science, 2014, 10, 63-69 Published Online September 2014 in MECS (http://www.mecs-press.org/) DOI: 10.5815/ijitcs.2014.10.09 Verification of Generic Ubiquitous

More information

Validation of Computer Simulations of the HyQ Robot

Validation of Computer Simulations of the HyQ Robot April 28, 217 16:4 WSPC - Proceedings Trim Size: 9in x 6in main 1 Validation of Computer Simulations of the HyQ Robot Marco Frigerio, Victor Barasuol, Michele Focchi, Darwin G. Caldwell and Claudio Semini

More information

Robotics and Autonomy. Control of Complex Systems (RMM)

Robotics and Autonomy. Control of Complex Systems (RMM) Robotics and Autonomy Richard M. Murray BE 107, 14 May 2015 Goals: Describe how behavior is implemented in robotic systems (vs biology) Discuss some of the ways that insights in robotics might impact biology

More information

SnakeSIM: a Snake Robot Simulation Framework for Perception-Driven Obstacle-Aided Locomotion

SnakeSIM: a Snake Robot Simulation Framework for Perception-Driven Obstacle-Aided Locomotion : a Snake Robot Simulation Framework for Perception-Driven Obstacle-Aided Locomotion Filippo Sanfilippo 1, Øyvind Stavdahl 1 and Pål Liljebäck 1 1 Dept. of Engineering Cybernetics, Norwegian University

More information

A Model-Theoretic Approach to the Verification of Situated Reasoning Systems

A Model-Theoretic Approach to the Verification of Situated Reasoning Systems A Model-Theoretic Approach to the Verification of Situated Reasoning Systems Anand 5. Rao and Michael P. Georgeff Australian Artificial Intelligence Institute 1 Grattan Street, Carlton Victoria 3053, Australia

More information

Some Thoughts on Runtime Verification

Some Thoughts on Runtime Verification Some Thoughts on Runtime Verification Oded Maler VERIMAG CNRS and the University of Grenoble (UGA) France RV, September 2016 Madrid Before Dinner Speech I like long and general introductions in my papers

More information

Ali-akbar Agha-mohammadi

Ali-akbar Agha-mohammadi Ali-akbar Agha-mohammadi Parasol lab, Dept. of Computer Science and Engineering, Texas A&M University Dynamics and Control lab, Dept. of Aerospace Engineering, Texas A&M University Statement of Research

More information

Human Robot Interaction

Human Robot Interaction Human Robot Interaction Taxonomy 1 Source Material About This Class Classifying Human-Robot Interaction an Updated Taxonomy Topics What is this taxonomy thing? Some ways of looking at Human-Robot relationships.

More information

Coordination in Human-Robot Teams Using Mental Modeling and Plan Recognition

Coordination in Human-Robot Teams Using Mental Modeling and Plan Recognition Coordination in Human-Robot Teams Using Mental Modeling and Plan Recognition Kartik Talamadupula Gordon Briggs Tathagata Chakraborti Matthias Scheutz Subbarao Kambhampati Dept. of Computer Science and

More information

Motion Planning for Real Robots. Sachin Chitta

Motion Planning for Real Robots. Sachin Chitta Motion Planning for Real Robots Needs, Challenges and Solutions Advanced Tools for Mobile Manipulation Sachin Chitta Associate Director Robotics Systems and Software SRI International Background PhD (GRASP,

More information

Bibliography. [3] S. Croomes, Overview of the DART Mishap Investigation Results, tech. rep., National Aeronautics and Space Administration, 2006.

Bibliography. [3] S. Croomes, Overview of the DART Mishap Investigation Results, tech. rep., National Aeronautics and Space Administration, 2006. 133 Bibliography [1] A. Elfes, J. L. Hall, J. F. Montgomery, C. F. Bergh, and B. A. Dudik, Towards a substantionally autonomous aerobot for exploration of Titan, in Proc. of the IEEE International Conference

More information

An Integrated Modeling and Simulation Methodology for Intelligent Systems Design and Testing

An Integrated Modeling and Simulation Methodology for Intelligent Systems Design and Testing An Integrated ing and Simulation Methodology for Intelligent Systems Design and Testing Xiaolin Hu and Bernard P. Zeigler Arizona Center for Integrative ing and Simulation The University of Arizona Tucson,

More information

The fridge door is open Temporal Verification of a Robotic Assistant s Behaviours

The fridge door is open Temporal Verification of a Robotic Assistant s Behaviours The fridge door is open Temporal Verification of a Robotic Assistant s Behaviours Clare Dixon 1, Matt Webster 1, Joe Saunders 2, Michael Fisher 1 and Kerstin Dautenhahn 2 1 Dept. of Computer Science, University

More information

Behaviour-Based Control. IAR Lecture 5 Barbara Webb

Behaviour-Based Control. IAR Lecture 5 Barbara Webb Behaviour-Based Control IAR Lecture 5 Barbara Webb Traditional sense-plan-act approach suggests a vertical (serial) task decomposition Sensors Actuators perception modelling planning task execution motor

More information

Learning the Proprioceptive and Acoustic Properties of Household Objects. Jivko Sinapov Willow Collaborators: Kaijen and Radu 6/24/2010

Learning the Proprioceptive and Acoustic Properties of Household Objects. Jivko Sinapov Willow Collaborators: Kaijen and Radu 6/24/2010 Learning the Proprioceptive and Acoustic Properties of Household Objects Jivko Sinapov Willow Collaborators: Kaijen and Radu 6/24/2010 What is Proprioception? It is the sense that indicates whether the

More information

NSF-Sponsored Workshop: Research Issues at at the Boundary of AI and Robotics

NSF-Sponsored Workshop: Research Issues at at the Boundary of AI and Robotics NSF-Sponsored Workshop: Research Issues at at the Boundary of AI and Robotics robotics.cs.tamu.edu/nsfboundaryws Nancy Amato, Texas A&M (ICRA-15 Program Chair) Sven Koenig, USC (AAAI-15 Program Co-Chair)

More information

Authoring and Verifying Human-Robot Interactions

Authoring and Verifying Human-Robot Interactions Authoring and Verifying Human-Robot Interactions David Porfirio, 1 Allison Sauppé, 2 Aws Albarghouthi, 1 Bilge Mutlu 1 1 University of Wisconsin Madison, Madison, Wisconsin, USA 2 University of Wisconsin

More information

Sean B. Andersson. Education and training: Positions: Honors: Teaching: Publications:

Sean B. Andersson. Education and training: Positions: Honors: Teaching: Publications: Sean B. Andersson Department of Mechanical Engineering Tel: 617-353-4949 Boston University Fax: 617-353-5866 110 Cummington Street E-mail: sanderss@bu.edu Boston, MA 02215 Web: http://people.bu.edu/sanderss

More information

and : Principles of Autonomy and Decision Making. Prof Brian Williams, Prof Emilio Frazzoli and Sertac Karaman September, 8 th, 2010

and : Principles of Autonomy and Decision Making. Prof Brian Williams, Prof Emilio Frazzoli and Sertac Karaman September, 8 th, 2010 16.410 and 16.412: Principles of Autonomy and Decision Making Prof Brian Williams, Prof Emilio Frazzoli and Sertac Karaman September, 8 th, 2010 1 1 Assignments Homework: Class signup, return at end of

More information

Team-Triggered Coordination of Robotic Networks for Optimal Deployment

Team-Triggered Coordination of Robotic Networks for Optimal Deployment Team-Triggered Coordination of Robotic Networks for Optimal Deployment Cameron Nowzari 1, Jorge Cortés 2, and George J. Pappas 1 Electrical and Systems Engineering 1 University of Pennsylvania Mechanical

More information

Planning for Human-Robot Teaming Challenges & Opportunities

Planning for Human-Robot Teaming Challenges & Opportunities for Human-Robot Teaming Challenges & Opportunities Subbarao Kambhampati Arizona State University Thanks Matthias Scheutz@Tufts HRI Lab [Funding from ONR, ARO J ] 1 [None (yet?) from NSF L ] 2 Two Great

More information

Formation Control for Mobile Robots with Limited Sensor Information

Formation Control for Mobile Robots with Limited Sensor Information Formation Control for Mobile Robots with imited Sensor Information Tove Gustavi and Xiaoming Hu Optimization and Systems Theory Royal Institute of Technology SE 1 44 Stockholm, Sweden gustavi@math.kth.se

More information

TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP

TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP TRUST-BASED CONTROL AND MOTION PLANNING FOR MULTI-ROBOT SYSTEMS WITH A HUMAN-IN-THE-LOOP Yue Wang, Ph.D. Warren H. Owen - Duke Energy Assistant Professor of Engineering Interdisciplinary & Intelligent

More information

Distributed Vision System: A Perceptual Information Infrastructure for Robot Navigation

Distributed Vision System: A Perceptual Information Infrastructure for Robot Navigation Distributed Vision System: A Perceptual Information Infrastructure for Robot Navigation Hiroshi Ishiguro Department of Information Science, Kyoto University Sakyo-ku, Kyoto 606-01, Japan E-mail: ishiguro@kuis.kyoto-u.ac.jp

More information

Event-based Algorithms for Robust and High-speed Robotics

Event-based Algorithms for Robust and High-speed Robotics Event-based Algorithms for Robust and High-speed Robotics Davide Scaramuzza All my research on event-based vision is summarized on this page: http://rpg.ifi.uzh.ch/research_dvs.html Davide Scaramuzza University

More information

Robot Motion Control and Planning

Robot Motion Control and Planning Robot Motion Control and Planning http://www.cs.bilkent.edu.tr/~saranli/courses/cs548 Lecture 1 Introduction and Logistics Uluç Saranlı http://www.cs.bilkent.edu.tr/~saranli CS548 - Robot Motion Control

More information

Distributed Control of Multi-Robot Teams: Cooperative Baton Passing Task

Distributed Control of Multi-Robot Teams: Cooperative Baton Passing Task Appeared in Proceedings of the 4 th International Conference on Information Systems Analysis and Synthesis (ISAS 98), vol. 3, pages 89-94. Distributed Control of Multi- Teams: Cooperative Baton Passing

More information

DiVA Digitala Vetenskapliga Arkivet

DiVA Digitala Vetenskapliga Arkivet DiVA Digitala Vetenskapliga Arkivet http://umu.diva-portal.org This is a paper presented at First International Conference on Robotics and associated Hightechnologies and Equipment for agriculture, RHEA-2012,

More information

Learning Probabilistic Models for Mobile Manipulation Robots

Learning Probabilistic Models for Mobile Manipulation Robots Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Learning Probabilistic Models for Mobile Manipulation Robots Jürgen Sturm and Wolfram Burgard University of Freiburg

More information

Cooperative robot team navigation strategies based on an environmental model

Cooperative robot team navigation strategies based on an environmental model Cooperative robot team navigation strategies based on an environmental model P. Urcola and L. Montano Instituto de Investigación en Ingeniería de Aragón, University of Zaragoza (Spain) Email: {urcola,

More information

Easy Robot Software. And the MoveIt! Setup Assistant 2.0. Dave Coleman, PhD davetcoleman

Easy Robot Software. And the MoveIt! Setup Assistant 2.0. Dave Coleman, PhD davetcoleman Easy Robot Software And the MoveIt! Setup Assistant 2.0 Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Study David Coleman, Ioan Sucan, Sachin Chitta, Nikolaus Correll Journal

More information

A Modular Architecture for an Interactive Real-Time Simulation and Training Environment for Satellite On-Orbit Servicing

A Modular Architecture for an Interactive Real-Time Simulation and Training Environment for Satellite On-Orbit Servicing A Modular Architecture for an Interactive Real-Time Simulation and Training Environment for Satellite On-Orbit Servicing Robin Wolff German Aerospace Center (DLR), Germany Slide 1 Outline! Motivation!

More information

Scalable Approaches to Deploying Swarms of Vehicles and Sensors

Scalable Approaches to Deploying Swarms of Vehicles and Sensors Scalable Approaches to Deploying Swarms of Vehicles and Sensors Vijay Kumar Laboratory University of Pennsylvania www.swarms.org Research supported by ARO Swarms (R. Zachery) and ONR IA (M. Steinberg)

More information

CS295-1 Final Project : AIBO

CS295-1 Final Project : AIBO CS295-1 Final Project : AIBO Mert Akdere, Ethan F. Leland December 20, 2005 Abstract This document is the final report for our CS295-1 Sensor Data Management Course Final Project: Project AIBO. The main

More information

Overview Agents, environments, typical components

Overview Agents, environments, typical components Overview Agents, environments, typical components CSC752 Autonomous Robotic Systems Ubbo Visser Department of Computer Science University of Miami January 23, 2017 Outline 1 Autonomous robots 2 Agents

More information

Jurnal TICOM Vol.1 No.1 September 2012 ISSN

Jurnal TICOM Vol.1 No.1 September 2012 ISSN Self Driving Car: Artificial Intelligence Approach Ronal Chandra* 1, Nazori Agani* 2, Yoga Prihastomo* 3 *Postgraduate Program, Master of Computer Science, University of Budi Luhur Jl. Raya Ciledug, Jakarta

More information

EECS 219C: Computer-Aided Verification Introduction & Overview. Sanjit A. Seshia EECS, UC Berkeley

EECS 219C: Computer-Aided Verification Introduction & Overview. Sanjit A. Seshia EECS, UC Berkeley EECS 219C: Computer-Aided Verification Introduction & Overview Sanjit A. Seshia EECS, UC Berkeley Computer-Aided Verification (informally) Does the system do what it is supposed to do? S. A. Seshia 2 The

More information

Using Reactive Deliberation for Real-Time Control of Soccer-Playing Robots

Using Reactive Deliberation for Real-Time Control of Soccer-Playing Robots Using Reactive Deliberation for Real-Time Control of Soccer-Playing Robots Yu Zhang and Alan K. Mackworth Department of Computer Science, University of British Columbia, Vancouver B.C. V6T 1Z4, Canada,

More information

Improved Model Generation of AMS Circuits for Formal Verification

Improved Model Generation of AMS Circuits for Formal Verification Improved Generation of AMS Circuits for Formal Verification Dhanashree Kulkarni, Satish Batchu, Chris Myers University of Utah Abstract Recently, formal verification has had success in rigorously checking

More information

Keywords: Multi-robot adversarial environments, real-time autonomous robots

Keywords: Multi-robot adversarial environments, real-time autonomous robots ROBOT SOCCER: A MULTI-ROBOT CHALLENGE EXTENDED ABSTRACT Manuela M. Veloso School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213, USA veloso@cs.cmu.edu Abstract Robot soccer opened

More information

Hybrid Decentralized Control System for Communication Aware Mobile Robotic Teams

Hybrid Decentralized Control System for Communication Aware Mobile Robotic Teams Hybrid Decentralized Control System for Communication Aware Mobile Robotic Teams James Stephan, Jonathan Fink, Ben Charrow, and Alejandro Ribeiro Abstract Enabling a team of robots to self-organize into

More information

The Future of AI A Robotics Perspective

The Future of AI A Robotics Perspective The Future of AI A Robotics Perspective Wolfram Burgard Autonomous Intelligent Systems Department of Computer Science University of Freiburg Germany The Future of AI My Robotics Perspective Wolfram Burgard

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Chapter 1 Chapter 1 1 Outline What is AI? A brief history The state of the art Chapter 1 2 What is AI? Systems that think like humans Systems that think rationally Systems that

More information

Formal Verification. Lecture 5: Computation Tree Logic (CTL)

Formal Verification. Lecture 5: Computation Tree Logic (CTL) Formal Verification Lecture 5: Computation Tree Logic (CTL) Jacques Fleuriot 1 jdf@inf.ac.uk 1 With thanks to Bob Atkey for some of the diagrams. Recap Previously: Linear-time Temporal Logic This time:

More information

LAB 5: Mobile robots -- Modeling, control and tracking

LAB 5: Mobile robots -- Modeling, control and tracking LAB 5: Mobile robots -- Modeling, control and tracking Overview In this laboratory experiment, a wheeled mobile robot will be used to illustrate Modeling Independent speed control and steering Longitudinal

More information

IBA: Intelligent Bug Algorithm A Novel Strategy to Navigate Mobile Robots Autonomously

IBA: Intelligent Bug Algorithm A Novel Strategy to Navigate Mobile Robots Autonomously IBA: Intelligent Bug Algorithm A Novel Strategy to Navigate Mobile Robots Autonomously Muhammad Zohaib 1, Syed Mustafa Pasha 1, Nadeem Javaid 2, and Jamshed Iqbal 1(&) 1 Department of Electrical Engineering,

More information

Situational Reasoning for Road Driving in an Urban Environment

Situational Reasoning for Road Driving in an Urban Environment Situational Reasoning for Road Driving in an Urban Environment Noel E. Du Toit, Tichakorn Wongpiromsarn, Joel W. Burdick, and Richard M. Murray California Institute of Technology Division of Engineering

More information

Transer Learning : Super Intelligence

Transer Learning : Super Intelligence Transer Learning : Super Intelligence GIS Group Dr Narayan Panigrahi, MA Rajesh, Shibumon Alampatta, Rakesh K P of Centre for AI and Robotics, Defence Research and Development Organization, C V Raman Nagar,

More information