Autonomy, how much human in the loop? Architecting systems for complex contexts

Similar documents
by Gerrit Muller University of South-Eastern Norway-NISE

Tutorial Roadmapping for Strategy Support

The Waferstepper Challenge: Innovation and Reliability despite Complexity

The Informal Nature of Systems Engineering

Decomposing the Architect; What are Critical Success Factors?

Roadmapping. Market Products Technology. People Process. time, ca 5 years

VSI Labs The Build Up of Automated Driving

Buskerud University College: Program Systems Engineering

Systems Engineering Fundamentals Assignments

Module Role of Software in Complex Systems

Gerrit Meixner Head of the Center for Human-Machine-Interaction (ZMMI)

Glossary of terms. Short explanation

Intelligent Technology for More Advanced Autonomous Driving

Introduction to Systems Engineering

A Functional Reference Architecture for Autonomous Driving

Why is Systems Integration understood so poorly? Reflections on 3 decades of unforeseen failures

AGENTS AND AGREEMENT TECHNOLOGIES: THE NEXT GENERATION OF DISTRIBUTED SYSTEMS

RoboCup. Presented by Shane Murphy April 24, 2003

Networked and Distributed Control Systems Lecture 1. Tamas Keviczky and Nathan van de Wouw

Autonomous and Autonomic Systems: With Applications to NASA Intelligent Spacecraft Operations and Exploration Systems

Tsuyoshi Sato PIONEER CORPORATION July 6, 2017

Buskerud University College: Program Systems. engineering

CS686: High-level Motion/Path Planning Applications

COVER STORY. how this new architecture will help carmakers master the complexity of autonomous driving.

Eliciting and Validating Stakeholder Needs

DENSO

THE FUTURE OF DATA AND INTELLIGENCE IN TRANSPORT

In-Vehicle Emergency Call Systems: From National Deployment to International Harmonization. Evgeni Meilikhov, PhD

The Role of the Architect in a Turbulent World

DENSO www. densocorp-na.com

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

GNSS in Autonomous Vehicles MM Vision

Comau AURA - Advanced Use Robotic Arm AURA. Soft as a Human Touch

Facing Moore s Law with Model-Driven R&D

AURA Soft as a Human Touch

Whitepaper. Lighting meets Artificial Intelligence (AI) - a way towards better lighting. By Lars Hellström & Henri Juslén at Helvar helvar.

William Milam Ford Motor Co

SOFTWARE AGENTS IN HANDLING ABNORMAL SITUATIONS IN INDUSTRIAL PLANTS

Horizon 2020 ICT Robotics Work Programme (draft - Publication: 20 October 2015)

Distributed Robotics: Building an environment for digital cooperation. Artificial Intelligence series

Autonomous Mobile Robot Design. Dr. Kostas Alexis (CSE)

ITS Radiocommunications in Japan Progress report and future directions

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017

ITS radiocommunications toward automated driving systems in Japan

Standardised Ground Data Systems Implementation: A Dream?

UNIT-III LIFE-CYCLE PHASES

Behaviour-Based Control. IAR Lecture 5 Barbara Webb

Using FMI/ SSP for Development of Autonomous Driving

II. ROBOT SYSTEMS ENGINEERING

Softing TDX ODX- and OTX-Based Diagnostic System Framework

Automation and Mechatronics Engineering Program. Your Path Towards Success

Introduction to Real-Time Systems

Connected and Autonomous Technology Evaluation Center (CAVTEC) Overview. TennSMART Spring Meeting April 9 th, 2019

INDUSTRY 4.0. Modern massive Data Analysis for Industry 4.0 Industry 4.0 at VŠB-TUO

interactive IP: Perception platform and modules

SEPTEMBER, 2018 PREDICTIVE MAINTENANCE SOLUTIONS

Robotics in Horizon 2020 ICT Work Programme

Digital Transformation. A Game Changer. How Does the Digital Transformation Affect Informatics as a Scientific Discipline?

THE NEW GENERATION OF MANUFACTURING SYSTEMS

Automotive Applications ofartificial Intelligence

The Tool Box of the System Architect

CPE/CSC 580: Intelligent Agents

Automation & Robotics (A&R) for Space Applications in the German Space Program

ROBOTIC MANIPULATION AND HAPTIC FEEDBACK VIA HIGH SPEED MESSAGING WITH THE JOINT ARCHITECTURE FOR UNMANNED SYSTEMS (JAUS)

Function architectures relevance in automotive research and education Bengt Jacobson, Chalmers

Artificial Intelligence and Law. Latifa Al-Abdulkarim Assistant Professor of Artificial Intelligence, KSU

Applied Robotics for Installations and Base Operations (ARIBO)

Robotics Introduction Matteo Matteucci

Team Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development paradigm

Blade Tip Timing Frequently asked Questions. Dr Pete Russhard

Humans and Automated Driving Systems

Threads of Reasoning in the Medical Imaging Case

Grundlagen des Software Engineering Fundamentals of Software Engineering

Holistic Lithography. Christophe Fouquet. Executive Vice President, Applications. 24 November 2014

Agent. Pengju Ren. Institute of Artificial Intelligence and Robotics

TRB Workshop on the Future of Road Vehicle Automation

Author s Name Name of the Paper Session. DYNAMIC POSITIONING CONFERENCE October 10-11, 2017 SENSORS SESSION. Sensing Autonomy.

Driving Force for. How cyber physical systems will change the way of future production

Visvesvaraya Technological University, Belagavi

CANADA S OCEAN SUPERCLUSTER DRAFT NOVEMBER 1

Israel Railways No Fault Liability Renewal The Implementation of New Technological Safety Devices at Level Crossings. Amos Gellert, Nataly Kats

A SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS

Limits of a Distributed Intelligent Networked Device in the Intelligence Space. 1 Brief History of the Intelligent Space

The Evolution of Artificial Intelligence in Workplaces

The GATEway Project London s Autonomous Push

ISSN: ISO 9001:2008 Certified International Journal of Engineering Science and Innovative Technology (IJESIT) Volume 6, Issue 2, March 2017

How to build an autonomous anything

Course Descriptions for Train-the-Trainer 24. Gateway Technical College, Kenosha, WI. July 24th -28th, 2017

Planning in autonomous mobile robotics

How to build an autonomous anything

GTU- Centre of Excellence in Automation

COCIR SELF-REGULATORY INITIATIVE FOR MEDICAL IMAGING EQUIPMENT COMPUTED TOMOGRAPHY MEASUREMENT OF ENERGY CONSUMPTION

Development of an Intelligent Agent based Manufacturing System

Chapter 31. Intelligent System Architectures

Development and Integration of Artificial Intelligence Technologies for Innovation Acceleration

Executive Summary. Chapter 1. Overview of Control

A Roadmap for Connected & Autonomous Vehicles. David Skipp Ford Motor Company

Aerospace Software* Cost and Timescale Reduction *and complex electronic hardware

Why Design for Testability Sooner? 21 October 2008 Bruce Bardell, Technical Fellow Bradley Chief Architect BAE Systems

CONTROLLING METHODS AND CHALLENGES OF ROBOTIC ARM

Transcription:

Architecting systems for complex contexts by Gerrit Muller University College of South East Norway e-mail: gaudisite@gmail.com www.gaudisite.nl Abstract The move from today s automotive archictectures to autonomous architectures triggers many questions. Todays architectures are federative, focused on safety through predictability, and legacy and bottom-up driven. Autonomy requires context understanding, and a fundamental discussion on the balance between humans and autonomous systems. This presentation takes the perspective from other domains with software intensive systems, to explore the potential hurdles in the transition to autonomous systems. Distribution This article or presentation is written as part of the Gaudí project. The Gaudí project philosophy is to improve by obtaining frequent feedback. Frequent feedback is pursued by an open creation process. This document is published as intermediate or nearly mature version to get feedback. Further distribution is allowed as long as the document remains complete and unchanged. status: planned

An outsiders perspective on Automotive The speaker s background Health care, MRI scanners 1981-1991 (and 2007-2010) Highly integrated architecture: Host computer + controllers Health care, Imaging workstations 1991-1997 Object Oriented, workstations + servers Semiconductor equipment 1997-1999 From federated to integrated architecture The speaker s perspective on automotive Loooong development cycles (heavy qualification, certification, verification) Where is the system from control perspective? Why do designers constrain themselves so much? (no dynamic memory management!) How can automotive move from such primitive state to autonomous driving? 2 Gerrit Muller AACSoutsidersPerspective

Figure of Contents TM architecture example and trends from semiconductor equipment domain automotive architecture and trends health care automation example autonomous driving? 3 Gerrit Muller AACSlogo

Example ASML Waferstepper 4 Gerrit Muller ASMLtwinscanPhoto

Control Hierarchy of a Waferstepper system control coordination ethernet laser lens illuminator measurement C&T reticle stage reticle handler wafer stage wafer handler VME VME vertical motion horizontal motion vertical motion horizontal motion 5 Gerrit Muller FAIcontrolHierarchy

Trend: Increased Frequency of Control Actions trend with increasing performance requirements SW sampling per die per wafer per batch per day preventive maintenance 10-3 1 10 3 10 6 seconds 6 Gerrit Muller FAIcontrolFrequency

Evolution of System Control user interface automation interface monitoring and optimization user interface static simple calibration sequencer 1990 150 kloc data store production and installation support feedforward metro exposure control dynamic calibration infrastructure 2000 2000 kloc job control data management monitoring 7 Gerrit Muller FAIcontrolEvolution

Consequences of Evolution Performance and functionality demands causes Complexity threatens Reliability loss of overview (150kloc fits in 1 mind, 2Mloc not) (more than?) exponential increase of coupling 1:1 relation HW:SW becomes n:m relation autonomous subsystems paradigm shift! integrated system 8 Gerrit Muller FAIevolutionConsequences

architecture example and trends from semiconductor equipment domain automotive architecture and trends health care automation example autonomous driving? 9 Gerrit Muller AACSlogoAutomotive

Conventional Vehicle Network Master Gateway ECU ECU ECU Free after: A reference architecture for cooperative driving. By Sagar Behere, Martin Törngren, De-Jiu Chen 10 Gerrit Muller AACSvehicleNetwork

Cooperative Driving Vehicle Network Master Gateway ECU ECU ECU Coop driving system From: A reference architecture for cooperative driving by Sagar Behere, Martin Törngren, De-Jiu Chen 11 Gerrit Muller AACSvehicleNetworkPlus

Conceptual view of the reference architecture Wireless reception To Supervisor Semantic Data analyser From: A reference architecture for cooperative driving. By Sagar Behere, Martin Törngren, De-Jiu Chen Model data supplier Super sensors Local sensors Vehicle gateway Other information sources Model data processors Data Fusion #1 World Model Generic data processor Map matching Model data consumers Wireless broadcast HMI Control Data flow Architecural element Generic data processor Plugin Local Actuators Vehicle Gateway 12 Gerrit Muller AACSreferenceArchitecture

architecture example and trends from semiconductor equipment domain automotive architecture and trends health care automation example autonomous driving? 13 Gerrit Muller AACSlogoAutomation

MRI: From Human Intent to Technical Realization clinical workflow protocol, request clinical imaging contrast, resolution, position,... 1990 exam card MRI physics method, TR, TE,... 1982 preset procedure machine desired waveforms corrected waveforms f.i. Eddy currents 1980 pulse programming digital samples analog currents human access and support 14 Gerrit Muller AACStransformationsMRI

Evolution in Operation of MRI operator knowledge and focus: from technical to application to workflow scope: from system to examination (including humans) to department or hospital positive: result orientation How robust is this set-up for more exceptional cases? focus on workflow efficiency focus on clinical imaging MRI physics knowledge machine knowledge 1980 1990 2000 2010 15 Gerrit Muller AACSevolutionMRIoperation

What are the Consequences of Automation Benefits Focus on patient and clinical aspects Less errors for routine cases, due to protocolized way of working Concerns How much do clinical users know and understand the imaging system? Will they understand and be able to cope with technical opportunities and constraints? Will they be able to operate the system for non-routine cases? Challenge of automating How can clinical users build up and maintain technical competence? 16 Gerrit Muller AACSautomationBCs

Symptom of Problematic Automation Alarm Fatigue Ignoring or switching off alarms that occur too often. Typical pattern When designers do not know how to handle an exception, then they make a configurable alarm, delegating the problem to the next person in the chain. Have you been in Critical Care Units or any control room? How many alarms are ignored? Deepwater Horizon, Gulf of Mexico The alarms in the crew cabins were switched off, since the alarm sounded too often 17 Gerrit Muller AACSalarmFatigue

architecture example and trends from semiconductor equipment domain automotive architecture and trends health care automation example autonomous driving? 18 Gerrit Muller AACSlogoAutonomous

Should Cars Ignore the Law? Date: Fri, 18 Dec 2015 07:18:52-0800 Subject: Driverless cars: too safe at any speed? Keith Naughton, 18 Dec 2015 Accident rates are twice as high for driverless cars as for regular cars, but the driverless cars have never been at fault. https://www.autonews.com/article/20151218/oem11/151219874/humans-are-slamming-intodriverless-cars-and-exposing-a-key-flaw DETROIT (Bloomberg) -- The self-driving car, that cutting-edge creation that's supposed to lead to a world without accidents, is achieving the exact opposite right now: The vehicles have racked up a crash rate double that of those with human drivers. The glitch? They obey the law all the time, as in, without exception. This may sound like the right way to program a robot to drive a car, but good luck trying to merge onto a chaotic, jam-packed highway with traffic flying along well above the speed limit. It tends not to work out well. As the accidents have piled up -- all minor scrape-ups for now -- the arguments among programmers at places like Google Inc. and Carnegie Mellon University are heating up: Should they teach the cars how to commit infractions from time to time to stay out of trouble? [...] 19 Gerrit Muller AACScompRisksQuote

A functional architecture for autonomous driving off-board guidance systems tele-operation/remote monitoring/fleet management on-board vehicle systems sensing external localization semantic understanding world model external S 1 sensor fusion decision and control cognitive driving intelligence S k trajectory energy platform fault man vehicle platform abstraction vehicle platform internal S 1 S n diagnostics & fault man. reactive control energy management trajectory execution platform stabilization propulsion/steering/braking passive safety internal from: A Functional Architecture for Autonomous Driving, by Sagar Behere, Martin Törngren 20 Gerrit Muller AACSautonomousArchitecture

Human and Automotive Minds System 2 slow, lazy, critical thinking situation awareness sometimes lured by System 1 System 1 fast, intuitive situation assessment and handling often right Thinking Fast and Slow by: Daniel Kahneman artificial intelligence? cognitive driving intelligence fast situation assessment and handling how often right or wrong? intelligent transport system (or wider context) sometimes wrong cerebellum autonomic nervous system peripheral nervous system vehicle platform very fast local 21 Gerrit Muller AACSmodelMinds

What is your Conclusion? When and why do we benefit from full autonomous driving? Will we have time and energy for new developments? Will we lose our own capabilities? 22 Gerrit Muller AACSconclusion