Combining ROS and AI for fail-operational automated driving
|
|
- Victoria Eaton
- 5 years ago
- Views:
Transcription
1 Combining ROS and AI for fail-operational automated driving Prof. Dr. Daniel Watzenig Virtual Vehicle Research Center, Graz, Austria and Institute of Automation and Control at Graz University of Technology VIRTUAL VEHICLE 1
2 COMET K2-Center AUTOMOTIVE RAIL AEROSPACE Gegründet: 2002 Mitarbeiter: 204 Umsatz: Standort: Website: 20,3 Mio. EUR Graz Shareholder: Dr. Jost Bernasch Geschäftsführer Prof. Hermann Steffan Wissenschaftlicher Leiter December 2017 Software Defined Vehicles VIRTUAL VEHICLE 2
3 Our automated driving research activities Embedded control and software functions Real-time sensor fusion Sensor self-diagnostics and fail-operational architectures Dependable computing and reliable in vehicle control (strong multi-core expertise in both SW and HW) Functional safety analyses (ISO PAS 21448) Virtual prototyping of automated driving functions Validation of real driving scenarios (real-time co-simulation) Traffic simulation (micro, macro) / infrastructure integration AI in both function development and vehicle operation December 2017 Software Defined Vehicles VIRTUAL VEHICLE 3
4 Outline Motivating example The challenge fail-operational ROS and AI integration Simulation, visualization, and communication AD demo car AI example for active safety design Summary December 2017 Software Defined Vehicles VIRTUAL VEHICLE 4
5 Motivating example Virtual Vehicle Research Center in Graz (about 200 employees) Expertise in simulation and experimental verification Focus on Automated Driving Dependable Systems Group Functional safety Verification and validation December 2017 Software Defined Vehicles VIRTUAL VEHICLE 5
6 Motivating example Motivating example Uber car Safety is top priority for user acceptance of automated driving December 2017 Software Defined Vehicles VIRTUAL VEHICLE 6
7 Motivating example Motivating example consequences Achieve user acceptance Avoid accidents and hazards (see example) Keep development and verification efforts reasonable Easy to use simulation environment during development Verify software on different test platforms MiL, SIL, HiL, and vehicle Simple goals, hard to achieve December 2017 Software Defined Vehicles VIRTUAL VEHICLE 7
8 Technical challenges Reference architecture Perceived objects and events Value judgement Plan evaluation Situation evaluation Plan results Sensory processing Update Predicted Input Environment model Plan State Behaviour generation Sensor inputs Actions Sensors Actuators ANSI Reference architecture of intelligent systems Information and data uncertainties! December 2017 Software Defined Vehicles VIRTUAL VEHICLE 8
9 Technical challenges Vehicle technologies Sensory processing Camera, RADAR, LiDAR, Value judgement and environment model High performance computing (HPC) Segmentation (using AI) Camera HPC ECU Accelaration/Brake Situation identification RADAR Behaviour estimation of other traffic participants LiDAR Steering Behaviour generation Electronic Control Units (ECU) Vehicle control algorithms December 2017 Software Defined Vehicles VIRTUAL VEHICLE 9
10 Limits of sensors As effective sensors are, they have some drawbacks Limited range Performance is susceptible to common environmental conditions (rain, fog, varying lighting conditions) False positives Range determination not as accurate as required The use of several sensor types can ensure a higher level of confidence in target detection and characterization Robust sensors and sensor self-diagnosis Redundancy in HW and SW ( fail-operational ) Sensor fusion (raw data? objects? hybrid?) December 2017 Software Defined Vehicles VIRTUAL VEHICLE 10
11 Vehicle detection: false positives Use of heat maps (buffer where each pixel of successfully detected window adds 1 ) Average the buffer from the last frames Use only pixels that survived a certain amount of frames Extract component bounding blocks vehicle(s) December 2017 Software Defined Vehicles VIRTUAL VEHICLE 11
12 Enhancement of view Austrian test region ALP.Lab December 2017 Software Defined Vehicles VIRTUAL VEHICLE 12
13 Enhancement of view December 2017 Software Defined Vehicles VIRTUAL VEHICLE 13
14 System architecture automated driving unpredictable conditions fuse all input to one model plan safe actions under current conditions Radar LIDAR Cameras Infrared Ultrasonic V2X Reliable sensor data processing and fusion Raw data analysis of all sensors Deliver consistent environmental model Scene understanding, driver monitoring, decision making, and planning Situation and behaviour prediction Planning of provably safe trajectories Handover/takeover planning Other Sensors System Performance and Driver Monitoring Out-of-position Warning Intervention Measure reliability and uncertainty Detection and decision on function availability System degradation Sensor self-diagnosis Ensuring failoperational behaviour steer functions and vehicle Fail-operational X-by-wire actuation(low level control) [Source: based on ECSEL Project RobustSense, 2015] December 2017 Software Defined Vehicles VIRTUAL VEHICLE 14
15 Towards fail-operational: e.g. power steering Fail-safe (what we have now) No emergency operation necessary Safe state: system off, driver immediately in control loop High-availability Safe state: system off, driver immediately in control loop Emergency operation is desirable but not required Minimize hazardous situation in case of potential misuse Fail-operational Emergency operation is required (10-15s) Eyes-off, brain-off Achieved by adding measures to all vital parts [Source: Steindl, Miedl, Safetronic, 2015] December 2017 Software Defined Vehicles VIRTUAL VEHICLE 15
16 Homogeneous vs. diversity concept Homogeneous redundancy uses a minimum of two equal instances in parallel the effort in development can be reduced due to the identical components because of the equality, this approach only protects against random faults caused by aging, deterioration or bit flips probability for a complete system crash is higher than in approaches with diverse components Redundancy by diversity (avionics) The calculating components are heterogeneous, e.g. from different manufacturers System SW of each unit is different or uses at least different HW components this system SW diversity complements functional diversity of the application SW Different implementations result in a lower probability of failure for the system due to the lower probability that the diverse components show the same misbehavior at the same time December 2017 Software Defined Vehicles VIRTUAL VEHICLE 16
17 Fail-operational architecture EC Project PRYSTINE (2018 to 2021, Programmable systems for intelligence in automobiles) Infineon, Scania, Ford, BMW, Virtual Vehicle, TU Graz December 2017 Software Defined Vehicles VIRTUAL VEHICLE 17
18 Fail-operational architecture Massive redundancy will not be the solution (2x and 3x, STANAG 4626) We need smart solutions! Mechanism for HW fault detection (e.g. BIST, built-in self tests) HW extensions for predictive diagnosis Reconfiguration strategies (isolation of faulty function and shift of functions ) Degradation strategies (critical vs. non-critical functions) December 2017 Software Defined Vehicles VIRTUAL VEHICLE 18
19 PRYSTINE December 2017 Software Defined Vehicles VIRTUAL VEHICLE 19
20 ROS Introduction December 2017 Software Defined Vehicles VIRTUAL VEHICLE 20
21 ROS Introduction Robot Operating System (ROS) Open-source, meta-operating system for robots Originally developed by Stanford AI Lab and Willow Garage in 2007 Maintained by the Open Source Robotics Foundation (OSRF) Runs on top of e.g. Ubuntu/Linux Designed for many kinds of robots Provides tools for building/running code Including software libraries Hardware abstraction Allows for low-level device control Provides communication system December 2017 Software Defined Vehicles VIRTUAL VEHICLE 21
22 ROS Introduction ROS Communication Peer-to-peer communication Central service registration Supports UDP and TCP Advantages Flexible configuration Fast communication Simple distribution of functions on computation platforms December 2017 Software Defined Vehicles VIRTUAL VEHICLE 22
23 ROS Introduction Integration of common solutions Sensor data processing Library for 2D/3D image and point cloud processing Filtering, feature detection, Tracking on camera data Motion planning Support of multiple planning algorithms 3D simulation and visualization Dynamics, kinematics, sensors, Data transformation Coordination system transformations for sensor data December 2017 Software Defined Vehicles VIRTUAL VEHICLE 23
24 ROS Introduction ROS Simulation 3D environment Sensor simulation Laser scanner built in Camera available Extension possible Sensor simulation Vehicle simulation Position Orientation Speed Steering December 2017 Software Defined Vehicles VIRTUAL VEHICLE 24
25 ROS Introduction Driving Simulation Detailed street layouts Number of lanes Street markings Traffic management Traffic signs and signals Different weather conditions Sunshine, snow, rain, Sensor simulation Multiple sensor types available Komplexe Straßenverläufe Änderungen im Straßenverlauf Ändernde Umweltbedingungen Unterschiedliche Straßenbeschaffenheit Extension possible December 2017 Software Defined Vehicles VIRTUAL VEHICLE 25
26 AI Integration Simulation Exchangeability of simulation and real environment Replacement of sensor data format Software deployment can be freely chosen ROS Simulation ROS messages ROS Function Implementation Driving Simulation Sensor data ROS Converter Decision making Sensor data processing available Segmentation (AI function) available Behaviour generation Real world data HPC #1 HPC #2 ECU December 2017 Software Defined Vehicles VIRTUAL VEHICLE 26
27 AI Integration AI function control flow Standard Software - Read image - Copy to GPU memory - Read result - Send message call return result AI inference - Matrix operations (multiply and add) - Mass non-linear function (ReLU, sigmoid, ) CPU GPU ROS specific part can be implemented as usual December 2017 Software Defined Vehicles VIRTUAL VEHICLE 27
28 Our automated drive test vehicle ROS Deployment Use ROS function implementation in vehicle No change of SW needed Integrated sensors Six radar sensors Four long range, two short range 6 Cameras Front, two side, back One Mobile Eye Virtual Vehicle Automated Drive test vehicle Full vehicle control Steering, acceleration, brake, Virtual Vehicle AD test vehicle trunk December 2017 Software Defined Vehicles VIRTUAL VEHICLE 28
29 Active safety design using ML techniques December 2017 Software Defined Vehicles VIRTUAL VEHICLE 29
30 Motivation: Development process active safety systems Problem: Complexity and high variation of accidents Safety functions for every combination of accident type and cause Type: Cause: speeding, slippery road, etc First 50%: 26 types and causes of accidents Last 50%: 5287 types and causes of accidents Function design based an quantitative (e.g. DESTATIS) and qualitative accident databases (e.g. GIDAS Pre-Crash-Matrix) An exponential effort in the development of individual active safety systems is required to cover only significant increase in the addressing of accidents! December 2017 Software Defined Vehicles VIRTUAL VEHICLE 30
31 Function development based on real world data Method analysis: From the accident to the active safety system Accident recording by highly automated vehicles (SAE Level 3) [BMW] [Here] [Kostal] Backend 360 environment recognition High-precision digital maps incl. localization Driver monitoring Backend communication Data recording: Course of the ego vehicle and other traffic participants road geometry, driver behavior 1) Evaluation of active safety systems with recorded traffic data 2) Learning the function behavior of active safety systems directly from recorded data [Source: BMW and Virtual Vehicle, cooperative R&D project, 2017] December 2017 Software Defined Vehicles VIRTUAL VEHICLE 31
32 Vision: Optimization based on real world traffic data 360 sensors High-precision maps Driver monitoring Backend Project use case: Crossing pedestrian (75% of all pedestrian accidents) Generated pedestrian scenarios from the effectiveness analysis Crossing scenarios Total scenarios Accidents Training data Test data December 2017 Software Defined Vehicles VIRTUAL VEHICLE 32
33 Function development active safety system December 2017 Software Defined Vehicles VIRTUAL VEHICLE 33
34 Simulation results: False positives vs. speed reduction Variation by the algorithm evaluation: 1)Feature set(featurevariation) 2) Training data(reduced speed range pedestrian) Random Forest Neural Network Speed reduction Reference Implementation 73.7% Random Forest 83.4% Neural Network 92.0% Speed reduction [%] Reference algorithm 20 RF RF (Extended Features) 10 RF (Reduced Training Data) RF (Extended Features / Reduced Training Data) False positives Speed reduction [%] Reference algorithm 20 NN NN (Extended Features) 10 NN (Reduced Training Data) NN (Extended Features / Reduced Training Data) False positives December 2017 Software Defined Vehicles VIRTUAL VEHICLE 34
35 AI-based systems challenges to be faced Requirements engineering (Machine Learning algorithms) Identification of Key Performance Indicators for ML algorithms e.g. accuracy(fault tolerances but also mis-detection), speed, etc. HW requirements for different DNN structures Identification of relevant safety analyses according to ISO and ISO PAS Determination of safety measures, time tolerances for detection etc. How to measure code and structure coverage of DNNs? Selection of training and test data Work out criteria based on statistical methods, quality, and versatility SW unit tests and integration test Verification and validation of SW safety requirements December 2017 Software Defined Vehicles VIRTUAL VEHICLE 35
36 Summary Automated driving requires redundancy (SW and HW) Fail-operational architectures ISO PAS Minimum redundancy but maximum reliability Homogeneous redundancy vs. redundancy by diversity trade-off AI functions have already proven their usefulness Object detection and localization (segmentation) End-to-End driving vs. modular approach AI in function development ROS is already widely used Sound basis for rapid prototyping Seamless transition from simulation to real hardware ROS is a suitable development and test environment for AI functions December 2017 Software Defined Vehicles VIRTUAL VEHICLE 36
37 Thank you for your attention. Prof. Dr. Daniel Watzenig December 2017 Software Defined Vehicles VIRTUAL VEHICLE 37
23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017
23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 Product Vision Company Introduction Apostera GmbH with headquarter in Munich, was
More informationPhysics Based Sensor simulation
Physics Based Sensor simulation Jordan Gorrochotegui - Product Manager Software and Services Mike Phillips Software Engineer Restricted Siemens AG 2017 Realize innovation. Siemens offers solutions across
More informationinteractive IP: Perception platform and modules
interactive IP: Perception platform and modules Angelos Amditis, ICCS 19 th ITS-WC-SIS76: Advanced integrated safety applications based on enhanced perception, active interventions and new advanced sensors
More informationDavid Howarth. Business Development Manager Americas
David Howarth Business Development Manager Americas David Howarth IPG Automotive USA, Inc. Business Development Manager Americas david.howarth@ipg-automotive.com ni.com Testing Automated Driving Functions
More informationPEGASUS Effectively ensuring automated driving. Prof. Dr.-Ing. Karsten Lemmer April 6, 2017
PEGASUS Effectively ensuring automated driving. Prof. Dr.-Ing. Karsten Lemmer April 6, 2017 Starting Position for Automated Driving Top issue! Technology works Confidence Testing differently automated
More informationVSI Labs The Build Up of Automated Driving
VSI Labs The Build Up of Automated Driving October - 2017 Agenda Opening Remarks Introduction and Background Customers Solutions VSI Labs Some Industry Content Opening Remarks Automated vehicle systems
More informationSIS63-Building the Future-Advanced Integrated Safety Applications: interactive Perception platform and fusion modules results
SIS63-Building the Future-Advanced Integrated Safety Applications: interactive Perception platform and fusion modules results Angelos Amditis (ICCS) and Lali Ghosh (DEL) 18 th October 2013 20 th ITS World
More informationARGUING THE SAFETY OF MACHINE LEARNING FOR HIGHLY AUTOMATED DRIVING USING ASSURANCE CASES LYDIA GAUERHOF BOSCH CORPORATE RESEARCH
ARGUING THE SAFETY OF MACHINE LEARNING FOR HIGHLY AUTOMATED DRIVING USING ASSURANCE CASES 14.12.2017 LYDIA GAUERHOF BOSCH CORPORATE RESEARCH Arguing Safety of Machine Learning for Highly Automated Driving
More informationIntelligent driving TH« TNO I Innovation for live
Intelligent driving TNO I Innovation for live TH«Intelligent Transport Systems have become an integral part of the world. In addition to the current ITS systems, intelligent vehicles can make a significant
More informationVirtual Homologation of Software- Intensive Safety Systems: From ESC to Automated Driving
Virtual Homologation of Software- Intensive Safety Systems: From ESC to Automated Driving Dr. Houssem Abdellatif Global Head Autonomous Driving & ADAS TÜV SÜD Auto Service Christian Gnandt Lead Engineer
More informationVirtual testing by coupling high fidelity vehicle simulation with microscopic traffic flow simulation
DYNA4 with DYNAanimation in Co-Simulation with SUMO vehicle under test Virtual testing by coupling high fidelity vehicle simulation with microscopic traffic flow simulation Dr.-Ing. Jakob Kaths TESIS GmbH
More informationThe Building Blocks of Autonomous Control. Phil Magney, Founder & Principal Advisor July 2016
The Building Blocks of Autonomous Control Phil Magney, Founder & Principal Advisor July 2016 Agenda VSI Remarks The Building Blocks of Autonomy Elements of Autonomous Control Motion Control (path, maneuver,
More informationPerception platform and fusion modules results. Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event
Perception platform and fusion modules results Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event 20 th -21 st November 2013 Agenda Introduction Environment Perception in Intelligent Transport
More informationA Winning Combination
A Winning Combination Risk factors Statements in this presentation that refer to future plans and expectations are forward-looking statements that involve a number of risks and uncertainties. Words such
More informationEvaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed
AUTOMOTIVE Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed Yoshiaki HAYASHI*, Izumi MEMEZAWA, Takuji KANTOU, Shingo OHASHI, and Koichi TAKAYAMA ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
More informationEmbracing Complexity. Gavin Walker Development Manager
Embracing Complexity Gavin Walker Development Manager 1 MATLAB and Simulink Proven Ability to Make the Complex Simpler 1970 Stanford Ph.D. thesis, with thousands of lines of Fortran code 2 MATLAB and Simulink
More informationFusion in EU projects and the Perception Approach. Dr. Angelos Amditis interactive Summer School 4-6 July, 2012
Fusion in EU projects and the Perception Approach Dr. Angelos Amditis interactive Summer School 4-6 July, 2012 Content Introduction Data fusion in european research projects EUCLIDE PReVENT-PF2 SAFESPOT
More informationModel-Based Design for Sensor Systems
2009 The MathWorks, Inc. Model-Based Design for Sensor Systems Stephanie Kwan Applications Engineer Agenda Sensor Systems Overview System Level Design Challenges Components of Sensor Systems Sensor Characterization
More informationFinal Report Non Hit Car And Truck
Final Report Non Hit Car And Truck 2010-2013 Project within Vehicle and Traffic Safety Author: Anders Almevad Date 2014-03-17 Content 1. Executive summary... 3 2. Background... 3. Objective... 4. Project
More informationUsing FMI/ SSP for Development of Autonomous Driving
Using FMI/ SSP for Development of Autonomous Driving presented by Jochen Köhler (ZF) FMI User Meeting 15.05.2017 Prague / Czech Republic H.M. Heinkel S.Rude P. R. Mai J. Köhler M. Rühl / A. Pillekeit Motivation
More informationAutomated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance Systems Lionel Briand Vector Testing Symposium, Stuttgart, 2018 SnT Centre Top level research in Information & Communication Technologies Created to fuel
More informationADAS Development using Advanced Real-Time All-in-the-Loop Simulators. Roberto De Vecchi VI-grade Enrico Busto - AddFor
ADAS Development using Advanced Real-Time All-in-the-Loop Simulators Roberto De Vecchi VI-grade Enrico Busto - AddFor The Scenario The introduction of ADAS and AV has created completely new challenges
More informationTransformation to Artificial Intelligence with MATLAB Roy Lurie, PhD Vice President of Engineering MATLAB Products
Transformation to Artificial Intelligence with MATLAB Roy Lurie, PhD Vice President of Engineering MATLAB Products 2018 The MathWorks, Inc. 1 A brief history of the automobile First Commercial Gas Car
More informationSignificant Reduction of Validation Efforts for Dynamic Light Functions with FMI for Multi-Domain Integration and Test Platforms
Significant Reduction of Validation Efforts for Dynamic Light Functions with FMI for Multi-Domain Integration and Test Platforms Dr. Stefan-Alexander Schneider Johannes Frimberger BMW AG, 80788 Munich,
More informationIndustrial Keynotes. 06/09/2018 Juan-Les-Pins
Industrial Keynotes 1 06/09/2018 Juan-Les-Pins Agenda 1. The End of Driving Simulation? 2. Autonomous Vehicles: the new UI 3. Augmented Realities 4. Choose your factions 5. No genuine AI without flawless
More informationAutonomous Automation: How do we get to a Million Miles of testing?
Autonomous Automation: How do we get to a Million Miles of testing? Jace Allen Business Development Manager Simulation, Test, and EEDM dspace Inc. 50131 Pontiac Trail Wixom, MI 48393 USA 1 Agenda 1. Intro
More informationA Roadmap for Connected & Autonomous Vehicles. David Skipp Ford Motor Company
A Roadmap for Connected & Autonomous Vehicles David Skipp Ford Motor Company ! Why does an Autonomous Vehicle need a roadmap? Where might the roadmap take us? What should we focus on next? Why does an
More informationSAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL,
SAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL, 17.02.2017 The need for safety cases Interaction and Security is becoming more than what happens when things break functional
More informationADAS/AD Challenge. Copyright 2017, dspace GmbH
ADAS/AD Challenge 2 dspace Automotive Simulation Models (ASM) for ADAS and AD Michael Peperhowe, Group Manager ASM VD & Traffic dspace GmbH Rathenaustr. 26 33102 Paderborn Germany 3 ASM Overview 4 ASM
More informationFAIL OPERATIONAL E/E SYSTEM CONCEPT FOR FUTURE APPLICATION IN ADAS AND AUTONOMOUS DRIVING
FAIL OPERATIONAL E/E SYSTEM CONCEPT FOR FUTURE APPLICATION IN ADAS AND AUTONOMOUS DRIVING Fail Safe Fail Operational Fault Tolerance ISO 26262 Hermann Kränzle, TÜV NORD Systems OUR FUNCTIONAL SAFETY CERTIFIED
More informationChoosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles
Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles Ali Osman Ors May 2, 2017 Copyright 2017 NXP Semiconductors 1 Sensing Technology Comparison Rating: H = High, M=Medium,
More informationIsrael Railways No Fault Liability Renewal The Implementation of New Technological Safety Devices at Level Crossings. Amos Gellert, Nataly Kats
Mr. Amos Gellert Technological aspects of level crossing facilities Israel Railways No Fault Liability Renewal The Implementation of New Technological Safety Devices at Level Crossings Deputy General Manager
More informationVirtual Testing of Autonomous Vehicles
Virtual Testing of Autonomous Vehicles Mike Dempsey Claytex Services Limited Software, Consultancy, Training Based in Leamington Spa, UK Office in Cape Town, South Africa Experts in Systems Engineering,
More informationDr George Gillespie. CEO HORIBA MIRA Ltd. Sponsors
Dr George Gillespie CEO HORIBA MIRA Ltd Sponsors Intelligent Connected Vehicle Roadmap George Gillespie September 2017 www.automotivecouncil.co.uk ICV Roadmap built on Travellers Needs study plus extensive
More informationNext-generation automotive image processing with ARM Mali-C71
Next-generation automotive image processing with ARM Mali-C71 Chris Turner Director, Advanced Technology Marketing CPU Group, ARM ARM Tech Forum Korea June 28 th 2017 Pioneers in imaging and vision signal
More informationGNSS in Autonomous Vehicles MM Vision
GNSS in Autonomous Vehicles MM Vision MM Technology Innovation Automated Driving Technologies (ADT) Evaldo Bruci Context & motivation Within the robotic paradigm Magneti Marelli chose Think & Decision
More informationAutomotive Needs and Expectations towards Next Generation Driving Simulation
Automotive Needs and Expectations towards Next Generation Driving Simulation Dr. Hans-Peter Schöner - Insight fromoutside -Consulting - Senior Automotive Expert, Driving Simulation Association September
More informationAI Application Processing Requirements
AI Application Processing Requirements 1 Low Medium High Sensor analysis Activity Recognition (motion sensors) Stress Analysis or Attention Analysis Audio & sound Speech Recognition Object detection Computer
More informationInfineon at a glance
Infineon at a glance 2017 www.infineon.com We make life easier, safer and greener with technology that achieves more, consumes less and is accessible to everyone. Microelectronics from Infineon is the
More informationAutonomous Vehicle Simulation (MDAS.ai)
Autonomous Vehicle Simulation (MDAS.ai) Sridhar Lakshmanan Department of Electrical & Computer Engineering University of Michigan - Dearborn Presentation for Physical Systems Replication Panel NDIA Cyber-Enabled
More informationWilliam Milam Ford Motor Co
Sharing technology for a stronger America Verification Challenges in Automotive Embedded Systems William Milam Ford Motor Co Chair USCAR CPS Task Force 10/20/2011 What is USCAR? The United States Council
More informationA SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS
Tools and methodologies for ITS design and drivers awareness A SERVICE-ORIENTED SYSTEM ARCHITECTURE FOR THE HUMAN CENTERED DESIGN OF INTELLIGENT TRANSPORTATION SYSTEMS Jan Gačnik, Oliver Häger, Marco Hannibal
More informationAgent. Pengju Ren. Institute of Artificial Intelligence and Robotics
Agent Pengju Ren Institute of Artificial Intelligence and Robotics pengjuren@xjtu.edu.cn 1 Review: What is AI? Artificial intelligence (AI) is intelligence exhibited by machines. In computer science, the
More informationSilicon radars and smart algorithms - disruptive innovation in perceptive IoT systems Andy Dewilde PUBLIC
Silicon radars and smart algorithms - disruptive innovation in perceptive IoT systems Andy Dewilde PUBLIC Fietser in levensgevaar na ongeval met vrachtwagen op Louizaplein Het Laatste Nieuws 16/06/2017
More informationDeliverable D1.6 Initial System Specifications Executive Summary
Deliverable D1.6 Initial System Specifications Executive Summary Version 1.0 Dissemination Project Coordination RE Ford Research and Advanced Engineering Europe Due Date 31.10.2010 Version Date 09.02.2011
More informationGetting to Smart Paul Barnard Design Automation
Getting to Smart Paul Barnard Design Automation paul.barnard@mathworks.com 2012 The MathWorks, Inc. Getting to Smart WHO WHAT HOW autonomous, responsive, multifunction, adaptive, transformable, and smart
More informationADAS COMPUTER VISION AND AUGMENTED REALITY SOLUTION
ENGINEERING ENERGY TELECOM TRAVEL AND AVIATION SOFTWARE FINANCIAL SERVICES ADAS COMPUTER VISION AND AUGMENTED REALITY SOLUTION Sergii Bykov, Technical Lead TECHNOLOGY AUTOMOTIVE Product Vision Road To
More informationMOBILITY RESEARCH NEEDS FROM THE GOVERNMENT PERSPECTIVE
MOBILITY RESEARCH NEEDS FROM THE GOVERNMENT PERSPECTIVE First Annual 2018 National Mobility Summit of US DOT University Transportation Centers (UTC) April 12, 2018 Washington, DC Research Areas Cooperative
More informationCAPACITIES FOR TECHNOLOGY TRANSFER
CAPACITIES FOR TECHNOLOGY TRANSFER The Institut de Robòtica i Informàtica Industrial (IRI) is a Joint University Research Institute of the Spanish Council for Scientific Research (CSIC) and the Technical
More informationFollowing Dirt Roads at Night-Time
Following Dirt Roads at Night-Time Sensors and Features for Lane Recognition and Tracking Sebastian F. X. Bayerl Thorsten Luettel Hans-Joachim Wuensche Autonomous Systems Technology (TAS) Department of
More informationICT4 Manuf. Competence Center
ICT4 Manuf. Competence Center Prof. Yacine Ouzrout University Lumiere Lyon 2 ICT 4 Manufacturing Competence Center AI and CPS for Manufacturing Robot software testing Development of software technologies
More informationHAVEit Highly Automated Vehicles for Intelligent Transport
HAVEit Highly Automated Vehicles for Intelligent Transport Holger Zeng Project Manager CONTINENTAL AUTOMOTIVE HAVEit General Information Project full title: Highly Automated Vehicles for Intelligent Transport
More informationTarget Recognition and Tracking based on Data Fusion of Radar and Infrared Image Sensors
Target Recognition and Tracking based on Data Fusion of Radar and Infrared Image Sensors Jie YANG Zheng-Gang LU Ying-Kai GUO Institute of Image rocessing & Recognition, Shanghai Jiao-Tong University, China
More informationVehicle-to-X communication using millimeter waves
Infrastructure Person Vehicle 5G Slides Robert W. Heath Jr. (2016) Vehicle-to-X communication using millimeter waves Professor Robert W. Heath Jr., PhD, PE mmwave Wireless Networking and Communications
More informationAnalysis and Investigation Method for All Traffic Scenarios (AIMATS)
Analysis and Investigation Method for All Traffic Scenarios (AIMATS) Dr. Christian Erbsmehl*, Dr. Nils Lubbe**, Niels Ferson**, Hitoshi Yuasa**, Dr. Tom Landgraf*, Martin Urban* *Fraunhofer Institute for
More informationAuthor s Name Name of the Paper Session. DYNAMIC POSITIONING CONFERENCE October 10-11, 2017 SENSORS SESSION. Sensing Autonomy.
Author s Name Name of the Paper Session DYNAMIC POSITIONING CONFERENCE October 10-11, 2017 SENSORS SESSION Sensing Autonomy By Arne Rinnan Kongsberg Seatex AS Abstract A certain level of autonomy is already
More informationInvited talk IET-Renault Workshop Autonomous Vehicles: From theory to full scale applications Novotel Paris Les Halles, June 18 th 2015
Risk assessment & Decision-making for safe Vehicle Navigation under Uncertainty Christian LAUGIER, First class Research Director at Inria http://emotion.inrialpes.fr/laugier Contributions from Mathias
More informationAutomated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF
Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Konstantin Dmitriev The MathWorks, Inc. Certification and Standards Group 2018 The MathWorks, Inc. 1 Agenda Use of simulation
More informationHuman-Centric Trusted AI for Data-Driven Economy
Human-Centric Trusted AI for Data-Driven Economy Masugi Inoue 1 and Hideyuki Tokuda 2 National Institute of Information and Communications Technology inoue@nict.go.jp 1, Director, International Research
More informationLEARNING FROM THE AVIATION INDUSTRY
DEVELOPMENT Power Electronics 26 AUTHORS Dipl.-Ing. (FH) Martin Heininger is Owner of Heicon, a Consultant Company in Schwendi near Ulm (Germany). Dipl.-Ing. (FH) Horst Hammerer is Managing Director of
More informationHorizon 2020 ICT Robotics Work Programme (draft - Publication: 20 October 2015)
NCP TRAINING BRUSSELS 07 OCTOBER 2015 1 Horizon 2020 ICT Robotics Work Programme 2016 2017 (draft - Publication: 20 October 2015) Cécile Huet Deputy Head of Unit Robotics Directorate General for Communication
More informationPractical Experiences on a Road Guidance Protocol for Intersection Collision Warning Application
Practical Experiences on a Road Guidance Protocol for Intersection Collision Warning Application Hyun Jeong Yun*, Jeong Dan Choi* *Cooperative Vehicle-Infra Research Section, ETRI, 138 Gajeong-ro Yuseong-gu,
More informationInstitute of Computer Technology
1 Faculty of Informatics Faculty of Mechanical and Industrial Engineering Faculty of Electrical Engineering and Information Technology 8 Institute of Fundamentals and Theory of Electrical Engineering Institute
More informationDevid Will, Adrian Zlocki
Devid Will, Adrian Zlocki fka Forschungsgesellschaft Kraftfahrwesen mbh TS91 Sensors for Automated Vehicles State of the Art Analysis for Connected and Automated Driving within the SCOUT Project Overview
More informationMotionDesk. 3-D online animation of simulated mechanical systems in real time. Highlights
MotionDesk 3-D online animation of simulated mechanical systems in real time Highlights Tight integration to ModelDesk and ASM Enhanced support for all aspects of advanced driver assistance systems (ADAS)
More informationA.I in Automotive? Why and When.
A.I in Automotive? Why and When. AGENDA 01 02 03 04 Definitions A.I? A.I in automotive Now? Next big A.I breakthrough in Automotive 01 DEFINITIONS DEFINITIONS Artificial Intelligence Artificial Intelligence:
More informationFLASH LiDAR KEY BENEFITS
In 2013, 1.2 million people died in vehicle accidents. That is one death every 25 seconds. Some of these lives could have been saved with vehicles that have a better understanding of the world around them
More informationComponent Based Design for Embedded Systems
Component Based Design for Embedded Systems Report on the US-EU Workshop July 7-8 th, 2005 in Paris http://www.artist-embedded.org/fp6/artist2events/pastevents/ist-nsf/ ssdf Table of Contents 1. Executive
More informationNext-generation automotive image processing with ARM Mali-C71
Next-generation automotive image processing with ARM Mali-C71 Steve Steele Director, Product Marketing Imaging & Vision Group, ARM ARM Tech Forum Taipei July 4th 2017 Pioneers in imaging and vision 2 Automotive
More informationSoftware Computer Vision - Driver Assistance
Software Computer Vision - Driver Assistance Work @Bosch for developing desktop, web or embedded software and algorithms / computer vision / artificial intelligence for Driver Assistance Systems and Automated
More informationMATLAB 및 Simulink 를이용한운전자지원시스템개발
MATLAB 및 Simulink 를이용한운전자지원시스템개발 김종헌차장 Senior Application Engineer MathWorks Korea 2015 The MathWorks, Inc. 1 Example : Sensor Fusion with Monocular Vision & Radar Configuration Monocular Vision installed
More informationThe GATEway Project London s Autonomous Push
The GATEway Project London s Autonomous Push 06/2016 Why TRL? Unrivalled industry position with a focus on mobility 80 years independent transport research Public and private sector with global reach 350+
More informationTechnology trends in the digitalization era. ANSYS Innovation Conference Bologna, Italy June 13, 2018 Michele Frascaroli Technical Director, CRIT Srl
Technology trends in the digitalization era ANSYS Innovation Conference Bologna, Italy June 13, 2018 Michele Frascaroli Technical Director, CRIT Srl Summary About CRIT Top Trends for Emerging Technologies
More informationAutomation and Control Electrical Engineering
Automation and Control Electrical Engineering Technical University of Denmark DTU-Building 326 DK-2800 Kgs. Lyngby Denmark aut.elektro.dtu.dk Ole Ravn Total students ~9.300 including Ph.D. 1.150 and Int.
More information* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged
ADVANCED ROBOTICS SOLUTIONS * Intelli Mobile Robot for Multi Specialty Operations * Advanced Robotic Pick and Place Arm and Hand System * Automatic Color Sensing Robot using PC * AI Based Image Capturing
More informationDevelopment of a 24 GHz Band Peripheral Monitoring Radar
Special Issue OneF Automotive Technology Development of a 24 GHz Band Peripheral Monitoring Radar Yasushi Aoyagi * In recent years, the safety technology of automobiles has evolved into the collision avoidance
More informationEmbedding Artificial Intelligence into Our Lives
Embedding Artificial Intelligence into Our Lives Michael Thompson, Synopsys D&R IP-SOC DAYS Santa Clara April 2018 1 Agenda Introduction What AI is and is Not Where AI is being used Rapid Advance of AI
More informationVideo Injection Methods in a Real-world Vehicle for Increasing Test Efficiency
DEVELOPMENT SIMUL ATION AND TESTING Video Injection Methods in a Real-world Vehicle for Increasing Test Efficiency IPG Automotive AUTHORS For the testing of camera-based driver assistance systems under
More informationMULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT
MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003
More informationCS 599: Distributed Intelligence in Robotics
CS 599: Distributed Intelligence in Robotics Winter 2016 www.cpp.edu/~ftang/courses/cs599-di/ Dr. Daisy Tang All lecture notes are adapted from Dr. Lynne Parker s lecture notes on Distributed Intelligence
More informationHiFi Radar Target. Kristian Karlsson (RISE)
HiFi Radar Target Kristian Karlsson (RISE) Outline HiFi Radar Target: Overview Background & goals Radar introduction RCS measurements: Setups Uncertainty contributions (ground reflection) Back scattering
More informationSimulationbased Development of ADAS and Automated Driving with the Help of Machine Learning
Simulationbased Development of ADAS and Automated Driving with the Help of Machine Learning Dr. Andreas Kuhn A N D A T A München, 2017-06-27 2 Fields of Competence Artificial Intelligence Data Mining Big
More informationIntelligent Technology for More Advanced Autonomous Driving
FEATURED ARTICLES Autonomous Driving Technology for Connected Cars Intelligent Technology for More Advanced Autonomous Driving Autonomous driving is recognized as an important technology for dealing with
More informationCS686: High-level Motion/Path Planning Applications
CS686: High-level Motion/Path Planning Applications Sung-Eui Yoon ( 윤성의 ) Course URL: http://sglab.kaist.ac.kr/~sungeui/mpa Class Objectives Discuss my general research view on motion planning Discuss
More informationMACHINE LEARNING Games and Beyond. Calvin Lin, NVIDIA
MACHINE LEARNING Games and Beyond Calvin Lin, NVIDIA THE MACHINE LEARNING ERA IS HERE And it is transforming every industry... including Game Development OVERVIEW NVIDIA Volta: An Architecture for Machine
More informationRobust Positioning for Urban Traffic
Robust Positioning for Urban Traffic Motivations and Activity plan for the WG 4.1.4 Dr. Laura Ruotsalainen Research Manager, Department of Navigation and positioning Finnish Geospatial Research Institute
More informationProposers Day Workshop
Proposers Day Workshop Monday, January 23, 2017 @srcjump, #JUMPpdw Cognitive Computing Vertical Research Center Mandy Pant Academic Research Director Intel Corporation Center Motivation Today s deep learning
More informationIndustrial Applications and Challenges for Verifying Reactive Embedded Software. Tom Bienmüller, SC 2 Summer School, MPI Saarbrücken, August 2017
Industrial Applications and Challenges for Verifying Reactive Embedded Software Tom Bienmüller, SC 2 Summer School, MPI Saarbrücken, August 2017 Agenda 2 Who am I? Who is BTC Embedded Systems? Formal Methods
More informationStanford Center for AI Safety
Stanford Center for AI Safety Clark Barrett, David L. Dill, Mykel J. Kochenderfer, Dorsa Sadigh 1 Introduction Software-based systems play important roles in many areas of modern life, including manufacturing,
More informationNCCT IEEE PROJECTS ADVANCED ROBOTICS SOLUTIONS. Latest Projects, in various Domains. Promise for the Best Projects
NCCT Promise for the Best Projects IEEE PROJECTS in various Domains Latest Projects, 2009-2010 ADVANCED ROBOTICS SOLUTIONS EMBEDDED SYSTEM PROJECTS Microcontrollers VLSI DSP Matlab Robotics ADVANCED ROBOTICS
More informationNeural Models for Multi-Sensor Integration in Robotics
Department of Informatics Intelligent Robotics WS 2016/17 Neural Models for Multi-Sensor Integration in Robotics Josip Josifovski 4josifov@informatik.uni-hamburg.de Outline Multi-sensor Integration: Neurally
More informationHonda R&D Americas, Inc.
Honda R&D Americas, Inc. Topics Honda s view on ITS and V2X Activity Honda-lead V2I Message Set Development Status Challenges Topics Honda s view on ITS and V2X Activity Honda-lead V2I Message Set Standard
More informationSilicon Austria Labs SAL. The Austrian Research Center for Electronic Based Systems
Silicon Austria Labs SAL The Austrian Research Center for Electronic Based Systems What is Silicon Austria Labs Silicon Austria Labs is Austria s Research Center for Electronic Based Systems (EBS) Applied
More informationTECHNOLOGY DEVELOPMENT AREAS IN AAWA
TECHNOLOGY DEVELOPMENT AREAS IN AAWA Technologies for realizing remote and autonomous ships exist. The task is to find the optimum way to combine them reliably and cost effecticely. Ship state definition
More informationQosmotec. Software Solutions GmbH. Technical Overview. QPER C2X - Car-to-X Signal Strength Emulator and HiL Test Bench. Page 1
Qosmotec Software Solutions GmbH Technical Overview QPER C2X - Page 1 TABLE OF CONTENTS 0 DOCUMENT CONTROL...3 0.1 Imprint...3 0.2 Document Description...3 1 SYSTEM DESCRIPTION...4 1.1 General Concept...4
More informationNight-time pedestrian detection via Neuromorphic approach
Night-time pedestrian detection via Neuromorphic approach WOO JOON HAN, IL SONG HAN Graduate School for Green Transportation Korea Advanced Institute of Science and Technology 335 Gwahak-ro, Yuseong-gu,
More informationUnlock the power of location. Gjermund Jakobsen ITS Konferansen 2017
Unlock the power of location Gjermund Jakobsen ITS Konferansen 2017 50B 200 Countries mapped HERE in numbers Our world in numbers 7,000+ Employees in 56 countries focused on delivering the world s best
More informationPositioning Challenges in Cooperative Vehicular Safety Systems
Positioning Challenges in Cooperative Vehicular Safety Systems Dr. Luca Delgrossi Mercedes-Benz Research & Development North America, Inc. October 15, 2009 Positioning for Automotive Navigation Personal
More informationMobile Crowdsensing enabled IoT frameworks: harnessing the power and wisdom of the crowd
Mobile Crowdsensing enabled IoT frameworks: harnessing the power and wisdom of the crowd Malamati Louta Konstantina Banti University of Western Macedonia OUTLINE Internet of Things Mobile Crowd Sensing
More informationInteraction in Urban Traffic Insights into an Observation of Pedestrian-Vehicle Encounters
Interaction in Urban Traffic Insights into an Observation of Pedestrian-Vehicle Encounters André Dietrich, Chair of Ergonomics, TUM andre.dietrich@tum.de CARTRE and SCOUT are funded by Monday, May the
More information