23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017
|
|
- Jessica Stanley
- 6 years ago
- Views:
Transcription
1 23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS Sergii Bykov Technical Lead Machine Learning 12 Oct 2017
2 Product Vision
3 Company Introduction Apostera GmbH with headquarter in Munich, was established in March, 2017 together with 3 affiliated R&D centers to leverage 10+ years engineering experience in complex software development for Automotive Industry. Apostera GmbH engineering and business experience in Driver Experience, Navigation and Telecommunication domains together with unique IP and mathematical talent guarantees creation of advanced product portfolio to bring mobility world to new era of autonomy. Apostera GmbH today s target is to reshape areas of Automotive Perception, Visualization, Path Planning, V2X and finally Autonomous Driving in open and collaborative manner. Perception: Advanced Surround View Monitoring, Software Smart Camera and Sensor Fusion Visualization: Software Augmented Guidance (HUD and LCD) Quality: A (AR, ADAS, AD) Testing Automated System Mobility: Software Managed Autonomous Driving
4 APOSTERA product lines - Basics IA Informational ADAS ADAS Platform AAC Active ADAS components HAD Highly Automated Driving
5 Representation For The Driver LCD screen HUD in car Outdated Smart Glasses Past Real-depth HUD with wide FOV in car Alternative, fast developing market (today) On going development +2 years
6 Key Challenges For In-Vehicle AR Usability augmented reality subsystem should not disturb driver as it is continuously observed Hardware limitations computational, power consumption, zero latency (HUD) Requirements for precise environmental model estimation for occlusion avoiding Dependency on inaccurate map and navigation data Distributed HW architectures, platform flexibility requirements High precision absolute and relative positioning requirements Components synchronization and latency avoidance Embedded memory usage limitations, different memory models Algorithms should be both configurable and efficient Specific rendering requirements, not covered by general purpose frameworks Variety of inputs under different platforms Out-of-vehicle simulation (does not support natural simulation like classical navigation)
7 System Concept
8 Unique Automotive Augmented Reality Solution Solution capable to create Augmented, mixed visual Reality for drivers and passengers based on Computer Vision, vehicle sensor, map data, V2X, navigation guidance using Data Fusion. Sensors/CAN Telematics/V2X ADAS Platform Step I ADAS Platform In progress ADAS Platform Further Steps Automotive Cameras Vehicle displays Projection on wind shield - HUD Integration of V2X information Motorbikes helmets Path Planning and AR 360 Navigation System/Map Data
9 Scientific and Engineering Expertise Recognition and Tracking Road boundaries and lane detection Slopes estimation Vehicle recognition and tracking Distance & time to collision estimation Pedestrian detection and tracking Facade recognition and texture extraction Road signs recognition Positioning Precise relative and absolute positioning Flexible data fusion and smooth Map Matching Automotive constrained SLAM Video-based digital gyroscope Computer Vision Approaches Real-time feature extraction from video sensors Road scene semantic segmentation Adaptability and confidence estimation of output data GPU optimization for different platforms Machine Learning Specifics CNN and DNN approaches Supervised MRF parameters adjustment CSP-based structure & parameters adjustment (both supervised and unsupervised) Weak classifiers boosting & others Sensor Fusion Flexible fusion of data from internal and external sources LIDAR data merging 3D-environment model reconstruction based on different sensors Latency compensation & data extrapolation Augmented Reality LCD, HUD & further output devices Natural navigation hints & infographics Collison, Lane departure, Blind spots warnings, etc. POIs and supportive information (facades and parking slots highlighting, etc.) Predictable Environmental Model, Safety Apps - V2X BSM transmitting/receiving Remote Vehicles trajectory prediction Basic safety applications based on collision detection Integration with HD Maps HD Maps utilization for Precise positioning, Map matching and Path planning, Junction assistance Data generation for HD Maps Contribution to ADAS attributes structure NDS (HERE)
10 System Overview Quick-install demonstration solution Platform for AR (allows to be portable) Integration with Head Units Integration with vehicle networks Using of own sensors if needed Navigation data, preprocessed sensor data, etc. Head Unit ADAS Engine Sensor Abstraction Layer Web Interface SW Update Configuration Diagnostic Live data from vehicle: - CAN data, Sensors - Video stream ECU (e.g. Jetson TX2) ADAS/AR Engine Video Stream with augmented objects Control/Settings HUD/LCD
11 Perception Concept
12 Sensor Fusion: Data Inference Optimal fusion filter parameters adjustment problem statement and solution developed to fit different car models with different chassis geometries and steering wheel models/parameters. Features: Absolute and relative positioning Dead reckoning Fusion with available automotive grade sensors GPS, steering wheel, steering wheel rate, wheels sensors Fusion with navigation data Rear movements support Complex steering wheel models identification. Ability to integrate with provided models GPS errors correction Stability and robustness against complex conditions tunnels, urban canyons
13 Sensor Fusion: Advanced Augmented Objects Positioning Solving map accuracy problems Placing: Road model Vehicles detection Map data Position clarification: Camera motion model: Video-based gyroscope Positioner Component Road model Objects tracking
14 Sensor Fusion: Comparing Solutions Apostera solution Reference solution Update frequency ~15 Hz (+extrapolation with any fps) Update frequency ~4-5 Hz
15 Lane Detection: Adaptability and Confidence
16 Lane Detection: 3D-scene Recognition Pipeline Low level invariant features Single camera Stereo data Point clouds Structural analysis Probabilistic models Real-world features Physical objects 3D scene reconstruction Road situation 3D space scene fusion (different sensors input) Backward knowledge propagation from high levels
17 Vehicle Detection Convolutional neural network for vehicle detection GPU Acceleration CUDA Running real-time on NVidia Jetson TX2 Inference speedup on embedded (TX2) GPU vs CPU is ~3x More potential with new libraries (e.g. TensorRT) Training speedup on desktop GPU vs CPU is ~20x Classifier accuracy (about 50k, 960x540, ~55-60 deg HFOV) Positive: 99.65% Negative: 99.82% Size of detection down to 30 pix, detection range of about 60 m Figure Vehicle detection examples
18 Road Scene Semantic Segmentation Deep fully convolutional neural network for semantic pixel-wise segmentation Road scene understanding use cases: model appearance, shape, spatial-relationship between classes Inference speedup GPU vs CPU is ~3x Figure Road scene segmentation examples
19 HMI Concept
20 Rendering Component Structure Figure Rendering component
21 Augmented Objects Primitives Barrier Lane Line Street Name Lane Arrow Fishbone
22 Augmented Objects Primitives And HMI
23 Head Up Display Concept. HUD vs LCD Hardware limitation HUD devices are rarely available on market FOV and object size Timings Zero latency Driver eye position Driver perception Virtual image distance Information balance
24 HUD Image Correction (Dewarping) Need to correct slight distortion in the HUD image A custom warp map was made by taking an image of a test pattern that was projected by the HUD and recorded by a camera Figure Uncorrected image Figure Corrected image
25 Demo Application (LCD)
26 Summary: Key Technology Advantages Proved understanding of pragmatic intersection and synergy between fundamental theoretical results and final requirements Formal mathematical approaches are complemented by deep learning Solid GPU optimization Automotive grade solutions integrated with all the data sources in vehicle data fusion approaches High robustness in various weather and road conditions, confidence is estimated for efficient fusion Closed loops designed and implemented to enhance speed and robustness of each component Integration with V2X and various navigation systems System architecture supports distributed HW setup and integration with existing in-vehicle components if required (environmental model, objects detection, navigation, positioner etc.) Hierarchical Algorithmic Framework design highly optimizes computations on embedded platforms Collaboration with scientific groups to integrate cutting edge approaches
27 BRINGING MOBILITY WORLD TO NEW ERA OF AUTONOMY Sergii Bykov Technical Lead Machine Learning
ADAS COMPUTER VISION AND AUGMENTED REALITY SOLUTION
ENGINEERING ENERGY TELECOM TRAVEL AND AVIATION SOFTWARE FINANCIAL SERVICES ADAS COMPUTER VISION AND AUGMENTED REALITY SOLUTION Sergii Bykov, Technical Lead TECHNOLOGY AUTOMOTIVE Product Vision Road To
More informationChoosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles
Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles Ali Osman Ors May 2, 2017 Copyright 2017 NXP Semiconductors 1 Sensing Technology Comparison Rating: H = High, M=Medium,
More informationSIS63-Building the Future-Advanced Integrated Safety Applications: interactive Perception platform and fusion modules results
SIS63-Building the Future-Advanced Integrated Safety Applications: interactive Perception platform and fusion modules results Angelos Amditis (ICCS) and Lali Ghosh (DEL) 18 th October 2013 20 th ITS World
More informationVision with Precision Webinar Series Augmented & Virtual Reality Aaron Behman, Xilinx Mark Beccue, Tractica. Copyright 2016 Xilinx
Vision with Precision Webinar Series Augmented & Virtual Reality Aaron Behman, Xilinx Mark Beccue, Tractica Xilinx Vision with Precision Webinar Series Perceiving Environment / Taking Action: AR / VR Monitoring
More informationADAS Development using Advanced Real-Time All-in-the-Loop Simulators. Roberto De Vecchi VI-grade Enrico Busto - AddFor
ADAS Development using Advanced Real-Time All-in-the-Loop Simulators Roberto De Vecchi VI-grade Enrico Busto - AddFor The Scenario The introduction of ADAS and AV has created completely new challenges
More informationinteractive IP: Perception platform and modules
interactive IP: Perception platform and modules Angelos Amditis, ICCS 19 th ITS-WC-SIS76: Advanced integrated safety applications based on enhanced perception, active interventions and new advanced sensors
More informationVisione per il veicolo Paolo Medici 2017/ Visual Perception
Visione per il veicolo Paolo Medici 2017/2018 02 Visual Perception Today Sensor Suite for Autonomous Vehicle ADAS Hardware for ADAS Sensor Suite Which sensor do you know? Which sensor suite for Which algorithms
More informationVSI Labs The Build Up of Automated Driving
VSI Labs The Build Up of Automated Driving October - 2017 Agenda Opening Remarks Introduction and Background Customers Solutions VSI Labs Some Industry Content Opening Remarks Automated vehicle systems
More informationMACHINE LEARNING Games and Beyond. Calvin Lin, NVIDIA
MACHINE LEARNING Games and Beyond Calvin Lin, NVIDIA THE MACHINE LEARNING ERA IS HERE And it is transforming every industry... including Game Development OVERVIEW NVIDIA Volta: An Architecture for Machine
More informationAI Application Processing Requirements
AI Application Processing Requirements 1 Low Medium High Sensor analysis Activity Recognition (motion sensors) Stress Analysis or Attention Analysis Audio & sound Speech Recognition Object detection Computer
More informationPerception platform and fusion modules results. Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event
Perception platform and fusion modules results Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event 20 th -21 st November 2013 Agenda Introduction Environment Perception in Intelligent Transport
More informationPhysics Based Sensor simulation
Physics Based Sensor simulation Jordan Gorrochotegui - Product Manager Software and Services Mike Phillips Software Engineer Restricted Siemens AG 2017 Realize innovation. Siemens offers solutions across
More informationThe Building Blocks of Autonomous Control. Phil Magney, Founder & Principal Advisor July 2016
The Building Blocks of Autonomous Control Phil Magney, Founder & Principal Advisor July 2016 Agenda VSI Remarks The Building Blocks of Autonomy Elements of Autonomous Control Motion Control (path, maneuver,
More informationIntelligent Technology for More Advanced Autonomous Driving
FEATURED ARTICLES Autonomous Driving Technology for Connected Cars Intelligent Technology for More Advanced Autonomous Driving Autonomous driving is recognized as an important technology for dealing with
More informationTsuyoshi Sato PIONEER CORPORATION July 6, 2017
Technology R&D for for Highly Highly Automated Automated Driving Driving Tsuyoshi Sato PIONEER CORPORATION July 6, 2017 Agenda Introduction Overview Architecture R&D for Highly Automated Driving Hardware
More informationEmbedding Artificial Intelligence into Our Lives
Embedding Artificial Intelligence into Our Lives Michael Thompson, Synopsys D&R IP-SOC DAYS Santa Clara April 2018 1 Agenda Introduction What AI is and is Not Where AI is being used Rapid Advance of AI
More informationA Winning Combination
A Winning Combination Risk factors Statements in this presentation that refer to future plans and expectations are forward-looking statements that involve a number of risks and uncertainties. Words such
More informationAutonomous Mobile Robot Design. Dr. Kostas Alexis (CSE)
Autonomous Mobile Robot Design Dr. Kostas Alexis (CSE) Course Goals To introduce students into the holistic design of autonomous robots - from the mechatronic design to sensors and intelligence. Develop
More informationHAVEit Highly Automated Vehicles for Intelligent Transport
HAVEit Highly Automated Vehicles for Intelligent Transport Holger Zeng Project Manager CONTINENTAL AUTOMOTIVE HAVEit General Information Project full title: Highly Automated Vehicles for Intelligent Transport
More informationSemantic Segmentation on Resource Constrained Devices
Semantic Segmentation on Resource Constrained Devices Sachin Mehta University of Washington, Seattle In collaboration with Mohammad Rastegari, Anat Caspi, Linda Shapiro, and Hannaneh Hajishirzi Project
More informationUsing FMI/ SSP for Development of Autonomous Driving
Using FMI/ SSP for Development of Autonomous Driving presented by Jochen Köhler (ZF) FMI User Meeting 15.05.2017 Prague / Czech Republic H.M. Heinkel S.Rude P. R. Mai J. Köhler M. Rühl / A. Pillekeit Motivation
More informationA NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June Xavier Lagorce Head of Computer Vision & Systems
A NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June 2017 Xavier Lagorce Head of Computer Vision & Systems Imagine meeting the promise of Restoring sight to the blind Accident-free autonomous
More informationIndustrial Keynotes. 06/09/2018 Juan-Les-Pins
Industrial Keynotes 1 06/09/2018 Juan-Les-Pins Agenda 1. The End of Driving Simulation? 2. Autonomous Vehicles: the new UI 3. Augmented Realities 4. Choose your factions 5. No genuine AI without flawless
More informationEvaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed
AUTOMOTIVE Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed Yoshiaki HAYASHI*, Izumi MEMEZAWA, Takuji KANTOU, Shingo OHASHI, and Koichi TAKAYAMA ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
More informationTHE NEXT WAVE OF COMPUTING. September 2017
THE NEXT WAVE OF COMPUTING September 2017 SAFE HARBOR Forward-Looking Statements Except for the historical information contained herein, certain matters in this presentation including, but not limited
More informationCombining ROS and AI for fail-operational automated driving
Combining ROS and AI for fail-operational automated driving Prof. Dr. Daniel Watzenig Virtual Vehicle Research Center, Graz, Austria and Institute of Automation and Control at Graz University of Technology
More informationAdvances in Vehicle Periphery Sensing Techniques Aimed at Realizing Autonomous Driving
FEATURED ARTICLES Autonomous Driving Technology for Connected Cars Advances in Vehicle Periphery Sensing Techniques Aimed at Realizing Autonomous Driving Progress is being made on vehicle periphery sensing,
More informationTransformation to Artificial Intelligence with MATLAB Roy Lurie, PhD Vice President of Engineering MATLAB Products
Transformation to Artificial Intelligence with MATLAB Roy Lurie, PhD Vice President of Engineering MATLAB Products 2018 The MathWorks, Inc. 1 A brief history of the automobile First Commercial Gas Car
More informationDeep Learning for Autonomous Driving
Deep Learning for Autonomous Driving Shai Shalev-Shwartz Mobileye IMVC dimension, March, 2016 S. Shalev-Shwartz is also affiliated with The Hebrew University Shai Shalev-Shwartz (MobilEye) DL for Autonomous
More informationTHE VISIONLAB TEAM engineers - 1 physicist. Feasibility study and prototyping Hardware benchmarking Open and closed source libraries
VISIONLAB OPENING THE VISIONLAB TEAM 2018 6 engineers - 1 physicist Feasibility study and prototyping Hardware benchmarking Open and closed source libraries Deep learning frameworks GPU frameworks FPGA
More informationSoftware Computer Vision - Driver Assistance
Software Computer Vision - Driver Assistance Work @Bosch for developing desktop, web or embedded software and algorithms / computer vision / artificial intelligence for Driver Assistance Systems and Automated
More informationGESTURE RECOGNITION WITH 3D CNNS
April 4-7, 2016 Silicon Valley GESTURE RECOGNITION WITH 3D CNNS Pavlo Molchanov Xiaodong Yang Shalini Gupta Kihwan Kim Stephen Tyree Jan Kautz 4/6/2016 Motivation AGENDA Problem statement Selecting the
More informationGNSS in Autonomous Vehicles MM Vision
GNSS in Autonomous Vehicles MM Vision MM Technology Innovation Automated Driving Technologies (ADT) Evaldo Bruci Context & motivation Within the robotic paradigm Magneti Marelli chose Think & Decision
More informationCAPACITIES FOR TECHNOLOGY TRANSFER
CAPACITIES FOR TECHNOLOGY TRANSFER The Institut de Robòtica i Informàtica Industrial (IRI) is a Joint University Research Institute of the Spanish Council for Scientific Research (CSIC) and the Technical
More informationAn Information Fusion Method for Vehicle Positioning System
An Information Fusion Method for Vehicle Positioning System Yi Yan, Che-Cheng Chang and Wun-Sheng Yao Abstract Vehicle positioning techniques have a broad application in advanced driver assistant system
More informationInvited talk IET-Renault Workshop Autonomous Vehicles: From theory to full scale applications Novotel Paris Les Halles, June 18 th 2015
Risk assessment & Decision-making for safe Vehicle Navigation under Uncertainty Christian LAUGIER, First class Research Director at Inria http://emotion.inrialpes.fr/laugier Contributions from Mathias
More informationMotionDesk. 3-D online animation of simulated mechanical systems in real time. Highlights
MotionDesk 3-D online animation of simulated mechanical systems in real time Highlights Tight integration to ModelDesk and ASM Enhanced support for all aspects of advanced driver assistance systems (ADAS)
More informationVirtual Homologation of Software- Intensive Safety Systems: From ESC to Automated Driving
Virtual Homologation of Software- Intensive Safety Systems: From ESC to Automated Driving Dr. Houssem Abdellatif Global Head Autonomous Driving & ADAS TÜV SÜD Auto Service Christian Gnandt Lead Engineer
More informationThe 3xD Simulator for Intelligent Vehicles Professor Paul Jennings. 20 th October 2016
The 3xD Simulator for Intelligent Vehicles Professor Paul Jennings 20 th October 2016 An academic department within the science faculty Established in 1980 by Professor Lord Bhattacharyya as Warwick Manufacturing
More informationVirtual Co-Location for Crime Scene Investigation and Going Beyond
Virtual Co-Location for Crime Scene Investigation and Going Beyond Stephan Lukosch Faculty of Technology, Policy and Management, Systems Engineering Section Delft University of Technology Challenge the
More informationCOVER STORY. how this new architecture will help carmakers master the complexity of autonomous driving.
COVER STORY Semiconductors NXP ESTABLISHED AND NEW PLAYERS The era of self-driving cars places semiconductor companies at the center of important discussions about standards, methodologies, and design
More informationDavid Howarth. Business Development Manager Americas
David Howarth Business Development Manager Americas David Howarth IPG Automotive USA, Inc. Business Development Manager Americas david.howarth@ipg-automotive.com ni.com Testing Automated Driving Functions
More informationIntroduction to Virtual Reality (based on a talk by Bill Mark)
Introduction to Virtual Reality (based on a talk by Bill Mark) I will talk about... Why do we want Virtual Reality? What is needed for a VR system? Examples of VR systems Research problems in VR Most Computers
More informationPerSEE: a Central Sensors Fusion Electronic Control Unit for the development of perception-based ADAS
10-4 MVA2015 IAPR International Conference on Machine Vision Applications, May 18-22, 2015, Tokyo, JAPAN PerSEE: a Central Sensors Fusion Electronic Control Unit for the development of perception-based
More informationAutomotive Needs and Expectations towards Next Generation Driving Simulation
Automotive Needs and Expectations towards Next Generation Driving Simulation Dr. Hans-Peter Schöner - Insight fromoutside -Consulting - Senior Automotive Expert, Driving Simulation Association September
More informationThe Denali-MC HDR ISP Backgrounder
The Denali-MC HDR ISP Backgrounder 2-4 brackets up to 8 EV frame offset Up to 16 EV stops for output HDR LATM (tone map) up to 24 EV Noise reduction due to merging of 10 EV LDR to a single 16 EV HDR up
More informationPositioning Challenges in Cooperative Vehicular Safety Systems
Positioning Challenges in Cooperative Vehicular Safety Systems Dr. Luca Delgrossi Mercedes-Benz Research & Development North America, Inc. October 15, 2009 Positioning for Automotive Navigation Personal
More informationMarco Cavallo. Merging Worlds: A Location-based Approach to Mixed Reality. Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO
Marco Cavallo Merging Worlds: A Location-based Approach to Mixed Reality Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO Introduction: A New Realm of Reality 2 http://www.samsung.com/sg/wearables/gear-vr/
More informationNeural Networks The New Moore s Law
Neural Networks The New Moore s Law Chris Rowen, PhD, FIEEE CEO Cognite Ventures December 216 Outline Moore s Law Revisited: Efficiency Drives Productivity Embedded Neural Network Product Segments Efficiency
More informationMeasurement & Control of energy systems. Teppo Myllys National Instruments
Measurement & Control of energy systems Teppo Myllys National Instruments National Instruments Direct operations in over 50 Countries More than 1,000 products, 7000+ employees, and 700 Alliance Program
More informationIntelligent driving TH« TNO I Innovation for live
Intelligent driving TNO I Innovation for live TH«Intelligent Transport Systems have become an integral part of the world. In addition to the current ITS systems, intelligent vehicles can make a significant
More informationSafe, Efficient and Effective Testing of Connected and Autonomous Vehicles Paul Jennings. Franco-British Symposium on ITS 5 th October 2016
Safe, Efficient and Effective Testing of Connected and Autonomous Vehicles Paul Jennings Franco-British Symposium on ITS 5 th October 2016 An academic department within the science faculty Established
More informationPerception. Introduction to HRI Simmons & Nourbakhsh Spring 2015
Perception Introduction to HRI Simmons & Nourbakhsh Spring 2015 Perception my goals What is the state of the art boundary? Where might we be in 5-10 years? The Perceptual Pipeline The classical approach:
More informationTransportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 3/10/2009 1
Machine Vision Transportation Informatics Group University of Klagenfurt Alireza Fasih, 2009 3/10/2009 1 Address: L4.2.02, Lakeside Park, Haus B04, Ebene 2, Klagenfurt-Austria Index Driver Fatigue Detection
More informationSituational Awareness A Missing DP Sensor output
Situational Awareness A Missing DP Sensor output Improving Situational Awareness in Dynamically Positioned Operations Dave Sanderson, Engineering Group Manager. Abstract Guidance Marine is at the forefront
More informationSHAPING THE FUTURE OF IOT: PLATFORMS FOR CO-CREATION, RAPID PROTOTYPING AND SUCCESSFUL INDUSTRIALIZATION
SHAPING THE FUTURE OF IOT: PLATFORMS FOR CO-CREATION, RAPID PROTOTYPING AND SUCCESSFUL INDUSTRIALIZATION Dr. Julian Bartholomeyczik Head of Software Development Bosch Connected Devices and Solutions GmbH
More informationSéminaire Voiture Autonome: Technologies, Enjeux et Applications February , Paris (France) Asprom UIMM Cap Tronic
Embedded Perception & Risk Assessment for next Cars Generation Christian LAUGIER, Research Director at Inria Chroma Team & IRT Nanolec Christian.laugier@inria.fr Contributions from Mathias Perrollaz, Christopher
More informationFusion in EU projects and the Perception Approach. Dr. Angelos Amditis interactive Summer School 4-6 July, 2012
Fusion in EU projects and the Perception Approach Dr. Angelos Amditis interactive Summer School 4-6 July, 2012 Content Introduction Data fusion in european research projects EUCLIDE PReVENT-PF2 SAFESPOT
More informationComputer vision, wearable computing and the future of transportation
Computer vision, wearable computing and the future of transportation Amnon Shashua Hebrew University, Mobileye, OrCam 1 Computer Vision that will Change Transportation Amnon Shashua Mobileye 2 Computer
More informationISO JTC 1 SC 24 WG9 G E R A R D J. K I M K O R E A U N I V E R S I T Y
New Work Item Proposal: A Standard Reference Model for Generic MAR Systems ISO JTC 1 SC 24 WG9 G E R A R D J. K I M K O R E A U N I V E R S I T Y What is a Reference Model? A reference model (for a given
More informationDigital Transformation. A Game Changer. How Does the Digital Transformation Affect Informatics as a Scientific Discipline?
Digital Transformation A Game Changer How Does the Digital Transformation Affect Informatics as a Scientific Discipline? Manfred Broy Technische Universität München Institut for Informatics ... the change
More informationTeam Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development paradigm
Additive Manufacturing Renewable Energy and Energy Storage Astronomical Instruments and Precision Engineering Team Kanaloa: research initiatives and the Vertically Integrated Project (VIP) development
More informationRobust Positioning for Urban Traffic
Robust Positioning for Urban Traffic Motivations and Activity plan for the WG 4.1.4 Dr. Laura Ruotsalainen Research Manager, Department of Navigation and positioning Finnish Geospatial Research Institute
More informationMOBILITY RESEARCH NEEDS FROM THE GOVERNMENT PERSPECTIVE
MOBILITY RESEARCH NEEDS FROM THE GOVERNMENT PERSPECTIVE First Annual 2018 National Mobility Summit of US DOT University Transportation Centers (UTC) April 12, 2018 Washington, DC Research Areas Cooperative
More informationEnhancing Shipboard Maintenance with Augmented Reality
Enhancing Shipboard Maintenance with Augmented Reality CACI Oxnard, CA Dennis Giannoni dgiannoni@caci.com (805) 288-6630 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED. Agenda Virtual
More informationAutonomous Vehicle Simulation (MDAS.ai)
Autonomous Vehicle Simulation (MDAS.ai) Sridhar Lakshmanan Department of Electrical & Computer Engineering University of Michigan - Dearborn Presentation for Physical Systems Replication Panel NDIA Cyber-Enabled
More informationThermal Image Enhancement Using Convolutional Neural Network
SEOUL Oct.7, 2016 Thermal Image Enhancement Using Convolutional Neural Network Visual Perception for Autonomous Driving During Day and Night Yukyung Choi Soonmin Hwang Namil Kim Jongchan Park In So Kweon
More informationLecture 19: Depth Cameras. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011)
Lecture 19: Depth Cameras Kayvon Fatahalian CMU 15-869: Graphics and Imaging Architectures (Fall 2011) Continuing theme: computational photography Cheap cameras capture light, extensive processing produces
More informationOPEN CV BASED AUTONOMOUS RC-CAR
OPEN CV BASED AUTONOMOUS RC-CAR B. Sabitha 1, K. Akila 2, S.Krishna Kumar 3, D.Mohan 4, P.Nisanth 5 1,2 Faculty, Department of Mechatronics Engineering, Kumaraguru College of Technology, Coimbatore, India
More informationModel-Based Design for Sensor Systems
2009 The MathWorks, Inc. Model-Based Design for Sensor Systems Stephanie Kwan Applications Engineer Agenda Sensor Systems Overview System Level Design Challenges Components of Sensor Systems Sensor Characterization
More informationDENSO
DENSO www.densocorp-na.com Collaborative Automated Driving Description of Project DENSO is one of the biggest tier one suppliers in the automotive industry, and one of its main goals is to provide solutions
More informationUnpredictable movement performance of Virtual Reality headsets
Unpredictable movement performance of Virtual Reality headsets 2 1. Introduction Virtual Reality headsets use a combination of sensors to track the orientation of the headset, in order to move the displayed
More informationP1.4. Light has to go where it is needed: Future Light Based Driver Assistance Systems
Light has to go where it is needed: Future Light Based Driver Assistance Systems Thomas Könning¹, Christian Amsel¹, Ingo Hoffmann² ¹ Hella KGaA Hueck & Co., Lippstadt, Germany ² Hella-Aglaia Mobile Vision
More informationVirtual Worlds for the Perception and Control of Self-Driving Vehicles
Virtual Worlds for the Perception and Control of Self-Driving Vehicles Dr. Antonio M. López antonio@cvc.uab.es Index Context SYNTHIA: CVPR 16 SYNTHIA: Reloaded SYNTHIA: Evolutions CARLA Conclusions Index
More informationEM Simulation of Automotive Radar Mounted in Vehicle Bumper
EM Simulation of Automotive Radar Mounted in Vehicle Bumper Abstract Trends in automotive safety are pushing radar systems to higher levels of accuracy and reliable target identification for blind spot
More informationA.I in Automotive? Why and When.
A.I in Automotive? Why and When. AGENDA 01 02 03 04 Definitions A.I? A.I in automotive Now? Next big A.I breakthrough in Automotive 01 DEFINITIONS DEFINITIONS Artificial Intelligence Artificial Intelligence:
More informationThe GATEway Project London s Autonomous Push
The GATEway Project London s Autonomous Push 06/2016 Why TRL? Unrivalled industry position with a focus on mobility 80 years independent transport research Public and private sector with global reach 350+
More informationV2X-Locate Positioning System Whitepaper
V2X-Locate Positioning System Whitepaper November 8, 2017 www.cohdawireless.com 1 Introduction The most important piece of information any autonomous system must know is its position in the world. This
More informationSilicon radars and smart algorithms - disruptive innovation in perceptive IoT systems Andy Dewilde PUBLIC
Silicon radars and smart algorithms - disruptive innovation in perceptive IoT systems Andy Dewilde PUBLIC Fietser in levensgevaar na ongeval met vrachtwagen op Louizaplein Het Laatste Nieuws 16/06/2017
More informationVirtual Testing of Autonomous Vehicles
Virtual Testing of Autonomous Vehicles Mike Dempsey Claytex Services Limited Software, Consultancy, Training Based in Leamington Spa, UK Office in Cape Town, South Africa Experts in Systems Engineering,
More informationWhite paper on CAR28T millimeter wave radar
White paper on CAR28T millimeter wave radar Hunan Nanoradar Science and Technology Co., Ltd. Version history Date Version Version description 2017-07-13 1.0 the 1st version of white paper on CAR28T Contents
More informationPerception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision
11-25-2013 Perception Vision Read: AIMA Chapter 24 & Chapter 25.3 HW#8 due today visual aural haptic & tactile vestibular (balance: equilibrium, acceleration, and orientation wrt gravity) olfactory taste
More informationHigh Precision GNSS in Automotive
High Precision GNSS in Automotive Jonathan Auld, VP Engineering and Safety 6, March, 2018 2 Global OEM Positioning Solutions and Services for Land, Sea, and Air. GNSS in Automotive Today Today the primary
More informationARGUING THE SAFETY OF MACHINE LEARNING FOR HIGHLY AUTOMATED DRIVING USING ASSURANCE CASES LYDIA GAUERHOF BOSCH CORPORATE RESEARCH
ARGUING THE SAFETY OF MACHINE LEARNING FOR HIGHLY AUTOMATED DRIVING USING ASSURANCE CASES 14.12.2017 LYDIA GAUERHOF BOSCH CORPORATE RESEARCH Arguing Safety of Machine Learning for Highly Automated Driving
More informationTranser Learning : Super Intelligence
Transer Learning : Super Intelligence GIS Group Dr Narayan Panigrahi, MA Rajesh, Shibumon Alampatta, Rakesh K P of Centre for AI and Robotics, Defence Research and Development Organization, C V Raman Nagar,
More informationGlobal Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ( )
Industry Research by Koncept Analytics Global Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ----------------------------------------- (2017-2021) October 2017 Global
More informationVirtual testing by coupling high fidelity vehicle simulation with microscopic traffic flow simulation
DYNA4 with DYNAanimation in Co-Simulation with SUMO vehicle under test Virtual testing by coupling high fidelity vehicle simulation with microscopic traffic flow simulation Dr.-Ing. Jakob Kaths TESIS GmbH
More informationDeep learning for INTELLIGENT machines
Deep learning for INTELLIGENT machines GAMING DESIGN ENTERPRISE VIRTUALIZATION HPC & CLOUD SERVICE PROVIDERS INTELLIGENT MACHINES THE WORLD LEADER IN VISUAL COMPUTING 2 3 APPLICATIONS OF DEEP LEARNING
More informationAutomotive In-cabin Sensing Solutions. Nicolas Roux September 19th, 2018
Automotive In-cabin Sensing Solutions Nicolas Roux September 19th, 2018 Impact of Drowsiness 2 Drowsiness responsible for 20% to 25% of car crashes in Europe (INVS/AFSA) Beyond Drowsiness Driver Distraction
More informationATLANS-C. mobile mapping position and orientation solution
mobile mapping position and orientation solution mobile mapping position and orientation solution THE SMALLEST ATLANS-C is a high performance all-in-one position and orientation solution for both land
More informationKÜNSTLICHE INTELLIGENZ JOBKILLER VON MORGEN?
KÜNSTLICHE INTELLIGENZ JOBKILLER VON MORGEN? Marc Stampfli https://www.linkedin.com/in/marcstampfli/ https://twitter.com/marc_stampfli E-Mail: mstampfli@nvidia.com INTELLIGENT ROBOTS AND SMART MACHINES
More informationVideo Injection Methods in a Real-world Vehicle for Increasing Test Efficiency
DEVELOPMENT SIMUL ATION AND TESTING Video Injection Methods in a Real-world Vehicle for Increasing Test Efficiency IPG Automotive AUTHORS For the testing of camera-based driver assistance systems under
More informationLast Time: Acting Humanly: The Full Turing Test
Last Time: Acting Humanly: The Full Turing Test Alan Turing's 1950 article Computing Machinery and Intelligence discussed conditions for considering a machine to be intelligent Can machines think? Can
More informationTECHNOLOGY DEVELOPMENT AREAS IN AAWA
TECHNOLOGY DEVELOPMENT AREAS IN AAWA Technologies for realizing remote and autonomous ships exist. The task is to find the optimum way to combine them reliably and cost effecticely. Ship state definition
More informationDeliverable D1.6 Initial System Specifications Executive Summary
Deliverable D1.6 Initial System Specifications Executive Summary Version 1.0 Dissemination Project Coordination RE Ford Research and Advanced Engineering Europe Due Date 31.10.2010 Version Date 09.02.2011
More informationVolkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System
Volkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System By Dr. Kai Franke, Development Online Driver Assistance Systems, Volkswagen AG 10 Engineering Reality Magazine A
More informationWebinar. 9 things you should know about centimeter-level GNSS accuracy
Webinar 9 things you should know about centimeter-level GNSS accuracy Webinar agenda 9 things you should know about centimeter-level GNSS accuracy 1. High precision GNSS challenges 2. u-blox F9 technology
More informationHow to build an autonomous anything
How to build an autonomous anything Jim Tung jim@mathworks.com 2015 The MathWorks, Inc. 1 2 3 4 5 6 7 Autonomous Technology 8 Autonomy Having the power for self-governance 9 Autonomous Technology Provides
More informationDriver Assistance and Awareness Applications
Using s as Automotive Sensors Driver Assistance and Awareness Applications Faroog Ibrahim Visteon Corporation GNSS is all about positioning, sure. But for most automotive applications we need a map to
More informationWilliam Milam Ford Motor Co
Sharing technology for a stronger America Verification Challenges in Automotive Embedded Systems William Milam Ford Motor Co Chair USCAR CPS Task Force 10/20/2011 What is USCAR? The United States Council
More information