Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles

Similar documents
Making Vehicles Smarter and Safer with Diode Laser-Based 3D Sensing

White paper on CAR28T millimeter wave radar

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017

interactive IP: Perception platform and modules

Visione per il veicolo Paolo Medici 2017/ Visual Perception

SIS63-Building the Future-Advanced Integrated Safety Applications: interactive Perception platform and fusion modules results

Silicon radars and smart algorithms - disruptive innovation in perceptive IoT systems Andy Dewilde PUBLIC

Development of a 24 GHz Band Peripheral Monitoring Radar

P1.4. Light has to go where it is needed: Future Light Based Driver Assistance Systems

Perception platform and fusion modules results. Angelos Amditis - ICCS and Lali Ghosh - DEL interactive final event

Global Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ( )

Situational Awareness A Missing DP Sensor output

A Winning Combination

Revision of the EU General Safety Regulation and Pedestrian Safety Regulation

EG 1 Millimeter-wave & Integrated Antennas

Advances in Vehicle Periphery Sensing Techniques Aimed at Realizing Autonomous Driving

New Automotive Applications for Smart Radar Systems

VSI Labs The Build Up of Automated Driving

TECHNOLOGY DEVELOPMENT AREAS IN AAWA

An Information Fusion Method for Vehicle Positioning System

Minimizing Distraction While Adding Features

Following Dirt Roads at Night-Time

Moving from legacy 24 GHz to state-of-the-art 77 GHz radar

A.I in Automotive? Why and When.

Tsuyoshi Sato PIONEER CORPORATION July 6, 2017

ITS Radiocommunications in Japan Progress report and future directions

Computer vision, wearable computing and the future of transportation

Effective Collision Avoidance System Using Modified Kalman Filter

Invited talk IET-Renault Workshop Autonomous Vehicles: From theory to full scale applications Novotel Paris Les Halles, June 18 th 2015

Message points from SARA Active Safety through Automotive UWB Short Range Radar (SRR)

Building a Computer Vision Research Vehicle with ROS

Designing A Human Vehicle Interface For An Intelligent Community Vehicle

Autonomous driving made safe

FORESIGHT AUTONOMOUS HOLDINGS NASDAQ/TASE: FRSX. Investor Conference. December 2018

ADAS COMPUTER VISION AND AUGMENTED REALITY SOLUTION

Keysight Technologies Achieving Accurate E-band Power Measurements with E8486A Waveguide Power Sensors. Application Note

Machine Vision Beyond the Factory. Jeff Burnstein President October 18, 2012 Beijing

A NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June Xavier Lagorce Head of Computer Vision & Systems

The Building Blocks of Autonomous Control. Phil Magney, Founder & Principal Advisor July 2016

Devid Will, Adrian Zlocki

FLASH LiDAR KEY BENEFITS

White paper on CAR150 millimeter wave radar

Positioning Challenges in Cooperative Vehicular Safety Systems

Driver Assistance Systems (DAS)

Current Technologies in Vehicular Communications

CS686: High-level Motion/Path Planning Applications

COVER STORY. how this new architecture will help carmakers master the complexity of autonomous driving.

Systems characteristics of automotive radars operating in the frequency band GHz for intelligent transport systems applications

II. ADVANTAGES AND DISADVANTAGES

GNSS in Autonomous Vehicles MM Vision

Technical Datasheet. Blaxtair is an intelligent cameraa with the ability to generate alarms when a pedestrian is detected

TEPZZ _79748A_T EP A1 (19) (11) EP A1 (12) EUROPEAN PATENT APPLICATION. (51) Int Cl.: H04W 4/04 ( ) B60Q 1/00 (2006.

ROAD TO THE BEST ALPR IMAGES

By Pierre Olivier, Vice President, Engineering and Manufacturing, LeddarTech Inc.

Behind the Test Challenges of Automotive Radar Systems

MMW sensors for Industrial, safety, Traffic and security applications

LED flicker: Root cause, impact and measurement for automotive imaging applications

Advances in Radio Science

Embedding Artificial Intelligence into Our Lives

Vehicle-to-X communication using millimeter waves

Automotive 77GHz; Coupled 3D-EM / Asymptotic Simulations. Franz Hirtenfelder CST /AG

Fusion in EU projects and the Perception Approach. Dr. Angelos Amditis interactive Summer School 4-6 July, 2012

Intelligent Technology for More Advanced Autonomous Driving

Infineon at a glance

Transportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 3/10/2009 1

Automated Testing of Autonomous Driving Assistance Systems

Ultra-small, economical and cheap radar made possible thanks to chip technology

MotionDesk. 3-D online animation of simulated mechanical systems in real time. Highlights

Deliverable D1.6 Initial System Specifications Executive Summary

Civil Radar Systems.

CS 534: Computer Vision

Passive Components around ADAS Applications By Ron Demcko, AVX Fellow, AVX Corporation

Digital Engines for Smart and Connected Cars By Bob O Donnell, TECHnalysis Research Chief Analyst

Draft Report of the 1 st Session GRSG informal group on awareness of Vulnerable Road Users proximity in low speed manoeuvres (VRU-Proxi)

PerSEE: a Central Sensors Fusion Electronic Control Unit for the development of perception-based ADAS

Technical and Commercial Challenges of V2V and V2I networks

HAPTICS AND AUTOMOTIVE HMI

CMOS Image Sensors in Cell Phones, Cars and Beyond. Patrick Feng General manager BYD Microelectronics October 8, 2013

Test-bed for Unified Perception & Decision Architecture

Physics Based Sensor simulation

HAVEit Highly Automated Vehicles for Intelligent Transport

SAfety VEhicles using adaptive Interface Technology (SAVE-IT): A Program Overview

Model Deployment Overview. Debby Bezzina Senior Program Manager University of Michigan Transportation Research Institute

Intelligent driving TH« TNO I Innovation for live

Blind Spot Monitor Vehicle Blind Spot Monitor

Keysight Technologies

Autonomous driving technology and ITS

Driver Education Classroom and In-Car Curriculum Unit 3 Space Management System

Final Report Non Hit Car And Truck

Automotive Needs and Expectations towards Next Generation Driving Simulation

Driver Assistance and Awareness Applications

Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed

Embedded Bayesian Perception & V2X Communications for Autonomous Driving

ITS radiocommunications toward automated driving systems in Japan

Experimental Resilience Assessment of An Open-Source Driving Agent

Using FMI/ SSP for Development of Autonomous Driving

Development of Gaze Detection Technology toward Driver's State Estimation

Onboard supply control unit -J519- Fitting location: 1 - Onboard supply control unit -J519-

2013 ADVANCED TECHNOLOGY GUIDE

Computer Vision Introduction

Transcription:

Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles Ali Osman Ors May 2, 2017 Copyright 2017 NXP Semiconductors 1

Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Object Detection M H H H Classification H M L H Close-Proximity Detection M H L H Speed Detection L H M H Lane Detection H L L H Traffic Sign Recognition H L L H Range H (200m) H (250m) M (120m) Full range Work in Rain, Fog, Snow L H M H Work in Low Light L H H H Work in Bright Light M H H H Size Small Small Medium Mix Cost $ $$ $$$$ Mix Copyright 2017 NXP Semiconductors 2

Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Object Detection M H H H Radar and Lidar are not affected by obscurant conditions as much as camera systems. Cameras also affected by light variation and shadows. Copyright 2017 NXP Semiconductors 3

Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Classification H M L H Level of detail available for template matching much higher in camera systems. The range and height of detection area affects performance Copyright 2017 NXP Semiconductors 4

Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Speed Detection L H M H Radar and Lidar are active emitters that can make measurements on returning signals Object-level motion detection is difficult due to the dual motion introduced by the camera motion and the object motion Copyright 2017 NXP Semiconductors 5

Evolution of the Self Driving Car Copyright 2017 NXP Semiconductors 6

Limitations * www.volvo.com Copyright 2017 NXP Semiconductors 7

? Copyright 2017 NXP Semiconductors 8

RADAR *NXP *Hella Copyright 2017 NXP Semiconductors 9

RADAR TODAY SHORT RANGE/ MEDIUM RANGE RADAR Park Assist Cross-Traffic Alert Junction Assist MEDIUM RANGE RADAR Blind Spot Detection LONG RANGE RADAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 10

RADAR TOMORROW SHORT RANGE/ MEDIUM RANGE RADAR Park Assist Cross-Traffic Alert Junction Assist MEDIUM RANGE RADAR Blind Spot Detection Park Assist LONG RANGE RADAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Rear Collision Warning Copyright 2017 NXP Semiconductors 11

LIDAR *Velodyne *Quanergy *Leddartech Copyright 2017 NXP Semiconductors 12

LIDAR TODAY 360 o LIDAR Park Assist Cross-Traffic Alert Junction Assist Close Navigation Reverse Assist LIDAR Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 13

LIDAR TOMORROW 2D Flash LIDAR Blind Spot Detection Park Assist Cross-Traffic Alert Junction Assist Close Navigation Reverse Assist 3D Flash LIDAR Park Assist Cross-Traffic Alert Junction Assist Close Navigation In Cabin Gesture Recognition Occupancy Detection Touchless Controls Long Range 3D LIDAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 14

CAMERA Copyright 2017 NXP Semiconductors 15

VISION TODAY Surround Camera Parking Assist Cross-Traffic Alert Junction Assist Rear Camera Park Assist Cross-Traffic Alert Junction Assist In-Cabin IR Camera Driver Monitoring Forward Camera Single & Stereo Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Lane Keep Assist Automatic High Beam Control Traffic Sign Recognition Copyright 2017 NXP Semiconductors 16

VISION TOMORROW Rear and Side Camera Park Assist Cross-Traffic Alert Junction Assist Mirror Replacement In-Cabin IR & 3D Camera Driver Monitoring Presence detection Gesture recognition Surround Camera Parking Assist Cross-Traffic Alert Junction Assist Forward Camera Single & Stereo Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Lane Keep Assist Adaptive Front Light Control Traffic Sign Recognition Copyright 2017 NXP Semiconductors 17

Nighttime Scenes Copyright 2017 NXP Semiconductors 18

Autonomy Copyright 2017 NXP Semiconductors 19

3 OEMs, 3 Approaches 3x LRR Radar (150-250m) 2x MRR (70m) 4x SRR (40m) 6-9x Camera 3x LRR Radar (160-250m) 4x MRR (80m) 2x SRR (40m) 5x Camera 1x LRR Radar (250m) 4x MRR (80m) 1x LIDAR 5x Camera Copyright 2017 NXP Semiconductors 20

Take Aways All the sensor technologies used in ADAS and Autonomous Vehicles are evolving. To guarantee safety we need to have redundancy. The needs are not only outside the vehicle. True autonomous vehicles need more than distance and speed, they will need texture data and communication. Copyright 2017 NXP Semiconductors 21

About NXP As the leader in Automotive Semiconductors, Advanced Driver Assistance Systems (ADAS), NXP offers a broad portfolio of Radar sensing and processing, Vision processing, Secure V2X and Sensor Fusion technologies that drive innovation in autonomous cars. http://bit.ly/2ponsm6 Please visit our table in the exhibit hall to view some of our Neural Network based vision processing demos. Copyright 2017 NXP Semiconductors 22

Thank You Copyright 2017 NXP Semiconductors 23