Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous Vehicles Ali Osman Ors May 2, 2017 Copyright 2017 NXP Semiconductors 1
Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Object Detection M H H H Classification H M L H Close-Proximity Detection M H L H Speed Detection L H M H Lane Detection H L L H Traffic Sign Recognition H L L H Range H (200m) H (250m) M (120m) Full range Work in Rain, Fog, Snow L H M H Work in Low Light L H H H Work in Bright Light M H H H Size Small Small Medium Mix Cost $ $$ $$$$ Mix Copyright 2017 NXP Semiconductors 2
Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Object Detection M H H H Radar and Lidar are not affected by obscurant conditions as much as camera systems. Cameras also affected by light variation and shadows. Copyright 2017 NXP Semiconductors 3
Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Classification H M L H Level of detail available for template matching much higher in camera systems. The range and height of detection area affects performance Copyright 2017 NXP Semiconductors 4
Sensing Technology Comparison Rating: H = High, M=Medium, L = Low Camera Radar LiDAR Autonomous Requirement Speed Detection L H M H Radar and Lidar are active emitters that can make measurements on returning signals Object-level motion detection is difficult due to the dual motion introduced by the camera motion and the object motion Copyright 2017 NXP Semiconductors 5
Evolution of the Self Driving Car Copyright 2017 NXP Semiconductors 6
Limitations * www.volvo.com Copyright 2017 NXP Semiconductors 7
? Copyright 2017 NXP Semiconductors 8
RADAR *NXP *Hella Copyright 2017 NXP Semiconductors 9
RADAR TODAY SHORT RANGE/ MEDIUM RANGE RADAR Park Assist Cross-Traffic Alert Junction Assist MEDIUM RANGE RADAR Blind Spot Detection LONG RANGE RADAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 10
RADAR TOMORROW SHORT RANGE/ MEDIUM RANGE RADAR Park Assist Cross-Traffic Alert Junction Assist MEDIUM RANGE RADAR Blind Spot Detection Park Assist LONG RANGE RADAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Rear Collision Warning Copyright 2017 NXP Semiconductors 11
LIDAR *Velodyne *Quanergy *Leddartech Copyright 2017 NXP Semiconductors 12
LIDAR TODAY 360 o LIDAR Park Assist Cross-Traffic Alert Junction Assist Close Navigation Reverse Assist LIDAR Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 13
LIDAR TOMORROW 2D Flash LIDAR Blind Spot Detection Park Assist Cross-Traffic Alert Junction Assist Close Navigation Reverse Assist 3D Flash LIDAR Park Assist Cross-Traffic Alert Junction Assist Close Navigation In Cabin Gesture Recognition Occupancy Detection Touchless Controls Long Range 3D LIDAR Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Copyright 2017 NXP Semiconductors 14
CAMERA Copyright 2017 NXP Semiconductors 15
VISION TODAY Surround Camera Parking Assist Cross-Traffic Alert Junction Assist Rear Camera Park Assist Cross-Traffic Alert Junction Assist In-Cabin IR Camera Driver Monitoring Forward Camera Single & Stereo Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Lane Keep Assist Automatic High Beam Control Traffic Sign Recognition Copyright 2017 NXP Semiconductors 16
VISION TOMORROW Rear and Side Camera Park Assist Cross-Traffic Alert Junction Assist Mirror Replacement In-Cabin IR & 3D Camera Driver Monitoring Presence detection Gesture recognition Surround Camera Parking Assist Cross-Traffic Alert Junction Assist Forward Camera Single & Stereo Adaptive Cruise Control Automatic Emergency Braking Forward Collision Warning Lane Keep Assist Adaptive Front Light Control Traffic Sign Recognition Copyright 2017 NXP Semiconductors 17
Nighttime Scenes Copyright 2017 NXP Semiconductors 18
Autonomy Copyright 2017 NXP Semiconductors 19
3 OEMs, 3 Approaches 3x LRR Radar (150-250m) 2x MRR (70m) 4x SRR (40m) 6-9x Camera 3x LRR Radar (160-250m) 4x MRR (80m) 2x SRR (40m) 5x Camera 1x LRR Radar (250m) 4x MRR (80m) 1x LIDAR 5x Camera Copyright 2017 NXP Semiconductors 20
Take Aways All the sensor technologies used in ADAS and Autonomous Vehicles are evolving. To guarantee safety we need to have redundancy. The needs are not only outside the vehicle. True autonomous vehicles need more than distance and speed, they will need texture data and communication. Copyright 2017 NXP Semiconductors 21
About NXP As the leader in Automotive Semiconductors, Advanced Driver Assistance Systems (ADAS), NXP offers a broad portfolio of Radar sensing and processing, Vision processing, Secure V2X and Sensor Fusion technologies that drive innovation in autonomous cars. http://bit.ly/2ponsm6 Please visit our table in the exhibit hall to view some of our Neural Network based vision processing demos. Copyright 2017 NXP Semiconductors 22
Thank You Copyright 2017 NXP Semiconductors 23