Next-generation automotive image processing with ARM Mali-C71

Size: px
Start display at page:

Download "Next-generation automotive image processing with ARM Mali-C71"

Transcription

1 Next-generation automotive image processing with ARM Mali-C71 Chris Turner Director, Advanced Technology Marketing CPU Group, ARM ARM Tech Forum Korea June 28 th 2017

2 Pioneers in imaging and vision signal processing 2

3 What is an ISP? The Image Signal Processor (ISP) processes raw pixel data into great-looking images for display, encoding and further processing by computer vision algorithms 3

4 Automotive needs: viewability and reliability 4

5 Automotive needs: viewability and reliability 5

6 Automotive needs: viewability and reliability Pedestrian protection system Driver drowsiness detection Night vision Low latency Reliability Resistant to random and systematic faults Imagery feeds into computer vision engine Viewability Dynamic range Low-light and low-noise performance Imagery close to human eyes and at times beyond 6

7 Automotive ADAS growth Camera volume rising very rapidly, around 20% CAGR By 2023 (expected average): Mid-range (high volume) cars: three cameras Luxury sedans: <ten cameras 7

8 Advanced vision requires centralised processing ISP per camera sensor Less flexible Higher BOM costs Centralised sensor fusion SoC Centralised processing Flexible architecture Sensor fusion SoC 8

9 And there are standards!! A number of functional safety standards exist: ISO Road vehicles IEC Electrical, electronic programmable systems DO 254 Electronics that fly e.g. in airplanes, helicopters 9

10 ISO road vehicles functional safety Relates to electrical and electronic systems used in automobiles Qualitatively assesses risk of hazardous operational situations Aims to avoid or control systematic failures and detect or control random hardware failures, or mitigate their effects 10

11 ISO 26262: goals Provides an automotive safety lifecycle and supports tailoring the necessary activities during these lifecycle phases Covers functional safety aspects of the entire development process Provides an automotive-specific risk-based approach for determining risk classes (Automotive Safety Integrity Levels, ASILs) Provides requirements for validation and confirmation measures to ensure a sufficient and acceptable level of safety is being achieved 11

12 High-performance ISP for automotive: ARM Mali -C71 Ultra WDR Multi-camera input Designed for safety Ultra-wide dynamic range 24 stops Every detail captured Simultaneous support for human display and computer vision Virtual ISPs: <4 real-time camera inputs Pleasing and natural for human vision; predictable and reliable for computer vision Every pixel reliable Real-time safety for ADAS applications Enabling system-level ASIL D and SIL3 compliance 300+ fault detection circuits, built-in self-test (BIST), CRC on data paths, every pixel tagged 12

13 Mali-C71 block diagram Image sensor sources Colour/data plane outputs 13

14 Enabling system level ASIL D compliance Random faults Systematic faults Safety features 300+ dedicated fault detection circuits Built in continuous self-test Fault interrupt controller Pixel consistency image plane tagging reliability of every pixel Detection of sensor and hardware faults CRC checks to all data paths including memories and configurations Processes Developed within robust requirements, tracing and validation framework Safety manual Failure modes and effects analysis (FMEA) Development interface report Providing support for system level: SIL 3 / IEC ASIL D / ISO With a standards-agnostic approach 14

15 ARM Mali-C71 Image Signal Processor Designed to enable system-level certification Safety Element out of Context (SEooC) ISP has no direct control authority System integrating ARM s ISP needs to meet the requirements ISO26262 (ASIL D) IEC SIL3 Standard product Integrated into system (SoC) by our customers Specific use cases unknown to ARM Has to detect faults, perform self-tests Has a responsibility to provide timely, accurate and reliable information to the system Required for the system to be safe Road vehicles functional safety This flows down to the components of the system 15

16 Supporting output for human and machine vision Human display Computer vision 16

17 Ultra-wide dynamic range 2^24 2^8 Highlights clipped Mid-tones not revealed 0 2^8 Shadows details lost Preserved highlights As perceived by the human eye Enhanced mid-tones 0 0 Revealed shadows 17

18 Dynamic range management: iridix More than just the world s best local tonemapping engine Precise model of human retina contrast adaption Precisely simulates illumination by white light Basis of Nikon D-Lighting (2005) Shipped in over 2 billion devices iridix lets cameras see like the human eye 18

19 Dynamic range iridix engine: pixel-by-pixel tone mapping Contrast in highlights enhanced Contrast in midtones preserved iridix calculates a unique tone curve for each pixel of each frame Contrast in shadows enhanced 19

20 Management of dynamic range 20

21 Management of dynamic range 21

22 A complete, high-performing solution Performance Software Tuning 1.2 Giga-pixels/sec of processing performance Supports up to 4 real-time camera inputs and 16 camera streams with a single pipeline Control the ISP, sensor, auto-white balance and auto-exposure Roadmap to complete automotive software designed for ASIL compliance Full set of tools provided Ecosystem support for tuning and bringing up specific use-cases and sensors 22

23 Mali-C71: the next step in automotive vision First automotive ISP with ultra-wide dynamic range Supports both human display and computer vision Enables safer, more comfortable driving 23

24 The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited (or its subsidiaries) in the US and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners. Copyright 2017 ARM Limited

Next-generation automotive image processing with ARM Mali-C71

Next-generation automotive image processing with ARM Mali-C71 Next-generation automotive image processing with ARM Mali-C71 Steve Steele Director, Product Marketing Imaging & Vision Group, ARM ARM Tech Forum Taipei July 4th 2017 Pioneers in imaging and vision 2 Automotive

More information

Functional safety for semiconductor IP

Functional safety for semiconductor IP Functional safety for semiconductor IP Lauri Ora Functional Safety Manager, CPU Group NMI ISO 26262 Practitioner s Workshop January 20 th, 2016, Nuneaton Intellectual property supplier s point of view

More information

Automotive In-cabin Sensing Solutions. Nicolas Roux September 19th, 2018

Automotive In-cabin Sensing Solutions. Nicolas Roux September 19th, 2018 Automotive In-cabin Sensing Solutions Nicolas Roux September 19th, 2018 Impact of Drowsiness 2 Drowsiness responsible for 20% to 25% of car crashes in Europe (INVS/AFSA) Beyond Drowsiness Driver Distraction

More information

Enabling Mobile Virtual Reality ARM 助力移动 VR 产业腾飞

Enabling Mobile Virtual Reality ARM 助力移动 VR 产业腾飞 Enabling Mobile Virtual Reality ARM 助力移动 VR 产业腾飞 Nathan Li Ecosystem Manager Mobile Compute Business Line Shenzhen, China May 20, 2016 3 Photograph: Mark Zuckerberg Facebook https://www.facebook.com/photo.php?fbid=10102665120179591&set=pcb.10102665126861201&type=3&theater

More information

Sony Releases the Industry's Highest Resolution Effective Megapixel Stacked CMOS Image Sensor for Automotive Cameras

Sony Releases the Industry's Highest Resolution Effective Megapixel Stacked CMOS Image Sensor for Automotive Cameras 2 International Business Park #05-10 Tower One The Strategy Singapore 609930 Telephone: (65) 6544 8338 Facsimile: (65) 6544 8330 NEWS RELEASE: Immediate Sony Releases the Industry's Highest Resolution

More information

Transforming Industries with Enlighten

Transforming Industries with Enlighten Transforming Industries with Enlighten Alex Shang Senior Business Development Manager ARM Tech Forum 2016 Korea June 28, 2016 2 ARM: The Architecture for the Digital World ARM is about transforming markets

More information

The Denali-MC HDR ISP Backgrounder

The Denali-MC HDR ISP Backgrounder The Denali-MC HDR ISP Backgrounder 2-4 brackets up to 8 EV frame offset Up to 16 EV stops for output HDR LATM (tone map) up to 24 EV Noise reduction due to merging of 10 EV LDR to a single 16 EV HDR up

More information

Image Processing Architectures (and their future requirements)

Image Processing Architectures (and their future requirements) Lecture 17: Image Processing Architectures (and their future requirements) Visual Computing Systems Smart phone processing resources Qualcomm snapdragon Image credit: Qualcomm Apple A7 (iphone 5s) Chipworks

More information

Vision with Precision Webinar Series Augmented & Virtual Reality Aaron Behman, Xilinx Mark Beccue, Tractica. Copyright 2016 Xilinx

Vision with Precision Webinar Series Augmented & Virtual Reality Aaron Behman, Xilinx Mark Beccue, Tractica. Copyright 2016 Xilinx Vision with Precision Webinar Series Augmented & Virtual Reality Aaron Behman, Xilinx Mark Beccue, Tractica Xilinx Vision with Precision Webinar Series Perceiving Environment / Taking Action: AR / VR Monitoring

More information

A Winning Combination

A Winning Combination A Winning Combination Risk factors Statements in this presentation that refer to future plans and expectations are forward-looking statements that involve a number of risks and uncertainties. Words such

More information

Radar and Functional Safety technology for advanced driving assistance

Radar and Functional Safety technology for advanced driving assistance Radar and Functional Safety technology for advanced driving assistance Yves Legrand (Freescale Semiconductor) This presentation will describe advanced development in 77 GHz radar technology, enabling smaller

More information

The Building Blocks of Autonomous Control. Phil Magney, Founder & Principal Advisor July 2016

The Building Blocks of Autonomous Control. Phil Magney, Founder & Principal Advisor July 2016 The Building Blocks of Autonomous Control Phil Magney, Founder & Principal Advisor July 2016 Agenda VSI Remarks The Building Blocks of Autonomy Elements of Autonomous Control Motion Control (path, maneuver,

More information

Image Processing Architectures (and their future requirements)

Image Processing Architectures (and their future requirements) Lecture 16: Image Processing Architectures (and their future requirements) Visual Computing Systems Smart phone processing resources Example SoC: Qualcomm Snapdragon Image credit: Qualcomm Apple A7 (iphone

More information

Combining ROS and AI for fail-operational automated driving

Combining ROS and AI for fail-operational automated driving Combining ROS and AI for fail-operational automated driving Prof. Dr. Daniel Watzenig Virtual Vehicle Research Center, Graz, Austria and Institute of Automation and Control at Graz University of Technology

More information

FLEA 3 GigE Vision FLIR IMAGING PERFORMANCE SPECIFICATION. Version 1.1 Revised 1/27/2017

FLEA 3 GigE Vision FLIR IMAGING PERFORMANCE SPECIFICATION. Version 1.1 Revised 1/27/2017 IMAGING PERFORMANCE SPECIFICATION FLIR FLEA 3 GigE Vision Version 1.1 Revised 1/27/2017 Copyright 2010-2017 Solutions Inc. All rights reserved. FCC Compliance This device complies with Part 15 of the FCC

More information

Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF

Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Konstantin Dmitriev The MathWorks, Inc. Certification and Standards Group 2018 The MathWorks, Inc. 1 Agenda Use of simulation

More information

FLASH LiDAR KEY BENEFITS

FLASH LiDAR KEY BENEFITS In 2013, 1.2 million people died in vehicle accidents. That is one death every 25 seconds. Some of these lives could have been saved with vehicles that have a better understanding of the world around them

More information

SEE MORE, SMARTER. We design the most advanced vision systems to bring humanity to any device.

SEE MORE, SMARTER. We design the most advanced vision systems to bring humanity to any device. SEE MORE, SMARTER OUR VISION Immervision Enables Intelligent Vision OUR MISSION We design the most advanced vision systems to bring humanity to any device. ABOUT US Immervision enables intelligent vision

More information

EM Simulation of Automotive Radar Mounted in Vehicle Bumper

EM Simulation of Automotive Radar Mounted in Vehicle Bumper EM Simulation of Automotive Radar Mounted in Vehicle Bumper Abstract Trends in automotive safety are pushing radar systems to higher levels of accuracy and reliable target identification for blind spot

More information

Digital Engines for Smart and Connected Cars By Bob O Donnell, TECHnalysis Research Chief Analyst

Digital Engines for Smart and Connected Cars By Bob O Donnell, TECHnalysis Research Chief Analyst WHITE PAPER On Behalf of Digital Engines for Smart and Connected Cars By Bob O Donnell, TECHnalysis Research Chief Analyst SUMMARY Interest in advanced car electronics is extremely high, but there is a

More information

The IQ3 100MP Trichromatic. The science of color

The IQ3 100MP Trichromatic. The science of color The IQ3 100MP Trichromatic The science of color Our color philosophy Phase One s approach Phase One s knowledge of sensors comes from what we ve learned by supporting more than 400 different types of camera

More information

Movie 3. Basic Camera Raw workflow

Movie 3. Basic Camera Raw workflow Movie 3 Basic Camera Raw workflow 1 The tone adjustment controls The tone adjustment controls allow you to make adjustments to the highlight and shadow clipping points as well as the overall tone balance

More information

IHV means Independent Hardware Vendor. Example is Qualcomm Technologies Inc. that makes Snapdragon processors. OEM means Original Equipment

IHV means Independent Hardware Vendor. Example is Qualcomm Technologies Inc. that makes Snapdragon processors. OEM means Original Equipment 1 2 IHV means Independent Hardware Vendor. Example is Qualcomm Technologies Inc. that makes Snapdragon processors. OEM means Original Equipment Manufacturer. Examples are smartphone manufacturers. Tuning

More information

Table 1: Example Implementation Statistics for Xilinx FPGAs. Fmax (MHz) LUT FF IOB RAMB36 RAMB18 DSP48

Table 1: Example Implementation Statistics for Xilinx FPGAs. Fmax (MHz) LUT FF IOB RAMB36 RAMB18 DSP48 logislvds_rx Camera Sub-LVDS Receiver August 23 rd, 2017 Data Sheet Version: v1.1 Xylon d.o.o. Core Facts Fallerovo setaliste 22 10000 Zagreb, Croatia Phone: +385 1 368 00 26 Fax: +385 1 365 51 67 E-mail:

More information

A NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June Xavier Lagorce Head of Computer Vision & Systems

A NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June Xavier Lagorce Head of Computer Vision & Systems A NEW NEUROMORPHIC STRATEGY FOR THE FUTURE OF VISION FOR MACHINES June 2017 Xavier Lagorce Head of Computer Vision & Systems Imagine meeting the promise of Restoring sight to the blind Accident-free autonomous

More information

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017

23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS. Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 23270: AUGMENTED REALITY FOR NAVIGATION AND INFORMATIONAL ADAS Sergii Bykov Technical Lead Machine Learning 12 Oct 2017 Product Vision Company Introduction Apostera GmbH with headquarter in Munich, was

More information

Take Mobile Imaging to the Next Level

Take Mobile Imaging to the Next Level Take Mobile Imaging to the Next Level Solutions for mobile camera performance and features that compete with DSC/DSLR Who we are Leader in mobile imaging and computational photography. Developer of cutting-edge

More information

BLACKFLY USB3 Vision FLIR IMAGING PERFORMANCE SPECIFICATION. Version 5.1 Revised 1/26/2017

BLACKFLY USB3 Vision FLIR IMAGING PERFORMANCE SPECIFICATION. Version 5.1 Revised 1/26/2017 IMAGING PERFORMANCE SPECIFICATION FLIR BLACKFLY USB3 Vision Version 5.1 Revised 1/26/2017 Copyright 2013-2017 Solutions Inc. All rights reserved. FCC Compliance This device complies with Part 15 of the

More information

VSI Labs The Build Up of Automated Driving

VSI Labs The Build Up of Automated Driving VSI Labs The Build Up of Automated Driving October - 2017 Agenda Opening Remarks Introduction and Background Customers Solutions VSI Labs Some Industry Content Opening Remarks Automated vehicle systems

More information

Physics Based Sensor simulation

Physics Based Sensor simulation Physics Based Sensor simulation Jordan Gorrochotegui - Product Manager Software and Services Mike Phillips Software Engineer Restricted Siemens AG 2017 Realize innovation. Siemens offers solutions across

More information

Evaluating Functional Safety in Automotive Image Sensors

Evaluating Functional Safety in Automotive Image Sensors TND6233/D Rev. 1, MAY 2018 Evaluating Functional Safety in Automotive Image Sensors Semiconductor Components Industries, LLC, 2017 May, 2018 Rev. 1 1 Publication Order Number: TND6233/D Evaluating Functional

More information

Virtual Testing of Autonomous Vehicles

Virtual Testing of Autonomous Vehicles Virtual Testing of Autonomous Vehicles Mike Dempsey Claytex Services Limited Software, Consultancy, Training Based in Leamington Spa, UK Office in Cape Town, South Africa Experts in Systems Engineering,

More information

Improvements in Functional Safety of Automotive IP through ISO 26262:2018 Part 11

Improvements in Functional Safety of Automotive IP through ISO 26262:2018 Part 11 Young, A., & Walker, A. (2017). Improvements in Functional Safety of Automotive IP Through ISO 26262:2018 Part 11. In J. Stolfa, S. Stolfa, R. V. O Connor, & R. Messnarz (Eds.), Systems, Software and Services

More information

[Overview of the Consolidated Financial Results]

[Overview of the Consolidated Financial Results] 0 1 [Overview of the Consolidated Financial Results] 1. Consolidated revenue totaled 5,108.3 billion yen, increased by 581.1 billion yen (+12.8%) from the previous year. 2. Consolidated operating profit

More information

Software ISP Application Note

Software ISP Application Note NXP Semiconductors Document Number: AN12060 Application Notes Rev. 0, 10/2017 Software ISP Application Note 1. Introduction This document describes the software-based image signal processing application(sw-isp)

More information

CONVERTING AND EDITING RAW IMAGES

CONVERTING AND EDITING RAW IMAGES CONVERTING AND EDITING RAW IMAGES RAW V JPEG As we have found out, jpeg files are processed in the camera and much of the data is lost. Raw files are not and so all of the data is preserved. RAW FILE FORMATS:

More information

Converting and editing raw images

Converting and editing raw images Converting and editing raw images Raw v jpeg As we have found out, jpeg files are processed in the camera and much of the data is lost. Raw files are not. Raw file formats: General term for a variety of

More information

Faurecia : Smart Life on board An innovative company

Faurecia : Smart Life on board An innovative company Faurecia : Smart Life on board An innovative company Anna Rossi December 6,th, 2017 Les interactions confort et santé dans l habitacle automobile Faurecia is a leading equipment manufacturer 35 countries

More information

HDR with Smart Objects

HDR with Smart Objects HDR with Smart Objects March 2006 HDR with Smart Objects The article could be easily called Shoot once, Use it twice, because this article explains how to use a single RAW file to get most data out of

More information

Autonomous Automation: How do we get to a Million Miles of testing?

Autonomous Automation: How do we get to a Million Miles of testing? Autonomous Automation: How do we get to a Million Miles of testing? Jace Allen Business Development Manager Simulation, Test, and EEDM dspace Inc. 50131 Pontiac Trail Wixom, MI 48393 USA 1 Agenda 1. Intro

More information

Dealing with the Complexities of Camera ISP Tuning

Dealing with the Complexities of Camera ISP Tuning Dealing with the Complexities of Camera ISP Tuning Clément Viard, Sr Director, R&D Frédéric Guichard, CTO, co-founder cviard@dxo.com 1 Dealing with the Complexities of Camera ISP Tuning > Basic camera

More information

Striker II. Performance without compromise

Striker II. Performance without compromise Striker II Performance without compromise Introducing Striker II Fully digital colour helmet-mounted display system with integrated night vision camera. With decades of combat-proven experience, the new

More information

EF-45 Iris Recognition System

EF-45 Iris Recognition System EF-45 Iris Recognition System Innovative face positioning feedback provides outstanding subject ease-of-use at an extended capture range of 35 to 45 cm Product Description The EF-45 is advanced next generation

More information

About 3D perception. Experience & Innovation: Powered by People

About 3D perception. Experience & Innovation: Powered by People About 3D perception 3D perception designs and supplies seamless immersive visual display solutions and technologies for simulation and visualization applications. 3D perception s Northstar ecosystem of

More information

High dynamic range imaging and tonemapping

High dynamic range imaging and tonemapping High dynamic range imaging and tonemapping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 12 Course announcements Homework 3 is out. - Due

More information

Dr George Gillespie. CEO HORIBA MIRA Ltd. Sponsors

Dr George Gillespie. CEO HORIBA MIRA Ltd. Sponsors Dr George Gillespie CEO HORIBA MIRA Ltd Sponsors Intelligent Connected Vehicle Roadmap George Gillespie September 2017 www.automotivecouncil.co.uk ICV Roadmap built on Travellers Needs study plus extensive

More information

32 Float v3 Quick Start Guide. AUTHORED BY ANTHONY HERNANDEZ (415)

32 Float v3 Quick Start Guide. AUTHORED BY ANTHONY HERNANDEZ (415) 32 Float v3 Quick Start Guide 32 Float v3 Trademark/Copyright Information Copyright 2013 by United Color Technologies, LLC. All rights reserved. Unified Color Technologies, BeyondRGB, and HDR Expose are

More information

High Performance Imaging Using Large Camera Arrays

High Performance Imaging Using Large Camera Arrays High Performance Imaging Using Large Camera Arrays Presentation of the original paper by Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz,

More information

It should also be noted that with modern cameras users can choose for either

It should also be noted that with modern cameras users can choose for either White paper about color correction More drama Many application fields like digital printing industry or the human medicine require a natural display of colors. To illustrate the importance of color fidelity,

More information

Camera Image Processing Pipeline: Part II

Camera Image Processing Pipeline: Part II Lecture 14: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements

More information

An Introduction to Histograms in Photography

An Introduction to Histograms in Photography An Introduction to Histograms in Photography Histograms are a graphical representation of all the pixels that make up an image, and are plotted by 'Luminance' or brightness. Every pixel, regardless of

More information

Mission Space. Value-based use of augmented reality in support of critical contextual environments

Mission Space. Value-based use of augmented reality in support of critical contextual environments Mission Space Value-based use of augmented reality in support of critical contextual environments Vicki A. Barbur Ph.D. Senior Vice President and Chief Technical Officer Concurrent Technologies Corporation

More information

This document is a preview generated by EVS

This document is a preview generated by EVS TECHNICAL REPORT ISO/TR 19263-1 First edition 2017-03 Photography Archiving systems Part 1: Best practices for digital image capture of cultural heritage material Photographie Systèmes d archivage Partie

More information

ADAS Development using Advanced Real-Time All-in-the-Loop Simulators. Roberto De Vecchi VI-grade Enrico Busto - AddFor

ADAS Development using Advanced Real-Time All-in-the-Loop Simulators. Roberto De Vecchi VI-grade Enrico Busto - AddFor ADAS Development using Advanced Real-Time All-in-the-Loop Simulators Roberto De Vecchi VI-grade Enrico Busto - AddFor The Scenario The introduction of ADAS and AV has created completely new challenges

More information

Education and Training

Education and Training The magazine dedicated exclusively to the technology of evidence collection, processing, and preservation Volume 4, Number 2 March-April 2006 Education and Training SOME OF THE TOPICS IN THIS ISSUE Learning

More information

The GRAIL project: Galileo Localisation for the European Train Control System

The GRAIL project: Galileo Localisation for the European Train Control System The GRAIL project: Galileo Localisation for the European Train Control System CERGAL 2008 Braunschweig, 3. April 2008 M. Meyer zu Hörste, K. Lemmer, A. Urech and M. Jose Galileo 6 th Framework Programme

More information

A Roadmap for Connected & Autonomous Vehicles. David Skipp Ford Motor Company

A Roadmap for Connected & Autonomous Vehicles. David Skipp Ford Motor Company A Roadmap for Connected & Autonomous Vehicles David Skipp Ford Motor Company ! Why does an Autonomous Vehicle need a roadmap? Where might the roadmap take us? What should we focus on next? Why does an

More information

TECHNOLOGY DEVELOPMENT AREAS IN AAWA

TECHNOLOGY DEVELOPMENT AREAS IN AAWA TECHNOLOGY DEVELOPMENT AREAS IN AAWA Technologies for realizing remote and autonomous ships exist. The task is to find the optimum way to combine them reliably and cost effecticely. Ship state definition

More information

OVERVIEW WHERE TO FIND THE SETTINGS. CION Technical Notes #1 Exposure Index, Gamma and In-Camera Color Correction Comparison

OVERVIEW WHERE TO FIND THE SETTINGS. CION Technical Notes #1 Exposure Index, Gamma and In-Camera Color Correction Comparison CION Technical Notes #1 Exposure Index, Gamma and In-Camera Color Correction Comparison OVERVIEW The CION 4K/UltraHD and 2K/HD production camera from AJA offers vivid detail and vibrant colors at any resolution.

More information

Adaptive Vision Leveraging Digital Retinas: Extracting Meaningful Segments

Adaptive Vision Leveraging Digital Retinas: Extracting Meaningful Segments Adaptive Vision Leveraging Digital Retinas: Extracting Meaningful Segments Nicolas Burrus and Thierry M Bernard September 20, 2006 Nicolas Burrus Adaptive Vision Leveraging

More information

PHOTO 11: INTRODUCTION TO DIGITAL IMAGING

PHOTO 11: INTRODUCTION TO DIGITAL IMAGING 1 PHOTO 11: INTRODUCTION TO DIGITAL IMAGING Instructor: Sue Leith, sleith@csus.edu EXAM REVIEW Computer Components: Hardware - the term used to describe computer equipment -- hard drives, printers, scanners.

More information

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor ALMALENCE SUPER SENSOR A software component with an effect of increasing the pixel size and number of pixels in the sensor MOBILE CAMERA: SMALL SENSOR AND TINY LENS Insufficient resolution, low light performance,

More information

Responsible Data Use Assessment for Public Realm Sensing Pilot with Numina. Overview of the Pilot:

Responsible Data Use Assessment for Public Realm Sensing Pilot with Numina. Overview of the Pilot: Responsible Data Use Assessment for Public Realm Sensing Pilot with Numina Overview of the Pilot: Sidewalk Labs vision for people-centred mobility - safer and more efficient public spaces - requires a

More information

A Matter of Trust: white paper. How Smart Design Can Accelerate Automated Vehicle Adoption. Authors Jack Weast Matt Yurdana Adam Jordan

A Matter of Trust: white paper. How Smart Design Can Accelerate Automated Vehicle Adoption. Authors Jack Weast Matt Yurdana Adam Jordan white paper A Matter of Trust: How Smart Design Can Accelerate Automated Vehicle Adoption Authors Jack Weast Matt Yurdana Adam Jordan Executive Summary To Win Consumers, First Earn Trust It s an exciting

More information

Photomatix Light 1.0 User Manual

Photomatix Light 1.0 User Manual Photomatix Light 1.0 User Manual Table of Contents Introduction... iii Section 1: HDR...1 1.1 Taking Photos for HDR...2 1.1.1 Setting Up Your Camera...2 1.1.2 Taking the Photos...3 Section 2: Using Photomatix

More information

Camera Image Processing Pipeline: Part II

Camera Image Processing Pipeline: Part II Lecture 13: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements

More information

Visualization in automotive product development workflow

Visualization in automotive product development workflow Visualization in automotive product development workflow Image courtesy of Lean Design GmbH Contents Common challenges...1 The value of visualization...2 Conceptual design...2 Detailed design...3 Technical

More information

Volkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System

Volkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System Volkswagen Group: Leveraging VIRES VTD to Design a Cooperative Driver Assistance System By Dr. Kai Franke, Development Online Driver Assistance Systems, Volkswagen AG 10 Engineering Reality Magazine A

More information

Camera Requirements For Precision Agriculture

Camera Requirements For Precision Agriculture Camera Requirements For Precision Agriculture Radiometric analysis such as NDVI requires careful acquisition and handling of the imagery to provide reliable values. In this guide, we explain how Pix4Dmapper

More information

William Milam Ford Motor Co

William Milam Ford Motor Co Sharing technology for a stronger America Verification Challenges in Automotive Embedded Systems William Milam Ford Motor Co Chair USCAR CPS Task Force 10/20/2011 What is USCAR? The United States Council

More information

PRESS INFORMATION. Nikon Introduces Next Generation Image-Editing Software. Capture NX2: more powerful and easier to use

PRESS INFORMATION. Nikon Introduces Next Generation Image-Editing Software. Capture NX2: more powerful and easier to use Nikon Introduces Next Generation Image-Editing Software Capture NX2: more powerful and easier to use Amsterdam, the Netherlands, 03 June 2008 Nikon Europe is pleased to announce the introduction of its

More information

Deliverable D1.6 Initial System Specifications Executive Summary

Deliverable D1.6 Initial System Specifications Executive Summary Deliverable D1.6 Initial System Specifications Executive Summary Version 1.0 Dissemination Project Coordination RE Ford Research and Advanced Engineering Europe Due Date 31.10.2010 Version Date 09.02.2011

More information

Industrial Keynotes. 06/09/2018 Juan-Les-Pins

Industrial Keynotes. 06/09/2018 Juan-Les-Pins Industrial Keynotes 1 06/09/2018 Juan-Les-Pins Agenda 1. The End of Driving Simulation? 2. Autonomous Vehicles: the new UI 3. Augmented Realities 4. Choose your factions 5. No genuine AI without flawless

More information

FAIL OPERATIONAL E/E SYSTEM CONCEPT FOR FUTURE APPLICATION IN ADAS AND AUTONOMOUS DRIVING

FAIL OPERATIONAL E/E SYSTEM CONCEPT FOR FUTURE APPLICATION IN ADAS AND AUTONOMOUS DRIVING FAIL OPERATIONAL E/E SYSTEM CONCEPT FOR FUTURE APPLICATION IN ADAS AND AUTONOMOUS DRIVING Fail Safe Fail Operational Fault Tolerance ISO 26262 Hermann Kränzle, TÜV NORD Systems OUR FUNCTIONAL SAFETY CERTIFIED

More information

VGA CMOS Image Sensor BF3905CS

VGA CMOS Image Sensor BF3905CS VGA CMOS Image Sensor 1. General Description The BF3905 is a highly integrated VGA camera chip which includes CMOS image sensor (CIS), image signal processing function (ISP) and MIPI CSI-2(Camera Serial

More information

Neural Networks The New Moore s Law

Neural Networks The New Moore s Law Neural Networks The New Moore s Law Chris Rowen, PhD, FIEEE CEO Cognite Ventures December 216 Outline Moore s Law Revisited: Efficiency Drives Productivity Embedded Neural Network Product Segments Efficiency

More information

Development of a 24 GHz Band Peripheral Monitoring Radar

Development of a 24 GHz Band Peripheral Monitoring Radar Special Issue OneF Automotive Technology Development of a 24 GHz Band Peripheral Monitoring Radar Yasushi Aoyagi * In recent years, the safety technology of automobiles has evolved into the collision avoidance

More information

Retina 400 THE SIMPLE AND FLEXIBLE SOLUTION FOR HIGH DEFINITION RETINAL IMAGERY NON-MYDRIATIC RETINAL CAMERA C/D AUTO 60 H X 45 V LED. 2,2 mm.

Retina 400 THE SIMPLE AND FLEXIBLE SOLUTION FOR HIGH DEFINITION RETINAL IMAGERY NON-MYDRIATIC RETINAL CAMERA C/D AUTO 60 H X 45 V LED. 2,2 mm. Retina 400 THE SIMPLE AND FLEXIBLE SOLUTION FOR HIGH DEFINITION RETINAL IMAGERY Retina 400 NON-MYDRIATIC RETINAL CAMERA 60 H X 45 V 2,2 mm LED C/D AUTO Auto Cup-to-disc 5 MP photo THE SIMPLE AND FLEXIBLE

More information

Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed

Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed AUTOMOTIVE Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed Yoshiaki HAYASHI*, Izumi MEMEZAWA, Takuji KANTOU, Shingo OHASHI, and Koichi TAKAYAMA ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

More information

HIGH DYNAMIC RANGE VERSUS STANDARD DYNAMIC RANGE COMPRESSION EFFICIENCY

HIGH DYNAMIC RANGE VERSUS STANDARD DYNAMIC RANGE COMPRESSION EFFICIENCY HIGH DYNAMIC RANGE VERSUS STANDARD DYNAMIC RANGE COMPRESSION EFFICIENCY Ronan Boitard Mahsa T. Pourazad Panos Nasiopoulos University of British Columbia, Vancouver, Canada TELUS Communications Inc., Vancouver,

More information

White paper on CAR28T millimeter wave radar

White paper on CAR28T millimeter wave radar White paper on CAR28T millimeter wave radar Hunan Nanoradar Science and Technology Co., Ltd. Version history Date Version Version description 2017-07-13 1.0 the 1st version of white paper on CAR28T Contents

More information

Advanced Near-Realistic 3D Lighting: Capturing, Creating, and Using Image-Based Lighting

Advanced Near-Realistic 3D Lighting: Capturing, Creating, and Using Image-Based Lighting Advanced Near-Realistic 3D Lighting: Capturing, Creating, and Using Image-Based Lighting Christopher M Murray Autodesk Media & Entertainment DG4325 Intended for Autodesk 3ds Max 2012 and Autodesk Showcase

More information

Photoshop Elements for Genealogists Part 1

Photoshop Elements for Genealogists Part 1 Photoshop Elements for Genealogists Part 1 By Barry J. Ewell Topics Covered Photoshop Elements Workspace Exploring the Tools Quick Fix Preview Photoshop Elements Workspace Workspace File Edit Image Enhance

More information

Photographic Exposure Colin Legg

Photographic Exposure Colin Legg Why does Auto sometimes get it wrong? Photographic Exposure Colin Legg Correct exposure is subjective judgement Predominantly white subject camera will tend to under-expose Predominantly dark subject camera

More information

Global Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ( )

Global Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ( ) Industry Research by Koncept Analytics Global Image Sensor Market with Focus on Automotive CMOS Sensors: Industry Analysis & Outlook ----------------------------------------- (2017-2021) October 2017 Global

More information

The Xbox One System on a Chip and Kinect Sensor

The Xbox One System on a Chip and Kinect Sensor The Xbox One System on a Chip and Kinect Sensor John Sell, Patrick O Connor, Microsoft Corporation 1 Abstract The System on a Chip at the heart of the Xbox One entertainment console is one of the largest

More information

This histogram represents the +½ stop exposure from the bracket illustrated on the first page.

This histogram represents the +½ stop exposure from the bracket illustrated on the first page. Washtenaw Community College Digital M edia Arts Photo http://courses.wccnet.edu/~donw Don W erthm ann GM300BB 973-3586 donw@wccnet.edu Exposure Strategies for Digital Capture Regardless of the media choice

More information

Electronic Costing & Technology Experts

Electronic Costing & Technology Experts Electronic Costing & Technology Experts 21 rue la Nouë Bras de Fer 44200 Nantes France Phone : +33 (0) 240 180 916 email : info@systemplus.fr www.systemplus.fr October 2016 - Version 1 - written by Romain

More information

76-81GHz MMIC transceiver (4 RX / 3 TX) for automotive radar applications. Table 1. Device summary. Order code Package Packing

76-81GHz MMIC transceiver (4 RX / 3 TX) for automotive radar applications. Table 1. Device summary. Order code Package Packing STRADA770 76-81GHz MMIC transceiver (4 RX / 3 TX) for automotive radar applications Data brief ESD protected Scalable architecture (master/slave configuration) BIST structures Bicmos9MW, 0.13-µm SiGe:C

More information

Use of Photogrammetry for Sensor Location and Orientation

Use of Photogrammetry for Sensor Location and Orientation Use of Photogrammetry for Sensor Location and Orientation Michael J. Dillon and Richard W. Bono, The Modal Shop, Inc., Cincinnati, Ohio David L. Brown, University of Cincinnati, Cincinnati, Ohio In this

More information

Camera Requirements For Precision Agriculture

Camera Requirements For Precision Agriculture Camera Requirements For Precision Agriculture Radiometric analysis such as NDVI requires careful acquisition and handling of the imagery to provide reliable values. In this guide, we explain how Pix4Dmapper

More information

DEEP LEARNING A NEW COMPUTING MODEL. Sundara R Nagalingam Head Deep Learning Practice

DEEP LEARNING A NEW COMPUTING MODEL. Sundara R Nagalingam Head Deep Learning Practice DEEP LEARNING A NEW COMPUTING MODEL Sundara R Nagalingam Head Deep Learning Practice snagalingam@nvidia.com THE ERA OF AI AI CLOUD MOBILE PC 2 DEEP LEARNING Raw data Low-level features Mid-level features

More information

Teton Photography Group

Teton Photography Group Overview general post-processing (editing) workflow for serious photographers Focus on processes more than software Examples using Adobe Lightroom and Photoshop Teton Photography Group January 2016 Emphasis

More information

CORRECTED VISION. Here be underscores THE ROLE OF CAMERA AND LENS PARAMETERS IN REAL-WORLD MEASUREMENT

CORRECTED VISION. Here be underscores THE ROLE OF CAMERA AND LENS PARAMETERS IN REAL-WORLD MEASUREMENT Here be underscores CORRECTED VISION THE ROLE OF CAMERA AND LENS PARAMETERS IN REAL-WORLD MEASUREMENT JOSEPH HOWSE, NUMMIST MEDIA CIG-GANS WORKSHOP: 3-D COLLECTION, ANALYSIS AND VISUALIZATION LAWRENCETOWN,

More information

Multi-sensor Panoramic Network Camera

Multi-sensor Panoramic Network Camera Multi-sensor Panoramic Network Camera White Paper by Dahua Technology Release 1.0 Table of contents 1 Preface... 2 2 Overview... 3 3 Technical Background... 3 4 Key Technologies... 5 4.1 Feature Points

More information

Transportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 3/10/2009 1

Transportation Informatics Group, ALPEN-ADRIA University of Klagenfurt. Transportation Informatics Group University of Klagenfurt 3/10/2009 1 Machine Vision Transportation Informatics Group University of Klagenfurt Alireza Fasih, 2009 3/10/2009 1 Address: L4.2.02, Lakeside Park, Haus B04, Ebene 2, Klagenfurt-Austria Index Driver Fatigue Detection

More information

Basic Camera Craft. Roy Killen, GMAPS, EFIAP, MPSA. (c) 2016 Roy Killen Basic Camera Craft, Page 1

Basic Camera Craft. Roy Killen, GMAPS, EFIAP, MPSA. (c) 2016 Roy Killen Basic Camera Craft, Page 1 Basic Camera Craft Roy Killen, GMAPS, EFIAP, MPSA (c) 2016 Roy Killen Basic Camera Craft, Page 1 Basic Camera Craft Whether you use a camera that cost $100 or one that cost $10,000, you need to be able

More information

AUTOCOM VEHICLE INSPECTION SERVICES

AUTOCOM VEHICLE INSPECTION SERVICES AUTOCOM VEHICLE INSPECTION SERVICES Our business area Vehicle Inspection Services, was developed in order to offer our knowledge and services to join forces with you, our customer, and conceive the vehicle

More information

PHOTOGRAPHY: MINI-SYMPOSIUM

PHOTOGRAPHY: MINI-SYMPOSIUM PHOTOGRAPHY: MINI-SYMPOSIUM In Adobe Lightroom Loren Nelson www.naturalphotographyjackson.com Welcome and introductions Overview of general problems in photography Avoiding image blahs Focus / sharpness

More information

LEARNING FROM THE AVIATION INDUSTRY

LEARNING FROM THE AVIATION INDUSTRY DEVELOPMENT Power Electronics 26 AUTHORS Dipl.-Ing. (FH) Martin Heininger is Owner of Heicon, a Consultant Company in Schwendi near Ulm (Germany). Dipl.-Ing. (FH) Horst Hammerer is Managing Director of

More information