The Denali-MC HDR ISP Backgrounder

Transcription

1 The Denali-MC HDR ISP Backgrounder 2-4 brackets up to 8 EV frame offset Up to 16 EV stops for output HDR LATM (tone map) up to 24 EV Noise reduction due to merging of 10 EV LDR to a single 16 EV HDR up to 64x LATM (locally adaptive) reduces system noise by 8x Denali-MC HDR ISP Overview The Denali-MC HDR ISP is very flexible with the capability of customization to support up to 29 different CMOS sensors, 12 different HDR modes and is easily ported to the most widely used logic platforms. The Denali-MC HDR ISP demo platform utilizes a Xilinx Zynq 7045 FPGA and a Sony Starvis IMX290LQR CMOS sensor with low illumination and near IR, providing 24/7 video capture capabilities. The platform is ideally suited for surveillance, intelligent traffic systems, monocular automotive ADAS, commercial drones and machine vision applications. Denali-MC HDR ISP-Specific Features Advanced motion compensation algorithms virtually eliminate HDR merge artifacts and transition noise Tone Mapping Denali-MC is available as a complete camera-ready ISP. Pinnacle Imaging's Merge and Tone Mapping HDR IP cores can also be easily integrated into third-party ISPs making it ideal for developers and engineers seeking a stand-alone HDR solution for their existing imaging pipeline. The merge block accepts raw Bayer data as input and provides tone mapped Bayer data back to the ISP. Denali-MC HDR ISP Evaluation Kit Specs Sony Starvis IMX290LQR low illumination, near IR sensor Xilinx Zynq 7045 FPGA using 45% of resources Maximum output 1080p/60fps 16-bit processing Demosaic 3rd Party ISP Yuv Merge RGB Sensor Interface r-g-g-b Sensor r-g-g-b Denali-MC HDR Merge and Tone Mapping IP Cores Output Proprietary Locally Adaptive Tone Mapping technology preserves color fidelity through the entire tonal range with no halo artifacts or color shifts Automatic EV bracketing Automatic or manual contrast adaptation for global or local video correction React concurrent still frame and video capture feature, non-destructively extracts four source LDR Bayer images, merged Bayer HDR, tone mapped Bayer or HDMI RGB still frames without interrupting video Ability to capture separate HDR and tone mapped output video streams concurrently for ADAS Two or four multi-frame merge or conversion gain recombination HDR, low illumination and near IR capabilities with Sony IMX290 sensor enable 24/7 video capture

2 Denali-MC Standard ISP Features Automatic and manual exposure (including highlights/ shadows auto tracking modes) Automatic and manual white balance Auto gain Digital black level and gain pre-compensation for RGB Black level and gain compensation Veiling glare correction Local and global contrast adjustment (HDR) Bad pixel correction Automatic and manual Region of Interest (ROI) selection Signal to noise measurements, histogram calculation De-Mosaicing 50/60 Hz ambient artificial lighting sync 180 display rotation Denali-MC HDR ISP Applications For Surveillance The Denali HDR ISP platform is primarily a HDR surveillance platform, so camera placement is not constrained by the dynamic range of any scene. The platform has the capability of capturing high quality video in every scene regardless if it is a combination of deep shadow and bright open sunlight or a dark home or business into open sunlight. Denali-MC s image sensor is one of the best low illumination sensors available, the Sony Starvis IMX290LQR. Pinnacle will provide two choices of HDR modes, currently frameset output and adding DOL soon. Both modes are dependent on the required application and are used with Pinnacle s LATM.

3 Pinnacle Imaging Systems - Denali-MC Backgrounder The IMX290LQR also provides near IR when used with IR LED. React! - is powerful feature included within Pinnacle Imaging System s end-to-end HDR surveillance ISP platform that empowers home owners and SMB managers to initiate a tactical law enforcement response to a potential burglary or intrusion attempt, with a supporting mobile app. Intelligent traffic systems, smart traffic lights and smart cities require camera systems that capture in inclement weather, dusk, dawn, low illumination and extremely high contrast, for example scenes where the camera is pointed, out of necessity straight into the sun before dusk. These camera systems also require high dynamic range capture capabilities for recognition of various vehicles, pedestrians or animals. For Intelligent Traffic Systems Unfortunately, most installations do not meet all these requirements. The Denali-MC HDR ISP provides all these capabilities and more. Pinnacle s React! Feature again can provide unique capture capabilities with concurrent HDR, uninterrupted video and HDR still capture. React! provides the highest possible package of visual evidence and can be triggered by an imminent vehicle collision event, traffic density or pedestrian accident. The Denali-MC HDR ISP as an automotive imaging or ADAS solution provides forward facing monocular, rear facing monocular or interior driver monitoring capabilities, utilizing unique flexibility within the ISP, the industry s best motion compensation algorithms, highest dynamic range and state of the art locally adaptive tone mapping. Denali-MC splits the captured video into two streams: the first sends uninterrupted HDR video data to an ADAS edge or centralized processor for analytics. For Automotive ADAS

4 Pinnacle Imaging Systems - Denali-MC Backgrounder The second stream simultaneously sends video through the proprietary locally adaptive tone mapping (LATM) block, outputting to the center console display, preserving 100% of the original color data, enhancing interior viewing. As a machine vision ISP, Denali-MC HDR ISP can operate in lighting constrained environments or where beyond the throw of artificial light, in any high contrast or low illumination areas. The React! feature eliminates the requirement of special processing frame grabber companion boards or logic and is provided on the host FPGA. It captures concurrent HDR video and HDR still and can be pre-programmed for resolution and interval of capture. For Machine Vision

5 Pinnacle Imaging Systems Customer Engagement Testing a Denali-MC Eval Kit There are three methods for receiving and testing a Denali-MC HDR ISP evaluation platform; either from an authorized Pinnacle Imaging Systems partner, directly from Pinnacle Imaging Systems or through an authorized Pinnacle Imaging Systems reseller. There is a evaluation period for Denali-MC HDR ISP in all three circumstances. At the end of this period, all functionality of the ISP will be disabled. At this juncture, If you wish to license the Denali-MC HDR ISP at the end of the period for further camera development, a fee is charged for further usage of Pinnacle s Eval Platform. Denali-MC HDR ISP Eval Kit ZC706/IMX Units Units Post 45-day Development Fee $500 per $400 per Partner Program Evaluation During the evaluation period of Denali-MC, Pinnacle technical representatives will be available for any assistance you may need with interface or any other technical questions Monday through Friday, 9:00 AM to 5:00 PM Pacific Time. Evaluation Period There is a 45-day evaluation period for Denali-MC HDR ISP ZC706/IMX290 Eval Platform. At the end of this 45-day period, all functionality of the ISP will be automatically disabled. If you wish to license the Denali-MC ISP at the end of the 45 day period, the camera developer should contact a Pinnacle Imaging Systems directly. A Pinnacle sales representative will discuss your options for licensing. Volume licensing the Denali-MC for your project will either be based on: A Per Unit Plan: Unit volume and expected MSRP of an individual camera program, extending to end of life of camera program sales, renegotiable at designated intervals An Unlimited Plan: A once per year unlimited license which covers any and all camera programs and is renewable on a yearly basis Pinnacle Imaging Systems Customer Support Pinnacle Imaging Systems realizes the need to elevate customer support to the highest possible level to assist with the evaluation period through end of life of the product, and can provide extensive early interaction that is necessary with custom product development. To better assist our potential and existing customers, Pinnacle provides numerous support mechanisms, including: A dedicated, secure customer portal via our web site at: This secure portal is a repository for all proprietary and technical documentation for evaluation and further development, both COTS and custom A technical support phone hotline where messages can be left and response is guaranteed within 24 hours except weekends In-person technical training where applicable by either a Pinnacle Imaging Systems technical support engineer or via an field engineer from a Pinnacle authorized reseller All technical documentation such as quick start guides and technical data sheets to quickly get your evaluation up and running

6 Pinnacle Imaging Systems Custom Development - NRE As mentioned, the Denali-MC development platform was conceived and developed to be the most flexible HDR ISP available anywhere. The Denali-MC was built to be flexible, have modularaity and be customizable with as little as possible development needed to support various HDR capable sensors with diverse methodologies for achieving HDR. (See chart below for customized sensor options). Pinnacle s development goes much further than just providing support for these various sensors, with advanced algorithms for merge, recombination of exposures and Pinnacle s state of the art Locally Adaptive Tone Mapping IP. Contact Pinnacle Imaging Systems for futher information. Sony IMX136 IMX174 IMX123LQT IMX214 IMX224LQR IMX225LQR IMX230 IMX290LQC IMX274LQC IMX291 IMX326 IMX390CQV ONSemi/Aptina Omnivision ST Micro Dalsa/e2v AR0331 AR0230AT AR0230CS AR0140AT AR0231AT AR0136AT AR0132AT Python 1300 AR023Z OV10640 VXY769 EV76C771ABT/ACT OV10626 OV4689 OV9716 OS05A10 OS08A10 HDR Methods Multiple Frameset Output Dual Gain Merge Split Diode Dual Conversion Gain Digital Overlap Line - DOL Binning Multiplexed Exposure Spatially Multiplexed Exposure Multi Region of Interest Frame-based Sequential Line-based Staggered Deep-well Dual Exposure Multiple Photodiodes Per Pixel

7 Pinnacle Imaging Systems 288 Harbor Blvd. Belmont, CA Tel: