Short-course Compressive Sensing of Videos
|
|
- Blake Wilkinson
- 5 years ago
- Views:
Transcription
1 Short-course Compressive Sensing of Videos Venue CVPR 2012, Providence, RI, USA June 16, 2012 Richard G. Baraniuk Mohit Gupta Aswin C. Sankaranarayanan Ashok Veeraraghavan
2 Tutorial Outline Time Presenter Topic 1:30 2:00 Mohit Gupta Columbia University 2:00 3:00 Aswin Sankaranarayanan Rice University Introduction and Motivation Compressive Sensing Theory and Sparse Representations 3:30 4:30 Ashok Veeraraghavan Rice University 4:30 5:00 Mohit Gupta Columbia University Compressive Video Sensing Systems Discussion of CS in Other Domains and Related Problems
3 Space Shuttle Discovery Flight Deck Gigapan: 2.74 Gigapixels
4 Still Life Gigapan: 0.88 Gigapixels
5 Playing Drums Frame Rate: 50 fps
6 Playing Drums Frame Rate: 500 fps
7 Splashing Marbles Frame Rate: 50 fps
8 Splashing Marbles Frame Rate: 500 fps
9 Detail Fascinates
10 Automotive Testing Frame Rate: 2000 fps
11 Biomechanical Analysis Frame Rate: 2000 fps
12 Military Testing Frame Rate: 2000 fps
13 Selling Insurance Frame Rate: 4000 fps
14 Promoting HDTV Frame Rate: 1000 fps
15 Microscopy Frame Rate: 500 fps
16 Golf Swing Test Frame Rate: fps
17 Nature Frame Rate: 1000 fps Images captured for the BBC production "Life"
18 Nature Frame Rate: 1000 fps
19 High-Speed Schlieren Imaging Frame Rate: 500 fps
20 Capturing Photons Frame Rate: Trillion fps
21 Fun Frame Rate: 2000 fps
22 Cost: High-Performance Video Cameras Product Name Cost for Demo Unit Cost for New Unit SA5 775K M1 (MONO 8 GIGS) $68,500 $90,000 SA5 775K M2 w/ mech. Shutter SA5 1000K C2 RV COLOR -16 GIGS BC2 HD with Keypad SA2 M2 (MONO 16 GIG HIGH DEF ) $77,000 $80,000 $90,000 $55,500 $103,120 $113,120 $132,400 $100,000 No consumer high-performance sensors (>1MP, >1000fps) Photron cameras. Quotation source: from techimaging.com representative.
23 Why are these sensors so expensive? 1. Light Limitation Incident Illumination Space-Time Volume Scene y t Reflected Illumination Sensor x
24 Light Limitation Signal Level (electrons) Exposure time Incident Illumination Pixel Size F-number Scene Reflectivity Quantum Efficiency [Cossairt et al., 2012]
25 Light Limitation I src (lux) 2 x x number of electrons 6.2 x x FPS, 10MP camera: Exposure time of t = 1/1000 seconds, Pixel size of = 4µm. [Cossairt et al., 2012]
26 Light Limitation I src (lux) 2 x x number of electrons 6.2 x x Highly sensitive sensors required [Cossairt et al., 2012]
27 Why are these sensors so expensive? 2. Noise signal photon noise dark noise read noise Slide: Courtesy Marc Levoy
28 SNR Over The Years DxOMark-Insights/SNR-evolution-over-time Sensor technology has improved significantly over the years. But total number of voxels per unit volume has risen to offset these improvements. So, SNR has remained static. For higher-performance cameras of the future, sensor technology has to keep up with the rising number of voxels. Slide: Courtesy Marc Levoy
29 Why are these sensors so expensive? 3. Bandwidth Frame-rate is limited by the sensor readout rate Analog-to-digital conversion Time required to clear charge from the parallel register. Shutter opening delay in CCDs employing mechanical shutters. 1MP x 1000fps x 16-bit pixels = 4GB/s Expensive!
30 Spatio-Temporal Resolution Tradeoff Single image Spatial Resolution = 1X Temporal Resolution = 1X 30
31 Spatio-Temporal Resolution Tradeoff Captured Interpolated Thin-out Movie Movie (Row-wise sub-sampling) Spatial Resolution = 1/4X Temporal Resolution = 4X
32 Spatio-Temporal Resolution Tradeoff Captured Interpolated Thin-out Movie Movie (Row-wise sub-sampling) Spatial Resolution = 1/36X Temporal Resolution = 36X 32
33 Spatio-Temporal Resolution Tradeoff High-speed, High-res Video
34 Why are these sensors so expensive? 4. Non-visible wavelength sensors Infrared image Infrared camera (FLIR T620) Resolution: 640x480. Cost: $26,000. Expensive!
35 Do we need to capture all this data?
36 Redundancy in Visual Data Raw Captured Image (1.2MB) JPEG Compressed Image (40 KB) 30X Compression without significant loss of visual quality
37 Redundancy in Visual Data Raw Captured Video (270MB) H.264 Compressed Video (1.8 MB) 150X Compression without significant loss of visual quality
38 Redundancy in Visual Data Raw Captured Video (270MB) H.264 Compressed Video (1.8 MB) Massive data acquisi-on Most of the data is redundant and can be thrown away
39 The Sparseland Model for Images (Videos) Each image (video) patch = Sparse linear combination of dictionary atoms Slide courtesy: Guillermo Sapiro
40 The Sparseland Model for Images (Videos) Examples of dictionary: Wavelets, DCT, learned dictionaries Slide courtesy: Guillermo Sapiro
41 Capturing Relevant Data One can regard the possibility of digital compression as a failure of sensor design. If it is possible to compress measured data, one might argue that too many measurements were taken. David Brady
42 Capturing Relevant Data Can we design sensing systems that capture only the relevant data?
43 What is Compressive Sensing? Compressive Sensing is data acquisition protocols which directly acquire just the important information. Compressive Sensing is about acquiring and recovering a signal in the most efficient way possible.
44 What is Compressive Sensing? Compressive Sensing is data acquisition protocols which directly acquire just the important information. Compressive Sensing is about acquiring and recovering a signal in the most efficient way possible. Acquisition distinguishes compressive sensing from image processing
45 Compressive Sensing Acquisition: Time-domain measurements Frequency-domain measurements Important to Take `Good Measurements
46 Compressive Sensing: Challenges What are good measurements? How to take measurements in sparse domain?
47 Compressive Sensing: Challenges What are good measurements? How to take measurements in sparse domain?
48 Compressive Sensing: Enablers Incoherent Measurements for Sparse Recovery Signal Measurements Signal is local, measurements are global Each measurement picks up a little information about each component See papers by Candes, Romberg, Tao, Donoho for details Slide courtesy: Emmanuel Candes
49 Compressive Sensing: Challenges What are good measurements? How to take coded measurements?
50 Compressive Sensing: Enablers Computational Imaging and Optical Devices Conventional Camera Computational Camera A computational camera uses a combination of novel optics to map rays to pixels in some unconventional fashion. The captured image is optically coded and may not be meaningful in its raw form. The computational module decodes the captured image. See papers by Nayar, Levoy, Raskar, Freeman, Durand.
51 Novel Optical Devices Digital Micro-mirror Device (DMD) [10KHz] Single Pixel Camera [Rice] Liquid Crystal on Silicon (LCoS) [5KHz] Compressive Video Acquisition System [MERL, Rice, Columbia]
52 Why is Video Compressive Sensing Hard?
53 Specifications of the Human Eye Spatial resolution: Approximately 500 MegaPixels Temporal resolution: Approximately Frames Per Second
54 Eye as a Jitter Camera Eye FOV `Single-view Resolution
55 Eye as a Jitter Camera Eye FOV `Single-view Resolution
56 Eye as a Jitter Camera Eye FOV Higher Resolution Jitter Camera [Ben Ezra and Nayar]
57 Jittering in Time? Time is ephemeral in nature. Hard to take multiple measurements of the same duration. Can use multiple cameras, but it is an expensive solution Other practical issues such as registration. High-speed video using a camera array [Levoy et al.]
58 Tutorial Outline Time Presenter Topic 1:30 2:00 Mohit Gupta Introduction and Motivation 2:00 3:00 Aswin Sankaranarayanan Compressive Sensing Theory and Sparse Representations 3:30 4:30 Ashok Veeraraghavan Compressive Video Sensing Systems 4:30 5:00 Mohit Gupta Discussion of CS in Other Domains and Related Problems
Compressive Imaging. Aswin Sankaranarayanan (Computational Photography Fall 2017)
Compressive Imaging Aswin Sankaranarayanan (Computational Photography Fall 2017) Traditional Models for Sensing Linear (for the most part) Take as many measurements as unknowns sample Traditional Models
More informationIntroduction to Computer Vision
Introduction to Computer Vision CS / ECE 181B Thursday, April 1, 2004 Course Details HW #0 and HW #1 are available. Course web site http://www.ece.ucsb.edu/~manj/cs181b Syllabus, schedule, lecture notes,
More informationCoding and Modulation in Cameras
Coding and Modulation in Cameras Amit Agrawal June 2010 Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Schedule Introduction
More informationCompressive Imaging: Theory and Practice
Compressive Imaging: Theory and Practice Mark Davenport Richard Baraniuk, Kevin Kelly Rice University ECE Department Digital Revolution Digital Acquisition Foundation: Shannon sampling theorem Must sample
More informationTo Denoise or Deblur: Parameter Optimization for Imaging Systems
To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra, Oliver Cossairt and Ashok Veeraraghavan 1 ECE, Rice University 2 EECS, Northwestern University 3/3/2014 1 Capture moving
More informationA Framework for Analysis of Computational Imaging Systems
A Framework for Analysis of Computational Imaging Systems Kaushik Mitra, Oliver Cossairt, Ashok Veeraghavan Rice University Northwestern University Computational imaging CI systems that adds new functionality
More informationHigh Resolution BSI Scientific CMOS
CMOS, EMCCD AND CCD CAMERAS FOR LIFE SCIENCES High Resolution BSI Scientific CMOS Prime BSI delivers the perfect balance between high resolution imaging and sensitivity with an optimized pixel design and
More informationImplementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring
Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Ashill Chiranjan and Bernardt Duvenhage Defence, Peace, Safety and Security Council for Scientific
More informationNoise and ISO. CS 178, Spring Marc Levoy Computer Science Department Stanford University
Noise and ISO CS 178, Spring 2014 Marc Levoy Computer Science Department Stanford University Outline examples of camera sensor noise don t confuse it with JPEG compression artifacts probability, mean,
More informationA 4 Megapixel camera with 6.5μm pixels, Prime BSI captures highly. event goes undetected.
PRODUCT DATASHEET Prime BSI SCIENTIFIC CMOS CAMERA Can a camera single-handedly differentiate your product against competitors? With the Prime BSI, the answer is a resounding yes. Instrument builders no
More informationImage acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor
Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the
More informationCameras CS / ECE 181B
Cameras CS / ECE 181B Image Formation Geometry of image formation (Camera models and calibration) Where? Radiometry of image formation How bright? What color? Examples of cameras What is a Camera? A camera
More informationWhen Does Computational Imaging Improve Performance?
When Does Computational Imaging Improve Performance? Oliver Cossairt Assistant Professor Northwestern University Collaborators: Mohit Gupta, Changyin Zhou, Daniel Miau, Shree Nayar (Columbia University)
More informationTo Denoise or Deblur: Parameter Optimization for Imaging Systems
To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra a, Oliver Cossairt b and Ashok Veeraraghavan a a Electrical and Computer Engineering, Rice University, Houston, TX 77005 b
More informationEE 392B: Course Introduction
EE 392B Course Introduction About EE392B Goals Topics Schedule Prerequisites Course Overview Digital Imaging System Image Sensor Architectures Nonidealities and Performance Measures Color Imaging Recent
More informationDigital Imaging Rochester Institute of Technology
Digital Imaging 1999 Rochester Institute of Technology So Far... camera AgX film processing image AgX photographic film captures image formed by the optical elements (lens). Unfortunately, the processing
More informationDigital camera. Sensor. Memory card. Circuit board
Digital camera Circuit board Memory card Sensor Detector element (pixel). Typical size: 2-5 m square Typical number: 5-20M Pixel = Photogate Photon + Thin film electrode (semi-transparent) Depletion volume
More informationCoded Computational Photography!
Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!
More informationLecture 29: Image Sensors. Computer Graphics and Imaging UC Berkeley CS184/284A
Lecture 29: Image Sensors Computer Graphics and Imaging UC Berkeley Photon Capture The Photoelectric Effect Incident photons Ejected electrons Albert Einstein (wikipedia) Einstein s Nobel Prize in 1921
More informationOFFSET AND NOISE COMPENSATION
OFFSET AND NOISE COMPENSATION AO 10V 8.1 Offset and fixed pattern noise reduction Offset variation - shading AO 10V 8.2 Row Noise AO 10V 8.3 Offset compensation Global offset calibration Dark level is
More informationTRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0
TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TABLE OF CONTENTS Overview... 3 Color Filter Patterns... 3 Bayer CFA... 3 Sparse CFA... 3 Image Processing...
More informationarxiv: v1 [cs.cv] 16 Apr 2015
FPA-CS: Focal Plane Array-based Compressive Imaging in Short-wave Infrared Huaijin Chen, M. Salman Asif, Aswin C. Sankaranarayanan, Ashok Veeraraghavan ECE Department, Rice University, Houston, TX ECE
More informationCvision 2. António J. R. Neves João Paulo Silva Cunha. Bernardo Cunha. IEETA / Universidade de Aveiro
Cvision 2 Digital Imaging António J. R. Neves (an@ua.pt) & João Paulo Silva Cunha & Bernardo Cunha IEETA / Universidade de Aveiro Outline Image sensors Camera calibration Sampling and quantization Data
More informationVideo Compressive Sensing with On-Chip Programmable Subsampling
Video Compressive Sensing with On-Chip Programmable Subsampling Leonidas Spinoulas Kuan He Oliver Cossairt Aggelos Katsaggelos Department of Electrical Engineering and Computer Science, Northwestern University
More informationSpace-Time-Brightness Sampling Using an Adaptive Pixel-Wise Coded Exposure
Space-Time-Brightness Sampling Using an Adaptive Pixel-Wise Coded Exposure Hajime Nagahara Osaka University 2-8, Yamadaoka, Suita, Osaka, Japan nagahara@ids.osaka-u.ac.jp Dengyu Liu Intel Corporation 2200
More informationThe ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do?
Computational Photography The ultimate camera What does it do? Image from Durand & Freeman s MIT Course on Computational Photography Today s reading Szeliski Chapter 9 The ultimate camera Infinite resolution
More informatione2v Launches New Onyx 1.3M for Premium Performance in Low Light Conditions
e2v Launches New Onyx 1.3M for Premium Performance in Low Light Conditions e2v s Onyx family of image sensors is designed for the most demanding outdoor camera and industrial machine vision applications,
More informationDIGITAL IMAGING. Handbook of. Wiley VOL 1: IMAGE CAPTURE AND STORAGE. Editor-in- Chief
Handbook of DIGITAL IMAGING VOL 1: IMAGE CAPTURE AND STORAGE Editor-in- Chief Adjunct Professor of Physics at the Portland State University, Oregon, USA Previously with Eastman Kodak; University of Rochester,
More informationDappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing
Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research
More informationCameras. Fig. 2: Camera obscura View of Hotel de Ville, Paris, France, 2015 Photo by Abelardo Morell
Cameras camera is a remote sensing device that can capture and store or transmit images. Light is A collected and focused through an optical system on a sensitive surface (sensor) that converts intensity
More informationCompressive Sampling with R: A Tutorial
1/15 Mehmet Süzen msuzen@mango-solutions.com data analysis that delivers 15 JUNE 2011 2/15 Plan Analog-to-Digital conversion: Shannon-Nyquist Rate Medical Imaging to One Pixel Camera Compressive Sampling
More informationTIK: a time domain continuous imaging testbed using conventional still images and video
TIK: a time domain continuous imaging testbed using conventional still images and video Henry Dietz, Paul Eberhart, John Fike, Katie Long, Clark Demaree, and Jong Wu DPMI-081, 11:30AM February 1, 2017
More informationLENSLESS IMAGING BY COMPRESSIVE SENSING
LENSLESS IMAGING BY COMPRESSIVE SENSING Gang Huang, Hong Jiang, Kim Matthews and Paul Wilford Bell Labs, Alcatel-Lucent, Murray Hill, NJ 07974 ABSTRACT In this paper, we propose a lensless compressive
More informationApplication Note. Digital Low-Light CMOS Camera. NOCTURN Camera: Optimized for Long-Range Observation in Low Light Conditions
Digital Low-Light CMOS Camera Application Note NOCTURN Camera: Optimized for Long-Range Observation in Low Light Conditions PHOTONIS Digital Imaging, LLC. 6170 Research Road Suite 208 Frisco, TX USA 75033
More informationEC-433 Digital Image Processing
EC-433 Digital Image Processing Lecture 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such as a monochrome or color TV camera)
More informationLecture 20: Optical Tools for MEMS Imaging
MECH 466 Microelectromechanical Systems University of Victoria Dept. of Mechanical Engineering Lecture 20: Optical Tools for MEMS Imaging 1 Overview Optical Microscopes Video Microscopes Scanning Electron
More informationLast class. This class. CCDs Fancy CCDs. Camera specs scmos
CCDs and scmos Last class CCDs Fancy CCDs This class Camera specs scmos Fancy CCD cameras: -Back thinned -> higher QE -Unexposed chip -> frame transfer -Electron multiplying -> higher SNR -Fancy ADC ->
More informationWhat will be on the midterm?
What will be on the midterm? CS 178, Spring 2014 Marc Levoy Computer Science Department Stanford University General information 2 Monday, 7-9pm, Cubberly Auditorium (School of Edu) closed book, no notes
More informationHow does prism technology help to achieve superior color image quality?
WHITE PAPER How does prism technology help to achieve superior color image quality? Achieving superior image quality requires real and full color depth for every channel, improved color contrast and color
More informationCapturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f)
Capturing Light Rooms by the Sea, Edward Hopper, 1951 The Penitent Magdalen, Georges de La Tour, c. 1640 Some slides from M. Agrawala, F. Durand, P. Debevec, A. Efros, R. Fergus, D. Forsyth, M. Levoy,
More informationCoded photography , , Computational Photography Fall 2018, Lecture 14
Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 14 Overview of today s lecture The coded photography paradigm. Dealing with
More informationA Short History of Using Cameras for Weld Monitoring
A Short History of Using Cameras for Weld Monitoring 2 Background Ever since the development of automated welding, operators have needed to be able to monitor the process to ensure that all parameters
More informationHigh Performance Imaging Using Large Camera Arrays
High Performance Imaging Using Large Camera Arrays Presentation of the original paper by Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz,
More informationZEISS Axiocam 503 color Your 3 Megapixel Microscope Camera for Fast Image Acquisition Fast, in True Color and Regular Field of View
Product Information Version 1.0 ZEISS Axiocam 503 color Your 3 Megapixel Microscope Camera for Fast Image Acquisition Fast, in True Color and Regular Field of View ZEISS Axiocam 503 color Sensor Model
More informationImage sensor combining the best of different worlds
Image sensors and vision systems Image sensor combining the best of different worlds First multispectral time-delay-and-integration (TDI) image sensor based on CCD-in-CMOS technology. Introduction Jonathan
More informationProperties of a Detector
Properties of a Detector Quantum Efficiency fraction of photons detected wavelength and spatially dependent Dynamic Range difference between lowest and highest measurable flux Linearity detection rate
More informationWhite paper. Low Light Level Image Processing Technology
White paper Low Light Level Image Processing Technology Contents 1. Preface 2. Key Elements of Low Light Performance 3. Wisenet X Low Light Technology 3. 1. Low Light Specialized Lens 3. 2. SSNR (Smart
More informationDynamic Optically Multiplexed Imaging
Dynamic Optically Multiplexed Imaging Yaron Rachlin, Vinay Shah, R. Hamilton Shepard, and Tina Shih Lincoln Laboratory, Massachusetts Institute of Technology, 244 Wood Street, Lexington, MA, 02420 Distribution
More informationCOLOR FILTER PATTERNS
Sparse Color Filter Pattern Overview Overview The Sparse Color Filter Pattern (or Sparse CFA) is a four-channel alternative for obtaining full-color images from a single image sensor. By adding panchromatic
More informationCamera Image Processing Pipeline: Part II
Lecture 13: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements
More informationA simulation tool for evaluating digital camera image quality
A simulation tool for evaluating digital camera image quality Joyce Farrell ab, Feng Xiao b, Peter Catrysse b, Brian Wandell b a ImagEval Consulting LLC, P.O. Box 1648, Palo Alto, CA 94302-1648 b Stanford
More informationLecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A
Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley Reminder: The Pixel Stack Microlens array Color Filter Anti-Reflection Coating Stack height 4um is typical Pixel size 2um is typical
More informationPIXIS-XO: 400B 1340 x 400 imaging array 20 x 20 µm pixels Direct detection
PIXIS-XO: 400B 1340 x 400 imaging array 20 x 20 µm pixels Direct detection The PIXIS-XO series of fully integrated imaging cameras utilizes back-illuminated (BI) and back-illuminated, deepdepletion (BR)
More informationComputational Photography Introduction
Computational Photography Introduction Jongmin Baek CS 478 Lecture Jan 9, 2012 Background Sales of digital cameras surpassed sales of film cameras in 2004. Digital cameras are cool Free film Instant display
More informationCoded photography , , Computational Photography Fall 2017, Lecture 18
Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 18 Course announcements Homework 5 delayed for Tuesday. - You will need cameras
More informationA 120dB dynamic range image sensor with single readout using in pixel HDR
A 120dB dynamic range image sensor with single readout using in pixel HDR CMOS Image Sensors for High Performance Applications Workshop November 19, 2015 J. Caranana, P. Monsinjon, J. Michelot, C. Bouvier,
More informationDeblurring. Basics, Problem definition and variants
Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying
More informationAutomotive In-cabin Sensing Solutions. Nicolas Roux September 19th, 2018
Automotive In-cabin Sensing Solutions Nicolas Roux September 19th, 2018 Impact of Drowsiness 2 Drowsiness responsible for 20% to 25% of car crashes in Europe (INVS/AFSA) Beyond Drowsiness Driver Distraction
More informationWhite Paper. VIVOTEK Supreme Series Professional Network Camera- IP8151
White Paper VIVOTEK Supreme Series Professional Network Camera- IP8151 Contents 1. Introduction... 3 2. Sensor Technology... 4 3. Application... 5 4. Real-time H.264 1.3 Megapixel... 8 5. Conclusion...
More informationCamera Image Processing Pipeline
Lecture 13: Camera Image Processing Pipeline Visual Computing Systems Today (actually all week) Operations that take photons hitting a sensor to a high-quality image Processing systems used to efficiently
More informationMinimizes reflection losses from UV-IR; Optional AR coatings & wedge windows are available.
Now Powered by LightField PyLoN:2K 2048 x 512 The PyLoN :2K is a controllerless, cryogenically-cooled CCD camera designed for quantitative scientific spectroscopy applications demanding the highest possible
More informationInfrared detectors for wavefront sensing
Infrared detectors for wavefront sensing Jean-Luc Gach et al. The project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 673944 First
More informationWhite Paper High Dynamic Range Imaging
WPE-2015XI30-00 for Machine Vision What is Dynamic Range? Dynamic Range is the term used to describe the difference between the brightest part of a scene and the darkest part of a scene at a given moment
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY LINCOLN LABORATORY 244 WOOD STREET LEXINGTON, MASSACHUSETTS
MASSACHUSETTS INSTITUTE OF TECHNOLOGY LINCOLN LABORATORY 244 WOOD STREET LEXINGTON, MASSACHUSETTS 02420-9108 3 February 2017 (781) 981-1343 TO: FROM: SUBJECT: Dr. Joseph Lin (joseph.lin@ll.mit.edu), Advanced
More informationCamera Test Protocol. Introduction TABLE OF CONTENTS. Camera Test Protocol Technical Note Technical Note
Technical Note CMOS, EMCCD AND CCD CAMERAS FOR LIFE SCIENCES Camera Test Protocol Introduction The detector is one of the most important components of any microscope system. Accurate detector readings
More informationCompatible with Windows 8/7/XP, and Linux; Universal programming interfaces for easy custom programming.
NIRvana: 640LN The NIRvana: 640LN from Princeton Instruments is a scientific-grade, deep-cooled, large format InGaAs camera for low-light scientific SWIR imaging and spectroscopy applications. The camera
More informationRemoval of Glare Caused by Water Droplets
2009 Conference for Visual Media Production Removal of Glare Caused by Water Droplets Takenori Hara 1, Hideo Saito 2, Takeo Kanade 3 1 Dai Nippon Printing, Japan hara-t6@mail.dnp.co.jp 2 Keio University,
More informationEvaluating Commercial Scanners for Astronomical Images. The underlying technology of the scanners: Pixel sizes:
Evaluating Commercial Scanners for Astronomical Images Robert J. Simcoe Associate Harvard College Observatory rjsimcoe@cfa.harvard.edu Introduction: Many organizations have expressed interest in using
More informationLow Cost Earth Sensor based on Oxygen Airglow
Assessment Executive Summary Date : 16.06.2008 Page: 1 of 7 Low Cost Earth Sensor based on Oxygen Airglow Executive Summary Prepared by: H. Shea EPFL LMTS herbert.shea@epfl.ch EPFL Lausanne Switzerland
More informationX-ray light valve (XLV): a novel detectors technology for digital mammography*
X-ray light valve (XLV): a novel detectors technology for digital mammography* Sorin Marcovici, Vlad Sukhovatkin, Peter Oakham XLV Diagnostics Inc., Thunder Bay, ON P7A 7T1, Canada ABSTRACT A novel method,
More informationHigh Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 )
High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 ) School of Electronic Science & Engineering Nanjing University caoxun@nju.edu.cn Dec 30th, 2015 Computational Photography
More informationModule 3: Video Sampling Lecture 18: Filtering operations in Camera and display devices. The Lecture Contains: Effect of Temporal Aperture:
The Lecture Contains: Effect of Temporal Aperture: Spatial Aperture: Effect of Display Aperture: file:///d /...e%20(ganesh%20rana)/my%20course_ganesh%20rana/prof.%20sumana%20gupta/final%20dvsp/lecture18/18_1.htm[12/30/2015
More informationCooled cameras for scientific applications and astronomy. Ian Alderton Alrad Imaging division of Alrad Instruments Ltd
Cooled cameras for scientific applications and astronomy Ian Alderton Alrad Imaging division of Alrad Instruments Ltd www.alrad.co.uk History 1970 - started as Wenzel Elektronic UK in NIM modules and radiation
More informationData Sheet SMX-160 Series USB2.0 Cameras
Data Sheet SMX-160 Series USB2.0 Cameras SMX-160 Series USB2.0 Cameras Data Sheet Revision 3.0 Copyright 2001-2010 Sumix Corporation 4005 Avenida de la Plata, Suite 201 Oceanside, CA, 92056 Tel.: (877)233-3385;
More informationRandom Coded Sampling for High-Speed HDR Video
Random Coded Sampling for High-Speed HDR Video Travis Portz Li Zhang Hongrui Jiang University of Wisconsin Madison http://pages.cs.wisc.edu/~lizhang/projects/hs-hdr/ Abstract We propose a novel method
More informationABSTRACT. Imaging Plasmons with Compressive Hyperspectral Microscopy. Liyang Lu
ABSTRACT Imaging Plasmons with Compressive Hyperspectral Microscopy by Liyang Lu With the ability of revealing the interactions between objects and electromagnetic waves, hyperspectral imaging in optical
More informationExamination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy,
KTH Applied Physics Examination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy, 2009-06-05, 8-13, FB51 Allowed aids: Compendium Imaging Physics (handed out) Compendium Light Microscopy
More informationComputational Approaches to Cameras
Computational Approaches to Cameras 11/16/17 Magritte, The False Mirror (1935) Computational Photography Derek Hoiem, University of Illinois Announcements Final project proposal due Monday (see links on
More informationComputational Cameras. Rahul Raguram COMP
Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene
More informationBasic principles of photography. David Capel 346B IST
Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse
More informationSolution Set #2
05-78-0 Solution Set #. For the sampling function shown, analyze to determine its characteristics, e.g., the associated Nyquist sampling frequency (if any), whether a function sampled with s [x; x] may
More informationCamera Selection Criteria. Richard Crisp May 25, 2011
Camera Selection Criteria Richard Crisp rdcrisp@earthlink.net www.narrowbandimaging.com May 25, 2011 Size size considerations Key issues are matching the pixel size to the expected spot size from the optical
More informationLecture 18: Light field cameras. (plenoptic cameras) Visual Computing Systems CMU , Fall 2013
Lecture 18: Light field cameras (plenoptic cameras) Visual Computing Systems Continuing theme: computational photography Cameras capture light, then extensive processing produces the desired image Today:
More informationPhotons and solid state detection
Photons and solid state detection Photons represent discrete packets ( quanta ) of optical energy Energy is hc/! (h: Planck s constant, c: speed of light,! : wavelength) For solid state detection, photons
More informationComputational Camera & Photography: Coded Imaging
Computational Camera & Photography: Coded Imaging Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Image removed due to copyright restrictions. See Fig. 1, Eight major types
More informationGigE MV Cameras - XCG
GigE MV Cameras - XCG Gig-E Camera Line-Up - XCG Speed EXview HAD High IR sensitive ICX-625 (Super HAD) ICX-274 (Super HAD) ICX-285 (EXView HAD) ICX-424 (HAD) XCG-V60E B&W, 1/3 VGA, 90fps XCG-SX97E SX99E
More informationEX85 Megapixel-IP Infrared Imager powered by
Megapixel IP Infrared Imaging (I 3 ) Design Black Diamond Infrared Bit-Reduce Design - IP67 Rated DCRI Performance Parameters Detection Classification Recognition Identification 420ft (128m) 320ft (98m)
More informationCamera Image Processing Pipeline: Part II
Lecture 14: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements
More informationIntroduction to Light Fields
MIT Media Lab Introduction to Light Fields Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Introduction to Light Fields Ray Concepts for 4D and 5D Functions Propagation of
More informationBack-illuminated scientific CMOS camera. Datasheet
Back-illuminated scientific CMOS camera Datasheet Breakthrough Technology KURO DATASHEET Highlights The KURO from Princeton Instruments is the world s first scientific CMOS (scmos) camera system to implement
More informationEffects of Basis-mismatch in Compressive Sampling of Continuous Sinusoidal Signals
Effects of Basis-mismatch in Compressive Sampling of Continuous Sinusoidal Signals Daniel H. Chae, Parastoo Sadeghi, and Rodney A. Kennedy Research School of Information Sciences and Engineering The Australian
More informationAdvanced Camera and Image Sensor Technology. Steve Kinney Imaging Professional Camera Link Chairman
Advanced Camera and Image Sensor Technology Steve Kinney Imaging Professional Camera Link Chairman Content Physical model of a camera Definition of various parameters for EMVA1288 EMVA1288 and image quality
More informationPhotography Basics. Exposure
Photography Basics Exposure Impact Voice Transformation Creativity Narrative Composition Use of colour / tonality Depth of Field Use of Light Basics Focus Technical Exposure Courtesy of Bob Ryan Depth
More informationFundamentals of CMOS Image Sensors
CHAPTER 2 Fundamentals of CMOS Image Sensors Mixed-Signal IC Design for Image Sensor 2-1 Outline Photoelectric Effect Photodetectors CMOS Image Sensor(CIS) Array Architecture CIS Peripherals Design Considerations
More informationPIXIS-XO: 1024B 1024 x 1024 imaging array 13 x 13 µm pixels
The PIXIS-XO series of fully integrated imaging cameras utilizes back-illuminated (BI) and back-illuminated, deepdepletion CCDs without AR coating, for direct detection of the widest range of X-rays between
More informationEXACT SIGNAL RECOVERY FROM SPARSELY CORRUPTED MEASUREMENTS
EXACT SIGNAL RECOVERY FROM SPARSELY CORRUPTED MEASUREMENTS THROUGH THE PURSUIT OF JUSTICE Jason Laska, Mark Davenport, Richard Baraniuk SSC 2009 Collaborators Mark Davenport Richard Baraniuk Compressive
More informationCMOS Today & Tomorrow
CMOS Today & Tomorrow Uwe Pulsfort TDALSA Product & Application Support Overview Image Sensor Technology Today Typical Architectures Pixel, ADCs & Data Path Image Quality Image Sensor Technology Tomorrow
More informationSUPER RESOLUTION INTRODUCTION
SUPER RESOLUTION Jnanavardhini - Online MultiDisciplinary Research Journal Ms. Amalorpavam.G Assistant Professor, Department of Computer Sciences, Sambhram Academy of Management. Studies, Bangalore Abstract:-
More informationElectron-Bombarded CMOS
New Megapixel Single Photon Position Sensitive HPD: Electron-Bombarded CMOS University of Lyon / CNRS-IN2P3 in collaboration with J. Baudot, E. Chabanat, P. Depasse, W. Dulinski, N. Estre, M. Winter N56:
More informationLENSES. INEL 6088 Computer Vision
LENSES INEL 6088 Computer Vision Digital camera A digital camera replaces film with a sensor array Each cell in the array is a Charge Coupled Device light-sensitive diode that converts photons to electrons
More information