Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor"

Transcription

1 Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the digital sensing element is one of the following: Single sensor Line array Area array

2 Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the digital sensing element is one of the following: Single sensor Line array Area array indirect imaging techniques, e.g., MRI (Fourier), CT (Backprojection) physical quantities other than intensities are measured computation leads to 2-D map displayed as intensity

3 Single sensor acquisition

4 Linear array acquisition

5 Array sensor acquisition Irradiance incident at each photo-site is integrated over time Resulting array of intensities is moved out of sensor array and into a buffer Quantized intensities are stored as a grayscale image

6 Array sensor acquisition Irradiance incident at each photo-site is integrated over time Resulting array of intensities is moved out of sensor array and into a buffer Quantized intensities are stored as a grayscale image Two types of quantization: spatial: limited number of pixels gray-level: limited number of bits to represent intensity at a pixel

7 Spatial resolution

8 Grayscale resolution

9 Sensors - CCD & CMOS CCD (charge-coupled device) Charge-coupled device. Quantum efficiency of 70% (film has 2% QE). Mature technology. In development since Uses photo-diodes in conjunction with capacitors to store charge. Charge converted to voltage at limited nodes. Varied architectures used for read-out. Most of pixel area is light sensitive. Good fill-factor. CMOS (complementary metal-oxide-semiconductor) QE of 19-26%. Whole systems can be integrated on the same device. Camera-on-chip. Standard semiconductor device manufacturing process. Each pixel has read-out electronics, amplifiers, noise correction, and ADC. Consume far less power than CCDs. Need more room for electronics. Fill-factor generally not as good as CCDs.

10 CCD architectures CCDs function in two stages exposure and read-out Photons are collected and charge is accumulated during exposure Area arrays use vertical and horizontal shift registers for read-out In some architectures, charge is transferred to an inactive/opaque region before readout Linear array Pixel intensities are read sequentially Full frame transfer The entire pixel area is active Time between exposures is significant Needs mechanical shutter

11 CCD architectures Frame transfer Need 2x optically active area and thus are larger and costlier Half of the array (for storage) is masked Shutter delay is smaller than full frame transfer Interline transfer Charge shifted to adjacent opaque area Subsequently shifted row-wise to a horizontal shift register Complex design (requires micro-mirrors or microlenses for good optical efficiency)

12 Image formation Both CCD and CMOS sensors are monochromatic Color images are acquired using color filters overlaid on the sensor The intensity measured at a pixel is c i = f i (λ)g(λ)x(λ)l(λ)dλ + η i i = 1,..., k are distinct color channels sampled at each location f i (λ) - spectral transmittance of color filter g(λ) - sensitivity of sensor x(λ) - spectral reflectance of imaged surface l(λ) - spectral power density of illuminant η i - measurement noise

13 Spectral response of common illuminants Source:

14 Multiple sensors To acquire a 2-D image, multiple CCDs are used to acquire separate color bands Dichroic prism A dichroic prism is used to split incoming irradiance into narrow-band beams Red, blue, and green beams directed to separate optical sensors Issues: cost, weight, registration Beam splitter in action

15 Single sensor acquisition To avoid the cost and complexity associated with multiple-sensor acquisition, most color digital cameras use a single sensor Each pixel is overlaid with a color filter such that only one color channel is acquired at a particular pixel location The Bayer array is the most common color filter array Green is sampled at twice the density of red and blue since the human visual system (HVS) is more sensitive in the green region of the spectrum The quincunx sampling arrangement ensures that aliasing in the green channel is least along the horizontal and vertical directions The full color image is recovered in a post-processing stage known as demosaicking

16 Direct color imaging The Foveon X3 sensor captures colors at different depths at the same spatial location The increased density leads to much better spatial resolution The spectral sensitivity functions at the different layers have substantial overlap Color separation is a major issue for such sensors

17 Digital camera pipeline Lens assembly IR blocking (hot mirror) Anti-aliasing: blurs to increase spatial correlation among color channels to help with demosaicking Focus control Active auto-focus systems use IR emitters to estimate distance A passive method dynamically adjusts the focus setting to maximimize high-frequency energy Exposure control Good contrast across image by manipulating aperture size and exposure time Prevents overand under-exposed images

18 Digital camera pipeline Correct for lens distortion: barrel (fish-eye), pincushion (telephoto), vignetting (reduced brightness at edges) Gamma correction to compensate for nonlinearity of sensor response (opto-electronic conversion function) Compensation for dark current. Capture appropriate dark-image, subtract from acquired image. Lens flare (scattered light) compensation (mostly proprietary)

19 Digital camera pipeline HVS remarkably adaptive; e.g., paper appears white under incandescent light or sunlight Imaging system will integrate spectral content of irradiance. Without color compensation, images appear unnatural and dissimilar to viewed scenes White balancing algorithms based on one of two philosophies: Gray-world assumption R = kr R, B = k b B; k r = G mean /R mean, k b = G mean /B mean Perfect reflector method Brightest pixel corresponds to white. R = R/R max, G = G/G max, B = B/B max

20 Digital camera pipeline Bayer demosaicking Reconstruct sparsely sampled signal to form 3-color image Multitude of methods based on heuristics, properties of the HVS, and mathematical formulations Since the Bayer array is the most common, most algorithms are tailored specifically for it Effective algorithms use inter-channel correlation

21 Digital camera pipeline Captured image is in the digital camera color space. Colors are not impulses at specific wavelength. The sensitivity function of the camera color sensors dictates the camera color space. The camera-rgb image is transformed to one of many standard color spaces. Most commonly, the transformation is Camera-RGB CIEXYZ. The CIEXYZ space defined by CIE (Commission Internationale de l Eclairage the International Commission on Illumination) corresponds to the human visual subspace Many enhancement algorithms use non-rgb color spaces.

22 Digital camera pipeline Removal of color artifacts due to demosaicking algorithms based on the constant-hue assumption Sharpening performed on luminance component only Denoising median filters, bilateral filtering, and thresholding

23 Digital camera pipeline Display Images are converted to a format appropriate for display medium (srgb for monitors, CMY/CMYK for printers). Compression Most cameras offer flexible compression options. JPEG is standard in current models. Some JPEG2000. Storage Low-end cameras offer only JPEG images as output. Some high-end point-and-shoot cameras and most SLRs will allow for retrieval of RAW images that are unprocessed. RAW images can be processed later on a PC without time and computational constraints.

Digital camera. Sensor. Memory card. Circuit board

Digital camera. Sensor. Memory card. Circuit board Digital camera Circuit board Memory card Sensor Detector element (pixel). Typical size: 2-5 m square Typical number: 5-20M Pixel = Photogate Photon + Thin film electrode (semi-transparent) Depletion volume

More information

Digital Cameras The Imaging Capture Path

Digital Cameras The Imaging Capture Path Manchester Group Royal Photographic Society Imaging Science Group Digital Cameras The Imaging Capture Path by Dr. Tony Kaye ASIS FRPS Silver Halide Systems Exposure (film) Processing Digital Capture Imaging

More information

Camera Image Processing Pipeline

Camera Image Processing Pipeline Lecture 13: Camera Image Processing Pipeline Visual Computing Systems Today (actually all week) Operations that take photons hitting a sensor to a high-quality image Processing systems used to efficiently

More information

Image Formation and Capture

Image Formation and Capture Figure credits: B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, A. Theuwissen, and J. Malik Image Formation and Capture COS 429: Computer Vision Image Formation and Capture Real world Optics Sensor Devices

More information

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen Image Formation and Capture Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen Image Formation and Capture Real world Optics Sensor Devices Sources of Error

More information

General Imaging System

General Imaging System General Imaging System Lecture Slides ME 4060 Machine Vision and Vision-based Control Chapter 5 Image Sensing and Acquisition By Dr. Debao Zhou 1 2 Light, Color, and Electromagnetic Spectrum Penetrate

More information

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros Acquisition Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros Image Acquisition Digital Camera Film Outline Pinhole camera Lens Lens aberrations Exposure Sensors Noise

More information

Acquisition Basics. How can we measure material properties? Goal of this Section. Special Purpose Tools. General Purpose Tools

Acquisition Basics. How can we measure material properties? Goal of this Section. Special Purpose Tools. General Purpose Tools Course 10 Realistic Materials in Computer Graphics Acquisition Basics MPI Informatik (moving to the University of Washington Goal of this Section practical, hands-on description of acquisition basics general

More information

Camera Image Processing Pipeline: Part II

Camera Image Processing Pipeline: Part II Lecture 13: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements

More information

Lecture Notes 11 Introduction to Color Imaging

Lecture Notes 11 Introduction to Color Imaging Lecture Notes 11 Introduction to Color Imaging Color filter options Color processing Color interpolation (demozaicing) White balancing Color correction EE 392B: Color Imaging 11-1 Preliminaries Up till

More information

Cvision 2. António J. R. Neves João Paulo Silva Cunha. Bernardo Cunha. IEETA / Universidade de Aveiro

Cvision 2. António J. R. Neves João Paulo Silva Cunha. Bernardo Cunha. IEETA / Universidade de Aveiro Cvision 2 Digital Imaging António J. R. Neves (an@ua.pt) & João Paulo Silva Cunha & Bernardo Cunha IEETA / Universidade de Aveiro Outline Image sensors Camera calibration Sampling and quantization Data

More information

Photons and solid state detection

Photons and solid state detection Photons and solid state detection Photons represent discrete packets ( quanta ) of optical energy Energy is hc/! (h: Planck s constant, c: speed of light,! : wavelength) For solid state detection, photons

More information

Cameras CS / ECE 181B

Cameras CS / ECE 181B Cameras CS / ECE 181B Image Formation Geometry of image formation (Camera models and calibration) Where? Radiometry of image formation How bright? What color? Examples of cameras What is a Camera? A camera

More information

Camera Image Processing Pipeline: Part II

Camera Image Processing Pipeline: Part II Lecture 14: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements

More information

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera Outline Cameras Pinhole camera Film camera Digital camera Video camera Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/3/6 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

More information

ME 6406 MACHINE VISION. Georgia Institute of Technology

ME 6406 MACHINE VISION. Georgia Institute of Technology ME 6406 MACHINE VISION Georgia Institute of Technology Class Information Instructor Professor Kok-Meng Lee MARC 474 Office hours: Tues/Thurs 1:00-2:00 pm kokmeng.lee@me.gatech.edu (404)-894-7402 Class

More information

Lecture 29: Image Sensors. Computer Graphics and Imaging UC Berkeley CS184/284A

Lecture 29: Image Sensors. Computer Graphics and Imaging UC Berkeley CS184/284A Lecture 29: Image Sensors Computer Graphics and Imaging UC Berkeley Photon Capture The Photoelectric Effect Incident photons Ejected electrons Albert Einstein (wikipedia) Einstein s Nobel Prize in 1921

More information

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Cameras Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Camera trial #1 scene film Put a piece of film in front of

More information

DIGITAL IMAGING. Handbook of. Wiley VOL 1: IMAGE CAPTURE AND STORAGE. Editor-in- Chief

DIGITAL IMAGING. Handbook of. Wiley VOL 1: IMAGE CAPTURE AND STORAGE. Editor-in- Chief Handbook of DIGITAL IMAGING VOL 1: IMAGE CAPTURE AND STORAGE Editor-in- Chief Adjunct Professor of Physics at the Portland State University, Oregon, USA Previously with Eastman Kodak; University of Rochester,

More information

CHARGE-COUPLED DEVICE (CCD)

CHARGE-COUPLED DEVICE (CCD) CHARGE-COUPLED DEVICE (CCD) Definition A charge-coupled device (CCD) is an analog shift register, enabling analog signals, usually light, manipulation - for example, conversion into a digital value that

More information

Digital Imaging Rochester Institute of Technology

Digital Imaging Rochester Institute of Technology Digital Imaging 1999 Rochester Institute of Technology So Far... camera AgX film processing image AgX photographic film captures image formed by the optical elements (lens). Unfortunately, the processing

More information

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TABLE OF CONTENTS Overview... 3 Color Filter Patterns... 3 Bayer CFA... 3 Sparse CFA... 3 Image Processing...

More information

Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern

Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern James DiBella*, Marco Andreghetti, Amy Enge, William Chen, Timothy Stanka, Robert Kaser (Eastman Kodak

More information

Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A

Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley Reminder: The Pixel Stack Microlens array Color Filter Anti-Reflection Coating Stack height 4um is typical Pixel size 2um is typical

More information

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object. Camera trial #1 Cameras Digital Visual Effects Yung-Yu Chuang scene film with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Put a piece of film in front of an object. Pinhole camera

More information

LENSES. INEL 6088 Computer Vision

LENSES. INEL 6088 Computer Vision LENSES INEL 6088 Computer Vision Digital camera A digital camera replaces film with a sensor array Each cell in the array is a Charge Coupled Device light-sensitive diode that converts photons to electrons

More information

Digital photography , , Computational Photography Fall 2017, Lecture 2

Digital photography , , Computational Photography Fall 2017, Lecture 2 Digital photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 2 Course announcements To the 14 students who took the course survey on

More information

EE 392B: Course Introduction

EE 392B: Course Introduction EE 392B Course Introduction About EE392B Goals Topics Schedule Prerequisites Course Overview Digital Imaging System Image Sensor Architectures Nonidealities and Performance Measures Color Imaging Recent

More information

Introduction to Computer Vision

Introduction to Computer Vision Introduction to Computer Vision CS / ECE 181B Thursday, April 1, 2004 Course Details HW #0 and HW #1 are available. Course web site http://www.ece.ucsb.edu/~manj/cs181b Syllabus, schedule, lecture notes,

More information

Image Sensor Characterization in a Photographic Context

Image Sensor Characterization in a Photographic Context Image Sensor Characterization in a Photographic Context Sean C. Kelly, Gloria G. Putnam, Richard B. Wheeler, Shen Wang, William Davis, Ed Nelson, and Doug Carpenter Eastman Kodak Company Rochester, New

More information

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics Chapters 1-3 Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation Radiation sources Classification of remote sensing systems (passive & active) Electromagnetic

More information

Goal of this Section. Capturing Reflectance From Theory to Practice. Acquisition Basics. How can we measure material properties? Special Purpose Tools

Goal of this Section. Capturing Reflectance From Theory to Practice. Acquisition Basics. How can we measure material properties? Special Purpose Tools Capturing Reflectance From Theory to Practice Acquisition Basics GRIS, TU Darmstadt (formerly University of Washington, Seattle Goal of this Section practical, hands-on description of acquisition basics

More information

Spectral and Polarization Configuration Guide for MS Series 3-CCD Cameras

Spectral and Polarization Configuration Guide for MS Series 3-CCD Cameras Spectral and Polarization Configuration Guide for MS Series 3-CCD Cameras Geospatial Systems, Inc (GSI) MS 3100/4100 Series 3-CCD cameras utilize a color-separating prism to split broadband light entering

More information

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera High dynamic range imaging

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera High dynamic range imaging Outline Cameras Pinhole camera Film camera Digital camera Video camera High dynamic range imaging Digital Visual Effects, Spring 2006 Yung-Yu Chuang 2006/3/1 with slides by Fedro Durand, Brian Curless,

More information

The new CMOS Tracking Camera used at the Zimmerwald Observatory

The new CMOS Tracking Camera used at the Zimmerwald Observatory 13-0421 The new CMOS Tracking Camera used at the Zimmerwald Observatory M. Ploner, P. Lauber, M. Prohaska, P. Schlatter, J. Utzinger, T. Schildknecht, A. Jaeggi Astronomical Institute, University of Bern,

More information

Capturing Light in man and machine. Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al.

Capturing Light in man and machine. Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al. Capturing Light in man and machine Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al. 15-463: Computational Photography Alexei Efros, CMU, Fall 2005 Image Formation Digital

More information

Image Formation: Camera Model

Image Formation: Camera Model Image Formation: Camera Model Ruigang Yang COMP 684 Fall 2005, CS684-IBMR Outline Camera Models Pinhole Perspective Projection Affine Projection Camera with Lenses Digital Image Formation The Human Eye

More information

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics Chapters 1-3 Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation Radiation sources Classification of remote sensing systems (passive & active) Electromagnetic

More information

White Paper High Dynamic Range Imaging

White Paper High Dynamic Range Imaging WPE-2015XI30-00 for Machine Vision What is Dynamic Range? Dynamic Range is the term used to describe the difference between the brightest part of a scene and the darkest part of a scene at a given moment

More information

A simulation tool for evaluating digital camera image quality

A simulation tool for evaluating digital camera image quality A simulation tool for evaluating digital camera image quality Joyce Farrell ab, Feng Xiao b, Peter Catrysse b, Brian Wandell b a ImagEval Consulting LLC, P.O. Box 1648, Palo Alto, CA 94302-1648 b Stanford

More information

RGB RESOLUTION CONSIDERATIONS IN A NEW CMOS SENSOR FOR CINE MOTION IMAGING

RGB RESOLUTION CONSIDERATIONS IN A NEW CMOS SENSOR FOR CINE MOTION IMAGING WHITE PAPER RGB RESOLUTION CONSIDERATIONS IN A NEW CMOS SENSOR FOR CINE MOTION IMAGING Written by Larry Thorpe Professional Engineering & Solutions Division, Canon U.S.A., Inc. For more info: cinemaeos.usa.canon.com

More information

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 - COMPUTERIZED IMAGING Section I: Chapter 2 RADT 3463 Computerized Imaging 1 SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 COMPUTERIZED IMAGING Section I: Chapter 2 RADT

More information

A 1.3 Megapixel CMOS Imager Designed for Digital Still Cameras

A 1.3 Megapixel CMOS Imager Designed for Digital Still Cameras A 1.3 Megapixel CMOS Imager Designed for Digital Still Cameras Paul Gallagher, Andy Brewster VLSI Vision Ltd. San Jose, CA/USA Abstract VLSI Vision Ltd. has developed the VV6801 color sensor to address

More information

High Dynamic Range Imaging

High Dynamic Range Imaging High Dynamic Range Imaging 1 2 Lecture Topic Discuss the limits of the dynamic range in current imaging and display technology Solutions 1. High Dynamic Range (HDR) Imaging Able to image a larger dynamic

More information

Unit 1: Image Formation

Unit 1: Image Formation Unit 1: Image Formation 1. Geometry 2. Optics 3. Photometry 4. Sensor Readings Szeliski 2.1-2.3 & 6.3.5 1 Physical parameters of image formation Geometric Type of projection Camera pose Optical Sensor

More information

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics IMAGE FORMATION Light source properties Sensor characteristics Surface Exposure shape Optics Surface reflectance properties ANALOG IMAGES An image can be understood as a 2D light intensity function f(x,y)

More information

Digital Photographs, Image Sensors and Matrices

Digital Photographs, Image Sensors and Matrices Digital Photographs, Image Sensors and Matrices Digital Camera Image Sensors Electron Counts Checkerboard Analogy Bryce Bayer s Color Filter Array Mosaic. Image Sensor Data to Matrix Data Visualization

More information

Improvements of Demosaicking and Compression for Single Sensor Digital Cameras

Improvements of Demosaicking and Compression for Single Sensor Digital Cameras Improvements of Demosaicking and Compression for Single Sensor Digital Cameras by Colin Ray Doutre B. Sc. (Electrical Engineering), Queen s University, 2005 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF

More information

COLOR FILTER PATTERNS

COLOR FILTER PATTERNS Sparse Color Filter Pattern Overview Overview The Sparse Color Filter Pattern (or Sparse CFA) is a four-channel alternative for obtaining full-color images from a single image sensor. By adding panchromatic

More information

Charged Coupled Device (CCD) S.Vidhya

Charged Coupled Device (CCD) S.Vidhya Charged Coupled Device (CCD) S.Vidhya 02.04.2016 Sensor Physical phenomenon Sensor Measurement Output A sensor is a device that measures a physical quantity and converts it into a signal which can be read

More information

Understand brightness, intensity, eye characteristics, and gamma correction, halftone technology, Understand general usage of color

Understand brightness, intensity, eye characteristics, and gamma correction, halftone technology, Understand general usage of color Understand brightness, intensity, eye characteristics, and gamma correction, halftone technology, Understand general usage of color 1 ACHROMATIC LIGHT (Grayscale) Quantity of light physics sense of energy

More information

Introduction. Prof. Lina Karam School of Electrical, Computer, & Energy Engineering Arizona State University

Introduction. Prof. Lina Karam School of Electrical, Computer, & Energy Engineering Arizona State University EEE 508 - Digital Image & Video Processing and Compression http://lina.faculty.asu.edu/eee508/ Introduction Prof. Lina Karam School of Electrical, Computer, & Energy Engineering Arizona State University

More information

TDI Imaging: An Efficient AOI and AXI Tool

TDI Imaging: An Efficient AOI and AXI Tool TDI Imaging: An Efficient AOI and AXI Tool Yakov Bulayev Hamamatsu Corporation Bridgewater, New Jersey Abstract As a result of heightened requirements for quality, integrity and reliability of electronic

More information

Digital photography , , Computational Photography Fall 2018, Lecture 2

Digital photography , , Computational Photography Fall 2018, Lecture 2 Digital photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 2 Course announcements To the 26 students who took the start-of-semester

More information

Cameras As Computing Systems

Cameras As Computing Systems Cameras As Computing Systems Prof. Hank Dietz In Search Of Sensors University of Kentucky Electrical & Computer Engineering Things You Already Know The sensor is some kind of chip Most can't distinguish

More information

Aperture. The lens opening that allows more, or less light onto the sensor formed by a diaphragm inside the actual lens.

Aperture. The lens opening that allows more, or less light onto the sensor formed by a diaphragm inside the actual lens. PHOTOGRAPHY TERMS: AE - Auto Exposure. When the camera is set to this mode, it will automatically set all the required modes for the light conditions. I.e. Shutter speed, aperture and white balance. The

More information

University Of Lübeck ISNM Presented by: Omar A. Hanoun

University Of Lübeck ISNM Presented by: Omar A. Hanoun University Of Lübeck ISNM 12.11.2003 Presented by: Omar A. Hanoun What Is CCD? Image Sensor: solid-state device used in digital cameras to capture and store an image. Photosites: photosensitive diodes

More information

ELEC Dr Reji Mathew Electrical Engineering UNSW

ELEC Dr Reji Mathew Electrical Engineering UNSW ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Filter Design Circularly symmetric 2-D low-pass filter Pass-band radial frequency: ω p Stop-band radial frequency: ω s 1 δ p Pass-band tolerances: δ

More information

CCD Requirements for Digital Photography

CCD Requirements for Digital Photography IS&T's 2 PICS Conference IS&T's 2 PICS Conference Copyright 2, IS&T CCD Requirements for Digital Photography Richard L. Baer Hewlett-Packard Laboratories Palo Alto, California Abstract The performance

More information

Noise and ISO. CS 178, Spring Marc Levoy Computer Science Department Stanford University

Noise and ISO. CS 178, Spring Marc Levoy Computer Science Department Stanford University Noise and ISO CS 178, Spring 2014 Marc Levoy Computer Science Department Stanford University Outline examples of camera sensor noise don t confuse it with JPEG compression artifacts probability, mean,

More information

CS 89.15/189.5, Fall 2015 ASPECTS OF DIGITAL PHOTOGRAPHY COMPUTATIONAL. Sensors & Demosaicing. Wojciech Jarosz

CS 89.15/189.5, Fall 2015 ASPECTS OF DIGITAL PHOTOGRAPHY COMPUTATIONAL. Sensors & Demosaicing. Wojciech Jarosz CS 89.15/189.5, Fall 2015 COMPUTATIONAL ASPECTS OF DIGITAL PHOTOGRAPHY Sensors & Demosaicing Wojciech Jarosz wojciech.k.jarosz@dartmouth.edu Today s agenda How do cameras record light? How do cameras record

More information

Camera Requirements For Precision Agriculture

Camera Requirements For Precision Agriculture Camera Requirements For Precision Agriculture Radiometric analysis such as NDVI requires careful acquisition and handling of the imagery to provide reliable values. In this guide, we explain how Pix4Dmapper

More information

CS6640 Computational Photography. 6. Color science for digital photography Steve Marschner

CS6640 Computational Photography. 6. Color science for digital photography Steve Marschner CS6640 Computational Photography 6. Color science for digital photography 2012 Steve Marschner 1 What visible light is One octave of the electromagnetic spectrum (380-760nm) NASA/Wikimedia Commons 2 What

More information

Overview. Charge-coupled Devices. MOS capacitor. Charge-coupled devices. Charge-coupled devices:

Overview. Charge-coupled Devices. MOS capacitor. Charge-coupled devices. Charge-coupled devices: Overview Charge-coupled Devices Charge-coupled devices: MOS capacitors Charge transfer Architectures Color Limitations 1 2 Charge-coupled devices MOS capacitor The most popular image recording technology

More information

Control of Noise and Background in Scientific CMOS Technology

Control of Noise and Background in Scientific CMOS Technology Control of Noise and Background in Scientific CMOS Technology Introduction Scientific CMOS (Complementary metal oxide semiconductor) camera technology has enabled advancement in many areas of microscopy

More information

Detectors for microscopy - CCDs, APDs and PMTs. Antonia Göhler. Nov 2014

Detectors for microscopy - CCDs, APDs and PMTs. Antonia Göhler. Nov 2014 Detectors for microscopy - CCDs, APDs and PMTs Antonia Göhler Nov 2014 Detectors/Sensors in general are devices that detect events or changes in quantities (intensities) and provide a corresponding output,

More information

Digital Photographs and Matrices

Digital Photographs and Matrices Digital Photographs and Matrices Digital Camera Image Sensors Electron Counts Checkerboard Analogy Bryce Bayer s Color Filter Array Mosaic. Image Sensor Data to Matrix Data Visualization of Matrix Addition

More information

How does prism technology help to achieve superior color image quality?

How does prism technology help to achieve superior color image quality? WHITE PAPER How does prism technology help to achieve superior color image quality? Achieving superior image quality requires real and full color depth for every channel, improved color contrast and color

More information

Images and Displays. Lecture Steve Marschner 1

Images and Displays. Lecture Steve Marschner 1 Images and Displays Lecture 2 2008 Steve Marschner 1 Introduction Computer graphics: The study of creating, manipulating, and using visual images in the computer. What is an image? A photographic print?

More information

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Announcement A total of 5 (five) late days are allowed for projects. Office hours Announcement A total of 5 (five) late days are allowed for projects. Office hours Me: 3:50-4:50pm Thursday (or by appointment) Jake: 12:30-1:30PM Monday and Wednesday Image Formation Digital Camera Film

More information

The Science Seeing of process Digital Media. The Science of Digital Media Introduction

The Science Seeing of process Digital Media. The Science of Digital Media Introduction The Human Science eye of and Digital Displays Media Human Visual System Eye Perception of colour types terminology Human Visual System Eye Brains Camera and HVS HVS and displays Introduction 2 The Science

More information

Fundamentals of CMOS Image Sensors

Fundamentals of CMOS Image Sensors CHAPTER 2 Fundamentals of CMOS Image Sensors Mixed-Signal IC Design for Image Sensor 2-1 Outline Photoelectric Effect Photodetectors CMOS Image Sensor(CIS) Array Architecture CIS Peripherals Design Considerations

More information

CERTIFIED PROFESSIONAL PHOTOGRAPHER (CPP) TEST SPECIFICATIONS CAMERA, LENSES AND ATTACHMENTS (12%)

CERTIFIED PROFESSIONAL PHOTOGRAPHER (CPP) TEST SPECIFICATIONS CAMERA, LENSES AND ATTACHMENTS (12%) CERTIFIED PROFESSIONAL PHOTOGRAPHER (CPP) TEST SPECIFICATIONS CAMERA, LENSES AND ATTACHMENTS (12%) Items relating to this category will include digital cameras as well as the various lenses, menu settings

More information

Building a Real Camera. Slides Credit: Svetlana Lazebnik

Building a Real Camera. Slides Credit: Svetlana Lazebnik Building a Real Camera Slides Credit: Svetlana Lazebnik Home-made pinhole camera Slide by A. Efros http://www.debevec.org/pinhole/ Shrinking the aperture Why not make the aperture as small as possible?

More information

Building a Real Camera

Building a Real Camera Building a Real Camera Home-made pinhole camera Slide by A. Efros http://www.debevec.org/pinhole/ Shrinking the aperture Why not make the aperture as small as possible? Less light gets through Diffraction

More information

The Xiris Glossary of Machine Vision Terminology

The Xiris Glossary of Machine Vision Terminology X The Xiris Glossary of Machine Vision Terminology 2 Introduction Automated welding, camera technology, and digital image processing are all complex subjects. When you combine them in a system featuring

More information

Image Processing: An Overview

Image Processing: An Overview Image Processing: An Overview Sebastiano Battiato, Ph.D. battiato@dmi.unict.it Program Image Representation & Color Spaces Image files format (Compressed/Not compressed) Bayer Pattern & Color Interpolation

More information

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008 CS559: Computer Graphics Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008 Today Eyes Cameras Light Why can we see? Visible Light and Beyond Infrared, e.g. radio wave longer wavelength

More information

Applied Machine Vision

Applied Machine Vision Applied Machine Vision ME Machine Vision Class Doug Britton GTRI 12/1/2005 Not everybody trusts paintings but people believe photographs. Ansel Adams Machine Vision Components Product Camera/Sensor Illumination

More information

Image Processing for Mechatronics Engineering For senior undergraduate students Academic Year 2017/2018, Winter Semester

Image Processing for Mechatronics Engineering For senior undergraduate students Academic Year 2017/2018, Winter Semester Image Processing for Mechatronics Engineering For senior undergraduate students Academic Year 2017/2018, Winter Semester Lecture 6: Image Acquisition and Digitization 14.10.2017 Dr. Mohammed Abdel-Megeed

More information

A CAMERA IS A LIGHT TIGHT BOX

A CAMERA IS A LIGHT TIGHT BOX HOW CAMERAS WORK A CAMERA IS A LIGHT TIGHT BOX Pinhole Principle All contemporary cameras have the same basic features A light-tight box to hold the camera parts and recording material A viewing system

More information

PIXPOLAR WHITE PAPER 29 th of September 2013

PIXPOLAR WHITE PAPER 29 th of September 2013 PIXPOLAR WHITE PAPER 29 th of September 2013 Pixpolar s Modified Internal Gate (MIG) image sensor technology offers numerous benefits over traditional Charge Coupled Device (CCD) and Complementary Metal

More information

Camera Requirements For Precision Agriculture

Camera Requirements For Precision Agriculture Camera Requirements For Precision Agriculture Radiometric analysis such as NDVI requires careful acquisition and handling of the imagery to provide reliable values. In this guide, we explain how Pix4Dmapper

More information

Observational Astronomy

Observational Astronomy Observational Astronomy Instruments The telescope- instruments combination forms a tightly coupled system: Telescope = collecting photons and forming an image Instruments = registering and analyzing the

More information

F-number sequence. a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity,

F-number sequence. a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity, 1 F-number sequence a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity, 0.7, 1, 1.4, 2, 2.8, 4, 5.6, 8, 11, 16, 22, 32, Example: What is the difference

More information

Sensors and Sensing Cameras and Camera Calibration

Sensors and Sensing Cameras and Camera Calibration Sensors and Sensing Cameras and Camera Calibration Todor Stoyanov Mobile Robotics and Olfaction Lab Center for Applied Autonomous Sensor Systems Örebro University, Sweden todor.stoyanov@oru.se 20.11.2014

More information

WHITE PAPER. Guide to CCD-Based Imaging Colorimeters

WHITE PAPER. Guide to CCD-Based Imaging Colorimeters Guide to CCD-Based Imaging Colorimeters How to choose the best imaging colorimeter CCD-based instruments offer many advantages for measuring light and color. When configured effectively, CCD imaging systems

More information

Putting It All Together: Computer Architecture and the Digital Camera

Putting It All Together: Computer Architecture and the Digital Camera 461 Putting It All Together: Computer Architecture and the Digital Camera This book covers many topics in circuit analysis and design, so it is only natural to wonder how they all fit together and how

More information

Lenses, exposure, and (de)focus

Lenses, exposure, and (de)focus Lenses, exposure, and (de)focus http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 15 Course announcements Homework 4 is out. - Due October 26

More information

Properties of a Detector

Properties of a Detector Properties of a Detector Quantum Efficiency fraction of photons detected wavelength and spatially dependent Dynamic Range difference between lowest and highest measurable flux Linearity detection rate

More information

SUPER RESOLUTION INTRODUCTION

SUPER RESOLUTION INTRODUCTION SUPER RESOLUTION Jnanavardhini - Online MultiDisciplinary Research Journal Ms. Amalorpavam.G Assistant Professor, Department of Computer Sciences, Sambhram Academy of Management. Studies, Bangalore Abstract:-

More information

CCDS. Lesson I. Wednesday, August 29, 12

CCDS. Lesson I. Wednesday, August 29, 12 CCDS Lesson I CCD OPERATION The predecessor of the CCD was a device called the BUCKET BRIGADE DEVICE developed at the Phillips Research Labs The BBD was an analog delay line, made up of capacitors such

More information

A High-Speed Imaging Colorimeter LumiCol 1900 for Display Measurements

A High-Speed Imaging Colorimeter LumiCol 1900 for Display Measurements A High-Speed Imaging Colorimeter LumiCol 19 for Display Measurements Shigeto OMORI, Yutaka MAEDA, Takehiro YASHIRO, Jürgen NEUMEIER, Christof THALHAMMER, Martin WOLF Abstract We present a novel high-speed

More information

OFFSET AND NOISE COMPENSATION

OFFSET AND NOISE COMPENSATION OFFSET AND NOISE COMPENSATION AO 10V 8.1 Offset and fixed pattern noise reduction Offset variation - shading AO 10V 8.2 Row Noise AO 10V 8.3 Offset compensation Global offset calibration Dark level is

More information

Digital Photogrammetry. Presented by: Dr. Hamid Ebadi

Digital Photogrammetry. Presented by: Dr. Hamid Ebadi Digital Photogrammetry Presented by: Dr. Hamid Ebadi Background First Generation Analog Photogrammetry Analytical Photogrammetry Digital Photogrammetry Photogrammetric Generations 2000 digital photogrammetry

More information

A Unified Framework for the Consumer-Grade Image Pipeline

A Unified Framework for the Consumer-Grade Image Pipeline A Unified Framework for the Consumer-Grade Image Pipeline Konstantinos N. Plataniotis University of Toronto kostas@dsp.utoronto.ca www.dsp.utoronto.ca Common work with Rastislav Lukac Outline The problem

More information

NEW 35MM CMOS IMAGE SENSOR FOR DIGITAL CINE MOTION IMAGING

NEW 35MM CMOS IMAGE SENSOR FOR DIGITAL CINE MOTION IMAGING WHITE PAPER NEW 35MM CMOS IMAGE SENSOR FOR DIGITAL CINE MOTION IMAGING Updated April 2, 2012 Written by Larry Thorpe Professional Engineering & Solutions Division, Canon U.S.A., Inc. For more info: cinemaeos.usa.canon.com

More information

Color Image Processing EEE 6209 Digital Image Processing. Outline

Color Image Processing EEE 6209 Digital Image Processing. Outline Outline Color Image Processing Motivation and Color Fundamentals Standard Color Models (RGB/CMYK/HSI) Demosaicing and Color Filtering Pseudo-color and Full-color Image Processing Color Transformation Tone

More information

Examination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy,

Examination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy, KTH Applied Physics Examination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy, 2009-06-05, 8-13, FB51 Allowed aids: Compendium Imaging Physics (handed out) Compendium Light Microscopy

More information