Building a Real Camera

Similar documents
Building a Real Camera. Slides Credit: Svetlana Lazebnik

Image Formation III Chapter 1 (Forsyth&Ponce) Cameras Lenses & Sensors

CS6670: Computer Vision

CS6670: Computer Vision

The Camera : Computational Photography Alexei Efros, CMU, Fall 2008

Two strategies for realistic rendering capture real world data synthesize from bottom up

The Camera : Computational Photography Alexei Efros, CMU, Fall 2005

Cameras. CSE 455, Winter 2010 January 25, 2010

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13

Unit 1: Image Formation

Lecture 02 Image Formation 1

LENSES. INEL 6088 Computer Vision

Projection. Projection. Image formation. Müller-Lyer Illusion. Readings. Readings. Let s design a camera. Szeliski 2.1. Szeliski 2.

Lecture 7: Camera Models

CSE 473/573 Computer Vision and Image Processing (CVIP)

How do we see the world?

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Image Formation: Camera Model

Image Formation and Capture

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

Cameras, lenses and sensors

Lecture 2 Camera Models

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

CS 443: Imaging and Multimedia Cameras and Lenses

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction

Lecture 7: Camera Models

Lecture 2 Camera Models

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2!

Computer Vision. The Pinhole Camera Model

Lenses, exposure, and (de)focus

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

VC 14/15 TP2 Image Formation

VC 11/12 T2 Image Formation

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

Basic principles of photography. David Capel 346B IST

brief history of photography foveon X3 imager technology description

What will be on the midterm?

Lecture 8 Camera Models

CSE 527: Introduction to Computer Vision

Lenses. Overview. Terminology. The pinhole camera. Pinhole camera Lenses Principles of operation Limitations

VC 16/17 TP2 Image Formation

Dr F. Cuzzolin 1. September 29, 2015

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera High dynamic range imaging

Single-view Metrology and Cameras

Lecture 22: Cameras & Lenses III. Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2017

Computational Photography and Video. Prof. Marc Pollefeys

Proj 2. Looks like the evaluation function changed in converting to Python, and 80% on Notre Dame is more tricky to reach.

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

CPSC 425: Computer Vision

IMAGE SENSOR SOLUTIONS. KAC-96-1/5" Lens Kit. KODAK KAC-96-1/5" Lens Kit. for use with the KODAK CMOS Image Sensors. November 2004 Revision 2

Notes from Lens Lecture with Graham Reed

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

Applied Optics. , Physics Department (Room #36-401) , ,

Chapter 25 Optical Instruments

Capturing Light in man and machine

Chapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing

Announcements. Image Formation: Outline. The course. How Cameras Produce Images. Earliest Surviving Photograph. Image Formation and Cameras

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

6.A44 Computational Photography

Limitations of lenses

Megapixels and more. The basics of image processing in digital cameras. Construction of a digital camera

Computational Approaches to Cameras

Physics 1230: Light and Color. Guest Lecture, Jack again. Lecture 23: More about cameras

Virtual and Digital Cameras

COURSE NAME: PHOTOGRAPHY AND AUDIO VISUAL PRODUCTION (VOCATIONAL) FOR UNDER GRADUATE (FIRST YEAR)

Optical Components for Laser Applications. Günter Toesko - Laserseminar BLZ im Dezember

Prof. Feng Liu. Spring /05/2017

Machine Vision: Image Formation

Chapter 2-Digital Components

Capturing light and color

Topic 9 - Sensors Within

TSBB09 Image Sensors 2018-HT2. Image Formation Part 1

Optical Systems: Pinhole Camera Pinhole camera: simple hole in a box: Called Camera Obscura Aristotle discussed, Al-Hazen analyzed in Book of Optics

HISTORY OF PHOTOGRAPHY

Criteria for Optical Systems: Optical Path Difference How do we determine the quality of a lens system? Several criteria used in optical design

Image Formation and Camera Design

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Computational Photography: Principles and Practice

Waves & Oscillations

Chapter 18 Optical Elements

Astronomical Cameras

F-number sequence. a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity,

Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A

Applications of Optics

A CAMERA IS A LIGHT TIGHT BOX

Lecture 2: Geometrical Optics. Geometrical Approximation. Lenses. Mirrors. Optical Systems. Images and Pupils. Aberrations.

Capturing Light in man and machine. Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al.

Optics: An Introduction

Consumer digital CCD cameras

Design of a digital holographic interferometer for the. ZaP Flow Z-Pinch

Topic 6 - Optics Depth of Field and Circle Of Confusion

Introduction to Digital Photography

Transcription:

Building a Real Camera

Home-made pinhole camera Slide by A. Efros http://www.debevec.org/pinhole/

Shrinking the aperture Why not make the aperture as small as possible? Less light gets through Diffraction effects Slide by Steve Seitz

Shrinking the aperture

Adding a lens

Adding a lens A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) Slide by Steve Seitz

Adding a lens focal point f A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) All rays parallel to the optical axis pass through the focal point Slide by Steve Seitz

Thin lens formula What is the relation between the focal length ( f ), the distance of the object from the optical center (D), and the distance at which the object will be in focus (D )? D f D image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! D f D image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! y /y = D /D D D f y y image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! D D f y y /y = D /D y /y = (D f )/f y image plane lens object Slide by Frédo Durand

Thin lens formula 1 + 1 = 1 D D f Any point satisfying the thin lens equation is in focus. D f D image plane lens object Slide by Frédo Durand

Depth of Field circle of confusion A lens focuses light onto the film There is a specific distance at which objects are in focus other points project to a circle of confusion in the image Slide by Steve Seitz

Depth of Field http://www.cambridgeincolour.com/tutorials/depth-of-field.htm Slide by A. Efros

Controlling depth of field Changing the aperture size affects depth of field A smaller aperture increases the range in which the object is approximately in focus But small aperture reduces amount of light need to increase exposure http://en.wikipedia.org/wiki/file:depth_of_field_illustration.svg

Varying the aperture Large aperture = small DOF Small aperture = large DOF Slide by A. Efros

Field of View Slide by A. Efros

Field of View Slide by A. Efros

Field of View f f FOV depends on focal length and size of the camera retina Larger focal length = smaller FOV Slide by A. Efros

Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car Sources: A. Efros, F. Durand

Same effect for faces wide-angle standard telephoto Source: F. Durand

Approximating an orthographic camera Source: Hartley & Zisserman

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject http://en.wikipedia.org/wiki/dolly_zoom

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject The Vertigo shot Example of dolly zoom from Goodfellas (YouTube) Example of dolly zoom from La Haine (YouTube)

Real lenses

Lens flaws: Vignetting

Radial Distortion Caused by imperfect lenses Deviations are most noticeable near the edge of the lens No distortion Pin cushion Barrel

Lens flaws: Spherical aberration Spherical lenses don t focus light perfectly Rays farther from the optical axis focus closer

Lens Flaws: Chromatic Aberration Lens has different refractive indices for different wavelengths: causes color fringing Near Lens Center Near Lens Outer Edge

Digital camera sensors Each cell in a sensor array is a light-sensitive diode that converts photons to electrons Dominant in the past: Charge Coupled Device (CCD) Dominant now: Complementary Metal Oxide Semiconductor (CMOS) http://electronics360.globalspec.com/article/9464/ccd-vs-cmos-the-shift-inimage-sensor-technology

Color filter arrays Bayer grid Demosaicing: Estimation of missing components from neighboring values Why more green? Human Luminance Sensitivity Function Source: Steve Seitz

Misc. digital camera artifacts Noise low light is where you most notice noise light sensitivity (ISO) / noise tradeoff stuck pixels In-camera processing oversharpening can produce halos Compression JPEG artifacts, blocking Blooming CCD charge overflowing into neighboring pixels Color artifacts Color moire Purple fringing from microlenses

Historic milestones Pinhole model: Mozi (470-390 BCE), Aristotle (384-322 BCE) Principles of optics (including lenses): Alhacen (965-1039 CE) Camera obscura: Leonardo da Vinci (1452-1519), Johann Zahn (1631-1707) First photo: Joseph Nicephore Niepce (1822) Daguerréotypes (1839) Photographic film (Eastman, 1889) Cinema (Lumière Brothers, 1895) Color Photography (Lumière Brothers, 1908) Television (Baird, Farnsworth, Zworykin, 1920s) First consumer camera with CCD Sony Mavica (1981) First fully digital camera: Kodak DCS100 (1990) Alhacen s notes Niepce, La Table Servie, 1822 Old television camera

First digitally scanned photograph 1957, 176x176 pixels http://listverse.com/history/top-10-incredible-early-firsts-in-photography/