Building a Real Camera. Slides Credit: Svetlana Lazebnik

Similar documents
Building a Real Camera

Image Formation III Chapter 1 (Forsyth&Ponce) Cameras Lenses & Sensors

CS6670: Computer Vision

CS6670: Computer Vision

The Camera : Computational Photography Alexei Efros, CMU, Fall 2008

CSE 473/573 Computer Vision and Image Processing (CVIP)

Two strategies for realistic rendering capture real world data synthesize from bottom up

The Camera : Computational Photography Alexei Efros, CMU, Fall 2005

Cameras. CSE 455, Winter 2010 January 25, 2010

Unit 1: Image Formation

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13

LENSES. INEL 6088 Computer Vision

Lecture 7: Camera Models

Projection. Projection. Image formation. Müller-Lyer Illusion. Readings. Readings. Let s design a camera. Szeliski 2.1. Szeliski 2.

Lecture 02 Image Formation 1

How do we see the world?

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Lecture 2 Camera Models

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Image Formation: Camera Model

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

Image Formation and Capture

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction

Cameras, lenses and sensors

CS 443: Imaging and Multimedia Cameras and Lenses

Lecture 7: Camera Models

Computer Vision. The Pinhole Camera Model

Lenses, exposure, and (de)focus

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

Lecture 2 Camera Models

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2!

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

Basic principles of photography. David Capel 346B IST

VC 14/15 TP2 Image Formation

VC 11/12 T2 Image Formation

Lecture 8 Camera Models

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

CSE 527: Introduction to Computer Vision

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

brief history of photography foveon X3 imager technology description

What will be on the midterm?

Lecture 22: Cameras & Lenses III. Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2017

VC 16/17 TP2 Image Formation

Dr F. Cuzzolin 1. September 29, 2015

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera High dynamic range imaging

Computational Photography and Video. Prof. Marc Pollefeys

Single-view Metrology and Cameras

Lenses. Overview. Terminology. The pinhole camera. Pinhole camera Lenses Principles of operation Limitations

6.A44 Computational Photography

CPSC 425: Computer Vision

Chapter 25 Optical Instruments

Chapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

Notes from Lens Lecture with Graham Reed

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

Proj 2. Looks like the evaluation function changed in converting to Python, and 80% on Notre Dame is more tricky to reach.

Virtual and Digital Cameras

Announcements. Image Formation: Outline. The course. How Cameras Produce Images. Earliest Surviving Photograph. Image Formation and Cameras

IMAGE SENSOR SOLUTIONS. KAC-96-1/5" Lens Kit. KODAK KAC-96-1/5" Lens Kit. for use with the KODAK CMOS Image Sensors. November 2004 Revision 2

Prof. Feng Liu. Spring /05/2017

Capturing Light in man and machine

Computational Approaches to Cameras

Physics 1230: Light and Color. Guest Lecture, Jack again. Lecture 23: More about cameras

Applied Optics. , Physics Department (Room #36-401) , ,

COURSE NAME: PHOTOGRAPHY AND AUDIO VISUAL PRODUCTION (VOCATIONAL) FOR UNDER GRADUATE (FIRST YEAR)

Applications of Optics

Limitations of lenses

Criteria for Optical Systems: Optical Path Difference How do we determine the quality of a lens system? Several criteria used in optical design

Chapter 18 Optical Elements

TSBB09 Image Sensors 2018-HT2. Image Formation Part 1

Image Formation and Camera Design

Topic 6 - Optics Depth of Field and Circle Of Confusion

Camera Simulation. References. Photography, B. London and J. Upton Optics in Photography, R. Kingslake The Camera, The Negative, The Print, A.

HISTORY OF PHOTOGRAPHY

Optical Components for Laser Applications. Günter Toesko - Laserseminar BLZ im Dezember

Computational Photography: Principles and Practice

Capturing light and color

Megapixels and more. The basics of image processing in digital cameras. Construction of a digital camera

Chapter 2-Digital Components

Topic 9 - Sensors Within

Optical Systems: Pinhole Camera Pinhole camera: simple hole in a box: Called Camera Obscura Aristotle discussed, Al-Hazen analyzed in Book of Optics

Machine Vision: Image Formation

Consumer digital CCD cameras

Lecture 2: Geometrical Optics. Geometrical Approximation. Lenses. Mirrors. Optical Systems. Images and Pupils. Aberrations.

Capturing Light in man and machine. Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al.

Physics 1230 Homework 8 Due Friday June 24, 2016

Imaging Optics Fundamentals

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Optics: An Introduction

DSLR Cameras have a wide variety of lenses that can be used.

Lecture 2: Geometrical Optics. Geometrical Approximation. Lenses. Mirrors. Optical Systems. Images and Pupils. Aberrations.

Astronomical Cameras

Computer Vision Lecture 1

Transcription:

Building a Real Camera Slides Credit: Svetlana Lazebnik

Home-made pinhole camera Slide by A. Efros http://www.debevec.org/pinhole/

Shrinking the aperture Why not make the aperture as small as possible? Less light gets through Diffraction effects Slide by Steve Seitz

Shrinking the aperture

Adding a lens

Adding a lens A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) Slide by Steve Seitz

Adding a lens focal point f A lens focuses light onto the film Thin lens model: Rays passing through the center are not deviated (pinhole projection model still holds) All parallel rays converge to one point on a plane located at the focal length f Slide by Steve Seitz

Adding a lens circle of confusion A lens focuses light onto the film There is a specific distance at which objects are in focus other points project to a circle of confusion in the image Slide by Steve Seitz

Thin lens formula What is the relation between the focal length ( f ), the distance of the object from the optical center (D), and the distance at which the object will be in focus (D )? D f D image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! D f D image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! y /y = D /D D D f y y image plane lens object Slide by Frédo Durand

Thin lens formula Similar triangles everywhere! D D f y y /y = D /D y /y = (D f )/f y image plane lens object Slide by Frédo Durand

Thin lens formula 1 + 1 = 1 D D f Any point satisfying the thin lens equation is in focus. D f D image plane lens object Slide by Frédo Durand

Depth of Field http://www.cambridgeincolour.com/tutorials/depth-of-field.htm Slide by A. Efros

Controlling depth of field Changing the aperture size affects depth of field A smaller aperture increases the range in which the object is approximately in focus But small aperture reduces amount of light need to increase exposure http://en.wikipedia.org/wiki/file:depth_of_field_illustration.svg

Motion blur Long exposure can result motion blur esp. in scenes with moving object

Varying the aperture Large aperture = small DOF Small aperture = large DOF

Varying the aperture Large aperture = small DOF Small aperture = large DOF Slide by A. Efros

Varying the aperture

Field of View Slide by A. Efros

Field of View Slide by A. Efros

Field of View f f FOV depends on focal length and size of the camera retina Larger focal length = smaller FOV Slide by A. Efros

Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car Sources: A. Efros, F. Durand

Same effect for faces wide-angle standard telephoto Source: F. Durand

Approximating an orthographic camera Source: Hartley & Zisserman

Orthographic vs. Perspective Projection Camera is moved to infinity... Image credits: www.script-tutorials.com/

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject http://en.wikipedia.org/wiki/dolly_zoom

The dolly zoom Continuously adjusting the focal length while the camera moves away from (or towards) the subject The Vertigo shot Example of dolly zoom from Goodfellas (YouTube) Example of dolly zoom from La Haine (YouTube)

Real lenses

Lens Flaws: Vignetting

Radial Distortion Caused by imperfect lenses Deviations are most noticeable near the edge of the lens No distortion Pin cushion Barrel

Lens flaws: Spherical aberration Spherical lenses don t focus light perfectly Rays farther from the optical axis focus closer

Lens Flaws: Chromatic Aberration Lens has different refractive indices for different wavelengths: causes color fringing Near Lens Center Near Lens Outer Edge

Lens Flaws: Chromatic Aberration Samples...

Digital camera A digital camera replaces film with a sensor array Each cell in the array is light-sensitive diode that converts photons to electrons Two common types Charge Coupled Device (CCD) Complementary metal oxide semiconductor (CMOS) http://electronics.howstuffworks.com/digital-camera.htm Slide by Steve Seitz

Color sensing in camera: Color filter array Bayer grid Estimate missing components from neighboring values (demosaicing) Why more green? Human Luminance Sensitivity Function Source: Steve Seitz

Problem with demosaicing: color moire Slide by F. Durand

The cause of color moire detector Fine black and white detail in image misinterpreted as color information Slide by F. Durand

Digital camera artifacts Noise low light is where you most notice noise light sensitivity (ISO) / noise tradeoff stuck pixels In-camera processing oversharpening can produce halos Compression JPEG artifacts, blocking Blooming charge overflowing into neighboring pixels Color artifacts purple fringing from microlenses, white balance Slide by Steve Seitz

Historic milestones Pinhole model: Mozi (470-390 BCE), Aristotle (384-322 BCE) Principles of optics (including lenses): Alhacen (Ibn al-haytham) (965-1039 CE) Camera obscura: Leonardo da Vinci (1452-1519), Johann Zahn (1631-1707) First photo: Joseph Nicephore Niepce (1822) Daguerréotypes (1839) Photographic film (Eastman, 1889) Cinema (Lumière Brothers, 1895) Color Photography (Lumière Brothers, 1908) Television (Baird, Farnsworth, Zworykin, 1920s) First consumer camera with CCD Sony Mavica (1981) First fully digital camera: Kodak DCS100 (1990) Alhacen s notes Niepce, La Table Servie, 1822 Old television camera

First digitally scanned photograph 1957, 176x176 pixels http://listverse.com/history/top-10-incredible-early-firsts-in-photography/