How do we see the world?

Similar documents
The Camera : Computational Photography Alexei Efros, CMU, Fall 2008

Two strategies for realistic rendering capture real world data synthesize from bottom up

The Camera : Computational Photography Alexei Efros, CMU, Fall 2005

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

Building a Real Camera. Slides Credit: Svetlana Lazebnik

Projection. Projection. Image formation. Müller-Lyer Illusion. Readings. Readings. Let s design a camera. Szeliski 2.1. Szeliski 2.

Building a Real Camera

Cameras. CSE 455, Winter 2010 January 25, 2010

Unit 1: Image Formation

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

CS6670: Computer Vision

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction

CSE 473/573 Computer Vision and Image Processing (CVIP)

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

Computer Vision. The Pinhole Camera Model

CS6670: Computer Vision

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

Single-view Metrology and Cameras

Announcement A total of 5 (five) late days are allowed for projects. Office hours

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

LENSES. INEL 6088 Computer Vision

VC 16/17 TP2 Image Formation

Lecture 7: Camera Models

Lecture 02 Image Formation 1

VC 11/12 T2 Image Formation

Lecture 2 Camera Models

Image Formation. World Optics Sensor Signal. Computer Vision. Introduction to. Light (Energy) Source. Surface Imaging Plane. Pinhole Lens.

VC 14/15 TP2 Image Formation

Lenses, exposure, and (de)focus

Image Formation. Light from distant things. Geometrical optics. Pinhole camera. Chapter 36

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Proj 2. Looks like the evaluation function changed in converting to Python, and 80% on Notre Dame is more tricky to reach.

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Image Processing & Projective geometry

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2!

Virtual and Digital Cameras

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

Digital Image Processing COSC 6380/4393

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

CPSC 425: Computer Vision

Image Formation and Capture

Basic principles of photography. David Capel 346B IST

Digital Image Processing COSC 6380/4393

3D Viewing. Introduction to Computer Graphics Torsten Möller / Manfred Klaffenböck. Machiraju/Zhang/Möller

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

TSBB09 Image Sensors 2018-HT2. Image Formation Part 1

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Image Formation III Chapter 1 (Forsyth&Ponce) Cameras Lenses & Sensors

Computer Vision. Thursday, August 30

Lecture 8 Camera Models

Computational Photography and Video. Prof. Marc Pollefeys

Fundamental Paraxial Equation for Thin Lenses

Lecture 7: Camera Models

Cameras, lenses, and sensors

Lenses. Overview. Terminology. The pinhole camera. Pinhole camera Lenses Principles of operation Limitations

Lecture 2 Camera Models

Image Formation: Camera Model

Introduction. Related Work

Graphics and Interaction Perspective Geometry

What will be on the midterm?

Reading. Angel. Chapter 5. Optional

Camera Simulation. References. Photography, B. London and J. Upton Optics in Photography, R. Kingslake The Camera, The Negative, The Print, A.

Lens Principal and Nodal Points

Lecture 22: Cameras & Lenses III. Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2017

Physics 1230 Homework 8 Due Friday June 24, 2016

CS354 Computer Graphics Viewing and Projections

CSE 527: Introduction to Computer Vision

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration

Chapter 25 Optical Instruments

Dr F. Cuzzolin 1. September 29, 2015

Adding Realistic Camera Effects to the Computer Graphics Camera Model

Cameras, lenses and sensors

Complete the diagram to show what happens to the rays. ... (1) What word can be used to describe this type of lens? ... (1)

Homogeneous Representation Representation of points & vectors. Properties. Homogeneous Transformations

Graphic Communications

Section 8. Objectives

Laboratory experiment aberrations

6.A44 Computational Photography

ECEG105/ECEU646 Optics for Engineers Course Notes Part 4: Apertures, Aberrations Prof. Charles A. DiMarzio Northeastern University Fall 2008

CS 443: Imaging and Multimedia Cameras and Lenses

PHY 1160C Homework Chapter 26: Optical Instruments Ch 26: 2, 3, 5, 9, 13, 15, 20, 25, 27

Lens Openings & Shutter Speeds

Aperture & ƒ/stop Worksheet

To start there are three key properties that you need to understand: ISO (sensitivity)

Transmission electron Microscopy

Overview. Image formation - 1

An Introduction to. Photographic Exposure: Aperture, ISO and Shutter Speed

( ) Deriving the Lens Transmittance Function. Thin lens transmission is given by a phase with unit magnitude.

Reading. Projections. The 3D synthetic camera model. Imaging with the synthetic camera. Angel. Chapter 5. Optional

Lab 2 Geometrical Optics

CAMERA BASICS. Stops of light

Name: Date: Math in Special Effects: Try Other Challenges. Student Handout

Chapter 18 Optical Elements

Topic 6 - Optics Depth of Field and Circle Of Confusion

Prof. Feng Liu. Spring /05/2017

Transcription:

The Camera 1

How do we see the world? Let s design a camera Idea 1: put a piece of film in front of an object Do we get a reasonable image? Credit: Steve Seitz 2

Pinhole camera Idea 2: Add a barrier to block off most of the rays This reduces blurring The opening known as the aperture How does this transform the image? Credit: Steve Seitz 3

Pinhole camera model Pinhole model: Captures pencil of rays all rays through a single point The point is called Center of Projection (COP) The image is formed on the Image Plane Effective focal length f is distance from COP to Image Plane Credit: Steve Seitz 4

Camera Obscura The first camera Known to Aristotle Depth of the room is the effective focal length Camera Obscura, Gemma Frisius, 1558 5

ABELARDO MORELL http://www.abelardomorell.net/books/books_m02.html 6

http://www.abelardomorell.net/posts/camera-obscura/ 7

8

9

10

11

Project 5: a Shoe-box Camera Obscura 12

Another way to make pinhole camera Why so blurry? http://www.debevec.org/pinhole/ 13

Shrinking the aperture Less light gets through Why not make the aperture as small as possible? Less light gets through Diffraction effects Credit: Steve Seitz 14

Shrinking the aperture 15

3D to 2D Perspective projection 16

Dimensionality Reduction Machine (3D to 2D) 3D world 2D image What have we lost? Angles Distances (lengths) Figures Stephen E. Palmer, 2002 17

Funny things happen 18

Parallel lines aren t Figure by David Forsyth 19

Lengths can t be trusted... Can you find the mistake in this figure? Credit: David Forsyth 20

but humans adapt! Müller-Lyer Illusion We don t make measurements in the image plane http://www.michaelbach.de/ot/sze_muelue/index.html 21

Projecting 3D to 2D (Perspective, Orthographic, Weak Perspective) 22

Perspective Projection The coordinate system: Pin-hole model as an approximation Optical center (Center Of Projection) at the origin Put the image plane (Projection Plane) in front of the COP Why? Camera looks down the negative z axis we need this if we want right-handedcoordinates Credit: Steve Seitz 23

Projection on the image plane Projection equations Compute intersection with PP of ray from (x,y,z) to COP Derived using similar triangles (on board) We get the projection by throwing out the last coordinate: How do we express this in matrix form? Credit: Steve Seitz 24

. Y.. X. (x, y) (X, Y, Z) Z Compute intersection Compute projection 1. Divide by w Projection matrix 3D point 2. Drop off last coordinate Projection on the image plane 25

Orthographic Projection Special case of perspective projection Distance from the COP to the PP is infinite Image World Also called parallel projection What s the projection matrix? Credit: Steve Seitz 26

Weak Perspective Projection average distance divide by w, drop z 27

Using lenses 28

Credit: Steve Seitz 29

Focus and Defocus Object Lens Film circle of confusion A lens focuses light onto the film There is a specific distance at which objects are in focus other points project to a circle of confusion in the image Changing the shape of the lens changes this distance Credit: Steve Seitz 30

Thin lenses Thin lens equation: Any object point satisfying this equation is in focus What is the shape of the focus region? How can we change the focus region? Credit: Steve Seitz 31

The thin lens assumption assumes the lens has no thickness, but this isn t true Object Lens Film Focal point By adding more elements to the lens, the distance at which a scene is in focus can be made roughly planar. Credit: Steve Seitz 32

http://graphics.stanford.edu/papers/lfcamera/ 33

Depth of Field http://www.cambridgeincolour.com/tutorials/depth-of-field.htm 34

Depth of field Aperture Film f / 5.6 f / 32 Changing the aperture size affects depth of field A smaller aperture increases the range in which the object is approximately in focus But small aperture reduces amount of light need to increase exposure http://en.wikipedia.org/wiki/depth_of_field

Large aperture = small DOF Small aperture = large DOF 36

37

Field of View (Zoom) 38

Field of View (Zoom) = Cropping 39

FOV depends of Focal Length f Smaller FOV = larger Focal Length 40

Sigma 200-500mm F2.8 EX DG lens What does 1600mm lens look like? http://www.digitalpixels.net/varia/the-web/sigma-200-500mm-f28-ex-dg-lens-on-the-field/ http://dancarrphotography.com/blog/wp-content/uploads/2011/05/canon_super_tele_comparison.jpg 41

Varying focal length and distance Credit: Zisserman & Hartley 42

Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car 43

http://petapixel.com/2012/05/03/trippy-example-of-hitchcock-zoom-shot-on-a-beach/ 44

45

Points to remember Optimal aperture of pinhole camera is between the geometric and diffraction limit 3 projection models (perspective, orthographic, weak perspective) When using a lens: change aperture size ==> change depth of field change focal length ==> change in field of view change focal length and camera distance ==> changes projection effect 46