Two strategies for realistic rendering capture real world data synthesize from bottom up

Similar documents
The Camera : Computational Photography Alexei Efros, CMU, Fall 2008

The Camera : Computational Photography Alexei Efros, CMU, Fall 2005

How do we see the world?

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1

Projection. Projection. Image formation. Müller-Lyer Illusion. Readings. Readings. Let s design a camera. Szeliski 2.1. Szeliski 2.

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

Cameras. CSE 455, Winter 2010 January 25, 2010

Building a Real Camera

Building a Real Camera. Slides Credit: Svetlana Lazebnik

CS6670: Computer Vision

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction

Unit 1: Image Formation

CSE 473/573 Computer Vision and Image Processing (CVIP)

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

CS6670: Computer Vision

LENSES. INEL 6088 Computer Vision

Computer Vision. The Pinhole Camera Model

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

Lecture 7: Camera Models

Proj 2. Looks like the evaluation function changed in converting to Python, and 80% on Notre Dame is more tricky to reach.

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Lenses, exposure, and (de)focus

Applied Optics. , Physics Department (Room #36-401) , ,

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Lecture 02 Image Formation 1

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

Lecture 2 Camera Models

Single-view Metrology and Cameras

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

VC 11/12 T2 Image Formation

CS 443: Imaging and Multimedia Cameras and Lenses

Image Formation III Chapter 1 (Forsyth&Ponce) Cameras Lenses & Sensors

Image Formation and Capture

VC 14/15 TP2 Image Formation

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2!

TSBB09 Image Sensors 2018-HT2. Image Formation Part 1

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

CSE 527: Introduction to Computer Vision

Lenses. Overview. Terminology. The pinhole camera. Pinhole camera Lenses Principles of operation Limitations

Chapter 25 Optical Instruments

Mirrors, Lenses &Imaging Systems

CPSC 425: Computer Vision

Chapter 18 Optical Elements

Ch 24. Geometric Optics

Laboratory experiment aberrations

Name. Light Chapter Summary Cont d. Refraction

VC 16/17 TP2 Image Formation

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

PHYS 1020 LAB 7: LENSES AND OPTICS. Pre-Lab

Waves & Oscillations

Chapter 23. Mirrors and Lenses

Mirrors and Lenses. Images can be formed by reflection from mirrors. Images can be formed by refraction through lenses.

Image Formation: Camera Model

CH. 23 Mirrors and Lenses HW# 6, 7, 9, 11, 13, 21, 25, 31, 33, 35

CHAPTER 18 REFRACTION & LENSES

Lenses. A transparent object used to change the path of light Examples: Human eye Eye glasses Camera Microscope Telescope

Chapter 23. Mirrors and Lenses

Chapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing

Optical Systems: Pinhole Camera Pinhole camera: simple hole in a box: Called Camera Obscura Aristotle discussed, Al-Hazen analyzed in Book of Optics

Lecture 7: Camera Models

Digital Image Processing COSC 6380/4393

Astronomy 80 B: Light. Lecture 9: curved mirrors, lenses, aberrations 29 April 2003 Jerry Nelson

Image Processing & Projective geometry

Dr F. Cuzzolin 1. September 29, 2015

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera High dynamic range imaging

Image Formation. Light from distant things. Geometrical optics. Pinhole camera. Chapter 36

Lecture 7: homogeneous coordinates

SNC2D PHYSICS 5/25/2013. LIGHT & GEOMETRIC OPTICS L Converging & Diverging Lenses (P ) Curved Lenses. Curved Lenses

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration

Lecture 2 Camera Models

Notation for Mirrors and Lenses. Chapter 23. Types of Images for Mirrors and Lenses. More About Images

PHYSICS OPTICS. Mr Rishi Gopie

Course Syllabus OSE 3200 Geometric Optics

Lab 2 Geometrical Optics

Note on Posted Slides. Fermat s Principle of Least Time. History of Light. Law of Reflection The angle of reflection equals the angle of incidence.

Note on Posted Slides. Fermat s Principle of Least Time. History of Light. Law of Reflection The angle of reflection equals the angle of incidence.

Computational Photography and Video. Prof. Marc Pollefeys

Chapter 28. Reflection and Refraction

Chapter Ray and Wave Optics

Average: Standard Deviation: Max: 99 Min: 40

General Physics II. Ray Optics

Notes from Lens Lecture with Graham Reed

Digital Image Processing COSC 6380/4393

Converging and Diverging Surfaces. Lenses. Converging Surface

GEOMETRICAL OPTICS AND OPTICAL DESIGN

Converging Lenses. Parallel rays are brought to a focus by a converging lens (one that is thicker in the center than it is at the edge).

Lenses Design Basics. Introduction. RONAR-SMITH Laser Optics. Optics for Medical. System. Laser. Semiconductor Spectroscopy.

Chapter 23. Geometrical Optics: Mirrors and Lenses and other Instruments

Lecture 8 Camera Models

Cameras, lenses, and sensors

Criteria for Optical Systems: Optical Path Difference How do we determine the quality of a lens system? Several criteria used in optical design

Test Review # 8. Physics R: Form TR8.17A. Primary colors of light

Chapter 29/30. Wave Fronts and Rays. Refraction of Sound. Dispersion in a Prism. Index of Refraction. Refraction and Lenses

R.B.V.R.R. WOMEN S COLLEGE (AUTONOMOUS) Narayanaguda, Hyderabad.

Transcription:

Recap from Wednesday Two strategies for realistic rendering capture real world data synthesize from bottom up Both have existed for 500 years. Both are successful. Attempts to take the best of both world have been successful. We re going to take it further.

Administrative Stuff Any questions? Syllabus Textbook Matlab Tutorial Office hours James: Monday and Wednesday, 1pm to 2pm Sam: Sunday 7:30-9:30pm Emanuel: Monday 5-7pm Project 1 is out

Project 1

The Camera Many slides by Alexei A. Efros CS 129: Computational Photography James Hays, Brown, Spring 2011

How do we see the world? Let s design a camera Idea 1: put a piece of film in front of an object Do we get a reasonable image? Slide by Steve Seitz

Pinhole camera Add a barrier to block off most of the rays This reduces blurring The opening known as the aperture How does this transform the image? Slide by Steve Seitz

Pinhole camera model Pinhole model: Captures pencil of rays all rays through a single point The point is called Center of Projection (COP) The image is formed on the Image Plane Effective focal length f is distance from COP to Image Plane Slide by Steve Seitz

Dimensionality Reduction Machine (3D to 2D) 3D world 2D image Point of observation What have we lost? Angles Depth, lengths Figures Stephen E. Palmer, 2002

Funny things happen

Lengths can t be trusted... B C A Figure by David Forsyth

but humans adopt! Müller-Lyer Illusion We don t make measurements in the image plane http://www.michaelbach.de/ot/sze_muelue/index.html

Modeling projection The coordinate system We will use the pin-hole model as an approximation Put the optical center (Center Of Projection) at the origin Put the image plane (Projection Plane) in front of the COP Why? The camera looks down the negative z axis we need this if we want right-handed-coordinates Slide by Steve Seitz

Modeling projection Projection equations Compute intersection with PP of ray from (x,y,z) to COP Derived using similar triangles We get the projection by throwing out the last coordinate: Slide by Steve Seitz

Homogeneous coordinates Is this a linear transformation? no division by z is nonlinear Trick: add one more coordinate: homogeneous image coordinates homogeneous scene coordinates Converting from homogeneous coordinates Slide by Steve Seitz

Perspective Projection Projection is a matrix multiply using homogeneous coordinates: divide by third coordinate This is known as perspective projection The matrix is the projection matrix Can also formulate as a 4x4 divide by fourth coordinate Slide by Steve Seitz

Orthographic Projection Special case of perspective projection Distance from the COP to the PP is infinite Image World Also called parallel projection What s the projection matrix? Slide by Steve Seitz

Building a real camera

Camera Obscura Camera Obscura, Gemma Frisius, 1558 The first camera Known to Aristotle Depth of the room is the effective focal length

Home-made pinhole camera Why so blurry? http://www.debevec.org/pinhole/

Shrinking the aperture Less light gets through Why not make the aperture as small as possible? Less light gets through Diffraction effects Slide by Steve Seitz

Shrinking the aperture

The reason for lenses Slide by Steve Seitz

Focus

Focus and Defocus circle of confusion A lens focuses light onto the film There is a specific distance at which objects are in focus other points project to a circle of confusion in the image Changing the shape of the lens changes this distance Slide by Steve Seitz

Thin lenses Thin lens equation: Any object point satisfying this equation is in focus What is the shape of the focus region? How can we change the focus region? Thin lens applet: http://www.phy.ntnu.edu.tw/java/lens/lens_e.html (by Fu-Kwun Hwang ) Slide by Steve Seitz

Depth Of Field

Depth of Field http://www.cambridgeincolour.com/tutorials/depth-of-field.htm

Aperture controls Depth of Field Changing the aperture size affects depth of field A smaller aperture increases the range in which the object is approximately in focus But small aperture reduces amount of light need to increase exposure

Large apeture = small DOF Small apeture = large DOF Varying the aperture

Depth of Field

Field of View (Zoom)

Field of View (Zoom)

Field of View (Zoom) = Cropping

FOV depends of Focal Length f Smaller FOV = larger Focal Length

From Zisserman & Hartley

Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car

Fun with Focal Length (Jim Sherwood) http://www.hash.com/users/jsherwood/tutes/focal/zoomin.mov

Lens Flaws

Lens Flaws: Chromatic Aberration Dispersion: wavelength-dependent refractive index (enables prism to spread white light beam into rainbow) Modifies ray-bending and lens focal length: f( ) color fringes near edges of image Corrections: add doublet lens of flint glass, etc.

Chromatic Aberration Near Lens Center Near Lens Outer Edge

Radial Distortion (e.g. Barrel and pin-cushion ) straight lines curve around the image center

Radial Distortion No distortion Pin cushion Barrel Radial distortion of the image Caused by imperfect lenses Deviations are most noticeable for rays that pass through the edge of the lens