Computational Cameras. Rahul Raguram COMP

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Computational Cameras. Rahul Raguram COMP"

Transcription

1 Computational Cameras Rahul Raguram COMP

2 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene Computational camera Coded image Additional information

3 Computational cameras - examples * Catadioptric cameras * Source: S. K. Nayar, 2006

4 Computational cameras - examples * * Catadioptric cameras HDR imaging with assorted pixels * Source: S. K. Nayar, 2006

5 Computational cameras - examples * * Catadioptric cameras HDR imaging with assorted pixels * # Multiview radial cameras Time-of-flight cameras * Source: S. K. Nayar, 2006 # Source: L. Guan and M. Pollefeys, 2008

6 The aperture Glossographia Anglicana Nova, 1707 Diameter of the lens opening (controlled by diaphragm) Expressed as a fraction of focal length (f-number) f/2.0 with a 50mm lens: aperture is 25mm f/2.0 with a 100mm lens: aperture is 50mm Typical f-numbers: f/1.4, f/2, f/2.8, f/4, f/5.6, f/8 see a pattern?

7 Varying the aperture Small aperture large depth of field

8 Varying the aperture Large aperture small depth of field Bokeh (derived from Japanese boke ぼけ, a noun form of bokeru ぼける, "become blurred or fuzzy")

9 Multi-Aperture Photography Paul Green MIT CSAIL Wenyang Sun MERL Wojciech Matusik MERL Frédo Durand MIT CSAIL Slides by Green et al.

10 Motivation Depth of Field Control Shallow Depth of Field Portrait Landscape Large Aperture Large Depth of Field Small Aperture

11 Depth and Defocus Blur sensor lens plane of focus circle of confusion subject rays from point in focus converge to single pixel defocus blur depends on distance from plane of focus

12 Defocus Blur & Aperture circle of confusion sensor lens aperture plane of focus subject defocus blur depends on aperture size

13 Goals Aperture size is a critical parameter for photographers post-exposure depth of field control extrapolate shallow depth of field beyond physical aperture

14 Outline Multi-Aperture Camera New camera design Capture multiple aperture settings simultaneously Applications Depth of field control Depth of field extrapolation (Limited) refocusing

15 Related Work Computational Cameras Plenoptic Cameras Adelson and Wang 92 Ng et al 05 Georgiev et al 06 Split-Aperture Camera Aggarwal and Ahuja 04 Optical Splitting Trees McGuire et al 07 Coded Aperture Levin et al 07 Veeraraghavan et al 07 Wavefront Coding Dowski and Cathey 95 Depth from Defocus Pentland 87 Adelson and Wang 92 McGuire et al 07 Georgiev et al 06 Aggarwal and Ahuja 04 Levin et al 07 Veeraraghavan et al 07

16 Plenoptic Cameras Capture 4D LightField 2D Spatial (x,y) 2D Angular (u,v Aperture) Lens Aperture v Trade resolution for flexibility after capture Refocusing Depth of field control Improved Noise Characteristics Lenslet Array u Subject Sensor (x,y) Lens (u,v)

17 1D vs 2D Aperture Sampling Aperture v u 2D Grid Sampling

18 1D vs. 2D Aperture Sampling Aperture Aperture v 45 Samples 4 Samples u 2D Grid Sampling 1D Ring Sampling

19 Goals post-exposure depth of field control extrapolate shallow depth of field (limited) refocusing 1d sampling no beamsplitters single sensor removable

20 Optical Design Principles 3D sampling 2D spatial 1D aperture size 1 image for each ring Aperture Sensor

21 Aperture Splitting Mirrors Focusing lenses Sensor Incoming light Tilted Mirrors

22 Aperture Splitting Ideally at aperture plane, but not physically possible! Solution: Relay Optics to create virtual aperture plane Photographic Relay Lens system Aperture splitting optics Aperture Plane New Aperture Plane

23 Optical Prototype mirrors lenses SLR Camera main lens relay optics tilted mirrors Mirror Close-up

24 Sample Data Raw data from our camera

25 Point Spread Function Occlusion inner ring 1 ring 2 outer combined Ideally would be rings Gaps are from occlusion

26 Outline Multi-Aperture Camera New camera design Capture multiple aperture settings simultaneously Applications Depth of field control Depth of field extrapolation Refocusing

27 DOF Navigation I0 I2 I I 1 3

28 DOF Extrapolation? Approximate defocus blur as convolution I n = I K( σ 0 n I 0 I 1 I 2 I 3 ) Depends on depth and aperture size? I E K( σ n ) - Circular aperture blurring kernel

29 DOF Extrapolation Roadmap capture estimate blur fit model extrapolate blur Blur size Largest physical aperture I I I 3 2 I 1 0 I E Aperture Diameter

30 Summary Multi-aperture camera 1D sampling of aperture Removable Post-Exposure depth of field control Depth of field extrapolation

31 Image and Depth from a Conventional Camera with a Coded Aperture Anat Levin, Rob Fergus, Frédo Durand, William Freeman MIT CSAIL Slides by Levin et al.

32 Single input image: Output #1: Depth map

33 Output #1: Depth map Single input image: Output #2: All-focused image

34 Output #1: Depth map Single input image: Output #2: All-focused image

35

36

37 Lens and defocus Lens aperture Image of a point light source Lens Camera sensor Point spread function Focal plane

38 Lens and defocus Lens aperture Image of a defocused point light source Object Lens Camera sensor Point spread function Focal plane

39 Lens and defocus Lens aperture Image of a defocused point light source Object Lens Camera sensor Point spread function Focal plane

40 Lens and defocus Lens aperture Image of a defocused point light source Object Lens Camera sensor Point spread function Focal plane

41 Lens and defocus Lens aperture Image of a defocused point light source Object Lens Camera sensor Point spread function Focal plane

42 Depth and defocus Out of focus Depth from defocus: Infer depth by analyzing local scale of defocus blur In focus

43 Challenges Hard to discriminate a smooth scene from defocus blur? Out of focus Hard to undo defocus blur Input Ringing with conventional deblurring algorithm

44 Key contributions Exploit prior on natural images - Improve deconvolution - Improve depth discrimination Natural Unnatural Coded aperture (mask inside lens) - make defocus patterns different from natural images and easier to discriminate

45 Defocus as local convolution Input defocused image Calibrated blur kernels at different depths

46 Defocus as local convolution Input defocused image yy = f x k Local sub-window k Calibrated blur kernels at depth k Sharp sub-window Depth k=1: y = f k x Depth k=2: y = f k x Depth k=3: y = f k x

47 Overview Try deconvolving local input windows with different scaled filters: =? Larger scale =? Correct scale =? Smaller scale Somehow: select best scale.

48 Hard to deconvolve even when kernel is known Challenges Input Ringing with the traditional Richardson-Lucy deconvolution algorithm Hard to identify correct scale: =? Larger scale =? Correct scale? = Smaller scale

49 Deconvolution is ill posed f x = y? =

50 Deconvolution is ill posed f x = y Solution 1:? = Solution 2:? =

51 Idea 1: Natural images prior What makes images special? Natural Unnatural Image gradient Natural images have sparse gradients put a penalty on gradients

52 Deconvolution with prior x = argmin f x y 2 + λ i ρ( x ) i Convolution error Derivatives prior 2 _ +? Equal convolution error Low 2? _ + High

53 Comparing deconvolution algorithms (Non blind) deconvolution code available online: Input ρ ( x) = x spread gradients 2 ρ ( x) = x 0.8 localizes gradients Richardson-Lucy Gaussian prior Sparse prior

54 Comparing deconvolution algorithms (Non blind) deconvolution code available online: Input ρ ( x) = x spread gradients 2 ρ ( x) = x 0.8 localizes gradients Richardson-Lucy Gaussian prior Sparse prior

55 Recall: Overview Try deconvolving local input windows with different scaled filters: = Larger scale? = Correct scale? = Smaller scale? Somehow: select best scale. Challenge: smaller scale not so different than correct

56 Idea 2: Coded Aperture Mask (code) in aperture plane - make defocus patterns different from natural images and easier to discriminate Conventional aperture Our coded aperture

57 Solution: lens with occluder Object Lens Camera sensor Point spread function Focal plane

58 Solution: lens with occluder Aperture pattern Image of a defocused point light source Object Lens with coded aperture Camera sensor Point spread function Focal plane

59 Solution: lens with occluder Aperture pattern Image of a defocused point light source Object Lens with coded aperture Camera sensor Point spread function Focal plane

60 Solution: lens with occluder Aperture pattern Image of a defocused point light source Object Lens with coded aperture Camera sensor Point spread function Focal plane

61 Solution: lens with occluder Aperture pattern Image of a defocused point light source Object Lens with coded aperture Camera sensor Point spread function Focal plane

62 Solution: lens with occluder Aperture pattern Image of a defocused point light source Object Lens with coded aperture Camera sensor Point spread function Focal plane

63 Why coded? Coded aperture- reduce uncertainty in scale identification Conventional Coded Larger scale Correct scale Smaller scale

64 Depth results

65 Regularizing depth estimation Try deblurring with 10 different aperture scales x = argmin f x _ y 2 Convolution error + λ 2 + i ρ( x ) Derivatives prior i Keep minimal error scale in each local window + regularization Input Local depth estimation Regularized depth

66 Regularizing depth estimation Local depth estimation Input Regularized depth 305

67 Sometimes, manual intervention Input Local depth estimation Regularized depth 305 After user corrections 305

68 All focused results

69 Input

70 All-focused (deconvolved)

71 Close-up Original image All-focus image

72 Input

73 All-focused (deconvolved)

74 Close-up Original image All-focus image Naïve sharpening

75 Comparison- conventional aperture result Ringing due to wrong scale estimation

76 Comparison- coded aperture result

77 Application: Digital refocusing from a single image

78 Application: Digital refocusing from a single image

79 Application: Digital refocusing from a single image

80 Application: Digital refocusing from a single image

81 Application: Digital refocusing from a single image

82 Application: Digital refocusing from a single image

83 Application: Digital refocusing from a single image

84 Coded aperture: pros and cons Image AND depth at a single shot No loss of image resolution Simple modification to lens Depth is coarse unable to get depth at untextured areas, might need manual corrections But depth is a pure bonus Loss some light But deconvolution increases depth of field

85 Deconvolution code available

86 50mm f/1.8: $79.95 Cardboard: $1 Tape: $1 Depth acquisition: priceless

Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/

More information

Coded Computational Photography!

Coded Computational Photography! Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!

More information

Wavefront coding. Refocusing & Light Fields. Wavefront coding. Final projects. Is depth of field a blur? Frédo Durand Bill Freeman MIT - EECS

Wavefront coding. Refocusing & Light Fields. Wavefront coding. Final projects. Is depth of field a blur? Frédo Durand Bill Freeman MIT - EECS 6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Final projects Send your slides by noon on Thrusday. Send final report Refocusing & Light Fields Frédo Durand Bill Freeman

More information

Coded Aperture and Coded Exposure Photography

Coded Aperture and Coded Exposure Photography Coded Aperture and Coded Exposure Photography Martin Wilson University of Cape Town Cape Town, South Africa Email: Martin.Wilson@uct.ac.za Fred Nicolls University of Cape Town Cape Town, South Africa Email:

More information

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Yosuke Bando 1,2 Henry Holtzman 2 Ramesh Raskar 2 1 Toshiba Corporation 2 MIT Media Lab Defocus & Motion Blur PSF Depth

More information

Admin Deblurring & Deconvolution Different types of blur

Admin Deblurring & Deconvolution Different types of blur Admin Assignment 3 due Deblurring & Deconvolution Lecture 10 Last lecture Move to Friday? Projects Come and see me Different types of blur Camera shake User moving hands Scene motion Objects in the scene

More information

Computational Photography and Video. Prof. Marc Pollefeys

Computational Photography and Video. Prof. Marc Pollefeys Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

Coded Aperture for Projector and Camera for Robust 3D measurement

Coded Aperture for Projector and Camera for Robust 3D measurement Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement

More information

Deblurring. Basics, Problem definition and variants

Deblurring. Basics, Problem definition and variants Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying

More information

Computational Camera & Photography: Coded Imaging

Computational Camera & Photography: Coded Imaging Computational Camera & Photography: Coded Imaging Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Image removed due to copyright restrictions. See Fig. 1, Eight major types

More information

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do?

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do? Computational Photography The ultimate camera What does it do? Image from Durand & Freeman s MIT Course on Computational Photography Today s reading Szeliski Chapter 9 The ultimate camera Infinite resolution

More information

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f)

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f) Capturing Light Rooms by the Sea, Edward Hopper, 1951 The Penitent Magdalen, Georges de La Tour, c. 1640 Some slides from M. Agrawala, F. Durand, P. Debevec, A. Efros, R. Fergus, D. Forsyth, M. Levoy,

More information

When Does Computational Imaging Improve Performance?

When Does Computational Imaging Improve Performance? When Does Computational Imaging Improve Performance? Oliver Cossairt Assistant Professor Northwestern University Collaborators: Mohit Gupta, Changyin Zhou, Daniel Miau, Shree Nayar (Columbia University)

More information

What are Good Apertures for Defocus Deblurring?

What are Good Apertures for Defocus Deblurring? What are Good Apertures for Defocus Deblurring? Changyin Zhou, Shree Nayar Abstract In recent years, with camera pixels shrinking in size, images are more likely to include defocused regions. In order

More information

On the Recovery of Depth from a Single Defocused Image

On the Recovery of Depth from a Single Defocused Image On the Recovery of Depth from a Single Defocused Image Shaojie Zhuo and Terence Sim School of Computing National University of Singapore Singapore,747 Abstract. In this paper we address the challenging

More information

Transfer Efficiency and Depth Invariance in Computational Cameras

Transfer Efficiency and Depth Invariance in Computational Cameras Transfer Efficiency and Depth Invariance in Computational Cameras Jongmin Baek Stanford University IEEE International Conference on Computational Photography 2010 Jongmin Baek (Stanford University) Transfer

More information

Restoration of Motion Blurred Document Images

Restoration of Motion Blurred Document Images Restoration of Motion Blurred Document Images Bolan Su 12, Shijian Lu 2 and Tan Chew Lim 1 1 Department of Computer Science,School of Computing,National University of Singapore Computing 1, 13 Computing

More information

Introduction to Light Fields

Introduction to Light Fields MIT Media Lab Introduction to Light Fields Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Introduction to Light Fields Ray Concepts for 4D and 5D Functions Propagation of

More information

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Cameras Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Camera trial #1 scene film Put a piece of film in front of

More information

Defocus Map Estimation from a Single Image

Defocus Map Estimation from a Single Image Defocus Map Estimation from a Single Image Shaojie Zhuo Terence Sim School of Computing, National University of Singapore, Computing 1, 13 Computing Drive, Singapore 117417, SINGAPOUR Abstract In this

More information

Understanding Focal Length

Understanding Focal Length JANUARY 19, 2018 BEGINNER Understanding Focal Length Featuring DIANE BERKENFELD, DAVE BLACK, MIKE CORRADO & LINDSAY SILVERMAN Focal length, usually represented in millimeters (mm), is the basic description

More information

Flexible Depth of Field Photography

Flexible Depth of Field Photography TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Flexible Depth of Field Photography Sujit Kuthirummal, Hajime Nagahara, Changyin Zhou, and Shree K. Nayar Abstract The range of scene depths

More information

Mastering Y our Your Digital Camera

Mastering Y our Your Digital Camera Mastering Your Digital Camera The Exposure Triangle The ISO setting on your camera defines how sensitive it is to light. Normally ISO 100 is the least sensitive setting on your camera and as the ISO numbers

More information

Basic principles of photography. David Capel 346B IST

Basic principles of photography. David Capel 346B IST Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse

More information

Light field sensing. Marc Levoy. Computer Science Department Stanford University

Light field sensing. Marc Levoy. Computer Science Department Stanford University Light field sensing Marc Levoy Computer Science Department Stanford University The scalar light field (in geometrical optics) Radiance as a function of position and direction in a static scene with fixed

More information

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Amit

More information

fast blur removal for wearable QR code scanners

fast blur removal for wearable QR code scanners fast blur removal for wearable QR code scanners Gábor Sörös, Stephan Semmler, Luc Humair, Otmar Hilliges ISWC 2015, Osaka, Japan traditional barcode scanning next generation barcode scanning ubiquitous

More information

High dynamic range imaging and tonemapping

High dynamic range imaging and tonemapping High dynamic range imaging and tonemapping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 12 Course announcements Homework 3 is out. - Due

More information

Coded Aperture Imaging

Coded Aperture Imaging Coded Aperture Imaging Manuel Martinello School of Engineering and Physical Sciences Heriot-Watt University A thesis submitted for the degree of PhilosophiæDoctor (PhD) May 2012 1. Reviewer: Prof. Richard

More information

Today. Defocus. Deconvolution / inverse filters. MIT 2.71/2.710 Optics 12/12/05 wk15-a-1

Today. Defocus. Deconvolution / inverse filters. MIT 2.71/2.710 Optics 12/12/05 wk15-a-1 Today Defocus Deconvolution / inverse filters MIT.7/.70 Optics //05 wk5-a- MIT.7/.70 Optics //05 wk5-a- Defocus MIT.7/.70 Optics //05 wk5-a-3 0 th Century Fox Focus in classical imaging in-focus defocus

More information

Image Deblurring with Blurred/Noisy Image Pairs

Image Deblurring with Blurred/Noisy Image Pairs Image Deblurring with Blurred/Noisy Image Pairs Huichao Ma, Buping Wang, Jiabei Zheng, Menglian Zhou April 26, 2013 1 Abstract Photos taken under dim lighting conditions by a handheld camera are usually

More information

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics IMAGE FORMATION Light source properties Sensor characteristics Surface Exposure shape Optics Surface reflectance properties ANALOG IMAGES An image can be understood as a 2D light intensity function f(x,y)

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Computational Aesthetics in Graphics, Visualization, and Imaging (2008) P. Brown, D. W. Cunningham, V. Interrante, and J. McCormack (Editors) Modeling and Synthesis of Aperture Effects in Cameras Douglas

More information

A Layer-Based Restoration Framework for Variable-Aperture Photography

A Layer-Based Restoration Framework for Variable-Aperture Photography A Layer-Based Restoration Framework for Variable-Aperture Photography Samuel W. Hasinoff Kiriakos N. Kutulakos University of Toronto {hasinoff,kyros}@cs.toronto.edu Abstract We present variable-aperture

More information

Sensors and Sensing Cameras and Camera Calibration

Sensors and Sensing Cameras and Camera Calibration Sensors and Sensing Cameras and Camera Calibration Todor Stoyanov Mobile Robotics and Olfaction Lab Center for Applied Autonomous Sensor Systems Örebro University, Sweden todor.stoyanov@oru.se 20.11.2014

More information

La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010

La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010 La photographie numérique Frank NIELSEN Lundi 7 Juin 2010 1 Le Monde digital Key benefits of the analog2digital paradigm shift? Dissociate contents from support : binarize Universal player (CPU, Turing

More information

TYPICAL cameras have three major controls

TYPICAL cameras have three major controls IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL., NO., JANUARY 2009 Multiple-Aperture Photography for High Dynamic Range and Post-Capture Refocusing Samuel W. Hasinoff, Member, IEEE,

More information

Privacy Preserving Optics for Miniature Vision Sensors

Privacy Preserving Optics for Miniature Vision Sensors Privacy Preserving Optics for Miniature Vision Sensors Francesco Pittaluga and Sanjeev J. Koppal University of Florida Electrical and Computer Engineering Shoham et al. 07, Wood 08, Enikov et al. 09, Agrihouse

More information

Image and Depth from a Single Defocused Image Using Coded Aperture Photography

Image and Depth from a Single Defocused Image Using Coded Aperture Photography Image and Depth from a Single Defocused Image Using Coded Aperture Photography Mina Masoudifar a, Hamid Reza Pourreza a a Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran

More information

Depth Estimation Algorithm for Color Coded Aperture Camera

Depth Estimation Algorithm for Color Coded Aperture Camera Depth Estimation Algorithm for Color Coded Aperture Camera Ivan Panchenko, Vladimir Paramonov and Victor Bucha; Samsung R&D Institute Russia; Moscow, Russia Abstract In this paper we present an algorithm

More information

4D Frequency Analysis of Computational Cameras for Depth of Field Extension

4D Frequency Analysis of Computational Cameras for Depth of Field Extension 4D Frequency Analysis of Computational Cameras for Depth of Field Extension Anat Levin1,2 Samuel W. Hasinoff1 Paul Green1 Fre do Durand1 1 MIT CSAIL 2 Weizmann Institute Standard lens image Our lattice-focal

More information

Flexible Depth of Field Photography

Flexible Depth of Field Photography TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Flexible Depth of Field Photography Sujit Kuthirummal, Hajime Nagahara, Changyin Zhou, and Shree K. Nayar Abstract The range of scene depths

More information

Reflectors vs. Refractors

Reflectors vs. Refractors 1 Telescope Types - Telescopes collect and concentrate light (which can then be magnified, dispersed as a spectrum, etc). - In the end it is the collecting area that counts. - There are two primary telescope

More information

Improving Film-Like Photography. aka, Epsilon Photography

Improving Film-Like Photography. aka, Epsilon Photography Improving Film-Like Photography aka, Epsilon Photography Ankit Mohan Courtesy of Ankit Mohan. Used with permission. Film-like like Optics: Imaging Intuition Angle(θ,ϕ) Ray Center of Projection Position

More information

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2!

Cameras and Sensors. Today. Today. It receives light from all directions. BIL721: Computational Photography! Spring 2015, Lecture 2! !! Cameras and Sensors Today Pinhole camera! Lenses! Exposure! Sensors! photo by Abelardo Morell BIL721: Computational Photography! Spring 2015, Lecture 2! Aykut Erdem! Hacettepe University! Computer Vision

More information

Coded Exposure HDR Light-Field Video Recording

Coded Exposure HDR Light-Field Video Recording Coded Exposure HDR Light-Field Video Recording David C. Schedl, Clemens Birklbauer, and Oliver Bimber* Johannes Kepler University Linz *firstname.lastname@jku.at Exposure Sequence long exposed short HDR

More information

Focusing and Metering

Focusing and Metering Focusing and Metering CS 478 Winter 2012 Slides mostly stolen by David Jacobs from Marc Levoy Focusing Outline Manual Focus Specialty Focus Autofocus Active AF Passive AF AF Modes Manual Focus - View Camera

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Part : Image Enhancement in the Spatial Domain AASS Learning Systems Lab, Dep. Teknik Room T9 (Fr, - o'clock) achim.lilienthal@oru.se Course Book Chapter 3-4- Contents. Image Enhancement

More information

Optical design of a high resolution vision lens

Optical design of a high resolution vision lens Optical design of a high resolution vision lens Paul Claassen, optical designer, paul.claassen@sioux.eu Marnix Tas, optical specialist, marnix.tas@sioux.eu Prof L.Beckmann, l.beckmann@hccnet.nl Summary:

More information

Kent Messamore 3/12/2010

Kent Messamore 3/12/2010 Photo Composition Kent Messamore 3/12/2010 Composition Choosing a Subject Quality of Light Framing the Image Depth of Field Backgrounds and Foregrounds Viewpoint Leading Lines Contrasts Patterns Negative

More information

Single-view Metrology and Cameras

Single-view Metrology and Cameras Single-view Metrology and Cameras 10/10/17 Computational Photography Derek Hoiem, University of Illinois Project 2 Results Incomplete list of great project pages Haohang Huang: Best presented project;

More information

Dental photography: Dentist Blog. This is what matters when choosing the right camera equipment! Checklist. blog.ivoclarvivadent.

Dental photography: Dentist Blog. This is what matters when choosing the right camera equipment! Checklist. blog.ivoclarvivadent. Dental photography: This is what matters when choosing the right camera equipment! Checklist Dentist Blog blog.ivoclarvivadent.com/dentist Dental photography: This is what matters when choosing the right

More information

To Denoise or Deblur: Parameter Optimization for Imaging Systems

To Denoise or Deblur: Parameter Optimization for Imaging Systems To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra, Oliver Cossairt and Ashok Veeraraghavan 1 ECE, Rice University 2 EECS, Northwestern University 3/3/2014 1 Capture moving

More information

Tomorrow s Digital Photography

Tomorrow s Digital Photography Tomorrow s Digital Photography Gerald Peter Vienna University of Technology Figure 1: a) - e): A series of photograph with five different exposures. f) In the high dynamic range image generated from a)

More information

Aperture Explained. helping you to better understand your digital SLR camera SLR PHOTOGRAPHY GUIDE

Aperture Explained. helping you to better understand your digital SLR camera SLR PHOTOGRAPHY GUIDE Aperture Explained helping you to better understand your digital SLR camera SLR PHOTOGRAPHY GUIDE WELCOME 1 helping you to better understand your digital SLR camera. This 4 part series will cover Aperture,

More information

Aperture, Shutter Speed and ISO

Aperture, Shutter Speed and ISO Aperture, Shutter Speed and ISO Before you start your journey to becoming a Rockstar Concert Photographer, you need to master the basics of photography. In this lecture I ll explain the 3 parameters aperture,

More information

Modulation Transfer Function

Modulation Transfer Function Modulation Transfer Function The Modulation Transfer Function (MTF) is a useful tool in system evaluation. t describes if, and how well, different spatial frequencies are transferred from object to image.

More information

The Formation of an Aerial Image, part 3

The Formation of an Aerial Image, part 3 T h e L i t h o g r a p h y T u t o r (July 1993) The Formation of an Aerial Image, part 3 Chris A. Mack, FINLE Technologies, Austin, Texas In the last two issues, we described how a projection system

More information

Computational Photography Image Stabilization

Computational Photography Image Stabilization Computational Photography Image Stabilization Jongmin Baek CS 478 Lecture Mar 7, 2012 Overview Optical Stabilization Lens-Shift Sensor-Shift Digital Stabilization Image Priors Non-Blind Deconvolution Blind

More information

A Comprehensive Review on Image Restoration Techniques

A Comprehensive Review on Image Restoration Techniques International Journal of Research in Advent Technology, Vol., No.3, March 014 E-ISSN: 31-9637 A Comprehensive Review on Image Restoration Techniques Biswa Ranjan Mohapatra, Ansuman Mishra, Sarat Kumar

More information

Progressive Inter-scale and Intra-scale Non-blind Image Deconvolution

Progressive Inter-scale and Intra-scale Non-blind Image Deconvolution Progressive Inter-scale and Intra-scale Non-blind Image Deconvolution Lu Yuan 1 Jian Sun 2 Long Quan 1 Heung-Yeung Shum 2 1 The Hong Kong University of Science and Technology 2 Microsoft Research Asia

More information

Focal Sweep Imaging with Multi-focal Diffractive Optics

Focal Sweep Imaging with Multi-focal Diffractive Optics Focal Sweep Imaging with Multi-focal Diffractive Optics Yifan Peng 2,3 Xiong Dun 1 Qilin Sun 1 Felix Heide 3 Wolfgang Heidrich 1,2 1 King Abdullah University of Science and Technology, Thuwal, Saudi Arabia

More information

1.1 Related work. Levin et al.

1.1 Related work. Levin et al. Image and Depth from a Conventional Camera with a Coded Aperture Anat Levin Rob Fergus Fre do Durand William T. Freeman Massachusetts Institute of Technology, Computer Science and Artificial Intelligence

More information

So far, I have discussed setting up the camera for

So far, I have discussed setting up the camera for Chapter 3: The Shooting Modes So far, I have discussed setting up the camera for quick shots, relying on features such as Auto mode for taking pictures with settings controlled mostly by the camera s automation.

More information

Pattern Recognition 44 (2011) Contents lists available at ScienceDirect. Pattern Recognition. journal homepage:

Pattern Recognition 44 (2011) Contents lists available at ScienceDirect. Pattern Recognition. journal homepage: Pattern Recognition 44 () 85 858 Contents lists available at ScienceDirect Pattern Recognition journal homepage: www.elsevier.com/locate/pr Defocus map estimation from a single image Shaojie Zhuo, Terence

More information

Accelerating defocus blur magnification

Accelerating defocus blur magnification Accelerating defocus blur magnification Florian Kriener, Thomas Binder and Manuel Wille Google Inc. (a) Input image I (b) Sparse blur map β (c) Full blur map α (d) Output image J Figure 1: Real world example

More information

Optical image stabilization (IS)

Optical image stabilization (IS) Optical image stabilization (IS) CS 178, Spring 2013 Begun 4/30/13, finished 5/2/13. Marc Levoy Computer Science Department Stanford University Outline what are the causes of camera shake? how can you

More information

Sensing Increased Image Resolution Using Aperture Masks

Sensing Increased Image Resolution Using Aperture Masks Sensing Increased Image Resolution Using Aperture Masks Ankit Mohan, Xiang Huang, Jack Tumblin EECS Department, Northwestern University http://www.cs.northwestern.edu/ amohan Ramesh Raskar Mitsubishi Electric

More information

Notes from Lens Lecture with Graham Reed

Notes from Lens Lecture with Graham Reed Notes from Lens Lecture with Graham Reed Light is refracted when in travels between different substances, air to glass for example. Light of different wave lengths are refracted by different amounts. Wave

More information

Warning : Be Aware that Some HyperFocal Distance (HFD) Calculators on the Web will give you misleading Hyperfocal Distance and DOF values

Warning : Be Aware that Some HyperFocal Distance (HFD) Calculators on the Web will give you misleading Hyperfocal Distance and DOF values Fountain Hills Photography Club Information Series Bruce Boyce 9/2/14 Warning : Be Aware that Some HyperFocal Distance (HFD) Calculators on the Web will give you misleading Hyperfocal Distance and DOF

More information

( ) Deriving the Lens Transmittance Function. Thin lens transmission is given by a phase with unit magnitude.

( ) Deriving the Lens Transmittance Function. Thin lens transmission is given by a phase with unit magnitude. Deriving the Lens Transmittance Function Thin lens transmission is given by a phase with unit magnitude. t(x, y) = exp[ jk o ]exp[ jk(n 1) (x, y) ] Find the thickness function for left half of the lens

More information

Perception. Introduction to HRI Simmons & Nourbakhsh Spring 2015

Perception. Introduction to HRI Simmons & Nourbakhsh Spring 2015 Perception Introduction to HRI Simmons & Nourbakhsh Spring 2015 Perception my goals What is the state of the art boundary? Where might we be in 5-10 years? The Perceptual Pipeline The classical approach:

More information

PTC School of Photography. Beginning Course Class 2 - Exposure

PTC School of Photography. Beginning Course Class 2 - Exposure PTC School of Photography Beginning Course Class 2 - Exposure Today s Topics: What is Exposure Shutter Speed for Exposure Shutter Speed for Motion Aperture for Exposure Aperture for Depth of Field Exposure

More information

Prof. Feng Liu. Spring /05/2017

Prof. Feng Liu. Spring /05/2017 Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 04/05/2017 Last Time Course overview Admin. Info Computational Photography 2 Today Digital Camera History of Camera Controlling Camera

More information

Reference and User Manual May, 2015 revision - 3

Reference and User Manual May, 2015 revision - 3 Reference and User Manual May, 2015 revision - 3 Innovations Foresight 2015 - Powered by Alcor System 1 For any improvement and suggestions, please contact customerservice@innovationsforesight.com Some

More information

Bioimage Informatics

Bioimage Informatics Bioimage Informatics Lecture 5, Spring 01 Fundamentals of Fluorescence Microscopy (II) Bioimage Data Analysis (I): Basic Operations Lecture 5 January 5, 01 1 Outline Performance metrics of a microscope

More information

History of projection

History of projection History of projection Ancient times: Greeks wrote about laws of perspective Renaissance: perspective is adopted by artists Duccio c. 1308 History of projection Later Renaissance: perspective formalized

More information

SHAPE FROM FOCUS. Keywords defocus, focus operator, focus measure function, depth estimation, roughness and tecture, automatic shapefromfocus.

SHAPE FROM FOCUS. Keywords defocus, focus operator, focus measure function, depth estimation, roughness and tecture, automatic shapefromfocus. SHAPE FROM FOCUS k.kanthamma*, Dr S.A.K.Jilani** *(Department of electronics and communication engineering, srinivasa ramanujan institute of technology, Anantapur,Andrapradesh,INDIA ** (Department of electronics

More information

DESIGNING AND IMPLEMENTING AN ADAPTIVE OPTICS SYSTEM FOR THE UH HOKU KE`A OBSERVATORY ABSTRACT

DESIGNING AND IMPLEMENTING AN ADAPTIVE OPTICS SYSTEM FOR THE UH HOKU KE`A OBSERVATORY ABSTRACT DESIGNING AND IMPLEMENTING AN ADAPTIVE OPTICS SYSTEM FOR THE UH HOKU KE`A OBSERVATORY University of Hawai`i at Hilo Alex Hedglen ABSTRACT The presented project is to implement a small adaptive optics system

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Part 2: Image Enhancement Digital Image Processing Course Introduction in the Spatial Domain Lecture AASS Learning Systems Lab, Teknik Room T26 achim.lilienthal@tech.oru.se Course

More information

Single-Image Shape from Defocus

Single-Image Shape from Defocus Single-Image Shape from Defocus José R.A. Torreão and João L. Fernandes Instituto de Computação Universidade Federal Fluminense 24210-240 Niterói RJ, BRAZIL Abstract The limited depth of field causes scene

More information

Image Formation: Camera Model

Image Formation: Camera Model Image Formation: Camera Model Ruigang Yang COMP 684 Fall 2005, CS684-IBMR Outline Camera Models Pinhole Perspective Projection Affine Projection Camera with Lenses Digital Image Formation The Human Eye

More information

Panoramic imaging. Ixyzϕθλt. 45 degrees FOV (normal view)

Panoramic imaging. Ixyzϕθλt. 45 degrees FOV (normal view) Camera projections Recall the plenoptic function: Panoramic imaging Ixyzϕθλt (,,,,,, ) At any point xyz,, in space, there is a full sphere of possible incidence directions ϕ, θ, covered by 0 ϕ 2π, 0 θ

More information

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the

More information

Wavelengths and Colors. Ankit Mohan MAS.131/531 Fall 2009

Wavelengths and Colors. Ankit Mohan MAS.131/531 Fall 2009 Wavelengths and Colors Ankit Mohan MAS.131/531 Fall 2009 Epsilon over time (Multiple photos) Prokudin-Gorskii, Sergei Mikhailovich, 1863-1944, photographer. Congress. Epsilon over time (Bracketing) Image

More information

Motion Blurred Image Restoration based on Super-resolution Method

Motion Blurred Image Restoration based on Super-resolution Method Motion Blurred Image Restoration based on Super-resolution Method Department of computer science and engineering East China University of Political Science and Law, Shanghai, China yanch93@yahoo.com.cn

More information

aperture, shutter speed

aperture, shutter speed CUDGEGONG C A M E R A C L U B aperture, shutter speed and ISO exposure When you think of the craft or art of photography, you must immediately think of exposure. Exposure is a critical element that determines

More information

arxiv: v2 [cs.cv] 31 Jul 2017

arxiv: v2 [cs.cv] 31 Jul 2017 Noname manuscript No. (will be inserted by the editor) Hybrid Light Field Imaging for Improved Spatial Resolution and Depth Range M. Zeshan Alam Bahadir K. Gunturk arxiv:1611.05008v2 [cs.cv] 31 Jul 2017

More information

Lensless Imaging with a Controllable Aperture

Lensless Imaging with a Controllable Aperture Lensless Imaging with a Controllable Aperture Assaf Zomet Shree K. Nayar Computer Science Department Columbia University New York, NY, 10027 E-mail: zomet@humaneyes.com, nayar@cs.columbia.edu Abstract

More information

Aberrations and adaptive optics for biomedical microscopes

Aberrations and adaptive optics for biomedical microscopes Aberrations and adaptive optics for biomedical microscopes Martin Booth Department of Engineering Science And Centre for Neural Circuits and Behaviour University of Oxford Outline Rays, wave fronts and

More information

Characterization of Actinic Mask Blank Inspection for Improving Sensitivity

Characterization of Actinic Mask Blank Inspection for Improving Sensitivity Characterization of Actinic Mask Blank Inspection for Improving Sensitivity Yoshihiro Tezuka, Toshihiko Tanaka, Tsuneo Terasawa, Toshihisa Tomie * M-ASET, Tsukuba, Japan * M-ASRC, AIST, Tsukuba, Japan

More information

Image features: Histograms, Aliasing, Filters, Orientation and HOG. D.A. Forsyth

Image features: Histograms, Aliasing, Filters, Orientation and HOG. D.A. Forsyth Image features: Histograms, Aliasing, Filters, Orientation and HOG D.A. Forsyth Simple color features Histogram of image colors in a window Opponent color representations R-G B-Y=B-(R+G)/2 Intensity=(R+G+B)/3

More information

Digital Imaging Systems for Historical Documents

Digital Imaging Systems for Historical Documents Digital Imaging Systems for Historical Documents Improvement Legibility by Frequency Filters Kimiyoshi Miyata* and Hiroshi Kurushima** * Department Museum Science, ** Department History National Museum

More information

Motivation: Image denoising. How can we reduce noise in a photograph?

Motivation: Image denoising. How can we reduce noise in a photograph? Linear filtering Motivation: Image denoising How can we reduce noise in a photograph? Moving average Let s replace each pixel with a weighted average of its neighborhood The weights are called the filter

More information

Non-adaptive Wavefront Control

Non-adaptive Wavefront Control OWL Phase A Review - Garching - 2 nd to 4 th Nov 2005 Non-adaptive Wavefront Control (Presented by L. Noethe) 1 Specific problems in ELTs and OWL Concentrate on problems which are specific for ELTs and,

More information

PHOTOGRAPHY: MINI-SYMPOSIUM

PHOTOGRAPHY: MINI-SYMPOSIUM PHOTOGRAPHY: MINI-SYMPOSIUM In Adobe Lightroom Loren Nelson www.naturalphotographyjackson.com Welcome and introductions Overview of general problems in photography Avoiding image blahs Focus / sharpness

More information

Michal Šorel, Filip Šroubek and Jan Flusser. Book title goes here

Michal Šorel, Filip Šroubek and Jan Flusser. Book title goes here Michal Šorel, Filip Šroubek and Jan Flusser Book title goes here 2 1 Towards super-resolution in the presence of spatially varying blur CONTENTS 1.1 Introduction.........................................................

More information

Aperture & ƒ/stop Worksheet

Aperture & ƒ/stop Worksheet Tools and Program Needed: Digital C. Computer USB Drive Bridge PhotoShop Name: Manipulating Depth-of-Field Aperture & stop Worksheet The aperture setting (AV on the dial) is a setting to control the amount

More information