La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010

Size: px
Start display at page:

Download "La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010"

Transcription

1 La photographie numérique Frank NIELSEN Lundi 7 Juin

2 Le Monde digital Key benefits of the analog2digital paradigm shift? Dissociate contents from support : binarize Universal player (CPU, Turing machine) Generic algorithms

3 Le Monde numérique Monde numérique omnipresent, informatique ubiquitaire Numérique = Digital + Calcul Nouveautés Exemple: Image numérique (=calculée)

4 Photographie numérique : Une profonde révolution a venir? Photography Computational Photography Pas seulement dans le domaine grand public mais aussi dans beaucoup d autres domaines des sciences Computational anatomy (differential geometry)

5 Introduction: What s computational photography?? Example 1 Non Photo Realistic Camera

6 Warm up: Nonphotorealistic camera (NPR camera) Multiple flashes to easily get depth discontinuities Canny edge detector Source image (for comparison only) Baseline 50mm (depth 5mm at 2 meters) Stylized rendering Multiflash depth edge

7 Warm up: Nonphotorealistic (NPR) camera Laparoscope camera with two fiber optics lighting Shadow to the right Difficult to analyze using traditional image processing techniques Shadow to the left Remove shadows, show lesion from depth discontinuity analysis A Non-Photorealistic Camera: Depth Edge Detection and Stylized Rendering with Multi-Flash Imaging.SIGGRAPH

8 Introduction: What s computational photography?? Example 2 Synthetic Aperture Focusing Camera

9 Warm up: Synthetic aperture focusing camera (SAF) aperture focal length sensor size Aperture means beyond pinhole camera algorithms ( SAF camera: 1-shot many images!) lens Camera array provides many individual apertures synthetic aperture focusing High Performance Imaging Using Large Camera Arrays. SIGGRAPH

10 Warm up: Synthetic aperture focusing camera(saf) Synthetic aperture focusing SAF is good enough for image recognition Single camera aperture 3D World Camera array Sensor plane Synthetic (= calcul ) Σ aperture +Averaging multiple images also improve Signal-to-Noise ratio (SNR)

11 Introduction: What s computational photography?? Example 3 Shape-Time Camera (Depict the world)

12 Warm up: Depicting the world Picasso Hockney Depict world in new ways: Shape-time photography (burst-mode on stereo adaptor) Stereo mount Shape-time photography. CVPR 2003 people.csail.mit.edu/billf/ Depictio n

13 Comp. Photography: Novel World Depictions Matte extraction: strobing application Old film of Etienne-Jules Marey Mosaicing+matting provides a kinetic experience Visualizing motion is important for video-based applications (PVR,etc.)

14 Comp. Photography: Novel World Depictions Computer generated motion lines

15 Computational Photography: Motion amplification A video example best described the result (Applications to telesurveillance, etc.) Motion magnification, SIGGRAPH

16 Computational Photography: Motion amplification Motion magnification, SIGGRAPH

17 Computational Photography Inpainting Texture Synthesis Hallucination. Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process

18 Computational Photography: ClickRemoval applet Demo Frank Nielsen, Richard Nock: ClickRemoval: interactive pinpoint image object removal. ACM Multimedia 2005:

19 Image retargetting Adjust contents to screen size (TV, PDA, Phone, etc.) SIGGRAPH 2007 Demo

20 Computational Photography: Human Perception Human Perception versus Digital Image Processing

21 S/W Computational Photo.: Hybrid images Low frequency at far distance High frequency at close distance Hybrid images, SIGGRAPH 2006.

22 Overriding Dynamic range Tone mapping Scientific (measurement) images Human perceptual images Disks are exactly identical but are perceived differently dark disks visible through light haze light disks visible through dark haze Image segmentation and lightness perception, Nature 434, 79-83, 2005

23 Computational Photography: H/W Computational Photography Novel hardware & processing techniques

24 Computational Photography: Vein Viewer Coaxial Infrared camera + Projector Transcoding (pseudo-coloring) VeinViewer (Luminetx)

25 Computational Photography: Computing in Optical Domain

26 H/W Comp. Photo.: Computing in Optical domain Control the rays in space-time: Exposure allows optical computations Light integration on the sensor Programmable imaging using a digital micromirror array (CVPR 04) Programmable Imaging: Towards a Flexible Camera, Int. Journal of Computer Vision. 2006

27 H/W Comp. Photo.: Computing in Optical domain Require to calibrate the DMD with the camera coarsely Convolution in optical domain Convolution in optical domain for face recognition Programmable imaging using a digital micromirror array (CVPR 04) Programmable Imaging: Towards a Flexible Camera, Int. Journal of Computer Vision. 2006

28 Computational Photography: Computing with exotic lenses

29 Computational Photo.: Lensless Camera Control the light rays on each layer: Multiple-layer aperture Traditional Lensless Imaging with a Controllable Aperture, CVPR 2006 New

30 Computational Photo.: Lensless Camera Pan/tilt field of view (fov) without physical moving parts Lensless Imaging with a Controllable Aperture, CVPR 2006

31 Computational Photo.: Lensless Camera Split field of view, spatially varying zoom Computations in optical domain Lensless Imaging with a Controllable Aperture, CVPR 2006

32 Computational Photography: Eye Optics Appearances of eyes captures both the environment and gazing direction Spherical panorama (latitude-longitude) Corneal Imaging System Environment from Eyes, Int. Journal on Computer Vision (IJCV) Eyes for relighting, SIGGRAPH 2004.

33 Comp. Photography: Radial Catadioptric Camera Capture a radial space of rays Both mirrored and object parts 3D reconstruction with BRDF (using a single shot!) Multiview Radial Catadioptric Imaging for Scene Capture SIGGRAPH 2006

34 Computational Photography: Beyond 2D pixels: 4D+ Light fields

35 Computational Photography: Plenoptic camera Plenoptic (latin plenus+optics) is a 7D function (X,Y,Z,θ,φ,λ,t) The Plenoptic Function and the Elements of Early Vision 1991 Plenoptic Modeling: An Image-Based Rendering System, SIGGRAPH 1995

36 Computational Photography: Light field camera Acquire first, postprocess later. Digital refocusing Moving the viewpoint 16 MP: 300x300 lens images Fourier Slice Photography, SIGGRAPH 2006

37 H/WComp. Photography: Light field camera Fourier Slice Photography Fourier Slice Photography, SIGGRAPH 2006

38 Computational Photography: Images in the 21st Century Lens Sensor Image Display Image numérique = calcul Generalized optics Computational sensor Computational imaging Novel displays

Frank NIELSEN. Ecole Polytechnique Sony Computer Science Laboratories, Inc Jeudi 13 Mars 2008

Frank NIELSEN. Ecole Polytechnique Sony Computer Science Laboratories, Inc Jeudi 13 Mars 2008 Computational Photography h --- La photographie hi computationnelle ti --- Frank NIELSEN Ecole Polytechnique Sony Computer Science Laboratories, Inc Jeudi 13 Mars 2008 1 Copyrights Disclaimer: In the following

More information

Computational Photography

Computational Photography Computational photography Computational Photography Digital Visual Effects Yung-Yu Chuang wikipedia: Computational photography h refers broadly to computational imaging techniques that enhance or extend

More information

Coding and Modulation in Cameras

Coding and Modulation in Cameras Coding and Modulation in Cameras Amit Agrawal June 2010 Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Schedule Introduction

More information

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f)

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f) Capturing Light Rooms by the Sea, Edward Hopper, 1951 The Penitent Magdalen, Georges de La Tour, c. 1640 Some slides from M. Agrawala, F. Durand, P. Debevec, A. Efros, R. Fergus, D. Forsyth, M. Levoy,

More information

Light field sensing. Marc Levoy. Computer Science Department Stanford University

Light field sensing. Marc Levoy. Computer Science Department Stanford University Light field sensing Marc Levoy Computer Science Department Stanford University The scalar light field (in geometrical optics) Radiance as a function of position and direction in a static scene with fixed

More information

Computational Photography: Principles and Practice

Computational Photography: Principles and Practice Computational Photography: Principles and Practice HCI & Robotics (HCI 및로봇응용공학 ) Ig-Jae Kim, Korea Institute of Science and Technology ( 한국과학기술연구원김익재 ) Jaewon Kim, Korea Institute of Science and Technology

More information

Wavefront coding. Refocusing & Light Fields. Wavefront coding. Final projects. Is depth of field a blur? Frédo Durand Bill Freeman MIT - EECS

Wavefront coding. Refocusing & Light Fields. Wavefront coding. Final projects. Is depth of field a blur? Frédo Durand Bill Freeman MIT - EECS 6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Final projects Send your slides by noon on Thrusday. Send final report Refocusing & Light Fields Frédo Durand Bill Freeman

More information

Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring

Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Ashill Chiranjan and Bernardt Duvenhage Defence, Peace, Safety and Security Council for Scientific

More information

What will be on the midterm?

What will be on the midterm? What will be on the midterm? CS 178, Spring 2014 Marc Levoy Computer Science Department Stanford University General information 2 Monday, 7-9pm, Cubberly Auditorium (School of Edu) closed book, no notes

More information

Computational Approaches to Cameras

Computational Approaches to Cameras Computational Approaches to Cameras 11/16/17 Magritte, The False Mirror (1935) Computational Photography Derek Hoiem, University of Illinois Announcements Final project proposal due Monday (see links on

More information

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University!

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Motivation! wikipedia! exposure sequence! -4 stops! Motivation!

More information

Lecture 18: Light field cameras. (plenoptic cameras) Visual Computing Systems CMU , Fall 2013

Lecture 18: Light field cameras. (plenoptic cameras) Visual Computing Systems CMU , Fall 2013 Lecture 18: Light field cameras (plenoptic cameras) Visual Computing Systems Continuing theme: computational photography Cameras capture light, then extensive processing produces the desired image Today:

More information

Light field photography and microscopy

Light field photography and microscopy Light field photography and microscopy Marc Levoy Computer Science Department Stanford University The light field (in geometrical optics) Radiance as a function of position and direction in a static scene

More information

Computational Cameras. Rahul Raguram COMP

Computational Cameras. Rahul Raguram COMP Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene

More information

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera Advanced Computer Graphics CSE 163 [Spring 2017], Lecture 14 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir To Do Assignment 2 due May 19 Any last minute issues or questions? Next two lectures: Imaging,

More information

CAMERA BASICS. Stops of light

CAMERA BASICS. Stops of light CAMERA BASICS Stops of light A stop of light isn t a quantifiable measurement it s a relative measurement. A stop of light is defined as a doubling or halving of any quantity of light. The word stop is

More information

Coded Aperture for Projector and Camera for Robust 3D measurement

Coded Aperture for Projector and Camera for Robust 3D measurement Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement

More information

Single Camera Catadioptric Stereo System

Single Camera Catadioptric Stereo System Single Camera Catadioptric Stereo System Abstract In this paper, we present a framework for novel catadioptric stereo camera system that uses a single camera and a single lens with conic mirrors. Various

More information

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research

More information

LENSLESS IMAGING BY COMPRESSIVE SENSING

LENSLESS IMAGING BY COMPRESSIVE SENSING LENSLESS IMAGING BY COMPRESSIVE SENSING Gang Huang, Hong Jiang, Kim Matthews and Paul Wilford Bell Labs, Alcatel-Lucent, Murray Hill, NJ 07974 ABSTRACT In this paper, we propose a lensless compressive

More information

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017 Cameras Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017 Camera Focus Camera Focus So far, we have been simulating pinhole cameras with perfect focus Often times, we want to simulate more

More information

Lenses, exposure, and (de)focus

Lenses, exposure, and (de)focus Lenses, exposure, and (de)focus http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 15 Course announcements Homework 4 is out. - Due October 26

More information

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3 Image Formation Dr. Gerhard Roth COMP 4102A Winter 2015 Version 3 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance

More information

Introduction , , Computational Photography Fall 2018, Lecture 1

Introduction , , Computational Photography Fall 2018, Lecture 1 Introduction http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 1 Overview of today s lecture Teaching staff introductions What is computational

More information

Admin. Lightfields. Overview. Overview 5/13/2008. Idea. Projects due by the end of today. Lecture 13. Lightfield representation of a scene

Admin. Lightfields. Overview. Overview 5/13/2008. Idea. Projects due by the end of today. Lecture 13. Lightfield representation of a scene Admin Lightfields Projects due by the end of today Email me source code, result images and short report Lecture 13 Overview Lightfield representation of a scene Unified representation of all rays Overview

More information

Computational Photography Introduction

Computational Photography Introduction Computational Photography Introduction Jongmin Baek CS 478 Lecture Jan 9, 2012 Background Sales of digital cameras surpassed sales of film cameras in 2004. Digital cameras are cool Free film Instant display

More information

Active Aperture Control and Sensor Modulation for Flexible Imaging

Active Aperture Control and Sensor Modulation for Flexible Imaging Active Aperture Control and Sensor Modulation for Flexible Imaging Chunyu Gao and Narendra Ahuja Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL,

More information

The camera s evolution over the past century has

The camera s evolution over the past century has C O V E R F E A T U R E Computational Cameras: Redefining the Image Shree K. Nayar Columbia University Computational cameras use unconventional optics and software to produce new forms of visual information,

More information

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Camera & Color Overview Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Book: Hartley 6.1, Szeliski 2.1.5, 2.2, 2.3 The trip

More information

Tomorrow s Digital Photography

Tomorrow s Digital Photography Tomorrow s Digital Photography Gerald Peter Vienna University of Technology Figure 1: a) - e): A series of photograph with five different exposures. f) In the high dynamic range image generated from a)

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

ME 6406 MACHINE VISION. Georgia Institute of Technology

ME 6406 MACHINE VISION. Georgia Institute of Technology ME 6406 MACHINE VISION Georgia Institute of Technology Class Information Instructor Professor Kok-Meng Lee MARC 474 Office hours: Tues/Thurs 1:00-2:00 pm kokmeng.lee@me.gatech.edu (404)-894-7402 Class

More information

Changyin Zhou. Ph.D, Computer Science, Columbia University Oct 2012

Changyin Zhou. Ph.D, Computer Science, Columbia University Oct 2012 Changyin Zhou Software Engineer at Google X Google Inc. 1600 Amphitheater Parkway, Mountain View, CA 94043 E-mail: changyin@google.com URL: http://www.changyin.org Office: (917) 209-9110 Mobile: (646)

More information

Computational Photography: Advanced Topics

Computational Photography: Advanced Topics Computational Photography: Advanced Topics Courtsey: : Jack Tumblin, Northwestern University Focus, Click, Print: Film-Like Photography Light + 3D Scene: Illumination, shape, movement, surface BRDF, Rays

More information

Coded photography , , Computational Photography Fall 2017, Lecture 18

Coded photography , , Computational Photography Fall 2017, Lecture 18 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 18 Course announcements Homework 5 delayed for Tuesday. - You will need cameras

More information

Coded photography , , Computational Photography Fall 2018, Lecture 14

Coded photography , , Computational Photography Fall 2018, Lecture 14 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 14 Overview of today s lecture The coded photography paradigm. Dealing with

More information

9/19/16. A Closer Look. Danae Wolfe. What We ll Cover. Basics of photography & your camera. Technical. Macro & close-up techniques.

9/19/16. A Closer Look. Danae Wolfe. What We ll Cover. Basics of photography & your camera. Technical. Macro & close-up techniques. A Closer Look Danae Wolfe What We ll Cover Basics of photography & your camera Technical Macro & close-up techniques Creative 1 What is Photography? Photography: the art, science, & practice of creating

More information

Understanding Focal Length

Understanding Focal Length JANUARY 19, 2018 BEGINNER Understanding Focal Length Featuring DIANE BERKENFELD, DAVE BLACK, MIKE CORRADO & LINDSAY SILVERMAN Focal length, usually represented in millimeters (mm), is the basic description

More information

Demosaicing and Denoising on Simulated Light Field Images

Demosaicing and Denoising on Simulated Light Field Images Demosaicing and Denoising on Simulated Light Field Images Trisha Lian Stanford University tlian@stanford.edu Kyle Chiang Stanford University kchiang@stanford.edu Abstract Light field cameras use an array

More information

Distance Estimation with a Two or Three Aperture SLR Digital Camera

Distance Estimation with a Two or Three Aperture SLR Digital Camera Distance Estimation with a Two or Three Aperture SLR Digital Camera Seungwon Lee, Joonki Paik, and Monson H. Hayes Graduate School of Advanced Imaging Science, Multimedia, and Film Chung-Ang University

More information

Light-Field Database Creation and Depth Estimation

Light-Field Database Creation and Depth Estimation Light-Field Database Creation and Depth Estimation Abhilash Sunder Raj abhisr@stanford.edu Michael Lowney mlowney@stanford.edu Raj Shah shahraj@stanford.edu Abstract Light-field imaging research has been

More information

Realistic Image Synthesis

Realistic Image Synthesis Realistic Image Synthesis - HDR Capture & Tone Mapping - Philipp Slusallek Karol Myszkowski Gurprit Singh Karol Myszkowski LDR vs HDR Comparison Various Dynamic Ranges (1) 10-6 10-4 10-2 100 102 104 106

More information

Computational Photography and Video. Prof. Marc Pollefeys

Computational Photography and Video. Prof. Marc Pollefeys Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence

More information

Privacy Preserving Optics for Miniature Vision Sensors

Privacy Preserving Optics for Miniature Vision Sensors Privacy Preserving Optics for Miniature Vision Sensors Francesco Pittaluga and Sanjeev J. Koppal University of Florida Electrical and Computer Engineering Shoham et al. 07, Wood 08, Enikov et al. 09, Agrihouse

More information

Camera Selection Criteria. Richard Crisp May 25, 2011

Camera Selection Criteria. Richard Crisp   May 25, 2011 Camera Selection Criteria Richard Crisp rdcrisp@earthlink.net www.narrowbandimaging.com May 25, 2011 Size size considerations Key issues are matching the pixel size to the expected spot size from the optical

More information

A Mathematical model for the determination of distance of an object in a 2D image

A Mathematical model for the determination of distance of an object in a 2D image A Mathematical model for the determination of distance of an object in a 2D image Deepu R 1, Murali S 2,Vikram Raju 3 Maharaja Institute of Technology Mysore, Karnataka, India rdeepusingh@mitmysore.in

More information

Focusing and Metering

Focusing and Metering Focusing and Metering CS 478 Winter 2012 Slides mostly stolen by David Jacobs from Marc Levoy Focusing Outline Manual Focus Specialty Focus Autofocus Active AF Passive AF AF Modes Manual Focus - View Camera

More information

History of projection. Perspective. History of projection. Plane projection in drawing

History of projection. Perspective. History of projection. Plane projection in drawing History of projection Ancient times: Greeks wrote about laws of perspective Renaissance: perspective is adopted by artists Perspective CS 4620 Lecture 3 Duccio c. 1308 1 2 History of projection Plane projection

More information

Depth Perception with a Single Camera

Depth Perception with a Single Camera Depth Perception with a Single Camera Jonathan R. Seal 1, Donald G. Bailey 2, Gourab Sen Gupta 2 1 Institute of Technology and Engineering, 2 Institute of Information Sciences and Technology, Massey University,

More information

EC-433 Digital Image Processing

EC-433 Digital Image Processing EC-433 Digital Image Processing Lecture 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such as a monochrome or color TV camera)

More information

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1 Image Formation Dr. Gerhard Roth COMP 4102A Winter 2014 Version 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance

More information

Edmonton Camera Club. Introduction to Exposure. and a few other bits!

Edmonton Camera Club. Introduction to Exposure. and a few other bits! Edmonton Camera Club Introduction to Exposure and a few other bits! Exposure 3 Variables 1. Aperture how much light 2. Shutter Speed for how long 3. Sensitivity ISO, Film Speed Also cover: Compensation

More information

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor ALMALENCE SUPER SENSOR A software component with an effect of increasing the pixel size and number of pixels in the sensor MOBILE CAMERA: SMALL SENSOR AND TINY LENS Insufficient resolution, low light performance,

More information

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object. Camera trial #1 Cameras Digital Visual Effects Yung-Yu Chuang scene film with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Put a piece of film in front of an object. Pinhole camera

More information

Lecture 19: Depth Cameras. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011)

Lecture 19: Depth Cameras. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011) Lecture 19: Depth Cameras Kayvon Fatahalian CMU 15-869: Graphics and Imaging Architectures (Fall 2011) Continuing theme: computational photography Cheap cameras capture light, extensive processing produces

More information

This document explains the reasons behind this phenomenon and describes how to overcome it.

This document explains the reasons behind this phenomenon and describes how to overcome it. Internal: 734-00583B-EN Release date: 17 December 2008 Cast Effects in Wide Angle Photography Overview Shooting images with wide angle lenses and exploiting large format camera movements can result in

More information

Basic principles of photography. David Capel 346B IST

Basic principles of photography. David Capel 346B IST Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse

More information

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Cameras Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Camera trial #1 scene film Put a piece of film in front of

More information

f= mm, mm (35mm format equivalent) Full-aperture F1.8 (Wide) - F4.9 (Telephoto) Constitution

f= mm, mm (35mm format equivalent) Full-aperture F1.8 (Wide) - F4.9 (Telephoto) Constitution Specications Model name FUJIFILM XQ2 Number of effective pixels 12.0 million pixels Image sensor 2/3-inch X-Trans CMOS Ⅱ with primary color filter Total number of Storage media Internal memory (approx.

More information

MIT CSAIL Advances in Computer Vision Fall Problem Set 6: Anaglyph Camera Obscura

MIT CSAIL Advances in Computer Vision Fall Problem Set 6: Anaglyph Camera Obscura MIT CSAIL 6.869 Advances in Computer Vision Fall 2013 Problem Set 6: Anaglyph Camera Obscura Posted: Tuesday, October 8, 2013 Due: Thursday, October 17, 2013 You should submit a hard copy of your work

More information

Flash Photography: 1

Flash Photography: 1 Flash Photography: 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well as an extension using a non-visible

More information

Dynamically Reparameterized Light Fields & Fourier Slice Photography. Oliver Barth, 2009 Max Planck Institute Saarbrücken

Dynamically Reparameterized Light Fields & Fourier Slice Photography. Oliver Barth, 2009 Max Planck Institute Saarbrücken Dynamically Reparameterized Light Fields & Fourier Slice Photography Oliver Barth, 2009 Max Planck Institute Saarbrücken Background What we are talking about? 2 / 83 Background What we are talking about?

More information

Coded Computational Photography!

Coded Computational Photography! Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!

More information

Active Stereo Vision. COMP 4102A Winter 2014 Gerhard Roth Version 1

Active Stereo Vision. COMP 4102A Winter 2014 Gerhard Roth Version 1 Active Stereo Vision COMP 4102A Winter 2014 Gerhard Roth Version 1 Why active sensors? Project our own texture using light (usually laser) This simplifies correspondence problem (much easier) Pluses Can

More information

Removing Temporal Stationary Blur in Route Panoramas

Removing Temporal Stationary Blur in Route Panoramas Removing Temporal Stationary Blur in Route Panoramas Jiang Yu Zheng and Min Shi Indiana University Purdue University Indianapolis jzheng@cs.iupui.edu Abstract The Route Panorama is a continuous, compact

More information

DEPTH FUSED FROM INTENSITY RANGE AND BLUR ESTIMATION FOR LIGHT-FIELD CAMERAS. Yatong Xu, Xin Jin and Qionghai Dai

DEPTH FUSED FROM INTENSITY RANGE AND BLUR ESTIMATION FOR LIGHT-FIELD CAMERAS. Yatong Xu, Xin Jin and Qionghai Dai DEPTH FUSED FROM INTENSITY RANGE AND BLUR ESTIMATION FOR LIGHT-FIELD CAMERAS Yatong Xu, Xin Jin and Qionghai Dai Shenhen Key Lab of Broadband Network and Multimedia, Graduate School at Shenhen, Tsinghua

More information

Less Is More: Coded Computational Photography

Less Is More: Coded Computational Photography Less Is More: Coded Computational Photography Ramesh Raskar Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA Abstract. Computational photography combines plentiful computing, digital sensors,

More information

Exercise questions for Machine vision

Exercise questions for Machine vision Exercise questions for Machine vision This is a collection of exercise questions. These questions are all examination alike which means that similar questions may appear at the written exam. I ve divided

More information

CSE 473/573 Computer Vision and Image Processing (CVIP)

CSE 473/573 Computer Vision and Image Processing (CVIP) CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu inwogu@buffalo.edu Lecture 4 Image formation(part I) Schedule Last class linear algebra overview Today Image formation and camera properties

More information

Chapter 18 Optical Elements

Chapter 18 Optical Elements Chapter 18 Optical Elements GOALS When you have mastered the content of this chapter, you will be able to achieve the following goals: Definitions Define each of the following terms and use it in an operational

More information

Single-view Metrology and Cameras

Single-view Metrology and Cameras Single-view Metrology and Cameras 10/10/17 Computational Photography Derek Hoiem, University of Illinois Project 2 Results Incomplete list of great project pages Haohang Huang: Best presented project;

More information

Perspective. Announcement: CS4450/5450. CS 4620 Lecture 3. Will be MW 8:40 9:55 How many can make the new time?

Perspective. Announcement: CS4450/5450. CS 4620 Lecture 3. Will be MW 8:40 9:55 How many can make the new time? Perspective CS 4620 Lecture 3 1 2 Announcement: CS4450/5450 Will be MW 8:40 9:55 How many can make the new time? 3 4 History of projection Ancient times: Greeks wrote about laws of perspective Renaissance:

More information

Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner.

Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner. Fusion and Reconstruction Dr. Yossi Rubner yossi@rubner.co.il Some slides stolen from: Jack Tumblin 1 Agenda We ve seen Panorama (from different FOV) Super-resolution (from low-res) HDR (from different

More information

Computer Vision. The Pinhole Camera Model

Computer Vision. The Pinhole Camera Model Computer Vision The Pinhole Camera Model Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2017/2018 Imaging device

More information

Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems

Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems Ricardo R. Garcia University of California, Berkeley Berkeley, CA rrgarcia@eecs.berkeley.edu Abstract In recent

More information

Computational Illumination Frédo Durand MIT - EECS

Computational Illumination Frédo Durand MIT - EECS Computational Illumination Frédo Durand MIT - EECS Some Slides from Ramesh Raskar (MIT Medialab) High level idea Control the illumination to Lighting as a post-process Extract more information Flash/no-flash

More information

Computational Illumination

Computational Illumination Computational Illumination Course WebPage : http://www.merl.com/people/raskar/photo/ Ramesh Raskar Mitsubishi Electric Research Labs Ramesh Raskar, Computational Illumination Computational Illumination

More information

Design of a digital holographic interferometer for the. ZaP Flow Z-Pinch

Design of a digital holographic interferometer for the. ZaP Flow Z-Pinch Design of a digital holographic interferometer for the M. P. Ross, U. Shumlak, R. P. Golingo, B. A. Nelson, S. D. Knecht, M. C. Hughes, R. J. Oberto University of Washington, Seattle, USA Abstract The

More information

High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 )

High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 ) High Resolution Spectral Video Capture & Computational Photography Xun Cao ( 曹汛 ) School of Electronic Science & Engineering Nanjing University caoxun@nju.edu.cn Dec 30th, 2015 Computational Photography

More information

One Week to Better Photography

One Week to Better Photography One Week to Better Photography Glossary Adobe Bridge Useful application packaged with Adobe Photoshop that previews, organizes and renames digital image files and creates digital contact sheets Adobe Photoshop

More information

1. This paper contains 45 multiple-choice-questions (MCQ) in 6 pages. 2. All questions carry equal marks. 3. You can take 1 hour for answering.

1. This paper contains 45 multiple-choice-questions (MCQ) in 6 pages. 2. All questions carry equal marks. 3. You can take 1 hour for answering. UNIVERSITY OF MORATUWA, SRI LANKA FACULTY OF ENGINEERING END OF SEMESTER EXAMINATION 2007/2008 (Held in Aug 2008) B.Sc. ENGINEERING LEVEL 2, JUNE TERM DE 2290 PHOTOGRAPHY Answer ALL questions in the answer

More information

Why learn about photography in this course?

Why learn about photography in this course? Why learn about photography in this course? Geri's Game: Note the background is blurred. - photography: model of image formation - Many computer graphics methods use existing photographs e.g. texture &

More information

A shooting direction control camera based on computational imaging without mechanical motion

A shooting direction control camera based on computational imaging without mechanical motion https://doi.org/10.2352/issn.2470-1173.2018.15.coimg-270 2018, Society for Imaging Science and Technology A shooting direction control camera based on computational imaging without mechanical motion Keigo

More information

LENSES. INEL 6088 Computer Vision

LENSES. INEL 6088 Computer Vision LENSES INEL 6088 Computer Vision Digital camera A digital camera replaces film with a sensor array Each cell in the array is a Charge Coupled Device light-sensitive diode that converts photons to electrons

More information

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response - application: high dynamic range imaging Why learn

More information

MEM455/800 Robotics II/Advance Robotics Winter 2009

MEM455/800 Robotics II/Advance Robotics Winter 2009 Admin Stuff Course Website: http://robotics.mem.drexel.edu/mhsieh/courses/mem456/ MEM455/8 Robotics II/Advance Robotics Winter 9 Professor: Ani Hsieh Time: :-:pm Tues, Thurs Location: UG Lab, Classroom

More information

Time-Lapse Light Field Photography With a 7 DoF Arm

Time-Lapse Light Field Photography With a 7 DoF Arm Time-Lapse Light Field Photography With a 7 DoF Arm John Oberlin and Stefanie Tellex Abstract A photograph taken by a conventional camera captures the average intensity of light at each pixel, discarding

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 22: Computational photography photomatix.com Announcements Final project midterm reports due on Tuesday to CMS by 11:59pm BRDF s can be incredibly complicated

More information

Lensless Imaging with a Controllable Aperture

Lensless Imaging with a Controllable Aperture Lensless Imaging with a Controllable Aperture Assaf Zomet Shree K. Nayar Computer Science Department Columbia University New York, NY, 10027 E-mail: zomet@humaneyes.com, nayar@cs.columbia.edu Abstract

More information

Point Spread Function Engineering for Scene Recovery. Changyin Zhou

Point Spread Function Engineering for Scene Recovery. Changyin Zhou Point Spread Function Engineering for Scene Recovery Changyin Zhou Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences

More information

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 - COMPUTERIZED IMAGING Section I: Chapter 2 RADT 3463 Computerized Imaging 1 SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 COMPUTERIZED IMAGING Section I: Chapter 2 RADT

More information

Introduction to Digital Photography

Introduction to Digital Photography Introduction to Digital Photography with Nick Davison Photography is The mastering of the technical aspects of the camera combined with, The artistic vision and creative know how to produce an interesting

More information

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS 6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Bill Freeman Frédo Durand MIT - EECS Administrivia PSet 1 is out Due Thursday February 23 Digital SLR initiation? During

More information

NTU CSIE. Advisor: Wu Ja Ling, Ph.D.

NTU CSIE. Advisor: Wu Ja Ling, Ph.D. An Interactive Background Blurring Mechanism and Its Applications NTU CSIE Yan Chih Yu Advisor: Wu Ja Ling, Ph.D. 1 2 Outline Introduction Related Work Method Object Segmentation Depth Map Generation Image

More information

Computational Photography: Illumination Part 2. Brown 1

Computational Photography: Illumination Part 2. Brown 1 Computational Photography: Illumination Part 2 Brown 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well

More information

Panoramic imaging. Ixyzϕθλt. 45 degrees FOV (normal view)

Panoramic imaging. Ixyzϕθλt. 45 degrees FOV (normal view) Camera projections Recall the plenoptic function: Panoramic imaging Ixyzϕθλt (,,,,,, ) At any point xyz,, in space, there is a full sphere of possible incidence directions ϕ, θ, covered by 0 ϕ 2π, 0 θ

More information

Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/

More information

Omni-Directional Catadioptric Acquisition System

Omni-Directional Catadioptric Acquisition System Technical Disclosure Commons Defensive Publications Series December 18, 2017 Omni-Directional Catadioptric Acquisition System Andreas Nowatzyk Andrew I. Russell Follow this and additional works at: http://www.tdcommons.org/dpubs_series

More information

Introduction. Related Work

Introduction. Related Work Introduction Depth of field is a natural phenomenon when it comes to both sight and photography. The basic ray tracing camera model is insufficient at representing this essential visual element and will

More information

Adding Realistic Camera Effects to the Computer Graphics Camera Model

Adding Realistic Camera Effects to the Computer Graphics Camera Model Adding Realistic Camera Effects to the Computer Graphics Camera Model Ryan Baltazar May 4, 2012 1 Introduction The camera model traditionally used in computer graphics is based on the camera obscura or

More information