Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner.

Size: px
Start display at page:

Download "Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner."

Transcription

1 Fusion and Reconstruction Dr. Yossi Rubner Some slides stolen from: Jack Tumblin 1 Agenda We ve seen Panorama (from different FOV) Super-resolution (from low-res) HDR (from different dynamic range) Today Best focus (from different focuses) / no flash (from 2 images) Depth edge detection (from different flashes) Motion blur (from different sub-exposures) Multispectral (from visible light and IR) Clear day (from bad weather) 2 Single photo: forces narrow tradeoffs: Focus, Exposure, aperture, time, sensitivity, noise, Usual result: Incomplete visual appearance. Multiple photos, assorted settings for Optics, Sensor, Lighting, Processing Fusion: Merge the best parts or Reconstruction: Detect changes photo changes, compute scene invariants NEAR

2 FAR

3

4

5 Source images Elmar Eisemann and Frédo Durand, Photography Enhancement via Intrinsic Relighting Georg Petschnigg, Maneesh Agrawala, Hugues Hoppe, Richard Szeliski, Michael Cohen, Kentaro Toyama. Digital Photography with and No- Image Pairs FUSION Graph Cuts Solution (using global maximum contrast image objective) Denoise no-flash image using flash image No-flash Result

6 No Available light: + nice lighting - noise/blurriness - color : + details + color - flat/artificial Cross-Bilateral Filter based Approach Transfer detail from flash image to no-flash image No-flash + original lighting + details/sharpness + color Result

7 Registration Compensate for camera motion (image translation) Difficult because lighting changes Edge detection Cross Bilateral Filter Similar to joint bilateral filter by Petschnigg et al. When no-flash image is too noisy Borrow similarity from flash image edge stopping from flash image No-flash Bilateral Cross Bilateral Shadow Correction Why? Shadow Detection No flash - = No-flash Ι Straightforward recombination

8 Shadow Detection Difference Ι = light from the flash? Results Goal: Find a threshold for Ι Automatic Threshold Detection (see paper) No-flash Ι Results Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering using Multi- Imaging No-flash Result Ramesh Raskar, Karhan Tan, Rogerio Feris, Jingyi Yu, Matthew Turk Mitsubishi Electric Research Labs (MERL), Cambridge, MA U of California at Santa Barbara U of North Carolina at Chapel Hill

9 ENGF343.JPG What are the problems with real photo in conveying information? Why do we hire artists to draw what can be photographed?

10 Depth Discontinuities Internal and external Shape boundaries, Occluding contour, Silhouettes Canny Our Method

11 Photo Result Our Method Canny Intensity Edge Detection Fluttered Shutter Camera Raskar, Agrawal, Tumblin Siggraph2006

12 Figure 2 results Input Image Rectified Image to make motion lines parallel to scan lines. Approximate cutout of the blurred image containing the taxi (vignetting on left edge). Exact alignment of cutout with taxi extent is not required. Image Deblurred by solving a linear system. No post-processing

13 Comparison Inverse Filter stable Inverse Filter Unstable

14 Solving: Single Line of Matlab Code Short Exposure Long Exposure Coded Exposure Our result Matlab Lucy Ground Truth No Post Processing! Bennett2007: Multispectral Video Fusion Clear Day from Foggy Days Two Different Foggy Conditions (Shree Nayar, Srinivasa Narasimhan 00) Dual-Bilateral filter: fuses best of visible + IR Clear Day Image Time: 3 PM Deweathering Time: 5:30 PM

Computational Illumination Frédo Durand MIT - EECS

Computational Illumination Frédo Durand MIT - EECS Computational Illumination Frédo Durand MIT - EECS Some Slides from Ramesh Raskar (MIT Medialab) High level idea Control the illumination to Lighting as a post-process Extract more information Flash/no-flash

More information

Computational Illumination

Computational Illumination Computational Illumination Course WebPage : http://www.merl.com/people/raskar/photo/ Ramesh Raskar Mitsubishi Electric Research Labs Ramesh Raskar, Computational Illumination Computational Illumination

More information

Flash Photography Enhancement via Intrinsic Relighting

Flash Photography Enhancement via Intrinsic Relighting Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann MIT/Artis-INRIA Frédo Durand MIT Introduction Satisfactory photos in dark environments are challenging! Introduction Available light:

More information

Computational 4/23/2009. Computational Illumination: SIGGRAPH 2006 Course. Course WebPage: Flash Shutter Open

Computational 4/23/2009. Computational Illumination: SIGGRAPH 2006 Course. Course WebPage:   Flash Shutter Open Ramesh Raskar, Computational Illumination Computational Illumination Computational Illumination SIGGRAPH 2006 Course Course WebPage: http://www.merl.com/people/raskar/photo/ Ramesh Raskar Mitsubishi Electric

More information

Computational Camera & Photography: Coded Imaging

Computational Camera & Photography: Coded Imaging Computational Camera & Photography: Coded Imaging Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Image removed due to copyright restrictions. See Fig. 1, Eight major types

More information

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University!

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Motivation! wikipedia! exposure sequence! -4 stops! Motivation!

More information

Computational Photography

Computational Photography Computational photography Computational Photography Digital Visual Effects Yung-Yu Chuang wikipedia: Computational photography h refers broadly to computational imaging techniques that enhance or extend

More information

Coding and Modulation in Cameras

Coding and Modulation in Cameras Coding and Modulation in Cameras Amit Agrawal June 2010 Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Schedule Introduction

More information

Deblurring. Basics, Problem definition and variants

Deblurring. Basics, Problem definition and variants Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying

More information

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research

More information

A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters

A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin EECS, Northwestern University Advanced Uses of Bilateral Filters Advanced

More information

Less Is More: Coded Computational Photography

Less Is More: Coded Computational Photography Less Is More: Coded Computational Photography Ramesh Raskar Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA Abstract. Computational photography combines plentiful computing, digital sensors,

More information

Image Enhancement of Low-light Scenes with Near-infrared Flash Images

Image Enhancement of Low-light Scenes with Near-infrared Flash Images Research Paper Image Enhancement of Low-light Scenes with Near-infrared Flash Images Sosuke Matsui, 1 Takahiro Okabe, 1 Mihoko Shimano 1, 2 and Yoichi Sato 1 We present a novel technique for enhancing

More information

A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters

A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin EECS, Northwestern University Advanced Uses of Bilateral Filters Advanced

More information

Image Enhancement of Low-light Scenes with Near-infrared Flash Images

Image Enhancement of Low-light Scenes with Near-infrared Flash Images IPSJ Transactions on Computer Vision and Applications Vol. 2 215 223 (Dec. 2010) Research Paper Image Enhancement of Low-light Scenes with Near-infrared Flash Images Sosuke Matsui, 1 Takahiro Okabe, 1

More information

High dynamic range imaging and tonemapping

High dynamic range imaging and tonemapping High dynamic range imaging and tonemapping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 12 Course announcements Homework 3 is out. - Due

More information

Implementation of Image Deblurring Techniques in Java

Implementation of Image Deblurring Techniques in Java Implementation of Image Deblurring Techniques in Java Peter Chapman Computer Systems Lab 2007-2008 Thomas Jefferson High School for Science and Technology Alexandria, Virginia January 22, 2008 Abstract

More information

Coded Computational Photography!

Coded Computational Photography! Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!

More information

Computational Photography Introduction

Computational Photography Introduction Computational Photography Introduction Jongmin Baek CS 478 Lecture Jan 9, 2012 Background Sales of digital cameras surpassed sales of film cameras in 2004. Digital cameras are cool Free film Instant display

More information

Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography

Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography Xi Luo Stanford University 450 Serra Mall, Stanford, CA 94305 xluo2@stanford.edu Abstract The project explores various application

More information

Coded photography , , Computational Photography Fall 2018, Lecture 14

Coded photography , , Computational Photography Fall 2018, Lecture 14 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 14 Overview of today s lecture The coded photography paradigm. Dealing with

More information

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do?

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do? Computational Photography The ultimate camera What does it do? Image from Durand & Freeman s MIT Course on Computational Photography Today s reading Szeliski Chapter 9 The ultimate camera Infinite resolution

More information

Continuous Flash. October 1, Technical Report MSR-TR Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052

Continuous Flash. October 1, Technical Report MSR-TR Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 Continuous Flash Hugues Hoppe Kentaro Toyama October 1, 2003 Technical Report MSR-TR-2003-63 Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 Page 1 of 7 Abstract To take a

More information

The Dynamic Range Problem. High Dynamic Range (HDR) Multiple Exposure Photography. Multiple Exposure Photography. Dr. Yossi Rubner.

The Dynamic Range Problem. High Dynamic Range (HDR) Multiple Exposure Photography. Multiple Exposure Photography. Dr. Yossi Rubner. The Dynamic Range Problem High Dynamic Range (HDR) starlight Domain of Human Vision: from ~10-6 to ~10 +8 cd/m moonlight office light daylight flashbulb 10-6 10-1 10 100 10 +4 10 +8 Dr. Yossi Rubner yossi@rubner.co.il

More information

Coded photography , , Computational Photography Fall 2017, Lecture 18

Coded photography , , Computational Photography Fall 2017, Lecture 18 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 18 Course announcements Homework 5 delayed for Tuesday. - You will need cameras

More information

Flash Photography: 1

Flash Photography: 1 Flash Photography: 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well as an extension using a non-visible

More information

Flash Photography Enhancement via Intrinsic Relighting

Flash Photography Enhancement via Intrinsic Relighting Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann and Frédo Durand MIT / ARTIS-GRAVIR/IMAG-INRIA and MIT CSAIL Abstract We enhance photographs shot in dark environments by combining

More information

Fixing the Gaussian Blur : the Bilateral Filter

Fixing the Gaussian Blur : the Bilateral Filter Fixing the Gaussian Blur : the Bilateral Filter Lecturer: Jianbing Shen Email : shenjianbing@bit.edu.cnedu Office room : 841 http://cs.bit.edu.cn/shenjianbing cn/shenjianbing Note: contents copied from

More information

Tonemapping and bilateral filtering

Tonemapping and bilateral filtering Tonemapping and bilateral filtering http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 6 Course announcements Homework 2 is out. - Due September

More information

Raskar, Camera Culture, MIT Media Lab. Ramesh Raskar. Camera Culture. Associate Professor, MIT Media Lab

Raskar, Camera Culture, MIT Media Lab. Ramesh Raskar. Camera Culture. Associate Professor, MIT Media Lab Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar C C lt Camera Culture Associate Professor, MIT Media Lab Where are the camera s? Where are the camera s? We focus on creating tools to

More information

Computational Photography: Illumination Part 2. Brown 1

Computational Photography: Illumination Part 2. Brown 1 Computational Photography: Illumination Part 2 Brown 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well

More information

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera

To Do. Advanced Computer Graphics. Outline. Computational Imaging. How do we see the world? Pinhole camera Advanced Computer Graphics CSE 163 [Spring 2017], Lecture 14 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir To Do Assignment 2 due May 19 Any last minute issues or questions? Next two lectures: Imaging,

More information

Preserving Natural Scene Lighting by Strobe-lit Video

Preserving Natural Scene Lighting by Strobe-lit Video Preserving Natural Scene Lighting by Strobe-lit Video Olli Suominen, Atanas Gotchev Department of Signal Processing, Tampere University of Technology Korkeakoulunkatu 1, 33720 Tampere, Finland ABSTRACT

More information

Flash Photography Enhancement via Intrinsic Relighting

Flash Photography Enhancement via Intrinsic Relighting Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann MIT / ARTIS -GRAVIR/IMAG-INRIA Frédo Durand MIT (a) (b) (c) Figure 1: (a) Top: Photograph taken in a dark environment, the image is

More information

Computational Photography and Video. Prof. Marc Pollefeys

Computational Photography and Video. Prof. Marc Pollefeys Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence

More information

A reprint from. American Scientist. the magazine of Sigma Xi, The Scientific Research Society

A reprint from. American Scientist. the magazine of Sigma Xi, The Scientific Research Society A reprint from American Scientist the magazine of Sigma Xi, The Scientific Research Society This reprint is provided for personal and noncommercial use. For any other use, please send a request Brian Hayes

More information

Multispectral Bilateral Video Fusion

Multispectral Bilateral Video Fusion IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 16, NO. 5, MAY 2007 1185 Multispectral Bilateral Video Fusion Eric P. Bennett, John L. Mason, and Leonard McMillan Abstract We present a technique for enhancing

More information

Improved motion invariant imaging with time varying shutter functions

Improved motion invariant imaging with time varying shutter functions Improved motion invariant imaging with time varying shutter functions Steve Webster a and Andrew Dorrell b Canon Information Systems Research, Australia (CiSRA), Thomas Holt Drive, North Ryde, Australia

More information

Photo Graphics Exposure An Infographic Guide To Photography

Photo Graphics Exposure An Infographic Guide To Photography Photo Graphics Exposure An Infographic Guide To Photography We have made it easy for you to find a PDF Ebooks without any digging. And by having access to our ebooks online or by storing it on your computer,

More information

! High&Dynamic!Range!Imaging! Slides!from!Marc!Pollefeys,!Gabriel! Brostow!(and!Alyosha!Efros!and! others)!!

! High&Dynamic!Range!Imaging! Slides!from!Marc!Pollefeys,!Gabriel! Brostow!(and!Alyosha!Efros!and! others)!! ! High&Dynamic!Range!Imaging! Slides!from!Marc!Pollefeys,!Gabriel! Brostow!(and!Alyosha!Efros!and! others)!! Today! High!Dynamic!Range!Imaging!(LDR&>HDR)! Tone!mapping!(HDR&>LDR!display)! The!Problem!

More information

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Yosuke Bando 1,2 Henry Holtzman 2 Ramesh Raskar 2 1 Toshiba Corporation 2 MIT Media Lab Defocus & Motion Blur PSF Depth

More information

A Review over Different Blur Detection Techniques in Image Processing

A Review over Different Blur Detection Techniques in Image Processing A Review over Different Blur Detection Techniques in Image Processing 1 Anupama Sharma, 2 Devarshi Shukla 1 E.C.E student, 2 H.O.D, Department of electronics communication engineering, LR College of engineering

More information

Composition Context Photography

Composition Context Photography Composition Context Photography Daniel Vaquero Nokia Technologies daniel.vaquero@nokia.com Matthew Turk Univ. of California, Santa Barbara mturk@cs.ucsb.edu Abstract Cameras are becoming increasingly aware

More information

Sensing Increased Image Resolution Using Aperture Masks

Sensing Increased Image Resolution Using Aperture Masks Sensing Increased Image Resolution Using Aperture Masks Ankit Mohan, Xiang Huang, Jack Tumblin Northwestern University Ramesh Raskar MIT Media Lab CVPR 2008 Supplemental Material Contributions Achieve

More information

HDR. High Dynamic Range Photograph

HDR. High Dynamic Range Photograph HDR High Dynamic Range Photograph HDR This is a properly exposed image. HDR This is a properly exposed image - if I meter off the mountain side. HDR If it s properly exposed, why can t I see details in

More information

A Framework for Analysis of Computational Imaging Systems

A Framework for Analysis of Computational Imaging Systems A Framework for Analysis of Computational Imaging Systems Kaushik Mitra, Oliver Cossairt, Ashok Veeraghavan Rice University Northwestern University Computational imaging CI systems that adds new functionality

More information

Glare Removal: A Review

Glare Removal: A Review Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 5, Issue. 1, January 2016,

More information

Lenses, exposure, and (de)focus

Lenses, exposure, and (de)focus Lenses, exposure, and (de)focus http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 15 Course announcements Homework 4 is out. - Due October 26

More information

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f)

Capturing Light. The Light Field. Grayscale Snapshot 12/1/16. P(q, f) Capturing Light Rooms by the Sea, Edward Hopper, 1951 The Penitent Magdalen, Georges de La Tour, c. 1640 Some slides from M. Agrawala, F. Durand, P. Debevec, A. Efros, R. Fergus, D. Forsyth, M. Levoy,

More information

Admin Deblurring & Deconvolution Different types of blur

Admin Deblurring & Deconvolution Different types of blur Admin Assignment 3 due Deblurring & Deconvolution Lecture 10 Last lecture Move to Friday? Projects Come and see me Different types of blur Camera shake User moving hands Scene motion Objects in the scene

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image

Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image Takahiro Hasegawa, Ryoji Tomizawa, Yuji Yamauchi, Takayoshi Yamashita and Hironobu Fujiyoshi Chubu University, 1200, Matsumoto-cho,

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 22: Computational photography photomatix.com Announcements Final project midterm reports due on Tuesday to CMS by 11:59pm BRDF s can be incredibly complicated

More information

Multispectral Image Dense Matching

Multispectral Image Dense Matching Multispectral Image Dense Matching Xiaoyong Shen Li Xu Qi Zhang Jiaya Jia The Chinese University of Hong Kong Image & Visual Computing Lab, Lenovo R&T 1 Multispectral Dense Matching Dataset We build a

More information

Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility

Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility Amit Agrawal Yi Xu Mitsubishi Electric Research Labs (MERL) 201 Broadway, Cambridge, MA, USA [agrawal@merl.com,xu43@cs.purdue.edu]

More information

Coded Aperture for Projector and Camera for Robust 3D measurement

Coded Aperture for Projector and Camera for Robust 3D measurement Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement

More information

When Does Computational Imaging Improve Performance?

When Does Computational Imaging Improve Performance? When Does Computational Imaging Improve Performance? Oliver Cossairt Assistant Professor Northwestern University Collaborators: Mohit Gupta, Changyin Zhou, Daniel Miau, Shree Nayar (Columbia University)

More information

Computational Photography: Principles and Practice

Computational Photography: Principles and Practice Computational Photography: Principles and Practice HCI & Robotics (HCI 및로봇응용공학 ) Ig-Jae Kim, Korea Institute of Science and Technology ( 한국과학기술연구원김익재 ) Jaewon Kim, Korea Institute of Science and Technology

More information

How to combine images in Photoshop

How to combine images in Photoshop How to combine images in Photoshop In Photoshop, you can use multiple layers to combine images, but there are two other ways to create a single image from mulitple images. Create a panoramic image with

More information

Working with your Camera

Working with your Camera Topic 5 Introduction to Shutter, Aperture and ISO Learning Outcomes In this topic, you will learn about the three main functions on a DSLR: Shutter, Aperture and ISO. We must also consider white balance

More information

Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/

More information

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Announcement A total of 5 (five) late days are allowed for projects. Office hours Announcement A total of 5 (five) late days are allowed for projects. Office hours Me: 3:50-4:50pm Thursday (or by appointment) Jake: 12:30-1:30PM Monday and Wednesday Image Formation Digital Camera Film

More information

Image Deblurring with Blurred/Noisy Image Pairs

Image Deblurring with Blurred/Noisy Image Pairs Image Deblurring with Blurred/Noisy Image Pairs Lu Yuan 1 Jian Sun 2 Long Quan 2 Heung-Yeung Shum 2 1 The Hong Kong University of Science and Technology 2 Microsoft Research Asia (a) blurred image (b)

More information

CS354 Computer Graphics Computational Photography. Qixing Huang April 23 th 2018

CS354 Computer Graphics Computational Photography. Qixing Huang April 23 th 2018 CS354 Computer Graphics Computational Photography Qixing Huang April 23 th 2018 Background Sales of digital cameras surpassed sales of film cameras in 2004 Digital Cameras Free film Instant display Quality

More information

HIGH DYNAMIC RANGE IMAGE ACQUISITION USING FLASH IMAGE

HIGH DYNAMIC RANGE IMAGE ACQUISITION USING FLASH IMAGE HIGH DYNAMIC RANGE IMAGE ACQUISITION USING FLASH IMAGE Ryo Matsuoka, Tatsuya Baba, Masahiro Okuda Univ. of Kitakyushu, Faculty of Environmental Engineering, JAPAN Keiichiro Shirai Shinshu University Faculty

More information

Coded Aperture and Coded Exposure Photography

Coded Aperture and Coded Exposure Photography Coded Aperture and Coded Exposure Photography Martin Wilson University of Cape Town Cape Town, South Africa Email: Martin.Wilson@uct.ac.za Fred Nicolls University of Cape Town Cape Town, South Africa Email:

More information

Signature redacted. Signature redacted. Computational Bounce Flash for Indoor Portraits. / Mr~sor Leslie A. Kolodziejski JUN

Signature redacted. Signature redacted. Computational Bounce Flash for Indoor Portraits. / Mr~sor Leslie A. Kolodziejski JUN Computational Bounce Flash for Indoor Portraits by Lukas Murmann M.Sc. Computer Graphics, Vision and Imaging University College London, 2013 B.Sc. Electrical Engineering Technische Universitit Mdrnchen,

More information

Removing Photography Artifacts using Gradient Projection and Flash-Exposure Sampling

Removing Photography Artifacts using Gradient Projection and Flash-Exposure Sampling MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Removing Photography Artifacts using Gradient Projection and Flash-Exposure Sampling Amit Agrawal, Ramesh Raskar, Shree Nayar, Yuanzhen Li

More information

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration Image stitching Stitching = alignment + blending Image stitching geometrical registration photometric registration Digital Visual Effects, Spring 2006 Yung-Yu Chuang 2005/3/22 with slides by Richard Szeliski,

More information

Capturing the Moment. Michael Cohen Microsoft Research

Capturing the Moment. Michael Cohen Microsoft Research Capturing the Moment Michael Cohen Microsoft Research The Moment Definition will (hopefully) evolve as talk progresses Goals Get you to think about moments as a new media type Start a discussion of what

More information

Computational Cameras. Rahul Raguram COMP

Computational Cameras. Rahul Raguram COMP Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene

More information

La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010

La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010 La photographie numérique Frank NIELSEN Lundi 7 Juin 2010 1 Le Monde digital Key benefits of the analog2digital paradigm shift? Dissociate contents from support : binarize Universal player (CPU, Turing

More information

Realistic Image Synthesis

Realistic Image Synthesis Realistic Image Synthesis - HDR Capture & Tone Mapping - Philipp Slusallek Karol Myszkowski Gurprit Singh Karol Myszkowski LDR vs HDR Comparison Various Dynamic Ranges (1) 10-6 10-4 10-2 100 102 104 106

More information

Optimal Single Image Capture for Motion Deblurring

Optimal Single Image Capture for Motion Deblurring Optimal Single Image Capture for Motion Deblurring Amit Agrawal Mitsubishi Electric Research Labs (MERL) 1 Broadway, Cambridge, MA, USA agrawal@merl.com Ramesh Raskar MIT Media Lab Ames St., Cambridge,

More information

High-Dynamic-Range Imaging & Tone Mapping

High-Dynamic-Range Imaging & Tone Mapping High-Dynamic-Range Imaging & Tone Mapping photo by Jeffrey Martin! Spatial color vision! JPEG! Today s Agenda The dynamic range challenge! Multiple exposures! Estimating the response curve! HDR merging:

More information

Limitations of the Medium, compensation or accentuation

Limitations of the Medium, compensation or accentuation The Art and Science of Depiction Limitations of the Medium, compensation or accentuation Fredo Durand MIT- Lab for Computer Science Limitations of the medium The medium cannot usually produce the same

More information

Limitations of the medium

Limitations of the medium The Art and Science of Depiction Limitations of the Medium, compensation or accentuation Limitations of the medium The medium cannot usually produce the same stimulus Real scene (possibly imaginary) Stimulus

More information

Efficient Image Retargeting for High Dynamic Range Scenes

Efficient Image Retargeting for High Dynamic Range Scenes 1 Efficient Image Retargeting for High Dynamic Range Scenes arxiv:1305.4544v1 [cs.cv] 20 May 2013 Govind Salvi, Puneet Sharma, and Shanmuganathan Raman Abstract Most of the real world scenes have a very

More information

Deconvolution , , Computational Photography Fall 2017, Lecture 17

Deconvolution , , Computational Photography Fall 2017, Lecture 17 Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 17 Course announcements Homework 4 is out. - Due October 26 th. - There was another

More information

Why learn about photography in this course?

Why learn about photography in this course? Why learn about photography in this course? Geri's Game: Note the background is blurred. - photography: model of image formation - Many computer graphics methods use existing photographs e.g. texture &

More information

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response - application: high dynamic range imaging Why learn

More information

Resolving Objects at Higher Resolution from a Single Motion-blurred Image

Resolving Objects at Higher Resolution from a Single Motion-blurred Image MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Resolving Objects at Higher Resolution from a Single Motion-blurred Image Amit Agrawal, Ramesh Raskar TR2007-036 July 2007 Abstract Motion

More information

multiframe visual-inertial blur estimation and removal for unmodified smartphones

multiframe visual-inertial blur estimation and removal for unmodified smartphones multiframe visual-inertial blur estimation and removal for unmodified smartphones, Severin Münger, Carlo Beltrame, Luc Humair WSCG 2015, Plzen, Czech Republic images taken by non-professional photographers

More information

Computational Approaches to Cameras

Computational Approaches to Cameras Computational Approaches to Cameras 11/16/17 Magritte, The False Mirror (1935) Computational Photography Derek Hoiem, University of Illinois Announcements Final project proposal due Monday (see links on

More information

Simulated Programmable Apertures with Lytro

Simulated Programmable Apertures with Lytro Simulated Programmable Apertures with Lytro Yangyang Yu Stanford University yyu10@stanford.edu Abstract This paper presents a simulation method using the commercial light field camera Lytro, which allows

More information

HDR videos acquisition

HDR videos acquisition HDR videos acquisition dr. Francesco Banterle francesco.banterle@isti.cnr.it How to capture? Videos are challenging: We need to capture multiple frames at different exposure times and everything moves

More information

Deconvolution , , Computational Photography Fall 2018, Lecture 12

Deconvolution , , Computational Photography Fall 2018, Lecture 12 Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 12 Course announcements Homework 3 is out. - Due October 12 th. - Any questions?

More information

Tone Adjustment of Underexposed Images Using Dynamic Range Remapping

Tone Adjustment of Underexposed Images Using Dynamic Range Remapping Tone Adjustment of Underexposed Images Using Dynamic Range Remapping Yanwen Guo and Xiaodong Xu National Key Lab for Novel Software Technology, Nanjing University Nanjing 210093, P. R. China {ywguo,xdxu}@nju.edu.cn

More information

CVPR Easter School. Michael S. Brown. School of Computing National University of Singapore

CVPR Easter School. Michael S. Brown. School of Computing National University of Singapore Computational Photography CVPR Easter School March 14 18 18 th, 2011, ANU Kioloa Coastal Campus Michael S. Brown School of Computing National University of Singapore Goal of this tutorial Introduce you

More information

Working with your Camera

Working with your Camera Topic 1 Commanding the Mode Dial Learning Outcomes In this topic, you will learn more about how to control the functions on your mode dial. We touched on this before but I want to go through these in detail

More information

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor

ALMALENCE SUPER SENSOR. A software component with an effect of increasing the pixel size and number of pixels in the sensor ALMALENCE SUPER SENSOR A software component with an effect of increasing the pixel size and number of pixels in the sensor MOBILE CAMERA: SMALL SENSOR AND TINY LENS Insufficient resolution, low light performance,

More information

Video Registration: Key Challenges. Richard Szeliski Microsoft Research

Video Registration: Key Challenges. Richard Szeliski Microsoft Research Video Registration: Key Challenges Richard Szeliski Microsoft Research 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. Key Challenges 1. Mosaics and panoramas 2. Object-based based segmentation (MPEG-4) 3. Engineering

More information

Composition Context Photography

Composition Context Photography UNIVERSITY OF CALIFORNIA Santa Barbara Composition Context Photography ADissertationsubmittedinpartialsatisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science by Daniel

More information

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017

Cameras. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017 Cameras Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017 Camera Focus Camera Focus So far, we have been simulating pinhole cameras with perfect focus Often times, we want to simulate more

More information

SynCam: Capturing sub-frame synchronous media using smartphones

SynCam: Capturing sub-frame synchronous media using smartphones SynCam: Capturing sub-frame synchronous media using smartphones by Ishit Mehta, Parikshit Sakurikar, Rajvi Shah, P J Narayanan in IEEE International Conference on Multimedia and Expo (ICME-2017 ) Report

More information

Automatic Content-aware Non-Photorealistic Rendering of Images

Automatic Content-aware Non-Photorealistic Rendering of Images Automatic Content-aware Non-Photorealistic Rendering of Images Akshay Gadi Patil Electrical Engineering Indian Institute of Technology Gandhinagar, India-382355 Email: akshay.patil@iitgn.ac.in Shanmuganathan

More information

Motion Estimation from a Single Blurred Image

Motion Estimation from a Single Blurred Image Motion Estimation from a Single Blurred Image Image Restoration: De-Blurring Build a Blur Map Adapt Existing De-blurring Techniques to real blurred images Analysis, Reconstruction and 3D reconstruction

More information

Defocus Map Estimation from a Single Image

Defocus Map Estimation from a Single Image Defocus Map Estimation from a Single Image Shaojie Zhuo Terence Sim School of Computing, National University of Singapore, Computing 1, 13 Computing Drive, Singapore 117417, SINGAPOUR Abstract In this

More information

Gray Point (A Plea to Forget About White Point)

Gray Point (A Plea to Forget About White Point) HPA Technology Retreat Indian Wells, California 2016.02.18 Gray Point (A Plea to Forget About White Point) George Joblove 2016 HPA Technology Retreat Indian Wells, California 2016.02.18 2016 George Joblove

More information

Introduction to Light Fields

Introduction to Light Fields MIT Media Lab Introduction to Light Fields Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Introduction to Light Fields Ray Concepts for 4D and 5D Functions Propagation of

More information