Coded Exposure HDR Light-Field Video Recording

Size: px
Start display at page:

Download "Coded Exposure HDR Light-Field Video Recording"

Transcription

1 Coded Exposure HDR Light-Field Video Recording David C. Schedl, Clemens Birklbauer, and Oliver Bimber* Johannes Kepler University Linz

2 Exposure Sequence long exposed short

3 HDR Image long exposed short

4 Motion long exposed short

5 HDR Image static motion

6 Exposure sequence each perspective HDR Light Field Reduce motion blur camera array

7 Bayer pattern Multiplexing Colors multiplexing colors Pixel quad-tuple green 2x Interpolation color (demosaicing) Bayer pattern

8 Multiplexing Exposure Times Our approach multiplex exposures (4) Camera quad-tuple interleave exposures (2x) Interpolate perspectives camera array

9 Multiplexing Exposure Times quad-tuple

10 Multiplexing Exposure Times Reduced capturing time strong motion blur motion blur motion blur quad-tuple

11 Multiplexing Exposure Times Reduced capturing time deblurring deblurring deblurring quad-tuple

12 Related Work: LF Cameras [Wilburn et al. 2005] mosaicing for single images [Georgiev et al. 2009, Georgiev et al. 2010] aperture varies / ND filter

13 Related Work: Deblurring [Tai et al. 2008] 2nd high fps camera [Xu and Jia, 2012] deblur stereo-pair

14 Our Approach registration PSFs capture depth segmentation depths

15 Our Approach registration PSFs capture depth segmentation depths

16 Our Approach (cont) deblur interp. segmentation deblurred full HDR light field

17 Outline registration PSFs capture depth segmentation depths

18 Capturing regular exposure sequence coded exposure 8 12 (interleaved) 1 subframe 1+2 subframes 2+1 subframes 8 subframes quad-tuple

19 Capturing 1 Frame 1 subframe 1+2 subframes 2+1 subframes 8 subframes

20 Outline registration PSFs capture depth segmentation depths

21 SURF 3D features matches subf. Registration rotation & translation Registration 1 st subframe T R 2 nd subframe

22 Registration (cont.) For every exposure (except longest) use previous as initial guess 1 x 3 x 7 x

23 up sample (to 7x) Registration (cont.)

24 PSF Calculation 3D features: best registration per projection Cluster: PSF depths

25 Outline registration PSFs capture depth segmentation depths

26 Composite Depth Map Compute depth for each exposure time

27 Composite Depth Map Compute depth for each exposure time Composite depth map: based on confidence combine composite depth

28 Our Approach registration PSFs capture depth segmentation depths

29 Scene Segmentation PSF depth clusters Dense PSF map: inter- & extrapolate Raw clusters: cluster PSF map composite depth map PSF map raw clusters (k=2)

30 Scene Segmentation PSF depth clusters Dense PSF map: inter- & extrapolate Raw clusters: cluster PSF map composite depth map PSF map raw clusters (k=2)

31 Scene Segmentation (cont.) Refine raw clusters [Levin, 2006] matting [Levin, 2006] raw Trimap clusters (k=2) clusters (2) cluster 1 cluster 2

32 Our Approach deblur interp. segmentation deblurred full HDR light field

33 Deblur Clusters Deblur PSF: least upsampled Non-blind deconvolution deblur cluster 1 non-blind blind (+initial guess)

34 Deblur Clusters Deblur PSF: least upsampled Non-blind deconvolution deblur cluster 1 non-blind blind (+initial guess)

35 Deblur Clusters Deblur PSF: least upsampled Semi-Blind Deconvolution deblur deblur [Levin, 2011] cluster 1 non-blind blind (+initial guess)

36 Merge Clusters Blend deblurred clusters merge

37 Merge Clusters Blend deblurred clusters merge rendered

38 PSF Shifting Exp. sequence 1 frame: 15 Coded Exp. 2 frames: x fps

39 Our Approach deblur interp. segmentation deblurred full HDR light field

40 Deblurred Composite Depth Map Recompute depth from deblurred perspectives

41 Deblurred Composite Depth Map Recompute depth from deblurred perspectives combine deblurred composite depth

42 Interpolation Interpolate missing perspectives Exposure sequence at each perspective interpolation

43

44

45 Example 2: Camera Rotation HDR: exposure sequence HDR: coded exposure

46 Thanks! Our Poster Level 3 Ballroom Foyer Tue & Wed: 12:15 to 1:15pm

CS354 Computer Graphics Computational Photography. Qixing Huang April 23 th 2018

CS354 Computer Graphics Computational Photography. Qixing Huang April 23 th 2018 CS354 Computer Graphics Computational Photography Qixing Huang April 23 th 2018 Background Sales of digital cameras surpassed sales of film cameras in 2004 Digital Cameras Free film Instant display Quality

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

Coded photography , , Computational Photography Fall 2018, Lecture 14

Coded photography , , Computational Photography Fall 2018, Lecture 14 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 14 Overview of today s lecture The coded photography paradigm. Dealing with

More information

Coded photography , , Computational Photography Fall 2017, Lecture 18

Coded photography , , Computational Photography Fall 2017, Lecture 18 Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 18 Course announcements Homework 5 delayed for Tuesday. - You will need cameras

More information

Toward Non-stationary Blind Image Deblurring: Models and Techniques

Toward Non-stationary Blind Image Deblurring: Models and Techniques Toward Non-stationary Blind Image Deblurring: Models and Techniques Ji, Hui Department of Mathematics National University of Singapore NUS, 30-May-2017 Outline of the talk Non-stationary Image blurring

More information

multiframe visual-inertial blur estimation and removal for unmodified smartphones

multiframe visual-inertial blur estimation and removal for unmodified smartphones multiframe visual-inertial blur estimation and removal for unmodified smartphones, Severin Münger, Carlo Beltrame, Luc Humair WSCG 2015, Plzen, Czech Republic images taken by non-professional photographers

More information

OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES

OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES D. C. Schedl 1 and O. Bimber 1 1 Institute of Computer Graphics, david.schedl@jku.at and oliver.bimber@jku.at MOTIVATION

More information

A Framework for Analysis of Computational Imaging Systems

A Framework for Analysis of Computational Imaging Systems A Framework for Analysis of Computational Imaging Systems Kaushik Mitra, Oliver Cossairt, Ashok Veeraghavan Rice University Northwestern University Computational imaging CI systems that adds new functionality

More information

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing

Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research

More information

Color image Demosaicing. CS 663, Ajit Rajwade

Color image Demosaicing. CS 663, Ajit Rajwade Color image Demosaicing CS 663, Ajit Rajwade Color Filter Arrays It is an array of tiny color filters placed before the image sensor array of a camera. The resolution of this array is the same as that

More information

Deblurring. Basics, Problem definition and variants

Deblurring. Basics, Problem definition and variants Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying

More information

When Does Computational Imaging Improve Performance?

When Does Computational Imaging Improve Performance? When Does Computational Imaging Improve Performance? Oliver Cossairt Assistant Professor Northwestern University Collaborators: Mohit Gupta, Changyin Zhou, Daniel Miau, Shree Nayar (Columbia University)

More information

Computational Photography

Computational Photography Computational photography Computational Photography Digital Visual Effects Yung-Yu Chuang wikipedia: Computational photography h refers broadly to computational imaging techniques that enhance or extend

More information

Computational Photography Introduction

Computational Photography Introduction Computational Photography Introduction Jongmin Baek CS 478 Lecture Jan 9, 2012 Background Sales of digital cameras surpassed sales of film cameras in 2004. Digital cameras are cool Free film Instant display

More information

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University!

Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Motivation! wikipedia! exposure sequence! -4 stops! Motivation!

More information

To Denoise or Deblur: Parameter Optimization for Imaging Systems

To Denoise or Deblur: Parameter Optimization for Imaging Systems To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra, Oliver Cossairt and Ashok Veeraraghavan 1 ECE, Rice University 2 EECS, Northwestern University 3/3/2014 1 Capture moving

More information

Sensing Increased Image Resolution Using Aperture Masks

Sensing Increased Image Resolution Using Aperture Masks Sensing Increased Image Resolution Using Aperture Masks Ankit Mohan, Xiang Huang, Jack Tumblin Northwestern University Ramesh Raskar MIT Media Lab CVPR 2008 Supplemental Material Contributions Achieve

More information

Computational Cameras. Rahul Raguram COMP

Computational Cameras. Rahul Raguram COMP Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene

More information

Coding and Modulation in Cameras

Coding and Modulation in Cameras Coding and Modulation in Cameras Amit Agrawal June 2010 Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Schedule Introduction

More information

Restoration of Motion Blurred Document Images

Restoration of Motion Blurred Document Images Restoration of Motion Blurred Document Images Bolan Su 12, Shijian Lu 2 and Tan Chew Lim 1 1 Department of Computer Science,School of Computing,National University of Singapore Computing 1, 13 Computing

More information

Basic principles of photography. David Capel 346B IST

Basic principles of photography. David Capel 346B IST Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse

More information

Recent advances in deblurring and image stabilization. Michal Šorel Academy of Sciences of the Czech Republic

Recent advances in deblurring and image stabilization. Michal Šorel Academy of Sciences of the Czech Republic Recent advances in deblurring and image stabilization Michal Šorel Academy of Sciences of the Czech Republic Camera shake stabilization Alternative to OIS (optical image stabilization) systems Should work

More information

4 STUDY OF DEBLURRING TECHNIQUES FOR RESTORED MOTION BLURRED IMAGES

4 STUDY OF DEBLURRING TECHNIQUES FOR RESTORED MOTION BLURRED IMAGES 4 STUDY OF DEBLURRING TECHNIQUES FOR RESTORED MOTION BLURRED IMAGES Abstract: This paper attempts to undertake the study of deblurring techniques for Restored Motion Blurred Images by using: Wiener filter,

More information

MDSP RESOLUTION ENHANCEMENT SOFTWARE USER S MANUAL 1

MDSP RESOLUTION ENHANCEMENT SOFTWARE USER S MANUAL 1 MDSP RESOLUTION ENHANCEMENT SOFTWARE USER S MANUAL 1 Sina Farsiu May 4, 2004 1 This work was supported in part by the National Science Foundation Grant CCR-9984246, US Air Force Grant F49620-03 SC 20030835,

More information

High dynamic range imaging and tonemapping

High dynamic range imaging and tonemapping High dynamic range imaging and tonemapping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 12 Course announcements Homework 3 is out. - Due

More information

Motion Estimation from a Single Blurred Image

Motion Estimation from a Single Blurred Image Motion Estimation from a Single Blurred Image Image Restoration: De-Blurring Build a Blur Map Adapt Existing De-blurring Techniques to real blurred images Analysis, Reconstruction and 3D reconstruction

More information

Deconvolution , , Computational Photography Fall 2017, Lecture 17

Deconvolution , , Computational Photography Fall 2017, Lecture 17 Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 17 Course announcements Homework 4 is out. - Due October 26 th. - There was another

More information

Computational Camera & Photography: Coded Imaging

Computational Camera & Photography: Coded Imaging Computational Camera & Photography: Coded Imaging Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Image removed due to copyright restrictions. See Fig. 1, Eight major types

More information

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysis Yosuke Bando 1,2 Henry Holtzman 2 Ramesh Raskar 2 1 Toshiba Corporation 2 MIT Media Lab Defocus & Motion Blur PSF Depth

More information

Image Mosaicing. Jinxiang Chai. Source: faculty.cs.tamu.edu/jchai/cpsc641_spring10/lectures/lecture8.ppt

Image Mosaicing. Jinxiang Chai. Source: faculty.cs.tamu.edu/jchai/cpsc641_spring10/lectures/lecture8.ppt CSCE 641 Computer Graphics: Image Mosaicing Jinxiang Chai Source: faculty.cs.tamu.edu/jchai/cpsc641_spring10/lectures/lecture8.ppt Outline Image registration - How to break assumptions? 3D-2D registration

More information

Total Variation Blind Deconvolution: The Devil is in the Details*

Total Variation Blind Deconvolution: The Devil is in the Details* Total Variation Blind Deconvolution: The Devil is in the Details* Paolo Favaro Computer Vision Group University of Bern *Joint work with Daniele Perrone Blur in pictures When we take a picture we expose

More information

Improving Signal- to- noise Ratio in Remotely Sensed Imagery Using an Invertible Blur Technique

Improving Signal- to- noise Ratio in Remotely Sensed Imagery Using an Invertible Blur Technique Improving Signal- to- noise Ratio in Remotely Sensed Imagery Using an Invertible Blur Technique Linda K. Le a and Carl Salvaggio a a Rochester Institute of Technology, Center for Imaging Science, Digital

More information

Deconvolution , , Computational Photography Fall 2018, Lecture 12

Deconvolution , , Computational Photography Fall 2018, Lecture 12 Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 12 Course announcements Homework 3 is out. - Due October 12 th. - Any questions?

More information

Video Registration: Key Challenges. Richard Szeliski Microsoft Research

Video Registration: Key Challenges. Richard Szeliski Microsoft Research Video Registration: Key Challenges Richard Szeliski Microsoft Research 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. Key Challenges 1. Mosaics and panoramas 2. Object-based based segmentation (MPEG-4) 3. Engineering

More information

An application of the least squares plane fitting interpolation process to image reconstruction and enhancement

An application of the least squares plane fitting interpolation process to image reconstruction and enhancement An application of the least squares plane fitting interpolation process to image reconstruction and enhancement Presented at the FIG Working Week 2016, May 2-6, 2016 in Christchurch, New Zealand Gabriel

More information

Recent Advances in Image Deblurring. Seungyong Lee (Collaboration w/ Sunghyun Cho)

Recent Advances in Image Deblurring. Seungyong Lee (Collaboration w/ Sunghyun Cho) Recent Advances in Image Deblurring Seungyong Lee (Collaboration w/ Sunghyun Cho) Disclaimer Many images and figures in this course note have been copied from the papers and presentation materials of previous

More information

Non-Uniform Motion Blur For Face Recognition

Non-Uniform Motion Blur For Face Recognition IOSR Journal of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vol. 08, Issue 6 (June. 2018), V (IV) PP 46-52 www.iosrjen.org Non-Uniform Motion Blur For Face Recognition Durga Bhavani

More information

fast blur removal for wearable QR code scanners

fast blur removal for wearable QR code scanners fast blur removal for wearable QR code scanners Gábor Sörös, Stephan Semmler, Luc Humair, Otmar Hilliges ISWC 2015, Osaka, Japan traditional barcode scanning next generation barcode scanning ubiquitous

More information

Coded Computational Photography!

Coded Computational Photography! Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 22: Computational photography photomatix.com Announcements Final project midterm reports due on Tuesday to CMS by 11:59pm BRDF s can be incredibly complicated

More information

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TABLE OF CONTENTS Overview... 3 Color Filter Patterns... 3 Bayer CFA... 3 Sparse CFA... 3 Image Processing...

More information

Spline wavelet based blind image recovery

Spline wavelet based blind image recovery Spline wavelet based blind image recovery Ji, Hui ( 纪辉 ) National University of Singapore Workshop on Spline Approximation and its Applications on Carl de Boor's 80 th Birthday, NUS, 06-Nov-2017 Spline

More information

How to combine images in Photoshop

How to combine images in Photoshop How to combine images in Photoshop In Photoshop, you can use multiple layers to combine images, but there are two other ways to create a single image from mulitple images. Create a panoramic image with

More information

2990 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 10, OCTOBER We assume that the exposure time stays constant.

2990 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 10, OCTOBER We assume that the exposure time stays constant. 2990 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL 20, NO 0, OCTOBER 20 Correspondence Removing Motion Blur With Space Time Processing Hiroyuki Takeda, Member, IEEE, and Peyman Milanfar, Fellow, IEEE Abstract

More information

A Review over Different Blur Detection Techniques in Image Processing

A Review over Different Blur Detection Techniques in Image Processing A Review over Different Blur Detection Techniques in Image Processing 1 Anupama Sharma, 2 Devarshi Shukla 1 E.C.E student, 2 H.O.D, Department of electronics communication engineering, LR College of engineering

More information

Synthetic aperture photography and illumination using arrays of cameras and projectors

Synthetic aperture photography and illumination using arrays of cameras and projectors Synthetic aperture photography and illumination using arrays of cameras and projectors technologies large camera arrays large projector arrays camera projector arrays Outline optical effects synthetic

More information

A Novel Image Deblurring Method to Improve Iris Recognition Accuracy

A Novel Image Deblurring Method to Improve Iris Recognition Accuracy A Novel Image Deblurring Method to Improve Iris Recognition Accuracy Jing Liu University of Science and Technology of China National Laboratory of Pattern Recognition, Institute of Automation, Chinese

More information

Figure 1 HDR image fusion example

Figure 1 HDR image fusion example TN-0903 Date: 10/06/09 Using image fusion to capture high-dynamic range (hdr) scenes High dynamic range (HDR) refers to the ability to distinguish details in scenes containing both very bright and relatively

More information

COMPUTATIONAL PHOTOGRAPHY. Chapter 10

COMPUTATIONAL PHOTOGRAPHY. Chapter 10 1 COMPUTATIONAL PHOTOGRAPHY Chapter 10 Computa;onal photography Computa;onal photography: image analysis and processing algorithms are applied to one or more photographs to create images that go beyond

More information

Removing Motion Blur with Space-Time Processing

Removing Motion Blur with Space-Time Processing 1 Removing Motion Blur with Space-Time Processing Hiroyuki Takeda, Student Member, IEEE, Peyman Milanfar, Fellow, IEEE Abstract Although spatial deblurring is relatively well-understood by assuming that

More information

TIK: a time domain continuous imaging testbed using conventional still images and video

TIK: a time domain continuous imaging testbed using conventional still images and video TIK: a time domain continuous imaging testbed using conventional still images and video Henry Dietz, Paul Eberhart, John Fike, Katie Long, Clark Demaree, and Jong Wu DPMI-081, 11:30AM February 1, 2017

More information

HDR videos acquisition

HDR videos acquisition HDR videos acquisition dr. Francesco Banterle francesco.banterle@isti.cnr.it How to capture? Videos are challenging: We need to capture multiple frames at different exposure times and everything moves

More information

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do?

The ultimate camera. Computational Photography. Creating the ultimate camera. The ultimate camera. What does it do? Computational Photography The ultimate camera What does it do? Image from Durand & Freeman s MIT Course on Computational Photography Today s reading Szeliski Chapter 9 The ultimate camera Infinite resolution

More information

Topic 9 - Sensors Within

Topic 9 - Sensors Within Topic 9 - Sensors Within Learning Outcomes In this topic, we will take a closer look at sensor sizes in digital cameras. By the end of this video you will have a better understanding of what the various

More information

Lenses, exposure, and (de)focus

Lenses, exposure, and (de)focus Lenses, exposure, and (de)focus http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 15 Course announcements Homework 4 is out. - Due October 26

More information

Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction

Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction 2013 IEEE International Conference on Computer Vision Modeling the calibration pipeline of the Lytro camera for high quality light-field image reconstruction Donghyeon Cho Minhaeng Lee Sunyeong Kim Yu-Wing

More information

Coded Aperture for Projector and Camera for Robust 3D measurement

Coded Aperture for Projector and Camera for Robust 3D measurement Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement

More information

Early art: events. Baroque art: portraits. Renaissance art: events. Being There: Capturing and Experiencing a Sense of Place

Early art: events. Baroque art: portraits. Renaissance art: events. Being There: Capturing and Experiencing a Sense of Place Being There: Capturing and Experiencing a Sense of Place Early art: events Richard Szeliski Microsoft Research Symposium on Computational Photography and Video Lascaux Early art: events Early art: events

More information

Correction of Spatially Varying Image and Video Motion Blur Using a Hybrid Camera

Correction of Spatially Varying Image and Video Motion Blur Using a Hybrid Camera 1012 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 32, NO. 6, JUNE 2010 Correction of Spatially Varying Image and Video Motion Blur Using a Hybrid Camera Yu-Wing Tai, Member, IEEE,

More information

Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern

Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern James DiBella*, Marco Andreghetti, Amy Enge, William Chen, Timothy Stanka, Robert Kaser (Eastman Kodak

More information

Computational Photography and Video. Prof. Marc Pollefeys

Computational Photography and Video. Prof. Marc Pollefeys Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence

More information

High Performance Imaging Using Large Camera Arrays

High Performance Imaging Using Large Camera Arrays High Performance Imaging Using Large Camera Arrays Presentation of the original paper by Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz,

More information

Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/

More information

Page 1 of 9. Blending Multiple Exposures The Manual Way to HDR (High Dynamic Range) TJ Avery 7-Feb-2008

Page 1 of 9. Blending Multiple Exposures The Manual Way to HDR (High Dynamic Range) TJ Avery 7-Feb-2008 Page 1 of 9 Blending Multiple Exposures The Manual Way to HDR (High Dynamic Range) TJ Avery 7-Feb-2008 The Problem Many natural landscape photographs will contain a range of light that exceeds what can

More information

Continuous Flash. October 1, Technical Report MSR-TR Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052

Continuous Flash. October 1, Technical Report MSR-TR Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 Continuous Flash Hugues Hoppe Kentaro Toyama October 1, 2003 Technical Report MSR-TR-2003-63 Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 Page 1 of 7 Abstract To take a

More information

To Denoise or Deblur: Parameter Optimization for Imaging Systems

To Denoise or Deblur: Parameter Optimization for Imaging Systems To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra a, Oliver Cossairt b and Ashok Veeraraghavan a a Electrical and Computer Engineering, Rice University, Houston, TX 77005 b

More information

Multi-sensor Super-Resolution

Multi-sensor Super-Resolution Multi-sensor Super-Resolution Assaf Zomet Shmuel Peleg School of Computer Science and Engineering, The Hebrew University of Jerusalem, 9904, Jerusalem, Israel E-Mail: zomet,peleg @cs.huji.ac.il Abstract

More information

Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility

Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility Amit Agrawal Yi Xu Mitsubishi Electric Research Labs (MERL) 201 Broadway, Cambridge, MA, USA [agrawal@merl.com,xu43@cs.purdue.edu]

More information

Working with your Camera

Working with your Camera Topic 1 Commanding the Mode Dial Learning Outcomes In this topic, you will learn more about how to control the functions on your mode dial. We touched on this before but I want to go through these in detail

More information

Improving Film-Like Photography. aka, Epsilon Photography

Improving Film-Like Photography. aka, Epsilon Photography Improving Film-Like Photography aka, Epsilon Photography Ankit Mohan Courtesy of Ankit Mohan. Used with permission. Film-like like Optics: Imaging Intuition Angle(θ,ϕ) Ray Center of Projection Position

More information

A 120dB dynamic range image sensor with single readout using in pixel HDR

A 120dB dynamic range image sensor with single readout using in pixel HDR A 120dB dynamic range image sensor with single readout using in pixel HDR CMOS Image Sensors for High Performance Applications Workshop November 19, 2015 J. Caranana, P. Monsinjon, J. Michelot, C. Bouvier,

More information

IMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY. Khosro Bahrami and Alex C. Kot

IMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY. Khosro Bahrami and Alex C. Kot 24 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) IMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY Khosro Bahrami and Alex C. Kot School of Electrical and

More information

Image Deblurring. This chapter describes how to deblur an image using the toolbox deblurring functions.

Image Deblurring. This chapter describes how to deblur an image using the toolbox deblurring functions. 12 Image Deblurring This chapter describes how to deblur an image using the toolbox deblurring functions. Understanding Deblurring (p. 12-2) Using the Deblurring Functions (p. 12-5) Avoiding Ringing in

More information

A Recognition of License Plate Images from Fast Moving Vehicles Using Blur Kernel Estimation

A Recognition of License Plate Images from Fast Moving Vehicles Using Blur Kernel Estimation A Recognition of License Plate Images from Fast Moving Vehicles Using Blur Kernel Estimation Kalaivani.R 1, Poovendran.R 2 P.G. Student, Dept. of ECE, Adhiyamaan College of Engineering, Hosur, Tamil Nadu,

More information

Motion Blurred Image Restoration based on Super-resolution Method

Motion Blurred Image Restoration based on Super-resolution Method Motion Blurred Image Restoration based on Super-resolution Method Department of computer science and engineering East China University of Political Science and Law, Shanghai, China yanch93@yahoo.com.cn

More information

Sharpness Metric Based on Line Local Binary Patterns and a Robust segmentation Algorithm for Defocus Blur

Sharpness Metric Based on Line Local Binary Patterns and a Robust segmentation Algorithm for Defocus Blur Sharpness Metric Based on Line Local Binary Patterns and a Robust segmentation Algorithm for Defocus Blur 1 Ravi Barigala, M.Tech,Email.Id: ravibarigala149@gmail.com 2 Dr.V.S.R. Kumari, M.E, Ph.D, Professor&HOD,

More information

ART 263 Digital Photography

ART 263 Digital Photography ART 263 Digital Photography Syllabus Instructor: Lewis Franklin Lecture / Lab # : RM.SSH-116D Mon, Tue, Wed & Thu 10:00-12:50 Office Hours starting Tuesday 1-2 each day after class Course Description:

More information

Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner.

Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner. Fusion and Reconstruction Dr. Yossi Rubner yossi@rubner.co.il Some slides stolen from: Jack Tumblin 1 Agenda We ve seen Panorama (from different FOV) Super-resolution (from low-res) HDR (from different

More information

Resolving Objects at Higher Resolution from a Single Motion-blurred Image

Resolving Objects at Higher Resolution from a Single Motion-blurred Image MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Resolving Objects at Higher Resolution from a Single Motion-blurred Image Amit Agrawal, Ramesh Raskar TR2007-036 July 2007 Abstract Motion

More information

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration

Image stitching. Image stitching. Video summarization. Applications of image stitching. Stitching = alignment + blending. geometrical registration Image stitching Stitching = alignment + blending Image stitching geometrical registration photometric registration Digital Visual Effects, Spring 2006 Yung-Yu Chuang 2005/3/22 with slides by Richard Szeliski,

More information

HDR. High Dynamic Range Photograph

HDR. High Dynamic Range Photograph HDR High Dynamic Range Photograph HDR This is a properly exposed image. HDR This is a properly exposed image - if I meter off the mountain side. HDR If it s properly exposed, why can t I see details in

More information

Manifesting a Blackboard Image Restore and Mosaic using Multifeature Registration Algorithm

Manifesting a Blackboard Image Restore and Mosaic using Multifeature Registration Algorithm Manifesting a Blackboard Image Restore and Mosaic using Multifeature Registration Algorithm Priyanka Virendrasinh Jadeja 1, Dr. Dhaval R. Bhojani 2 1 Department of Electronics and Communication Engineering,

More information

This histogram represents the +½ stop exposure from the bracket illustrated on the first page.

This histogram represents the +½ stop exposure from the bracket illustrated on the first page. Washtenaw Community College Digital M edia Arts Photo http://courses.wccnet.edu/~donw Don W erthm ann GM300BB 973-3586 donw@wccnet.edu Exposure Strategies for Digital Capture Regardless of the media choice

More information

Problem Set 3. Assigned: March 9, 2006 Due: March 23, (Optional) Multiple-Exposure HDR Images

Problem Set 3. Assigned: March 9, 2006 Due: March 23, (Optional) Multiple-Exposure HDR Images 6.098/6.882 Computational Photography 1 Problem Set 3 Assigned: March 9, 2006 Due: March 23, 2006 Problem 1 (Optional) Multiple-Exposure HDR Images Even though this problem is optional, we recommend you

More information

Coded Aperture and Coded Exposure Photography

Coded Aperture and Coded Exposure Photography Coded Aperture and Coded Exposure Photography Martin Wilson University of Cape Town Cape Town, South Africa Email: Martin.Wilson@uct.ac.za Fred Nicolls University of Cape Town Cape Town, South Africa Email:

More information

Comp Computational Photography Spatially Varying White Balance. Megha Pandey. Sept. 16, 2008

Comp Computational Photography Spatially Varying White Balance. Megha Pandey. Sept. 16, 2008 Comp 790 - Computational Photography Spatially Varying White Balance Megha Pandey Sept. 16, 2008 Color Constancy Color Constancy interpretation of material colors independent of surrounding illumination.

More information

High Dynamic Range (HDR) Photography in Photoshop CS2

High Dynamic Range (HDR) Photography in Photoshop CS2 Page 1 of 7 High dynamic range (HDR) images enable photographers to record a greater range of tonal detail than a given camera could capture in a single photo. This opens up a whole new set of lighting

More information

Admin Deblurring & Deconvolution Different types of blur

Admin Deblurring & Deconvolution Different types of blur Admin Assignment 3 due Deblurring & Deconvolution Lecture 10 Last lecture Move to Friday? Projects Come and see me Different types of blur Camera shake User moving hands Scene motion Objects in the scene

More information

The Fundamental Problem

The Fundamental Problem The What, Why & How WHAT IS IT? Technique of blending multiple different exposures of the same scene to create a single image with a greater dynamic range than can be achieved with a single exposure. Can

More information

HDR images acquisition

HDR images acquisition HDR images acquisition dr. Francesco Banterle francesco.banterle@isti.cnr.it Current sensors No sensors available to consumer for capturing HDR content in a single shot Some native HDR sensors exist, HDRc

More information

Computer Vision. The Pinhole Camera Model

Computer Vision. The Pinhole Camera Model Computer Vision The Pinhole Camera Model Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2017/2018 Imaging device

More information

HDR Darkroom 2 User Manual

HDR Darkroom 2 User Manual HDR Darkroom 2 User Manual Everimaging Ltd. 1 / 22 www.everimaging.com Cotent: 1. Introduction... 3 1.1 A Brief Introduction to HDR Photography... 3 1.2 Introduction to HDR Darkroom 2... 5 2. HDR Darkroom

More information

Preserving Natural Scene Lighting by Strobe-lit Video

Preserving Natural Scene Lighting by Strobe-lit Video Preserving Natural Scene Lighting by Strobe-lit Video Olli Suominen, Atanas Gotchev Department of Signal Processing, Tampere University of Technology Korkeakoulunkatu 1, 33720 Tampere, Finland ABSTRACT

More information

Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring

Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Ashill Chiranjan and Bernardt Duvenhage Defence, Peace, Safety and Security Council for Scientific

More information

CPSC 4040/6040 Computer Graphics Images. Joshua Levine

CPSC 4040/6040 Computer Graphics Images. Joshua Levine CPSC 4040/6040 Computer Graphics Images Joshua Levine levinej@clemson.edu Lecture 04 Displays and Optics Sept. 1, 2015 Slide Credits: Kenny A. Hunt Don House Torsten Möller Hanspeter Pfister Agenda Open

More information

Why learn about photography in this course?

Why learn about photography in this course? Why learn about photography in this course? Geri's Game: Note the background is blurred. - photography: model of image formation - Many computer graphics methods use existing photographs e.g. texture &

More information

PATCH-BASED BLIND DECONVOLUTION WITH PARAMETRIC INTERPOLATION OF CONVOLUTION KERNELS

PATCH-BASED BLIND DECONVOLUTION WITH PARAMETRIC INTERPOLATION OF CONVOLUTION KERNELS PATCH-BASED BLIND DECONVOLUTION WITH PARAMETRIC INTERPOLATION OF CONVOLUTION KERNELS Filip S roubek, Michal S orel, Irena Hora c kova, Jan Flusser UTIA, Academy of Sciences of CR Pod Voda renskou ve z

More information

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response

lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response - application: high dynamic range imaging Why learn

More information

Dynamic Range. H. David Stein

Dynamic Range. H. David Stein Dynamic Range H. David Stein Dynamic Range What is dynamic range? What is low or limited dynamic range (LDR)? What is high dynamic range (HDR)? What s the difference? Since we normally work in LDR Why

More information

Visual Media Processing Using MATLAB Beginner's Guide

Visual Media Processing Using MATLAB Beginner's Guide Visual Media Processing Using MATLAB Beginner's Guide Learn a range of techniques from enhancing and adding artistic effects to your photographs, to editing and processing your videos, all using MATLAB

More information