Computational Illumination Frédo Durand MIT - EECS
|
|
|
- MargaretMargaret Joanna Jordan
- 5 years ago
- Views:
Transcription
1 Computational Illumination Frédo Durand MIT - EECS Some Slides from Ramesh Raskar (MIT Medialab)
2 High level idea Control the illumination to Lighting as a post-process Extract more information
3 Flash/no-flash
4 Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann MIT/Artis-INRIA Frédo Durand MIT
5 Introduction Satisfactory photos in dark environments are challenging!
6 Introduction Available light: + original lighting - noise/blurriness - color No-flash
7 Introduction Flash: + details + color - flat/artificial - flash shadows - red eyes Flash
8 Introduction Our approach: Use no-flash image relight flash image No-flash Flash Result
9 Introduction Our approach: Use no-flash image relight flash image No-flash + original lighting + details/sharpness + color Result
10 Introduction One approach: Blend the two photos No-flash + Flash Blending
11 Introduction One approach: Blend the two photos Blending Our result
12 Introduction One approach: Blend the two photos Blending Our result
13 Introduction One approach: Blend the two photos Blending Our result
14 Introduction One approach: Blend the two photos Blending Our Solution: more details and less noise Our result
15 Overview Related Work Our Approach Results Conclusion and Future Work
16 Overview Related Work Our Approach Results Conclusion and Future Work
![[1999] Durand et al.](/docs-images/94/121082351/images/17-3.jpg "[2002] Choudhury et al.")
17 Related Work Tone Mapping of High Dynamic Range Images Decouple detail / large-scale information Tumblin et al. [1999] Durand et al. [2002] Choudhury et al. [2003] + Input Detail Large-Scale Output
18 Related Work Petschnigg et al.[2004]: many similarities part of this year s proceedings discussion at the end
19 Overview Related Work Our Approach Results Conclusion and Future Work
20 Our Approach - Main Idea
21 Our Approach - Main Idea
22 Our Approach - Main Idea
23 Our Approach - Main Idea
24 Our Approach - Main Idea
25 Our Approach - Main Idea
26 Our Approach
27 Our Approach
28 Our Approach
29 Our Approach
30 Our Approach
31 Our Approach
32 Our Approach
33 Our Approach
34 Our Approach
35 Our Approach
36 Our Approach
37 Our Approach
38 Our Approach Registration Registration
39 Registration Align to compensate for camera movement Difficult because lighting changes Edge detection No-flash See also Ward[2004], Kang[2003] Flash
40 Our Approach Registration Registration
41 Our Approach Decomposition
42 Decomposition Color / Intensity: original
43 Decomposition Color / Intensity: = * original intensity color
44 Our Approach Decomposition
45 Our Approach Decoupling
46 Decoupling Lighting : Large-scale Variation Texture : Small-scale Variation Large-scale Small-scale
47 Decoupling Lighting : Large-scale Variation Texture : Small-scale Variation Lighting : Large-scale Variation Texture : Small-scale Variation Large-scale Small-scale
48 Large-scale Layer Gaussian filter
49 Large-scale Layer Bilateral filter Smith and Brady 97 Tomasi & Manducci 98
50 Large-scale Layer Bilateral filter Smith and Brady 97 Tomasi & Manducci 98
51 Large-scale Layer Bilateral filter Smith and Brady 97 Tomasi & Manducci 98
52 Large-scale Layer Bilateral filter Smith and Brady 97 Tomasi & Manducci 98
53 Large-scale Layer Bilateral filter
54 Large-scale Layer Cross Bilateral filter Better smoothing for no-flash Value penalization based on flash image edge stopping from flash image
55 Detail Layer / = Intensity Large-scale Detail Recombination: Large scale * Detail = Intensity
56 Recombination * = Large-scale No-flash Detail Flash Intensity Result Recombination: Large scale * Detail = Intensity
57 Recombination shadows ~ * ~ Intensity Result Color Flash Result Recombination: Intensity * Color = Original
58 Our Approach
59 Our Approach Shadow Detection/ Treatment
60 Problem No correction Our result
61 Shadow Correction Why? Global white balance in shadows
62 Shadow Correction Why? Global white balance in shadows Several artifacts:
63 Shadow Correction Why? Global white balance in shadows Several artifacts: at shadow boundary
64 Shadow Correction Why? Global white balance in shadows Several artifacts: at shadow boundary inside shadows (color bleeding)
65 Shadow Correction Why? Global white balance in shadows Several artifacts: at shadow boundary inside shadows (color bleeding) shadows need to be corrected!
66 Shadow Correction Why? Global white balance in shadows Several artifacts: at shadow boundary inside shadows (color bleeding) shadows need to be corrected!... and detected
67 Shadow Detection Flash
68 Shadow Detection Flash
69 Shadow Detection Umbra Flash
70 Shadow Detection Flash Umbra Penumbra
71 Shadow Detection Flash Umbra Penumbra Detection in two steps
72 Shadow Detection
73 Shadow Detection Umbra detection
74 Shadow Detection Umbra detection uniform, scattered light from flash
75 Shadow Detection Umbra detection uniform, scattered light from flash Difference of the two photos ΔΙ reveals these regions
76 Shadow Detection Umbra detection uniform, scattered light from flash Difference of the two photos ΔΙ reveals these regions - = Flash No-flash ΔΙ
77 Shadow Detection Umbra detection Difference ΔΙ = light added by the flash Goal: Find a threshold for ΔΙ ΔΙ
78 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ
79 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ
80 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
81 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
82 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
83 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
84 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
85 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper) ΔΙ τcut
86 Shadow Detection Umbra detection Umbra Detection Threshold (details in paper)? ΔΙ τcut
87 Shadow Detection
88 Shadow Detection No-flash flash
89 Shadow Detection Penumbra detection strong gradient at boundary no strong gradient in no-flash image connected to umbra No-flash flash
90 Shadow Detection Penumbra detection strong gradient at boundary no strong gradient in no-flash image connected to umbra No-flash flash Umbra
91 Shadow Detection Penumbra detection strong gradient at boundary no strong gradient in no-flash image connected to umbra No-flash flash Umbra Penumbra
92 Shadow Correction Need a robust correction Correct color and detail Binary shadow mask
93 Shadow Color Correction Flash color
94 Shadow Color Correction Flash color
95 Shadow Color Correction Flash color Wrong color
96 Shadow Color Correction Correct color Flash color Wrong color
97 Shadow Color Correction Correct color Wrong color Flash color Fill in shadow from similar surrounding
98 Shadow Color Correction Correct color Wrong color Flash color Fill in shadow from similar surrounding
99 Shadow Color Correction Correct color Wrong color Flash color Fill in shadow from similar surrounding No-flash colors
100 Shadow Color Correction
101 Shadow Color Correction
102 Shadow Color Correction No-flash Flash
103 Shadow Color Correction No-flash Flash
104 Shadow Color Correction No-flash Flash
105 Shadow Color Correction No-flash Flash
106 Shadow Color Correction No-flash Flash Outside shadow
107 Shadow Color Correction No-flash Flash Inside shadow Outside shadow
108 Shadow Color Correction No-flash Flash Inside shadow Outside shadow Select pixel in shadow
109 Shadow Color Correction No-flash Flash Corresponding pixel Inside shadow Outside shadow
110 Shadow Color Correction No-flash Flash Spatial weights Inside shadow Outside shadow
111 Shadow Color Correction No-flash Flash Spatial and Color weights Inside shadow Outside shadow
112 Shadow Color Correction No-flash Flash Spatial and Color weights Inside shadow Outside shadow
113 Shadow Color Correction No-flash Flash Spatial and Color weights Inside shadow Outside shadow
114 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
115 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
116 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
117 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
118 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
119 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
120 Shadow Color Correction No-flash Flash Use shadow mask Inside shadow Outside shadow
121 Shadow Color Correction No-flash Flash se weights on flash color Inside shadow Outside shadow
122 Shadow Color Correction No-flash Flash Replace shadow pixel Inside shadow Outside shadow
123 Shadow Color Correction No-flash Flash Inside shadow Proceed for all shadow pixels Outside shadow
124 Shadow Color Correction No-flash Flash Inside shadow Proceed for all shadow pixels Outside shadow
125 Our Approach
126 Our Approach
127 Overview Related Work Our Approach Results Conclusion and Future Work
128 Results No-flash Flash
129 Results No-flash Flash
130 Results No correction Our result
131 Results No-flash Flash
132 Results No-flash Flash
133 Results No-flash Flash
134 Results No-flash Flash
135 Results No-flash Flash
136 Results No-flash Flash
137 Results No-flash Flash Our result
138 Results Our result
139 Results Our result
140 Results Our result
141 Results Our result Deduce distance to camera Exploit 1/r 2 flash intensity falloff
142 Results Our result Deduce distance to camera Exploit 1/r 2 flash intensity falloff Emphasized foreground
143 Results No-flash (Inverse) White balance to original illumination Flash
144 Results No-flash (Inverse) White balance to original illumination Flash
145 Results No-flash (Inverse) White balance to original illumination Flash
146 Results No-flash (Inverse) White balance to original illumination Flash
147 Results No-flash Flash Result
148 Results No-flash Flash Result
149 Overview Related Work Our Approach Results Conclusion and Future Work
150 Conclusion Improving photography in dim environments Capture original lighting Add sharpness/details Correct flash shadows No-flash Pseudo distance (emphasize foreground) Result white balancing Cross Bilateral Filter
151 NPR multiflash
152 Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering using Multi-Flash Imaging Ramesh Raskar, Karhan Tan, Rogerio Feris, Jingyi Yu, Matthew Turk Mitsubishi Electric Research Labs (MERL), Cambridge, MA
153 Depth Edge Camera
154 Depth Edges
155 Sigma = 9 Sigma = 5 Canny Intensity Edge Detection Sigma = 1 Our method captures shape edges
156 Canny Our Method
157 Photo Our Method
158 Photo Result Our Method Canny Intensity Edge Detection
159
160 Shadows Clutter Many Colors Highlight Shape Edges Mark moving parts Basic colors
161
162
163 Flash matting
164
165
166 Relighting
167
168
169
170
171
172
173
174 Dual photography
175
176
177
178
179
180
181 Separation of global/direct
182
183
184
185
186 References IEEE-Computer high.pdf
Flash Photography Enhancement via Intrinsic Relighting
Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann MIT/Artis-INRIA Frédo Durand MIT Introduction Satisfactory photos in dark environments are challenging! Introduction Available light:
Agenda. Fusion and Reconstruction. Image Fusion & Reconstruction. Image Fusion & Reconstruction. Dr. Yossi Rubner.
Fusion and Reconstruction Dr. Yossi Rubner yossi@rubner.co.il Some slides stolen from: Jack Tumblin 1 Agenda We ve seen Panorama (from different FOV) Super-resolution (from low-res) HDR (from different
Computational Illumination
Computational Illumination Course WebPage : http://www.merl.com/people/raskar/photo/ Ramesh Raskar Mitsubishi Electric Research Labs Ramesh Raskar, Computational Illumination Computational Illumination
Flash Photography Enhancement via Intrinsic Relighting
Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann MIT / ARTIS -GRAVIR/IMAG-INRIA Frédo Durand MIT (a) (b) (c) Figure 1: (a) Top: Photograph taken in a dark environment, the image is
Flash Photography Enhancement via Intrinsic Relighting
Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann and Frédo Durand MIT / ARTIS-GRAVIR/IMAG-INRIA and MIT CSAIL Abstract We enhance photographs shot in dark environments by combining
Computational 4/23/2009. Computational Illumination: SIGGRAPH 2006 Course. Course WebPage: Flash Shutter Open
Ramesh Raskar, Computational Illumination Computational Illumination Computational Illumination SIGGRAPH 2006 Course Course WebPage: http://www.merl.com/people/raskar/photo/ Ramesh Raskar Mitsubishi Electric
A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters
A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin EECS, Northwestern University Advanced Uses of Bilateral Filters Advanced
Computational Photography
Computational photography Computational Photography Digital Visual Effects Yung-Yu Chuang wikipedia: Computational photography h refers broadly to computational imaging techniques that enhance or extend
Fixing the Gaussian Blur : the Bilateral Filter
Fixing the Gaussian Blur : the Bilateral Filter Lecturer: Jianbing Shen Email : shenjianbing@bit.edu.cnedu Office room : 841 http://cs.bit.edu.cn/shenjianbing cn/shenjianbing Note: contents copied from
A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters
A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin EECS, Northwestern University Advanced Uses of Bilateral Filters Advanced
Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University!
Burst Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 7! Gordon Wetzstein! Stanford University! Motivation! wikipedia! exposure sequence! -4 stops! Motivation!
Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography
Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography Xi Luo Stanford University 450 Serra Mall, Stanford, CA 94305 xluo2@stanford.edu Abstract The project explores various application
Comp Computational Photography Spatially Varying White Balance. Megha Pandey. Sept. 16, 2008
Comp 790 - Computational Photography Spatially Varying White Balance Megha Pandey Sept. 16, 2008 Color Constancy Color Constancy interpretation of material colors independent of surrounding illumination.
CSC 320 H1S CSC320 Exam Study Guide (Last updated: April 2, 2015) Winter 2015
Question 1. Suppose you have an image I that contains an image of a left eye (the image is detailed enough that it makes a difference that it s the left eye). Write pseudocode to find other left eyes in
Fast Bilateral Filtering for the Display of High-Dynamic-Range Images
Fast Bilateral Filtering for the Display of High-Dynamic-Range Images Frédo Durand & Julie Dorsey Laboratory for Computer Science Massachusetts Institute of Technology Contributions Contrast reduction
Automatic Content-aware Non-Photorealistic Rendering of Images
Automatic Content-aware Non-Photorealistic Rendering of Images Akshay Gadi Patil Electrical Engineering Indian Institute of Technology Gandhinagar, India-382355 Email: akshay.patil@iitgn.ac.in Shanmuganathan
Computational Photography and Video. Prof. Marc Pollefeys
Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence
Fast Bilateral Filtering for the Display of High-Dynamic-Range Images
Contributions ing for the Display of High-Dynamic-Range Images for HDR images Local tone mapping Preserves details No halo Edge-preserving filter Frédo Durand & Julie Dorsey Laboratory for Computer Science
! High&Dynamic!Range!Imaging! Slides!from!Marc!Pollefeys,!Gabriel! Brostow!(and!Alyosha!Efros!and! others)!!
! High&Dynamic!Range!Imaging! Slides!from!Marc!Pollefeys,!Gabriel! Brostow!(and!Alyosha!Efros!and! others)!! Today! High!Dynamic!Range!Imaging!(LDR&>HDR)! Tone!mapping!(HDR&>LDR!display)! The!Problem!
Digital Image Processing
Digital Image Processing Part : Image Enhancement in the Spatial Domain AASS Learning Systems Lab, Dep. Teknik Room T9 (Fr, - o'clock) achim.lilienthal@oru.se Course Book Chapter 3-4- Contents. Image Enhancement
Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image
Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image Takahiro Hasegawa, Ryoji Tomizawa, Yuji Yamauchi, Takayoshi Yamashita and Hironobu Fujiyoshi Chubu University, 1200, Matsumoto-cho,
Less Is More: Coded Computational Photography
Less Is More: Coded Computational Photography Ramesh Raskar Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA Abstract. Computational photography combines plentiful computing, digital sensors,
Illumination Correction tutorial
Illumination Correction tutorial I. Introduction The Correct Illumination Calculate and Correct Illumination Apply modules are intended to compensate for the non uniformities in illumination often present
Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing
Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research
Prof. Feng Liu. Winter /10/2019
Prof. Feng Liu Winter 29 http://www.cs.pdx.edu/~fliu/courses/cs4/ //29 Last Time Course overview Admin. Info Computer Vision Computer Vision at PSU Image representation Color 2 Today Filter 3 Today Filters
Denoising and Effective Contrast Enhancement for Dynamic Range Mapping
Denoising and Effective Contrast Enhancement for Dynamic Range Mapping G. Kiruthiga Department of Electronics and Communication Adithya Institute of Technology Coimbatore B. Hakkem Department of Electronics
Computational Camera & Photography: Coded Imaging
Computational Camera & Photography: Coded Imaging Camera Culture Ramesh Raskar MIT Media Lab http://cameraculture.media.mit.edu/ Image removed due to copyright restrictions. See Fig. 1, Eight major types
Image Enhancement of Low-light Scenes with Near-infrared Flash Images
Research Paper Image Enhancement of Low-light Scenes with Near-infrared Flash Images Sosuke Matsui, 1 Takahiro Okabe, 1 Mihoko Shimano 1, 2 and Yoichi Sato 1 We present a novel technique for enhancing
Tone Adjustment of Underexposed Images Using Dynamic Range Remapping
Tone Adjustment of Underexposed Images Using Dynamic Range Remapping Yanwen Guo and Xiaodong Xu National Key Lab for Novel Software Technology, Nanjing University Nanjing 210093, P. R. China {ywguo,xdxu}@nju.edu.cn
High Dynamic Range Images : Rendering and Image Processing Alexei Efros. The Grandma Problem
High Dynamic Range Images 15-463: Rendering and Image Processing Alexei Efros The Grandma Problem 1 Problem: Dynamic Range 1 1500 The real world is high dynamic range. 25,000 400,000 2,000,000,000 Image
Glare Removal: A Review
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 5, Issue. 1, January 2016,
Image Enhancement of Low-light Scenes with Near-infrared Flash Images
IPSJ Transactions on Computer Vision and Applications Vol. 2 215 223 (Dec. 2010) Research Paper Image Enhancement of Low-light Scenes with Near-infrared Flash Images Sosuke Matsui, 1 Takahiro Okabe, 1
Tone mapping. Digital Visual Effects, Spring 2009 Yung-Yu Chuang. with slides by Fredo Durand, and Alexei Efros
Tone mapping Digital Visual Effects, Spring 2009 Yung-Yu Chuang 2009/3/5 with slides by Fredo Durand, and Alexei Efros Tone mapping How should we map scene luminances (up to 1:100,000) 000) to display
Limitations of the Medium, compensation or accentuation
The Art and Science of Depiction Limitations of the Medium, compensation or accentuation Fredo Durand MIT- Lab for Computer Science Limitations of the medium The medium cannot usually produce the same
Limitations of the medium
The Art and Science of Depiction Limitations of the Medium, compensation or accentuation Limitations of the medium The medium cannot usually produce the same stimulus Real scene (possibly imaginary) Stimulus
More image filtering , , Computational Photography Fall 2017, Lecture 4
More image filtering http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 4 Course announcements Any questions about Homework 1? - How many of you
High dynamic range imaging and tonemapping
High dynamic range imaging and tonemapping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 12 Course announcements Homework 3 is out. - Due
Multispectral Image Dense Matching
Multispectral Image Dense Matching Xiaoyong Shen Li Xu Qi Zhang Jiaya Jia The Chinese University of Hong Kong Image & Visual Computing Lab, Lenovo R&T 1 Multispectral Dense Matching Dataset We build a
Preserving Natural Scene Lighting by Strobe-lit Video
Preserving Natural Scene Lighting by Strobe-lit Video Olli Suominen, Atanas Gotchev Department of Signal Processing, Tampere University of Technology Korkeakoulunkatu 1, 33720 Tampere, Finland ABSTRACT
Achim J. Lilienthal Mobile Robotics and Olfaction Lab, AASS, Örebro University
Achim J. Lilienthal Mobile Robotics and Olfaction Lab, Room T29, Mo, -2 o'clock AASS, Örebro University (please drop me an email in advance) achim.lilienthal@oru.se 4.!!!!!!!!! Pre-Class Reading!!!!!!!!!
Realistic Image Synthesis
Realistic Image Synthesis - HDR Capture & Tone Mapping - Philipp Slusallek Karol Myszkowski Gurprit Singh Karol Myszkowski LDR vs HDR Comparison Various Dynamic Ranges (1) 10-6 10-4 10-2 100 102 104 106
Implementation of Image Deblurring Techniques in Java
Implementation of Image Deblurring Techniques in Java Peter Chapman Computer Systems Lab 2007-2008 Thomas Jefferson High School for Science and Technology Alexandria, Virginia January 22, 2008 Abstract
Prof. Feng Liu. Spring /12/2017
Prof. Feng Liu Spring 2017 http://www.cs.pd.edu/~fliu/courses/cs510/ 04/12/2017 Last Time Filters and its applications Today De-noise Median filter Bilateral filter Non-local mean filter Video de-noising
Matting & Compositing
6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Matting & Compositing Bill Freeman Frédo Durand MIT - EECS How does Superman fly? Super-human powers? OR Image Matting
La photographie numérique. Frank NIELSEN Lundi 7 Juin 2010
La photographie numérique Frank NIELSEN Lundi 7 Juin 2010 1 Le Monde digital Key benefits of the analog2digital paradigm shift? Dissociate contents from support : binarize Universal player (CPU, Turing
Flash Photography: 1
Flash Photography: 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well as an extension using a non-visible
Tonemapping and bilateral filtering
Tonemapping and bilateral filtering http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 6 Course announcements Homework 2 is out. - Due September
Fake Impressionist Paintings for Images and Video
Fake Impressionist Paintings for Images and Video Patrick Gregory Callahan pgcallah@andrew.cmu.edu Department of Materials Science and Engineering Carnegie Mellon University May 7, 2010 1 Abstract A technique
Computational Photography
Computational Photography Si Lu Spring 2018 http://web.cecs.pdx.edu/~lusi/cs510/cs510_computati onal_photography.htm 05/15/2018 With slides by S. Chenney, Y.Y. Chuang, F. Durand, and J. Sun. Last Time
Limitations of the Medium, compensation or accentuation: Contrast & Palette
The Art and Science of Depiction Limitations of the Medium, compensation or accentuation: Contrast & Palette Fredo Durand MIT- Lab for Computer Science Hans Holbein The Ambassadors Limitations: contrast
Computational Photography Introduction
Computational Photography Introduction Jongmin Baek CS 478 Lecture Jan 9, 2012 Background Sales of digital cameras surpassed sales of film cameras in 2004. Digital cameras are cool Free film Instant display
Shape-Enhanced Surgical Visualizations and Medical Illustrations with Multi-flash Imaging
Shape-Enhanced Surgical Visualizations and Medical Illustrations with Multi-flash Imaging Kar-Han Tan 1, James Kobler 2, Paul Dietz 3, Ramesh Raskar 3, and Rogerio S. Feris 4 1 University of Illinois at
Computational Photography
Computational Photography Eduard Gröller Most of material and slides courtesy of Fredo Durand (http://people.csail.mit.edu/fredo/) and Oliver Deussen (http://graphics.uni-konstanz.de/mitarbeiter/deussen.php)
Vision Review: Image Processing. Course web page:
Vision Review: Image Processing Course web page: www.cis.udel.edu/~cer/arv September 7, Announcements Homework and paper presentation guidelines are up on web page Readings for next Tuesday: Chapters 6,.,
Project 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/
Making better photos. Better Photos. Today s Agenda. Today s Agenda. What makes a good picture?! Tone Style Enhancement! What makes a good picture?!
Better Photos Photo by Luca Zanon Today s Agenda What makes a good picture? The Design of High-Level Features for Photo Quality Assessment, Ke et al., 2006 Tone Style Enhancement Two-scale Tone Management
Deblurring. Basics, Problem definition and variants
Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying
Computational Photography: Illumination Part 2. Brown 1
Computational Photography: Illumination Part 2 Brown 1 Lecture Topic Discuss ways to use illumination with further processing Three examples: 1. Flash/No-flash imaging for low-light photography (As well
Using VLSI for Full-HD Video/frames Double Integral Image Architecture Design of Guided Filter
Using VLSI for Full-HD Video/frames Double Integral Image Architecture Design of Guided Filter Aparna Lahane 1 1 M.E. Student, Electronics & Telecommunication,J.N.E.C. Aurangabad, Maharashtra, India ---------------------------------------------------------------------***---------------------------------------------------------------------
Multispectral Bilateral Video Fusion
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 16, NO. 5, MAY 2007 1185 Multispectral Bilateral Video Fusion Eric P. Bennett, John L. Mason, and Leonard McMillan Abstract We present a technique for enhancing
Efficient Document Image Binarization for Degraded Document Images using MDBUTMF and BiTA
RESEARCH ARTICLE OPEN ACCESS Efficient Document Image Binarization for Degraded Document Images using MDBUTMF and BiTA Leena.L.R, Gayathri. S2 1 Leena. L.R,Author is currently pursuing M.Tech (Information
HDR imaging and the Bilateral Filter
6.098 Digital and Computational Photography 6.882 Advanced Computational Photography HDR imaging and the Bilateral Filter Bill Freeman Frédo Durand MIT - EECS Announcement Why Matting Matters Rick Szeliski
Raskar, Camera Culture, MIT Media Lab. Ramesh Raskar. Camera Culture. Associate Professor, MIT Media Lab
Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar C C lt Camera Culture Associate Professor, MIT Media Lab Where are the camera s? Where are the camera s? We focus on creating tools to
Computational Photography: Principles and Practice
Computational Photography: Principles and Practice HCI & Robotics (HCI 및로봇응용공학 ) Ig-Jae Kim, Korea Institute of Science and Technology ( 한국과학기술연구원김익재 ) Jaewon Kim, Korea Institute of Science and Technology
Image Processing. Adam Finkelstein Princeton University COS 426, Spring 2019
Image Processing Adam Finkelstein Princeton University COS 426, Spring 2019 Image Processing Operations Luminance Brightness Contrast Gamma Histogram equalization Color Grayscale Saturation White balance
Two-scale Tone Management for Photographic Look
Two-scale Tone Management for Photographic Look Soonmin Bae Sylvain Paris Frédo Durand Computer Science and Artificial Intelligence Laboratory Massuchusetts Institute of Technology (a) input (b) sample
Tablet overrides: overrides current settings for opacity and size based on pen pressure.
Photoshop 1 Painting Eye Dropper Tool Samples a color from an image source and makes it the foreground color. Brush Tool Paints brush strokes with anti-aliased (smooth) edges. Brush Presets Quickly access
Image Visibility Restoration Using Fast-Weighted Guided Image Filter
International Journal of Electronics Engineering Research. ISSN 0975-6450 Volume 9, Number 1 (2017) pp. 57-67 Research India Publications http://www.ripublication.com Image Visibility Restoration Using
Automatic Selection of Brackets for HDR Image Creation
Automatic Selection of Brackets for HDR Image Creation Michel VIDAL-NAQUET, Wei MING Abstract High Dynamic Range imaging (HDR) is now readily available on mobile devices such as smart phones and compact
An Analysis of Image Denoising and Restoration of Handwritten Degraded Document Images
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 12, December 2014,
Defocus Map Estimation from a Single Image
Defocus Map Estimation from a Single Image Shaojie Zhuo Terence Sim School of Computing, National University of Singapore, Computing 1, 13 Computing Drive, Singapore 117417, SINGAPOUR Abstract In this
High-Dynamic-Range Imaging & Tone Mapping
High-Dynamic-Range Imaging & Tone Mapping photo by Jeffrey Martin! Spatial color vision! JPEG! Today s Agenda The dynamic range challenge! Multiple exposures! Estimating the response curve! HDR merging:
Image Capture and Problems
Image Capture and Problems A reasonable capture IVR Vision: Flat Part Recognition Fisher lecture 4 slide 1 Image Capture: Focus problems Focus set to one distance. Nearby distances in focus (depth of focus).
A reprint from. American Scientist. the magazine of Sigma Xi, The Scientific Research Society
A reprint from American Scientist the magazine of Sigma Xi, The Scientific Research Society This reprint is provided for personal and noncommercial use. For any other use, please send a request Brian Hayes
Templates and Image Pyramids
Templates and Image Pyramids 09/06/11 Computational Photography Derek Hoiem, University of Illinois Project 1 Due Monday at 11:59pm Options for displaying results Web interface or redirect (http://www.pa.msu.edu/services/computing/faq/autoredirect.html)
Computational Illumination
MAS.963: Computational Camera and Photography Fall 2009 Computational Illumination Prof. Ramesh Raskar October 2, 2009 October 2, 2009 Scribe: Anonymous MIT student Lecture 4 Poll: When will Google Earth
Performance Evaluation of Edge Detection Techniques for Square Pixel and Hexagon Pixel images
Performance Evaluation of Edge Detection Techniques for Square Pixel and Hexagon Pixel images Keshav Thakur 1, Er Pooja Gupta 2,Dr.Kuldip Pahwa 3, 1,M.Tech Final Year Student, Deptt. of ECE, MMU Ambala,
A collection of example photos SB-900
A collection of example photos SB-900 This booklet introduces techniques, example photos and an overview of flash shooting capabilities possible when shooting with an SB-900. En Selecting suitable illumination
Problem Set 3. Assigned: March 9, 2006 Due: March 23, (Optional) Multiple-Exposure HDR Images
6.098/6.882 Computational Photography 1 Problem Set 3 Assigned: March 9, 2006 Due: March 23, 2006 Problem 1 (Optional) Multiple-Exposure HDR Images Even though this problem is optional, we recommend you
6.A44 Computational Photography
Add date: Friday 6.A44 Computational Photography Depth of Field Frédo Durand We allow for some tolerance What happens when we close the aperture by two stop? Aperture diameter is divided by two is doubled
Prof. Feng Liu. Spring /22/2017. With slides by S. Chenney, Y.Y. Chuang, F. Durand, and J. Sun.
Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 05/22/2017 With slides by S. Chenney, Y.Y. Chuang, F. Durand, and J. Sun. Last Time Image segmentation 2 Today Matting Input user specified
The Dynamic Range Problem. High Dynamic Range (HDR) Multiple Exposure Photography. Multiple Exposure Photography. Dr. Yossi Rubner.
The Dynamic Range Problem High Dynamic Range (HDR) starlight Domain of Human Vision: from ~10-6 to ~10 +8 cd/m moonlight office light daylight flashbulb 10-6 10-1 10 100 10 +4 10 +8 Dr. Yossi Rubner yossi@rubner.co.il
Restoration of Motion Blurred Document Images
Restoration of Motion Blurred Document Images Bolan Su 12, Shijian Lu 2 and Tan Chew Lim 1 1 Department of Computer Science,School of Computing,National University of Singapore Computing 1, 13 Computing
Templates and Image Pyramids
Templates and Image Pyramids 09/07/17 Computational Photography Derek Hoiem, University of Illinois Why does a lower resolution image still make sense to us? What do we lose? Image: http://www.flickr.com/photos/igorms/136916757/
Sensing Increased Image Resolution Using Aperture Masks
Sensing Increased Image Resolution Using Aperture Masks Ankit Mohan, Xiang Huang, Jack Tumblin Northwestern University Ramesh Raskar MIT Media Lab CVPR 2008 Supplemental Material Contributions Achieve
Introduction to Visual Perception
The Art and Science of Depiction Introduction to Visual Perception Fredo Durand and Julie Dorsey MIT- Lab for Computer Science Vision is not straightforward The complexity of the problem was completely
Er. Varun Kumar 1, Ms.Navdeep Kaur 2, Er.Vikas 3. IJRASET 2015: All Rights are Reserved
Degrade Document Image Enhancement Using morphological operator Er. Varun Kumar 1, Ms.Navdeep Kaur 2, Er.Vikas 3 Abstract- Document imaging is an information technology category for systems capable of
A Study on Image Enhancement and Resolution through fused approach of Guided Filter and high-resolution Filter
VOLUME: 03 ISSUE: 06 JUNE-2016 WWW.IRJET.NET P-ISSN: 2395-0072 A Study on Image Enhancement and Resolution through fused approach of Guided Filter and high-resolution Filter Ashish Kumar Rathore 1, Pradeep
APPLICATION OF PATTERNS TO IMAGE FEATURES
Technical Disclosure Commons Defensive Publications Series March 31, 2016 APPLICATION OF PATTERNS TO IMAGE FEATURES Alex Powell Follow this and additional works at: http://www.tdcommons.org/dpubs_series
Basic Digital Dark Room
Basic Digital Dark Room When I took a good photograph I almost always trying to improve it using Photoshop: exposure, depth of field, black and white, duotones, blur and sharpness or even replace washed
Removal of Gaussian noise on the image edges using the Prewitt operator and threshold function technical
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661, p- ISSN: 2278-8727Volume 15, Issue 2 (Nov. - Dec. 2013), PP 81-85 Removal of Gaussian noise on the image edges using the Prewitt operator
Simulated Programmable Apertures with Lytro
Simulated Programmable Apertures with Lytro Yangyang Yu Stanford University yyu10@stanford.edu Abstract This paper presents a simulation method using the commercial light field camera Lytro, which allows
A Saturation-based Image Fusion Method for Static Scenes
2015 6th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES) A Saturation-based Image Fusion Method for Static Scenes Geley Peljor and Toshiaki Kondo Sirindhorn
Image Filtering in Spatial domain. Computer Vision Jia-Bin Huang, Virginia Tech
Image Filtering in Spatial domain Computer Vision Jia-Bin Huang, Virginia Tech Administrative stuffs Lecture schedule changes Office hours - Jia-Bin (44 Whittemore Hall) Friday at : AM 2: PM Office hours
Restoration of Degraded Historical Document Image 1
Restoration of Degraded Historical Document Image 1 B. Gangamma, 2 Srikanta Murthy K, 3 Arun Vikas Singh 1 Department of ISE, PESIT, Bangalore, Karnataka, India, 2 Professor and Head of the Department
Carmen Alonso Montes 23rd-27th November 2015
Practical Computer Vision: Theory & Applications calonso@bcamath.org 23rd-27th November 2015 Alternative Software Alternative software to matlab Octave Available for Linux, Mac and windows For Mac and
Filtering Images in the Spatial Domain Chapter 3b G&W. Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah
Filtering Images in the Spatial Domain Chapter 3b G&W Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah 1 Overview Correlation and convolution Linear filtering Smoothing, kernels,
Neuron Bundle 12: Digital Film Tools
Neuron Bundle 12: Digital Film Tools Neuron Bundle 12 consists of two plug-in sets Composite Suite Pro and zmatte from Digital Film Tools. Composite Suite Pro features a well rounded collection of visual
Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos
ABSTRACT AND FIGURES OF PAPER PUBLISHED IN IEEE TRANSACTIONS ON IMAGE PROCESSING VOL. 17, NO. 4, 2008 1 Bayesian Foreground and Shadow Detection in Uncertain Frame Rate Surveillance Videos Csaba Benedek,
Computational Cameras. Rahul Raguram COMP
Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene