PATCH-BASED BLIND DECONVOLUTION WITH PARAMETRIC INTERPOLATION OF CONVOLUTION KERNELS
|
|
- Veronica Scott
- 5 years ago
- Views:
Transcription
1 PATCH-BASED BLIND DECONVOLUTION WITH PARAMETRIC INTERPOLATION OF CONVOLUTION KERNELS Filip S roubek, Michal S orel, Irena Hora c kova, Jan Flusser UTIA, Academy of Sciences of CR Pod Voda renskou ve z ı 4, Prague 8, 18 08, Czech Republic (a) blurred input (b) our reconstruction (c) close-ups Fig. 1. Space-variant deconvolution of photos blurred by real camera shake: (a) one input blurry image; (b) reconstruction using the proposed method with parametric blur interpolation; (c) close-ups: (left) input blurry image, (middle) reconstruction with naive intensity interpolation shows strong artifacts, (right) proposed method. ABSTRACT We propose a method for removal of space-variant blur from images predominantly degraded by camera shake without any knowledge of camera trajectory. Blurs are first estimated in a small number of image patches. We derive a novel parametric blur interpolation method and discuss conditions under which it can be used to exactly calculate blurs for every pixel position. Having this information, we restore the sharp image by a standard regularization technique. Performance of the proposed method is experimentally validated. Index Terms blind deconvolution, space-variant convolution, interpolation 1. INTRODUCTION Blur induced by camera motion is a frequent problem in photography occurring mainly in poor light conditions, when the exposure time increases. Image stabilization devices help to reduce motion blur of limited extent. For larger blur, deblurring the image offline using mathematical algorithms remains the only way to obtain a sharp image. Homogenous blurring can be described by convolution with a point spread function (PSF). Unfortunately this is not the case for motion blur due to camera shake, especially if Thanks to GACR agency project GA13-95S for funding. the focal length of the lens is short. The blur is typically different in different parts of the image [1]; see an example in Fig. 1(a). The cause of its spatial variance (SV) is not only camera motion but also other factors such as optical aberrations. In practice deblurring is even more complicated, since we usually have no or limited information about the blur. We face an extremely ill-posed blind deconvolution (BD) problem. For certain types of camera motion, such as rotation, we can express the degradation operator as a linear combination of basis blurs (or images) and solve the blind problem in the space of the basis, which has much lower dimension than the original problem. Whyte et al. [] considered rotations about three axes up to several degrees and described blurring using three basis vectors. For blind deconvolution, they used an algorithm analogous to [3] based on marginalization over the latent sharp image. Gupta et al. [4] adopted a similar approach, replacing rotations about x and y axes by translations. Such projections to a low-dimension subspace look promising but they are disguised parametric methods with their main limitation that they only work for a specific class of blurs (in this case constrained camera motion) and they completely ignore any additional blurs, such as optical aberrations, that typically appear in real cases. Here we adopt a different approach, used e.g. in [5, 6], in which the blur operator is assumed to be locally space invari-
2 ant and thus can be locally approximated by standard convolution. This way we can deal with more general SV blurs. A good approximation of the SV blur operator is achieved by estimating PSFs in a neighbourhood of every pixel, which is computationally demanding. To avoid computation in each pixel, methods [5 7] estimate PSFs in a subset of pixels and use linear interpolation to express the PSF in the rest of the image. Linear interpolation however does not describe well how the PSF changes with position. The PSFs must be therefore estimated quite densely. In this paper, we propose a parametric interpolation method that accurately and quickly calculates PSFs in every pixel of the image from PSFs estimated in just a small number of image locations.. SPACE-VARIANT BLIND DECONVOLUTION The blurred image g is modeled by a general linear operator H applied to the latent image u: g(x, y) = [Hu](x, y) = u(x s, y t)h(s, t, x s, y t)dsdt. (1) The operator H is a generalization of standard convolution where h is now a function of four variables. We can think of this operation as a convolution with a SV PSF h(s, t, x, y) that depends on the position (x, y) in the image. Standard convolution is a special case of (1), where h(s, t, x, y) = h(s, t) for any (x, y). We assume that SV PSF changes relatively slowly in the image space, which is typically the case for camera motion and optical aberrations. Then the blur can be considered locally constant and we can approximate it by convolution in every image patch. Let us divide the image g into overlapping patches denoted as g p, where p is the patch index. The SV convolution model in (1) transforms into a set of convolutions g p = k p u p, () where k p is a convolution kernel that approximates h(s, t, x, y) for (x, y) in the p-th patch. In every patch, we thus have a classical BD problem. We have several ways how to solve such problem. If multiple blurred images of the same scene are available we can apply stable multichannel methods proposed for example in [8]. A special case is dual exposure problem when we combine a long exposure blurry image with a short exposure noisy one [5,6]. If only a single blurred image is used, we can apply single-channel BD methods proposed recently in [3, 9]. Solving BD in every patch would be extremely time consuming. Instead we propose to solve the SV BD problem in a more efficient way: Use BD methods on () to estimate PSFs in few patches distributed on a coarse grid. Apply our novel interpolation method (see Sec. 3) to generate PSFs on a dense grid. Generate SV blurring operator H from the interpolated PSFs and find the sharp image u by solving (1) using non-blind SV deconvolution method [10]. 3. PARAMETRIC INTERPOLATION A simple approach to interpolation as proposed in [5] is to take the estimated PSFs on a coarse grid and perform interpolation of PSF intensity values, i.e. for each pixel location we consider four closest PSFs on the coarse grid and run bilinear interpolation of their intensity values. This technique is illustrated in Fig. (a). The circled PSFs were estimated and the intermediate PSFs were interpolated. an advantage of intensity interpolation is that it can be efficiently implemented inside SV deconvolution [11]. However, the interpolated PSFs are often very different from the correct ones. Refer to the experiment in Fig. 4 and notice that intensity interpolation generates false PSFs that are not motion blurs. To solve this problem, we derive below a method (parametric interpolation), which interpolates camera motion SV PSFs very accurately. Let us consider the image a camera captures during its exposure window. Light from a scene point X w = [x w, y w, z w ] T projects on the image plane at a location X = [x, y] T. Using homogeneous coordinates in the image plane X = [dx T, d], the relation to X w is given by X = K[RX w + T ], (3) where R (3 3) and T (3 1) are the camera rotation matrix and translation vector, respectively. Upper triangular matrix K (3 3) is the camera intrinsic matrix. The third element d of the homogeneous coordinates corresponds to distance. During the exposure window the camera position and orientation may change and therefore the extrinsic parameters R and T are function of time t. The projected point X moves along a curve parametrized by t, which we denote as T (X) and call it a point trace. It is important to draw a relation between this curve and the SV PSF h. The SV PSF h(s, t, X) corresponds precisely to the rendered trace T ( X). The trace T ( X) is given by X(t) = K[R(t)K 1 X0 + 1 d 0 T (t)], (4) where X 0 = [X T, 1] T = [x, y, 1] is the initial location of the point in the image plane using normalized homogenous coordinates and d 0 is the third element of the corresponding X. The following proposition expresses a trace as a combination of two other traces.
3 Proposition 3.1 Let the distance d of all points from the camera be constant. Given traces T (Ā) and T ( B) at positions A and B, a trace T ( C) at a position C = ka + (1 k)b, k 0, 1 is expressed as T ( C) = kt (Ā) + (1 k)t ( B). The proof is direct application of (4). This proposition shows that a linear interpolation of two traces in homogenous coordinates generates any trace at a position lying on a line connecting these two traces. Unlike simple intensity interpolation, which performs linear interpolation in the space of intensity values, we interpolate here in the space of coordinates. However, the drawback is that we must know the homogenous coordinates of the projected points and thus the distance of the point from the camera at every time t. The next corollary alleviates this shortcoming. Corollary 3. Let the camera motion be constrained to rotation along optical z axis and translation in x-y plane. Proposition 3.1 simplifies to T (C) = kt (A) + (1 k)t (B). The proof is done by expressing the third element of homogenous coordinates and determining conditions under which it is equal to one. Using (4), the third element of X is d = R 3 (t)k 1 X0 + 1 d 0 T 3 (t), (5) where R 3 is the third row of R and T 3 is the third element of T. If the constrained camera motion of the corollary is assumed then d = 1. The above corollary shows that in the constrained camera motion the trace interpolation is independent of the scene distance and we can generate traces by working only with the projected points. Connecting pixels of a pair of traces (PSFs) that correspond to the same time t generates any PSF on the connected lines as illustrated in Fig. (b). Compare to intensity interpolation in Fig. (a), the PSFs are interpolated precisely. If we lift the camera motion constraints given in Corollary 3. and assume an arbitrary camera motion, the parametric interpolation T (C) = kt (A) + (1 k)t (B) is inexact but the error is very small in most of the practical cases. Examining (5) reveals that the second term is negligible since scene distance from the camera (d) is typically much larger than the camera shift in the z optical direction (T 3 ). The interpolation error is thus predominantly produced by the first term, which is a function of rotation about x and y axes. Fig. 3 plots the maximum interpolation error as a function of the number of known PSFs per row for rotation of up to in x and y axes (10 Mpx camera, full-frame sensor 36 4mm, resolution pixels). We assume that PSFs are correctly estimated at several locations equally spaced over the image plane and vary the density of estimation positions from 3 to 19 estimated PSFs per row. Then we calculate the maximum interpolation error among all neighbouring pairs of PSFs, which occurs close to image corners, where the rotational blur is the largest. Three curves correspond to three different focal lengths: f = 0mm (wide-angle (a) intensity interpolation (b) parametric interpolation Fig.. PSFs at nine different positions for a combination of camera motion in the x-y plane and rotation around z axis: (a) illustrates five PSFs interpolated using simple linear intensity interpolation of four circled PSFs; (b) demonstrates parametric interpolation. For every time instance of the camera exposition we know the position in all four traces. By interpolating these corresponding positions we can generate any PSF in the image plane. lens), f = 50mm (normal lens), and f = 00mm (telephoto lens). Note that the PSF length for these three lenses generated by the camera rotation of is roughly 00, 300, and 900 pixels, respectively, which can be regarded as extremely heavy blur. Interpolation error (pixels) f=0mm f=50mm f=00mm No. of PSFs per row Fig. 3. Interpolation error for three different focal lengths (f = 0, 50, 00mm) as a function of estimated PSF density (from 3 to 19 PSFs per row) for the case of rotation around the x and y axes. Fig. 3 demonstrated that parametric interpolation easily achieves sub-pixel precision. The tricky part is how to derive the analytical form from the matrix representation we get as an output of BD methods. In other words, we need to track the curve and find a mapping between any two PSFs. The mapping matches pixels of the same time instance. This is possible, when the curve does not cross itself and has one prevailing orientation, which are assumptions satisfied in many practical cases, when the time of exposure is not too long. Let a(x, y) and b(x, y), [x, y] [0... M, 0... N], denote two PSFs estimated by BD in patches located in A and B, respectively. For the parametric interpolation of two PSFs, the procedure we used can be outlined as follows:
4 Bring both PSFs into normalized positions and denote them a0 (x, y) and b0 (x, y). We use principal axes normalization based on constraining second-order moments (see [1] for details). Hence, PSFs are oriented such that their principal axes coincide with the y-axis. Find mapping of rows ya in a0 (x, y) to yb in b0 (x, y) P M P M PyB PyA a0 = y= b0. such that y= N N x= M x= M For each pair of mapped rows find mapping of x in a similar way, but in 1D. This way we get a mapping for every point [xb, yb ] = m(xa, ya ). Bring the PSFs into their original position. Connect the matching points given by mapping m and find the pixel position of the interpolated PSF according to Corollary 3.. The pixel intensity of the interpolated PSF is given by linear interpolation of intensities in a(x, y) and b(x, y). In practice we need to interpolate in two dimensions (from four PSFs). This is solved by first interpolating in one dimension using two pairs of PSFs and finally interpolating two PSFs from the previous step in the other dimension. (a) (b) (c) (d) Fig. 5. Parametric interpolation of PSFs (a) and (b) with crossovers generates false lines (c) compared to the correct PSF (d). PSFs in the corners, we interpolated the remaining ones on the grid using simple intensity interpolation (c) and proposed parametric interpolation (d). The similarity between the interpolated and true PSFs was assessed by the SSIM method [13] and is provided below figures. Intensity interpolation clearly generates PSFs that are incorrect and thus the reconstructed image exhibits strong artifacts as shown in the close-up in (c). Proposed interpolation generates PSFs similar to the true ones and the reconstructed image is almost perfect. If the PSFs have crossovers and/or no prevailing orientation, our implementation of the parametric interpolation often fails as illustrated in Fig. 5. This fault is not because of violation of theoretical assumptions but because our implementation works without the knowledge of trace parametrization. 4. EXPERIMENTS (a) (b) SSIM=0.99 (c) SSIM=0.967 Fig. 6. Comparison of interpolation methods on space-variant deconvolution in Fig. 1. SSIM compares to (a). (a) blurred input (b) original PSFs (c) intensity, SSIM=0.897 (d) parametric, SSIM=0.974 Fig. 4. Synthetic experiment of space-variant deconvolution Fig. 4 illustrates advantages of parametric interpolation in SV deconvolution. A blurred image (a) was synthetically generated by modeling camera motion, which results in SV PSFs visualized on the grid in (b). Using only four Fig. 1 shows an example of deblurring real photos. We took two pictures in a dark room blurred due to long exposure time. One of them is shown in Fig. 1(a). Next, we estimated 5 PSFs on the 5 5 grid (patch size ) using the BD method in [8]. Each PSF took about 19s, adding up to 5 19 = 475s. The PSFs are plotted in Fig. 6(a). We also generated PSFs using just four estimated PSFs in the corners by simple intensity interpolation (Fig. 6(b)) and proposed parametric interpolation (Fig. 6(c)). Both interpolation methods consume negligible time and the entire process took in this case about 4 19 = 76s. This is 6-times less than the full estimation of 5 PSFs and the computational time decreases even more if a denser grid is used. Intensity interpolation generates incorrect PSFs whereas the proposed method returns PSFs similar to the estimated ones by BD. Finally, we deblurred the images, which took about 7s, using the SV method [10] and compare results achieved by both interpolation methods. Close-ups are shown in Fig. 1(c), linear interpolation in the middle and parametric interpolation on the right. The complete reconstructed image using parametric interpolation is in Fig. 1(b).
5 5. REFERENCES [1] Michal Šorel and Jan Flusser, Space-variant restoration of images degraded by camera motion blur, IEEE Transactions on Image Processing, vol. 17, no., pp , Feb [] Oliver Whyte, Josef Sivic, Andrew Zisserman, and Jean Ponce, Non-uniform deblurring for shaken images, in Computer Vision and Pattern Recognition (CVPR), 010 IEEE Conference on, June 010, pp [3] Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, and William T. Freeman, Removing camera shake from a single photograph, in SIGGRAPH 06: ACM SIGGRAPH 006 Papers, New York, NY, USA, 006, pp , ACM. [11] James G. Nagy and Dianne P. O Leary, Restoring images degraded by spatially variant blur, SIAM JOUR- NAL ON SCIENTIFIC COMPUTING, vol. 19, no. 4, pp , [1] Jan Flusser, Tomáš Suk, and Barbara Zitová, Moments and Moment Invariants in Pattern Recognition, Wiley, 009. [13] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, Image quality assessment: from error visibility to structural similarity, IEEE Transactions on Image Processing, vol. 13, no. 4, pp , 004. [4] Ankit Gupta, Neel Joshi, C. Lawrence Zitnick, Michael Cohen, and Brian Curless, Single image deblurring using motion density functions, in Proceedings of the 11th European conference on Computer vision: Part I, Berlin, Heidelberg, 010, ECCV 10, pp , Springer-Verlag. [5] Michal Šorel and Filip Šroubek, Space-variant deblurring using one blurred and one underexposed image, in Proc. IEEE International Conference on Image Processing, 009. [6] Miguel Tallón, Javier Mateos, S. Derin Babacan, Rafael Molina, and Aggelos K. Katsaggelos, Space-variant blur deconvolution and denoising in the dual exposure problem, Information Fusion,, no. 0, pp., 01. [7] Stefan Harmeling, Hirsch Michael, and Bernhard Scholkopf, Space-variant single-image blind deconvolution for removing camera shake, in Advances in Neural Information Processing Systems 3, J. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R.S. Zemel, and A. Culotta, Eds., 010, pp [8] Filip Šroubek and Jan Flusser, Multichannel blind deconvolution of spatially misaligned images, IEEE Trans. Image Processing, vol. 14, no. 7, pp , July 005. [9] Li Xu and Jiaya Jia, Two-phase kernel estimation for robust motion deblurring, in Proceedings of the 11th European conference on Computer vision: Part I, Berlin, Heidelberg, 010, ECCV 10, pp , Springer-Verlag. [10] Stephen J. Olivas, Michal Šorel, and Joseph E. Ford, Platform motion blur image restoration system, Appl. Opt., vol. 51, no. 34, pp , Dec 01.
Non-Uniform Motion Blur For Face Recognition
IOSR Journal of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vol. 08, Issue 6 (June. 2018), V (IV) PP 46-52 www.iosrjen.org Non-Uniform Motion Blur For Face Recognition Durga Bhavani
More informationmultiframe visual-inertial blur estimation and removal for unmodified smartphones
multiframe visual-inertial blur estimation and removal for unmodified smartphones, Severin Münger, Carlo Beltrame, Luc Humair WSCG 2015, Plzen, Czech Republic images taken by non-professional photographers
More informationRecent Advances in Image Deblurring. Seungyong Lee (Collaboration w/ Sunghyun Cho)
Recent Advances in Image Deblurring Seungyong Lee (Collaboration w/ Sunghyun Cho) Disclaimer Many images and figures in this course note have been copied from the papers and presentation materials of previous
More informationRecent advances in deblurring and image stabilization. Michal Šorel Academy of Sciences of the Czech Republic
Recent advances in deblurring and image stabilization Michal Šorel Academy of Sciences of the Czech Republic Camera shake stabilization Alternative to OIS (optical image stabilization) systems Should work
More informationRecent Advances in Space-variant Deblurring and Image Stabilization
Recent Advances in Space-variant Deblurring and Image Stabilization Michal Šorel, Filip Šroubek and Jan Flusser Abstract The blur caused by camera motion is a serious problem in many areas of optical imaging
More informationAdmin Deblurring & Deconvolution Different types of blur
Admin Assignment 3 due Deblurring & Deconvolution Lecture 10 Last lecture Move to Friday? Projects Come and see me Different types of blur Camera shake User moving hands Scene motion Objects in the scene
More informationToward Non-stationary Blind Image Deblurring: Models and Techniques
Toward Non-stationary Blind Image Deblurring: Models and Techniques Ji, Hui Department of Mathematics National University of Singapore NUS, 30-May-2017 Outline of the talk Non-stationary Image blurring
More informationRestoration of Motion Blurred Document Images
Restoration of Motion Blurred Document Images Bolan Su 12, Shijian Lu 2 and Tan Chew Lim 1 1 Department of Computer Science,School of Computing,National University of Singapore Computing 1, 13 Computing
More informationA Review over Different Blur Detection Techniques in Image Processing
A Review over Different Blur Detection Techniques in Image Processing 1 Anupama Sharma, 2 Devarshi Shukla 1 E.C.E student, 2 H.O.D, Department of electronics communication engineering, LR College of engineering
More informationBlind Correction of Optical Aberrations
Blind Correction of Optical Aberrations Christian J. Schuler, Michael Hirsch, Stefan Harmeling, and Bernhard Schölkopf Max Planck Institute for Intelligent Systems, Tübingen, Germany {cschuler,mhirsch,harmeling,bs}@tuebingen.mpg.de
More informationDeblurring. Basics, Problem definition and variants
Deblurring Basics, Problem definition and variants Kinds of blur Hand-shake Defocus Credit: Kenneth Josephson Motion Credit: Kenneth Josephson Kinds of blur Spatially invariant vs. Spatially varying
More informationRegion Based Robust Single Image Blind Motion Deblurring of Natural Images
Region Based Robust Single Image Blind Motion Deblurring of Natural Images 1 Nidhi Anna Shine, 2 Mr. Leela Chandrakanth 1 PG student (Final year M.Tech in Signal Processing), 2 Prof.of ECE Department (CiTech)
More informationTutorial proposal for the 23rd International Conference on Pattern Recognition ICPR2016, Cancun, Mexico. Handling Blur
Tutorial proposal for the 23rd International Conference on Pattern Recognition ICPR2016, Cancun, Mexico Handling Blur Jan Flusser, Filip Sroubek, Barbara Zitova Institute of Information Theory and Automation
More informationAnalysis of Quality Measurement Parameters of Deblurred Images
Analysis of Quality Measurement Parameters of Deblurred Images Dejee Singh 1, R. K. Sahu 2 PG Student (Communication), Department of ET&T, Chhatrapati Shivaji Institute of Technology, Durg, India 1 Associate
More informationDeconvolution , , Computational Photography Fall 2017, Lecture 17
Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 17 Course announcements Homework 4 is out. - Due October 26 th. - There was another
More informationCoded Computational Photography!
Coded Computational Photography! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 9! Gordon Wetzstein! Stanford University! Coded Computational Photography - Overview!!
More informationMotion Estimation from a Single Blurred Image
Motion Estimation from a Single Blurred Image Image Restoration: De-Blurring Build a Blur Map Adapt Existing De-blurring Techniques to real blurred images Analysis, Reconstruction and 3D reconstruction
More informationCoded Aperture for Projector and Camera for Robust 3D measurement
Coded Aperture for Projector and Camera for Robust 3D measurement Yuuki Horita Yuuki Matugano Hiroki Morinaga Hiroshi Kawasaki Satoshi Ono Makoto Kimura Yasuo Takane Abstract General active 3D measurement
More informationProject Title: Sparse Image Reconstruction with Trainable Image priors
Project Title: Sparse Image Reconstruction with Trainable Image priors Project Supervisor(s) and affiliation(s): Stamatis Lefkimmiatis, Skolkovo Institute of Science and Technology (Email: s.lefkimmiatis@skoltech.ru)
More informationDeconvolution , , Computational Photography Fall 2018, Lecture 12
Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 12 Course announcements Homework 3 is out. - Due October 12 th. - Any questions?
More informationSimulated Programmable Apertures with Lytro
Simulated Programmable Apertures with Lytro Yangyang Yu Stanford University yyu10@stanford.edu Abstract This paper presents a simulation method using the commercial light field camera Lytro, which allows
More informationA Recognition of License Plate Images from Fast Moving Vehicles Using Blur Kernel Estimation
A Recognition of License Plate Images from Fast Moving Vehicles Using Blur Kernel Estimation Kalaivani.R 1, Poovendran.R 2 P.G. Student, Dept. of ECE, Adhiyamaan College of Engineering, Hosur, Tamil Nadu,
More informationTotal Variation Blind Deconvolution: The Devil is in the Details*
Total Variation Blind Deconvolution: The Devil is in the Details* Paolo Favaro Computer Vision Group University of Bern *Joint work with Daniele Perrone Blur in pictures When we take a picture we expose
More informationCoded photography , , Computational Photography Fall 2018, Lecture 14
Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 14 Overview of today s lecture The coded photography paradigm. Dealing with
More informationComputational Approaches to Cameras
Computational Approaches to Cameras 11/16/17 Magritte, The False Mirror (1935) Computational Photography Derek Hoiem, University of Illinois Announcements Final project proposal due Monday (see links on
More informationCamera Intrinsic Blur Kernel Estimation: A Reliable Framework
Camera Intrinsic Blur Kernel Estimation: A Reliable Framework Ali Mosleh 1 Paul Green Emmanuel Onzon Isabelle Begin J.M. Pierre Langlois 1 1 École Polytechnique de Montreál, Montréal, QC, Canada Algolux
More informationSUPER RESOLUTION INTRODUCTION
SUPER RESOLUTION Jnanavardhini - Online MultiDisciplinary Research Journal Ms. Amalorpavam.G Assistant Professor, Department of Computer Sciences, Sambhram Academy of Management. Studies, Bangalore Abstract:-
More informationarxiv: v2 [cs.cv] 29 Aug 2017
Motion Deblurring in the Wild Mehdi Noroozi, Paramanand Chandramouli, Paolo Favaro arxiv:1701.01486v2 [cs.cv] 29 Aug 2017 Institute for Informatics University of Bern {noroozi, chandra, paolo.favaro}@inf.unibe.ch
More informationMotion Blurred Image Restoration based on Super-resolution Method
Motion Blurred Image Restoration based on Super-resolution Method Department of computer science and engineering East China University of Political Science and Law, Shanghai, China yanch93@yahoo.com.cn
More information2015, IJARCSSE All Rights Reserved Page 312
Volume 5, Issue 11, November 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Shanthini.B
More informationfast blur removal for wearable QR code scanners
fast blur removal for wearable QR code scanners Gábor Sörös, Stephan Semmler, Luc Humair, Otmar Hilliges ISWC 2015, Osaka, Japan traditional barcode scanning next generation barcode scanning ubiquitous
More informationDappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing
Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing Ashok Veeraraghavan, Ramesh Raskar, Ankit Mohan & Jack Tumblin Amit Agrawal, Mitsubishi Electric Research
More informationCoded photography , , Computational Photography Fall 2017, Lecture 18
Coded photography http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 18 Course announcements Homework 5 delayed for Tuesday. - You will need cameras
More informationBlur and Recovery with FTVd. By: James Kerwin Zhehao Li Shaoyi Su Charles Park
Blur and Recovery with FTVd By: James Kerwin Zhehao Li Shaoyi Su Charles Park Blur and Recovery with FTVd By: James Kerwin Zhehao Li Shaoyi Su Charles Park Online: < http://cnx.org/content/col11395/1.1/
More informationRestoration for Weakly Blurred and Strongly Noisy Images
Restoration for Weakly Blurred and Strongly Noisy Images Xiang Zhu and Peyman Milanfar Electrical Engineering Department, University of California, Santa Cruz, CA 9564 xzhu@soe.ucsc.edu, milanfar@ee.ucsc.edu
More informationA Novel Image Deblurring Method to Improve Iris Recognition Accuracy
A Novel Image Deblurring Method to Improve Iris Recognition Accuracy Jing Liu University of Science and Technology of China National Laboratory of Pattern Recognition, Institute of Automation, Chinese
More informationDeclaration. Michal Šorel March 2007
Charles University in Prague Faculty of Mathematics and Physics Multichannel Blind Restoration of Images with Space-Variant Degradations Ph.D. Thesis Michal Šorel March 2007 Department of Software Engineering
More informationTHE RESTORATION OF DEFOCUS IMAGES WITH LINEAR CHANGE DEFOCUS RADIUS
THE RESTORATION OF DEFOCUS IMAGES WITH LINEAR CHANGE DEFOCUS RADIUS 1 LUOYU ZHOU 1 College of Electronics and Information Engineering, Yangtze University, Jingzhou, Hubei 43423, China E-mail: 1 luoyuzh@yangtzeu.edu.cn
More informationTo Denoise or Deblur: Parameter Optimization for Imaging Systems
To Denoise or Deblur: Parameter Optimization for Imaging Systems Kaushik Mitra a, Oliver Cossairt b and Ashok Veeraraghavan a a Electrical and Computer Engineering, Rice University, Houston, TX 77005 b
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 22: Computational photography photomatix.com Announcements Final project midterm reports due on Tuesday to CMS by 11:59pm BRDF s can be incredibly complicated
More informationSURVEILLANCE SYSTEMS WITH AUTOMATIC RESTORATION OF LINEAR MOTION AND OUT-OF-FOCUS BLURRED IMAGES. Received August 2008; accepted October 2008
ICIC Express Letters ICIC International c 2008 ISSN 1881-803X Volume 2, Number 4, December 2008 pp. 409 414 SURVEILLANCE SYSTEMS WITH AUTOMATIC RESTORATION OF LINEAR MOTION AND OUT-OF-FOCUS BLURRED IMAGES
More informationBlind Blur Estimation Using Low Rank Approximation of Cepstrum
Blind Blur Estimation Using Low Rank Approximation of Cepstrum Adeel A. Bhutta and Hassan Foroosh School of Electrical Engineering and Computer Science, University of Central Florida, 4 Central Florida
More informationImproved motion invariant imaging with time varying shutter functions
Improved motion invariant imaging with time varying shutter functions Steve Webster a and Andrew Dorrell b Canon Information Systems Research, Australia (CiSRA), Thomas Holt Drive, North Ryde, Australia
More informationMultichannel Blind Deconvolution in Eye Fundus Imaging
Multichannel Blind Deconvolution in Eye Fundus Imaging Andrés G. Marrugo Dept. of Optics and Optometry Universitat Politècnica de Catalunya, Spain andres.marrugo@upc.edu Filip Šroubek UTIA Academy of Sciences
More informationMotion Deblurring using Coded Exposure for a Wheeled Mobile Robot Kibaek Park, Seunghak Shin, Hae-Gon Jeon, Joon-Young Lee and In So Kweon
Motion Deblurring using Coded Exposure for a Wheeled Mobile Robot Kibaek Park, Seunghak Shin, Hae-Gon Jeon, Joon-Young Lee and In So Kweon Korea Advanced Institute of Science and Technology, Daejeon 373-1,
More informationIMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY. Khosro Bahrami and Alex C. Kot
24 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) IMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY Khosro Bahrami and Alex C. Kot School of Electrical and
More informationGradient-Based Correction of Chromatic Aberration in the Joint Acquisition of Color and Near-Infrared Images
Gradient-Based Correction of Chromatic Aberration in the Joint Acquisition of Color and Near-Infrared Images Zahra Sadeghipoor a, Yue M. Lu b, and Sabine Süsstrunk a a School of Computer and Communication
More information4 STUDY OF DEBLURRING TECHNIQUES FOR RESTORED MOTION BLURRED IMAGES
4 STUDY OF DEBLURRING TECHNIQUES FOR RESTORED MOTION BLURRED IMAGES Abstract: This paper attempts to undertake the study of deblurring techniques for Restored Motion Blurred Images by using: Wiener filter,
More informationImage Deblurring and Noise Reduction in Python TJHSST Senior Research Project Computer Systems Lab
Image Deblurring and Noise Reduction in Python TJHSST Senior Research Project Computer Systems Lab 2009-2010 Vincent DeVito June 16, 2010 Abstract In the world of photography and machine vision, blurry
More informationFACE IDENTIFICATION SYSTEM
International Journal of Power Control and Computation(IJPCSC) Vol 8. No.1 2016 Pp.38-43 gopalax Journals, Singapore available at : www.ijcns.com ISSN: 0976-268X FACE IDENTIFICATION SYSTEM R. Durgadevi
More informationImplementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring
Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring Ashill Chiranjan and Bernardt Duvenhage Defence, Peace, Safety and Security Council for Scientific
More informationOptical image stabilization (IS)
Optical image stabilization (IS) CS 178, Spring 2011 Marc Levoy Computer Science Department Stanford University Outline! what are the causes of camera shake? how can you avoid it (without having an IS
More informationSuper resolution with Epitomes
Super resolution with Epitomes Aaron Brown University of Wisconsin Madison, WI Abstract Techniques exist for aligning and stitching photos of a scene and for interpolating image data to generate higher
More informationRefocusing Phase Contrast Microscopy Images
Refocusing Phase Contrast Microscopy Images Liang Han and Zhaozheng Yin (B) Department of Computer Science, Missouri University of Science and Technology, Rolla, USA lh248@mst.edu, yinz@mst.edu Abstract.
More information2D Barcode Localization and Motion Deblurring Using a Flutter Shutter Camera
2D Barcode Localization and Motion Deblurring Using a Flutter Shutter Camera Wei Xu University of Colorado at Boulder Boulder, CO, USA Wei.Xu@colorado.edu Scott McCloskey Honeywell Labs Minneapolis, MN,
More informationWhen Does Computational Imaging Improve Performance?
When Does Computational Imaging Improve Performance? Oliver Cossairt Assistant Professor Northwestern University Collaborators: Mohit Gupta, Changyin Zhou, Daniel Miau, Shree Nayar (Columbia University)
More informationTeze disertace k získání vědeckého titulu doktor věd ve skupině věd Fyzikálně-Matematických. Multichannel Blind Image Restoration název práce
Teze disertace k získání vědeckého titulu doktor věd ve skupině věd Fyzikálně-Matematických Multichannel Blind Image Restoration název práce Komise pro obhajobu doktorských disertací v oboru: informatika
More informationA Literature Survey on Blur Detection Algorithms for Digital Imaging
2013 First International Conference on Artificial Intelligence, Modelling & Simulation A Literature Survey on Blur Detection Algorithms for Digital Imaging Boon Tatt Koik School of Electrical & Electronic
More informationLearning to Estimate and Remove Non-uniform Image Blur
2013 IEEE Conference on Computer Vision and Pattern Recognition Learning to Estimate and Remove Non-uniform Image Blur Florent Couzinié-Devy 1, Jian Sun 3,2, Karteek Alahari 2, Jean Ponce 1, 1 École Normale
More informationA New Method for Eliminating blur Caused by the Rotational Motion of the Images
A New Method for Eliminating blur Caused by the Rotational Motion of the Images Seyed Mohammad Ali Sanipour 1, Iman Ahadi Akhlaghi 2 1 Department of Electrical Engineering, Sadjad University of Technology,
More informationProject 4 Results http://www.cs.brown.edu/courses/cs129/results/proj4/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj4/damoreno/ http://www.cs.brown.edu/courses/csci1290/results/proj4/huag/
More informationImproving Signal- to- noise Ratio in Remotely Sensed Imagery Using an Invertible Blur Technique
Improving Signal- to- noise Ratio in Remotely Sensed Imagery Using an Invertible Blur Technique Linda K. Le a and Carl Salvaggio a a Rochester Institute of Technology, Center for Imaging Science, Digital
More informationComputer Vision. The Pinhole Camera Model
Computer Vision The Pinhole Camera Model Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2017/2018 Imaging device
More informationAnti-shaking Algorithm for the Mobile Phone Camera in Dim Light Conditions
Anti-shaking Algorithm for the Mobile Phone Camera in Dim Light Conditions Jong-Ho Lee, In-Yong Shin, Hyun-Goo Lee 2, Tae-Yoon Kim 2, and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 26
More informationDYNAMIC CONVOLUTIONAL NEURAL NETWORK FOR IMAGE SUPER- RESOLUTION
Journal of Advanced College of Engineering and Management, Vol. 3, 2017 DYNAMIC CONVOLUTIONAL NEURAL NETWORK FOR IMAGE SUPER- RESOLUTION Anil Bhujel 1, Dibakar Raj Pant 2 1 Ministry of Information and
More informationTransfer Efficiency and Depth Invariance in Computational Cameras
Transfer Efficiency and Depth Invariance in Computational Cameras Jongmin Baek Stanford University IEEE International Conference on Computational Photography 2010 Jongmin Baek (Stanford University) Transfer
More informationImage Deblurring with Blurred/Noisy Image Pairs
Image Deblurring with Blurred/Noisy Image Pairs Huichao Ma, Buping Wang, Jiabei Zheng, Menglian Zhou April 26, 2013 1 Abstract Photos taken under dim lighting conditions by a handheld camera are usually
More informationDe-Convolution of Camera Blur From a Single Image Using Fourier Transform
De-Convolution of Camera Blur From a Single Image Using Fourier Transform Neha B. Humbe1, Supriya O. Rajankar2 1Dept. of Electronics and Telecommunication, SCOE, Pune, Maharashtra, India. Email id: nehahumbe@gmail.com
More informationHardware Implementation of Motion Blur Removal
FPL 2012 Hardware Implementation of Motion Blur Removal Cabral, Amila. P., Chandrapala, T. N. Ambagahawatta,T. S., Ahangama, S. Samarawickrama, J. G. University of Moratuwa Problem and Motivation Photographic
More informationComputational Cameras. Rahul Raguram COMP
Computational Cameras Rahul Raguram COMP 790-090 What is a computational camera? Camera optics Camera sensor 3D scene Traditional camera Final image Modified optics Camera sensor Image Compute 3D scene
More informationLenses, exposure, and (de)focus
Lenses, exposure, and (de)focus http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 15 Course announcements Homework 4 is out. - Due October 26
More informationCora Beatriz Pérez Ariza José Manuel Llamas Sánchez [IMAGE RESTORATION SOFTWARE.] Blind Image Deconvolution User Manual Version 1.
2007 Cora Beatriz Pérez Ariza José Manuel Llamas Sánchez [IMAGE RESTORATION SOFTWARE.] Blind Image Deconvolution User Manual Version 1.0 * Table of Contents Page 1. Introduction. 4 1.1. Purpose of this.
More informationOverview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image
Camera & Color Overview Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Book: Hartley 6.1, Szeliski 2.1.5, 2.2, 2.3 The trip
More informationIMAGE RESTORATION WITH NEURAL NETWORKS. Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz
IMAGE RESTORATION WITH NEURAL NETWORKS Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz MOTIVATION The long path of images Bad Pixel Correction Black Level AF/AE Demosaic Denoise Lens Correction
More informationRestoration of Blurred Image Using Joint Statistical Modeling in a Space-Transform Domain
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 12, Issue 3, Ver. I (May.-Jun. 2017), PP 62-66 www.iosrjournals.org Restoration of Blurred
More informationSingle Image Blind Deconvolution with Higher-Order Texture Statistics
Single Image Blind Deconvolution with Higher-Order Texture Statistics Manuel Martinello and Paolo Favaro Heriot-Watt University School of EPS, Edinburgh EH14 4AS, UK Abstract. We present a novel method
More informationA Study of Slanted-Edge MTF Stability and Repeatability
A Study of Slanted-Edge MTF Stability and Repeatability Jackson K.M. Roland Imatest LLC, 2995 Wilderness Place Suite 103, Boulder, CO, USA ABSTRACT The slanted-edge method of measuring the spatial frequency
More informationSpline wavelet based blind image recovery
Spline wavelet based blind image recovery Ji, Hui ( 纪辉 ) National University of Singapore Workshop on Spline Approximation and its Applications on Carl de Boor's 80 th Birthday, NUS, 06-Nov-2017 Spline
More informationModeling and Synthesis of Aperture Effects in Cameras
Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting
More informationOptical image stabilization (IS)
Optical image stabilization (IS) CS 178, Spring 2010 Marc Levoy Computer Science Department Stanford University Outline! what are the causes of camera shake? how can you avoid it (without having an IS
More informationIMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics
IMAGE FORMATION Light source properties Sensor characteristics Surface Exposure shape Optics Surface reflectance properties ANALOG IMAGES An image can be understood as a 2D light intensity function f(x,y)
More informationPAPER An Image Stabilization Technology for Digital Still Camera Based on Blind Deconvolution
1082 IEICE TRANS. INF. & SYST., VOL.E94 D, NO.5 MAY 2011 PAPER An Image Stabilization Technology for Digital Still Camera Based on Blind Deconvolution Haruo HATANAKA a), Member, Shimpei FUKUMOTO, Haruhiko
More informationMeasurement of Texture Loss for JPEG 2000 Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates
Copyright SPIE Measurement of Texture Loss for JPEG Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates ABSTRACT The capture and retention of image detail are
More informationA Framework for Analysis of Computational Imaging Systems
A Framework for Analysis of Computational Imaging Systems Kaushik Mitra, Oliver Cossairt, Ashok Veeraghavan Rice University Northwestern University Computational imaging CI systems that adds new functionality
More informationUsing Line and Ellipse Features for Rectification of Broadcast Hockey Video
Using Line and Ellipse Features for Rectification of Broadcast Hockey Video Ankur Gupta, James J. Little, Robert J. Woodham Laboratory for Computational Intelligence (LCI) The University of British Columbia
More informationImage Deblurring Using Dark Channel Prior. Liang Zhang (lzhang432)
Image Deblurring Using Dark Channel Prior Liang Zhang (lzhang432) Motivation Solutions Dark Channel Model Optimization Application Future Work Reference Outline Motivation Recover Blur Image Photos are
More informationImage Restoration. Lecture 7, March 23 rd, Lexing Xie. EE4830 Digital Image Processing
Image Restoration Lecture 7, March 23 rd, 2009 Lexing Xie EE4830 Digital Image Processing http://www.ee.columbia.edu/~xlx/ee4830/ thanks to G&W website, Min Wu and others for slide materials 1 Announcements
More informationEnhanced Method for Image Restoration using Spatial Domain
Enhanced Method for Image Restoration using Spatial Domain Gurpal Kaur Department of Electronics and Communication Engineering SVIET, Ramnagar,Banur, Punjab, India Ashish Department of Electronics and
More informationInterleaved Regression Tree Field Cascades for Blind Image Deconvolution
Interleaved Regression Tree Field Cascades for Blind Image Deconvolution Kevin Schelten1 Sebastian Nowozin2 Jeremy Jancsary3 Carsten Rother4 Stefan Roth1 1 TU Darmstadt 2 Microsoft Research 3 Nuance Communications
More informationFilters. Materials from Prof. Klaus Mueller
Filters Materials from Prof. Klaus Mueller Think More about Pixels What exactly a pixel is in an image or on the screen? Solid square? This cannot be implemented A dot? Yes, but size matters Pixel Dots
More informationApplications of Flash and No-Flash Image Pairs in Mobile Phone Photography
Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography Xi Luo Stanford University 450 Serra Mall, Stanford, CA 94305 xluo2@stanford.edu Abstract The project explores various application
More informationMichal Šorel, Filip Šroubek and Jan Flusser. Book title goes here
Michal Šorel, Filip Šroubek and Jan Flusser Book title goes here 2 1 Towards super-resolution in the presence of spatially varying blur CONTENTS 1.1 Introduction.........................................................
More informationPhoto Quality Assessment based on a Focusing Map to Consider Shallow Depth of Field
Photo Quality Assessment based on a Focusing Map to Consider Shallow Depth of Field Dong-Sung Ryu, Sun-Young Park, Hwan-Gue Cho Dept. of Computer Science and Engineering, Pusan National University, Geumjeong-gu
More informationLearning Pixel-Distribution Prior with Wider Convolution for Image Denoising
Learning Pixel-Distribution Prior with Wider Convolution for Image Denoising Peng Liu University of Florida pliu1@ufl.edu Ruogu Fang University of Florida ruogu.fang@bme.ufl.edu arxiv:177.9135v1 [cs.cv]
More informationImage Deblurring. This chapter describes how to deblur an image using the toolbox deblurring functions.
12 Image Deblurring This chapter describes how to deblur an image using the toolbox deblurring functions. Understanding Deblurring (p. 12-2) Using the Deblurring Functions (p. 12-5) Avoiding Ringing in
More informationImage Processing & Projective geometry
Image Processing & Projective geometry Arunkumar Byravan Partial slides borrowed from Jianbo Shi & Steve Seitz Color spaces RGB Red, Green, Blue HSV Hue, Saturation, Value Why HSV? HSV separates luma,
More informationSINGLE IMAGE DEBLURRING FOR A REAL-TIME FACE RECOGNITION SYSTEM
SINGLE IMAGE DEBLURRING FOR A REAL-TIME FACE RECOGNITION SYSTEM #1 D.KUMAR SWAMY, Associate Professor & HOD, #2 P.VASAVI, Dept of ECE, SAHAJA INSTITUTE OF TECHNOLOGY & SCIENCES FOR WOMEN, KARIMNAGAR, TS,
More informationMODIFICATION OF ADAPTIVE LOGARITHMIC METHOD FOR DISPLAYING HIGH CONTRAST SCENES BY AUTOMATING THE BIAS VALUE PARAMETER
International Journal of Information Technology and Knowledge Management January-June 2012, Volume 5, No. 1, pp. 73-77 MODIFICATION OF ADAPTIVE LOGARITHMIC METHOD FOR DISPLAYING HIGH CONTRAST SCENES BY
More informationRemoving Motion Blur with Space-Time Processing
1 Removing Motion Blur with Space-Time Processing Hiroyuki Takeda, Student Member, IEEE, Peyman Milanfar, Fellow, IEEE Abstract Although spatial deblurring is relatively well-understood by assuming that
More informationRemoving Temporal Stationary Blur in Route Panoramas
Removing Temporal Stationary Blur in Route Panoramas Jiang Yu Zheng and Min Shi Indiana University Purdue University Indianapolis jzheng@cs.iupui.edu Abstract The Route Panorama is a continuous, compact
More information