Design of Practical Color Filter Array Interpolation Algorithms for Cameras, Part 2
|
|
- Roland Neal
- 5 years ago
- Views:
Transcription
1 Design of Practical Color Filter Array Interpolation Algorithms for Cameras, Part 2 James E. Adams, Jr. Eastman Kodak Company kodak. com Abstract Single-chip digital cameras use a color filter array and subsequent interpolation strategy to produce full-color images. While the design of the interpolation algorithm can be grounded in traditional sampling theory, the fact that the sampled data is distributed among three different color planes adds a level of complexity. Existing interpolation methods are usually derived from general numerical methods that do not make many assumptions about the nature of the data. Significant computational economies, without serious losses in image quality, can be achieved if it is recognized that the data is image data and some appropriate image model is assumed. 1. Introduction In a previous paper [ 11, the author described the makeup of a digital camera image processing chain with particular emphasis on the color filter array (CFA) interpolation process. This paper again explores the CFA interpolation process, this time from the standpoint of Fourier spectrum analysis and optimum algorithm design. Though the work presented can be generalized to most any CFA pattern, for simplicity, the Kodak Bayer CFA pattern [2] will be assumed throughout this paper. Figure 1 is an illustration of this pattern. In Fig. 1, R stands for red, G stands for green, and B stands for blue. blue information will be performed using Cok s method, described in the author s previous paper [1,]. A one-dimensional approach to CFA interpolation will be used. Used in conjunction with an adaptive strategy for selecting either a horizontal or vertical one-dimensional pixel neighborhood for each pixel in question, this produces a CFA interpolation algorithm capable of very high-quality image reconstructions. In a previous paper [4], the author described how to use the pixels within a resulting one-dimensional slice to produce the best estimate for the missing green pixel value in question. This paper will discuss how to algorithmically choose an appropriate orientation for interpolation. In order to design an optimum green pixel value predictor, the interpolation problem will be stated as a simple signal sampling and recovery problem, after Gaskill [5]. This will establish the characteristics of the perfect CFA interpolation predictor. Subsequently, the best approximation to this ideal predictor from [4] will be compared with the ideal predictor and the results used to develop an optimum pixel neighborhood selection scheme. It should be realized that the image processing operation modeled here, CFA sampling and interpolation, is not shift-invariant. Therefore, the following analysis, which assumes a linear, shift-invariant (LSI) system, cannot be expected to be rigorously correct. However, it does provide a framework from which some general and pragmatic results can be derived. The reader is reminded to keep this caveat in mind. 2. Sampling theory review We will assume the one-dimensional pixel neighborhood in Fig. 2 throughout most of this paper. Figure 1. Bayer CFA pattern This paper will concentrate on the reconstruction of the luminance information in the image. In this case, the green pixel information will be treated as the luminance information. The subsequent reconstruction of the red and... R-2 G-1 R, GI R2... Figure 2. One-dimensional pixel neighborhood In Fig. 2, R would be either a red pixel (for red-green rows) or a blue pixel (for blue-green rows) and G would be a green pixel. If f(x) is the original green image information, then the sampled green data, fs(x), would be given in Eq /98 $ IEEE 488
2 Evaluating Eq. 6 for odd integral values (i.e., green pixels) and for even integral values (Le., red or blue pixels) produces the desired results: The Fourier transform of Eq. 1 is given in Fig. 2. Equation 2 indicates the well-known fact that the spectrum of the sampled signal consists of the spectrum of the original signal, F(C), replicated along the frequency axis at regular intervals. Assuming the spectrum replicates do not overlap, then by eliminating the spectrum replicates, F(@, and, therefore, f(x), can be recovered. The ideal interpolation filter to perform such a spectrum replicate elimination is where Intp(Lj) = rect(25), (). Analysis of an optimum family of predictors m even Since Eq. 6 does not converge quickly enough for practical use, an approximation must be employed. In a previous paper [4], the author derived an approximation with optimum spatial frequency performance. The form of this predictor, a generalized 5-point FIR filter [7-91, is given in Eq. 9. Applying Intp(&) to F&) produces the desired result, to within an unimportant multiplicative constant. (See Eq. 5.) In Eq. 9, the first -point kernel is convolved with the existing green pixel values. The second 5-point kernel is convolved with the existing red pixel values. A good numerical example of Eq. 9 is given in Eq. 10. Taking the inverse Fourier transform of Eq. 5 produces the ideal interpolation process. (See Eq. 6.) In Eq. 6, Gaskill's definition of the sinc fiinction is assumed: Of course, Eq. 6 is the well-known Shannon-Whittaker sampling theorem [6]. Equally well known fs that a direct implementation of Eq. 6 is impractical because the summation has a painfully slow rate of convlergence. The spatial frequency response of Eq. 10 is given in Eq Intp(4) = cos2(n5)+-sin2(2n~) Figure is a plot of Eqs. and 11. It can be seen that there is good agreement between the ideal predictor (Eq. ) and the 5-point predictor (Eq. 11) up to roughly 0.25 cycles/sample. Beyond 0.25 cycles/samples the curves diverge significantly. We can define a simple figure of merit for how well the 5-point predictor performs as a function of spatial frequency by simply subtracting Eq. 11 from Eq. and taking the absolute value. (See Eq. 12 and Fig. 4.) clas(6) = lcos'(n<) + 1 sin2(2n<) - rect(26) 489
3 0.6 lntp 0.4 (5) Ideal -5-Point Predictor (cycledsam ple) Figure. Comparison of ideal and optimum 5-point interpolating function spectra i Pirr o h I\ J \ (cycle s/sa m pl e) Figure 4. Absolute difference between ideal and optimum 5-pOint interpolating function spectra Clearly, we would like to operate solely in the spatial region from 0 to just below 0.25 cycles/sample. 4. Creation of an optimum classifier the orientation that produces the smallest value. This should correspond to the direction that has the least amount of spatial frequency activity above 0.25 cycles/sample. The challenge will be being restricted to the available data points called out in Fig. 5. Referring back to our one-dimension pixel neighborhood of Fig. 2, two terms of our classifier immediately suggest themselves. These are the wellknown gradient and Laplacian operators. The gradient operator can be applied to the green data points and the Laplacian operator to the red data points. In terms of convolution kernels, we might express our initial classifier as done in Eq. 1 [7-91. g=21(1 0 -l)l+l(-l I)] (1) The first term is the green gradient operator and the second term is the red Laplacian operator. Note that we incorporate absolute value signs to prevent the operators from canceling each other out in any way. We also scale the gradient operation by two to permit both terms to have equal full-scale values. Equivalent clas(x) and Clas(5) functions are and where clas(x) = (z6~(~)]+[26(*)-~~6(f)] (14) Clas(c) = 4sin2(2n()+j4sin(2n{) (15) We can expand Fig. 2 into a two-dimensional representation. (See Fig. 5.) Figure 5. Two-dimensional pixel neighborhood Our strategy is going to be to evaluate the spatial frequency response of the data in both the horizontal and vertical directions and pick the direction that has the least amount of energy above 0.25 cycleslsample, i.e., where Clas(5) is greatest. In order to easily perform this spatial frequency content test, we will create a numeric classi$er that will have a spatial frequency response similar to Eq. 12. Once we have this classifier, then we simply evaluate it in both the horizontal and vertical directions and select and j is the square root of -1. Note that we have temporarily removed the absolute value signs in going from Eq. 1 to Eq. 14. Figure 6 is a plot of the absolute value of the components of Eq. 15 with the ideal response of Eq. 12. While there is reasonable agreement above 0.25 cycleslsample, below that frequency the responses diverge. What is needed is a third term that has a low response below 0.25 cycleslsample and a high response above 0.25 cycleslsample. If pixel R, in Fig. 2 were actually another green pixel, Go, we could then add a second Laplacian of the central three green pixel values to perform the needed discrimination. The new set of convolution kernels and corresponding clas(x) and Clas(5) expressions would then be [
4 If we are processing the line in Fig. 2 from left to right, then by the time calculation of Go is ready to begin, a value for G, has already been determined. Therefore, for the sake of using the convolution kernel in Eq. 18, we may estimate Go as,and (19) (c ycleslsam p le) Figure 6. Comparison of classifier spatial frequency responses. The gradient and Laplaciain functions have been scaled in amplitude for ease of comparison with the ideal response. Figure 7 is a repeat of Fig. 6 with the second Laplacian (labeled the mixed Laplacian for reasons explained below) added. Clas (5) 1.o (cycleslsam ple) Figure 7. Comparison of classifier spatial frequency responses. The gradient, Laplacian and mixed Laplacian functions have been scaled in amplitude for ease of comparison with the ideal response. Our new term has the desired frequency response. Now, we need to address the fact that we do not have Go. For the purposes of our classifier we can get a rough estimate of Go from previously interpolatedl green pixels by assuming the red and green channels are perfectly correlated to within an offset term. (See Eq. 21.) We can assume this image model because the RGB color planes of an image tend to be correlated [lo]. This estimate will probably not be nearly as accurate as the one produced by Eq. 10, but it will generally be sufficient for Eq. 18 to allow the correct interpolation orientation to be determined. All that is left is to use the results of Eq. 18 to select the correct orientation for interpolation. If we return to Fig. 5, we would apply Eq. 18 to the horizontal pixel neighborhood to determine the horizontal classification value. Then we would apply Eq. 18 to the vertical pixel neighborhood to determine the vertical classification value. Note that for the vertical classification calculation, we will want to estimate Go with the pixel values bo, &* and G;, assuming we are processing the image from top to bottom. Once we have classification values for both directions, we simply choose the direction that produces the smallest classification value for our preferred direction of interpolation. 5. Summary The process of color filter array sampling and interpolation can be cast in the form of a signal sampling and recovery problem using standard Fourier spectrum analysis. A simple image model can be used to permit the use of information from color channels other than green to aid in the reconstruction of the green (luminance) record. Fourier spectra can be derived for various CFA classifier kernels and relative image quality predictions be made from these spectra. 6. Acknowledgments The author would like to thank John Hamilton, Kevin Spaulding, Brian Keelan, and Karin Topfer, all of Eastman Kodak Company, for their valuable contributions to this material. 7. References [ 1 J. E. Adams, Jr., Interactions between color plane interpolation and other image processing functions in electronic photography, Proceeding of SPIE, C. Anagnostopoulos, M. Lesser, eds., vol. 2416, pp , SPIE, Bellingham, WA, [2] B. E. Bayer, Color imaging array, U.S. Patent,971,065,
5 [] D. R. Cok, Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal, U.S. Patent 4,642,678, [4] J. E. Adams, Jr., Design of practical color filter array interpolation algorithms for digital cameras, Proceeding ofspie, D. Sinha, ed., vol. 028, pp , SPIE, Bellingham, WA, [5] J. D. Gaskill, Linear Systems, Fourier Transforms, and Optics, John Wiley & Sons, New York, p. 266, [6] Zbid., p [7] J. E. Adams and Jr., J. F. Hamilton, Jr., Adaptive camera, U.S. Patent 5,506,619, [8] J. F. Hamilton and Jr., J. E. Adams, Jr., Adaptive camera, U.S. Patent 5,629,74, [9] J. E. Adams, Jr. and J. F. Hamilton, Jr., Adaptive camera, U.S. Patent 5,652,621, [ 101 K. Topfer, J. E. Adams, and B. W. Keelan, Modulation transfer functions and aliasing patterns of CFA interpolation algorithms, Proceedings of IS&T s FICS Conference, Portland, OR, p. 67,
Design of practical color filter array interpolation algorithms for digital cameras
Design of practical color filter array interpolation algorithms for digital cameras James E. Adams, Jr. Eastman Kodak Company, Imaging Research and Advanced Development Rochester, New York 14653-5408 ABSTRACT
More informationA Novel Method for Enhancing Satellite & Land Survey Images Using Color Filter Array Interpolation Technique (CFA)
A Novel Method for Enhancing Satellite & Land Survey Images Using Color Filter Array Interpolation Technique (CFA) Suma Chappidi 1, Sandeep Kumar Mekapothula 2 1 PG Scholar, Department of ECE, RISE Krishna
More informationEdge Potency Filter Based Color Filter Array Interruption
Edge Potency Filter Based Color Filter Array Interruption GURRALA MAHESHWAR Dept. of ECE B. SOWJANYA Dept. of ECE KETHAVATH NARENDER Associate Professor, Dept. of ECE PRAKASH J. PATIL Head of Dept.ECE
More informationMethod of color interpolation in a single sensor color camera using green channel separation
University of Wollongong Research Online Faculty of nformatics - Papers (Archive) Faculty of Engineering and nformation Sciences 2002 Method of color interpolation in a single sensor color camera using
More informationDemosaicing Algorithms
Demosaicing Algorithms Rami Cohen August 30, 2010 Contents 1 Demosaicing 2 1.1 Algorithms............................. 2 1.2 Post Processing.......................... 6 1.3 Performance............................
More informationFourier transforms, SIM
Fourier transforms, SIM Last class More STED Minflux Fourier transforms This class More FTs 2D FTs SIM 1 Intensity.5 -.5 FT -1.5 1 1.5 2 2.5 3 3.5 4 4.5 5 6 Time (s) IFT 4 2 5 1 15 Frequency (Hz) ff tt
More informationAN EFFECTIVE APPROACH FOR IMAGE RECONSTRUCTION AND REFINING USING DEMOSAICING
Research Article AN EFFECTIVE APPROACH FOR IMAGE RECONSTRUCTION AND REFINING USING DEMOSAICING 1 M.Jayasudha, 1 S.Alagu Address for Correspondence 1 Lecturer, Department of Information Technology, Sri
More informationDemosaicking methods for Bayer color arrays
Journal of Electronic Imaging 11(3), 306 315 (July 00). Demosaicking methods for Bayer color arrays Rajeev Ramanath Wesley E. Snyder Griff L. Bilbro North Carolina State University Department of Electrical
More informationImage Demosaicing. Chapter Introduction. Ruiwen Zhen and Robert L. Stevenson
Chapter 2 Image Demosaicing Ruiwen Zhen and Robert L. Stevenson 2.1 Introduction Digital cameras are extremely popular and have replaced traditional film-based cameras in most applications. To produce
More informationMeasurement of Texture Loss for JPEG 2000 Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates
Copyright SPIE Measurement of Texture Loss for JPEG Compression Peter D. Burns and Don Williams* Burns Digital Imaging and *Image Science Associates ABSTRACT The capture and retention of image detail are
More informationTopic 4: Image Filtering Workshop Solutions
Topic 4: Image Filtering Workshop Solutions Workshop Questions 5.1 At the Edge of an Image When an image is convolved in real space with a M M filter there is a problem of how deal with the edge of the
More informationColor Filter Array Interpolation Using Adaptive Filter
Color Filter Array Interpolation Using Adaptive Filter P.Venkatesh 1, Dr.V.C.Veera Reddy 2, Dr T.Ramashri 3 M.Tech Student, Department of Electrical and Electronics Engineering, Sri Venkateswara University
More information1.Discuss the frequency domain techniques of image enhancement in detail.
1.Discuss the frequency domain techniques of image enhancement in detail. Enhancement In Frequency Domain: The frequency domain methods of image enhancement are based on convolution theorem. This is represented
More information8.2 IMAGE PROCESSING VERSUS IMAGE ANALYSIS Image processing: The collection of routines and
8.1 INTRODUCTION In this chapter, we will study and discuss some fundamental techniques for image processing and image analysis, with a few examples of routines developed for certain purposes. 8.2 IMAGE
More informationDeconvolution , , Computational Photography Fall 2017, Lecture 17
Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 17 Course announcements Homework 4 is out. - Due October 26 th. - There was another
More informationRGB RESOLUTION CONSIDERATIONS IN A NEW CMOS SENSOR FOR CINE MOTION IMAGING
WHITE PAPER RGB RESOLUTION CONSIDERATIONS IN A NEW CMOS SENSOR FOR CINE MOTION IMAGING Written by Larry Thorpe Professional Engineering & Solutions Division, Canon U.S.A., Inc. For more info: cinemaeos.usa.canon.com
More informationEdge-Raggedness Evaluation Using Slanted-Edge Analysis
Edge-Raggedness Evaluation Using Slanted-Edge Analysis Peter D. Burns Eastman Kodak Company, Rochester, NY USA 14650-1925 ABSTRACT The standard ISO 12233 method for the measurement of spatial frequency
More informationPractical Implementation of LMMSE Demosaicing Using Luminance and Chrominance Spaces.
Practical Implementation of LMMSE Demosaicing Using Luminance and Chrominance Spaces. Brice Chaix de Lavarène,1, David Alleysson 2, Jeanny Hérault 1 Abstract Most digital color cameras sample only one
More informationInterference in stimuli employed to assess masking by substitution. Bernt Christian Skottun. Ullevaalsalleen 4C Oslo. Norway
Interference in stimuli employed to assess masking by substitution Bernt Christian Skottun Ullevaalsalleen 4C 0852 Oslo Norway Short heading: Interference ABSTRACT Enns and Di Lollo (1997, Psychological
More informationImproved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern
Improved sensitivity high-definition interline CCD using the KODAK TRUESENSE Color Filter Pattern James DiBella*, Marco Andreghetti, Amy Enge, William Chen, Timothy Stanka, Robert Kaser (Eastman Kodak
More information?t-) LILIITILIT LEITT LT. UIT DICTITI TIETTET 5,629,734. U.S. Patent º gá
U.S. Patent >? º gá?t-) lt,l LILIITILIT LEITT LT. UIT DICTITI TIETTET US005629734A United States Patent (19) 11 Patent Number: Hamilton, Jr. et al. 45 Date of Patent: May 13, 1997 54 ADAPTIVE COLOR PLAN
More informationSimultaneous Capturing of RGB and Additional Band Images Using Hybrid Color Filter Array
Simultaneous Capturing of RGB and Additional Band Images Using Hybrid Color Filter Array Daisuke Kiku, Yusuke Monno, Masayuki Tanaka, and Masatoshi Okutomi Tokyo Institute of Technology ABSTRACT Extra
More informationPerformance Evaluation of Edge Detection Techniques for Square Pixel and Hexagon Pixel images
Performance Evaluation of Edge Detection Techniques for Square Pixel and Hexagon Pixel images Keshav Thakur 1, Er Pooja Gupta 2,Dr.Kuldip Pahwa 3, 1,M.Tech Final Year Student, Deptt. of ECE, MMU Ambala,
More informationVision Review: Image Processing. Course web page:
Vision Review: Image Processing Course web page: www.cis.udel.edu/~cer/arv September 7, Announcements Homework and paper presentation guidelines are up on web page Readings for next Tuesday: Chapters 6,.,
More informationSimultaneous geometry and color texture acquisition using a single-chip color camera
Simultaneous geometry and color texture acquisition using a single-chip color camera Song Zhang *a and Shing-Tung Yau b a Department of Mechanical Engineering, Iowa State University, Ames, IA, USA 50011;
More informationDetermination of the MTF of JPEG Compression Using the ISO Spatial Frequency Response Plug-in.
IS&T's 2 PICS Conference IS&T's 2 PICS Conference Copyright 2, IS&T Determination of the MTF of JPEG Compression Using the ISO 2233 Spatial Frequency Response Plug-in. R. B. Jenkin, R. E. Jacobson and
More informationdigital film technology Resolution Matters what's in a pattern white paper standing the test of time
digital film technology Resolution Matters what's in a pattern white paper standing the test of time standing the test of time An introduction >>> Film archives are of great historical importance as they
More informationChapter 2 Fourier Integral Representation of an Optical Image
Chapter 2 Fourier Integral Representation of an Optical This chapter describes optical transfer functions. The concepts of linearity and shift invariance were introduced in Chapter 1. This chapter continues
More informationArtifacts Reduced Interpolation Method for Single-Sensor Imaging System
2016 International Conference on Computer Engineering and Information Systems (CEIS-16) Artifacts Reduced Interpolation Method for Single-Sensor Imaging System Long-Fei Wang College of Telecommunications
More informationAnalysis on Color Filter Array Image Compression Methods
Analysis on Color Filter Array Image Compression Methods Sung Hee Park Electrical Engineering Stanford University Email: shpark7@stanford.edu Albert No Electrical Engineering Stanford University Email:
More informationData Embedding Using Phase Dispersion. Chris Honsinger and Majid Rabbani Imaging Science Division Eastman Kodak Company Rochester, NY USA
Data Embedding Using Phase Dispersion Chris Honsinger and Majid Rabbani Imaging Science Division Eastman Kodak Company Rochester, NY USA Abstract A method of data embedding based on the convolution of
More informationConvolutional Networks Overview
Convolutional Networks Overview Sargur Srihari 1 Topics Limitations of Conventional Neural Networks The convolution operation Convolutional Networks Pooling Convolutional Network Architecture Advantages
More informationCamera Resolution and Distortion: Advanced Edge Fitting
28, Society for Imaging Science and Technology Camera Resolution and Distortion: Advanced Edge Fitting Peter D. Burns; Burns Digital Imaging and Don Williams; Image Science Associates Abstract A frequently
More informationCSCI 1290: Comp Photo
CSCI 29: Comp Photo Fall 28 @ Brown University James Tompkin Many slides thanks to James Hays old CS 29 course, along with all of its acknowledgements. Things I forgot on Thursday Grads are not required
More informationA Study of Slanted-Edge MTF Stability and Repeatability
A Study of Slanted-Edge MTF Stability and Repeatability Jackson K.M. Roland Imatest LLC, 2995 Wilderness Place Suite 103, Boulder, CO, USA ABSTRACT The slanted-edge method of measuring the spatial frequency
More informationInfluence of Image Enhancement Processing on SFR of Digital Cameras
IS&T s 998 PICS Conference Copyright 998, IS&T Influence of Image Processing on SFR of Digital Cameras Yukio Okano Sharp Corporation, Information Systems Labs. Yamatokoriyama, Nara, JAPAN Abstract The
More informationDeconvolution , , Computational Photography Fall 2018, Lecture 12
Deconvolution http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 12 Course announcements Homework 3 is out. - Due October 12 th. - Any questions?
More informationModule 3 : Sampling and Reconstruction Problem Set 3
Module 3 : Sampling and Reconstruction Problem Set 3 Problem 1 Shown in figure below is a system in which the sampling signal is an impulse train with alternating sign. The sampling signal p(t), the Fourier
More informationCS 4501: Introduction to Computer Vision. Filtering and Edge Detection
CS 451: Introduction to Computer Vision Filtering and Edge Detection Connelly Barnes Slides from Jason Lawrence, Fei Fei Li, Juan Carlos Niebles, Misha Kazhdan, Allison Klein, Tom Funkhouser, Adam Finkelstein,
More informationImage Filtering. Median Filtering
Image Filtering Image filtering is used to: Remove noise Sharpen contrast Highlight contours Detect edges Other uses? Image filters can be classified as linear or nonlinear. Linear filters are also know
More informationAn Improved Color Image Demosaicking Algorithm
An Improved Color Image Demosaicking Algorithm Shousheng Luo School of Mathematical Sciences, Peking University, Beijing 0087, China Haomin Zhou School of Mathematics, Georgia Institute of Technology,
More informationELEC Dr Reji Mathew Electrical Engineering UNSW
ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Filter Design Circularly symmetric 2-D low-pass filter Pass-band radial frequency: ω p Stop-band radial frequency: ω s 1 δ p Pass-band tolerances: δ
More informationNo-Reference Perceived Image Quality Algorithm for Demosaiced Images
No-Reference Perceived Image Quality Algorithm for Lamb Anupama Balbhimrao Electronics &Telecommunication Dept. College of Engineering Pune Pune, Maharashtra, India Madhuri Khambete Electronics &Telecommunication
More informationDenoising and Demosaicking of Color Images
Denoising and Demosaicking of Color Images by Mina Rafi Nazari Thesis submitted to the Faculty of Graduate and Postdoctoral Studies In partial fulfillment of the requirements For the Ph.D. degree in Electrical
More informationComputer Graphics (Fall 2011) Outline. CS 184 Guest Lecture: Sampling and Reconstruction Ravi Ramamoorthi
Computer Graphics (Fall 2011) CS 184 Guest Lecture: Sampling and Reconstruction Ravi Ramamoorthi Some slides courtesy Thomas Funkhouser and Pat Hanrahan Adapted version of CS 283 lecture http://inst.eecs.berkeley.edu/~cs283/fa10
More informationProf. Vidya Manian Dept. of Electrical and Comptuer Engineering
Image Processing Intensity Transformations Chapter 3 Prof. Vidya Manian Dept. of Electrical and Comptuer Engineering INEL 5327 ECE, UPRM Intensity Transformations 1 Overview Background Basic intensity
More informationSection 2 ADVANCED TECHNOLOGY DEVELOPMENTS
Section 2 ADVANCED TECHNOLOGY DEVELOPMENTS 2.A High-Power Laser Interferometry Central to the uniformity issue is the need to determine the factors that control the target-plane intensity distribution
More informationIntroduction to DSP ECE-S352 Fall Quarter 2000 Matlab Project 1
Objective: Introduction to DSP ECE-S352 Fall Quarter 2000 Matlab Project 1 This Matlab Project is an extension of the basic correlation theory presented in the course. It shows a practical application
More informationConvolution Pyramids. Zeev Farbman, Raanan Fattal and Dani Lischinski SIGGRAPH Asia Conference (2011) Julian Steil. Prof. Dr.
Zeev Farbman, Raanan Fattal and Dani Lischinski SIGGRAPH Asia Conference (2011) presented by: Julian Steil supervisor: Prof. Dr. Joachim Weickert Fig. 1.1: Gradient integration example Seminar - Milestones
More informationDigital Image Processing 3/e
Laboratory Projects for Digital Image Processing 3/e by Gonzalez and Woods 2008 Prentice Hall Upper Saddle River, NJ 07458 USA www.imageprocessingplace.com The following sample laboratory projects are
More informationThe Effect of Single-Sensor CFA Captures on Images Intended for Motion Picture and TV Applications
The Effect of Single-Sensor CFA Captures on Images Intended for Motion Picture and TV Applications Richard B. Wheeler, Nestor M. Rodriguez Eastman Kodak Company Abstract Current digital cinema camera designs
More informationColor Demosaicing Using Variance of Color Differences
Color Demosaicing Using Variance of Color Differences King-Hong Chung and Yuk-Hee Chan 1 Centre for Multimedia Signal Processing Department of Electronic and Information Engineering The Hong Kong Polytechnic
More informationDesign of a digital holographic interferometer for the. ZaP Flow Z-Pinch
Design of a digital holographic interferometer for the M. P. Ross, U. Shumlak, R. P. Golingo, B. A. Nelson, S. D. Knecht, M. C. Hughes, R. J. Oberto University of Washington, Seattle, USA Abstract The
More informationEvaluating Commercial Scanners for Astronomical Images. The underlying technology of the scanners: Pixel sizes:
Evaluating Commercial Scanners for Astronomical Images Robert J. Simcoe Associate Harvard College Observatory rjsimcoe@cfa.harvard.edu Introduction: Many organizations have expressed interest in using
More informationDEMOSAICING, also called color filter array (CFA)
370 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 14, NO. 3, MARCH 2005 Demosaicing by Successive Approximation Xin Li, Member, IEEE Abstract In this paper, we present a fast and high-performance algorithm
More informationColor filter arrays revisited - Evaluation of Bayer pattern interpolation for industrial applications
Color filter arrays revisited - Evaluation of Bayer pattern interpolation for industrial applications Matthias Breier, Constantin Haas, Wei Li and Dorit Merhof Institute of Imaging and Computer Vision
More informationOn Contrast Sensitivity in an Image Difference Model
On Contrast Sensitivity in an Image Difference Model Garrett M. Johnson and Mark D. Fairchild Munsell Color Science Laboratory, Center for Imaging Science Rochester Institute of Technology, Rochester New
More informationIntroduction. Prof. Lina Karam School of Electrical, Computer, & Energy Engineering Arizona State University
EEE 508 - Digital Image & Video Processing and Compression http://lina.faculty.asu.edu/eee508/ Introduction Prof. Lina Karam School of Electrical, Computer, & Energy Engineering Arizona State University
More informationLecture 3: Linear Filters
Signal Denoising Lecture 3: Linear Filters Math 490 Prof. Todd Wittman The Citadel Suppose we have a noisy 1D signal f(x). For example, it could represent a company's stock price over time. In order to
More informationSpeech and Audio Processing Recognition and Audio Effects Part 3: Beamforming
Speech and Audio Processing Recognition and Audio Effects Part 3: Beamforming Gerhard Schmidt Christian-Albrechts-Universität zu Kiel Faculty of Engineering Electrical Engineering and Information Engineering
More informationABSTRACT. Keywords: Color image differences, image appearance, image quality, vision modeling 1. INTRODUCTION
Measuring Images: Differences, Quality, and Appearance Garrett M. Johnson * and Mark D. Fairchild Munsell Color Science Laboratory, Chester F. Carlson Center for Imaging Science, Rochester Institute of
More informationLast Lecture. photomatix.com
Last Lecture photomatix.com HDR Video Assorted pixel (Single Exposure HDR) Assorted pixel Assorted pixel Pixel with Adaptive Exposure Control light attenuator element detector element T t+1 I t controller
More informationFocused Image Recovery from Two Defocused
Focused Image Recovery from Two Defocused Images Recorded With Different Camera Settings Murali Subbarao Tse-Chung Wei Gopal Surya Department of Electrical Engineering State University of New York Stony
More informationEvaluation of image quality of the compression schemes JPEG & JPEG 2000 using a Modular Colour Image Difference Model.
Evaluation of image quality of the compression schemes JPEG & JPEG 2000 using a Modular Colour Image Difference Model. Mary Orfanidou, Liz Allen and Dr Sophie Triantaphillidou, University of Westminster,
More informationECE 484 Digital Image Processing Lec 09 - Image Resampling
ECE 484 Digital Image Processing Lec 09 - Image Resampling Zhu Li Dept of CSEE, UMKC Office: FH560E, Email: lizhu@umkc.edu, Ph: x 2346. http://l.web.umkc.edu/lizhu slides created with WPS Office Linux
More informationDetermining MTF with a Slant Edge Target ABSTRACT AND INTRODUCTION
Determining MTF with a Slant Edge Target Douglas A. Kerr Issue 2 October 13, 2010 ABSTRACT AND INTRODUCTION The modulation transfer function (MTF) of a photographic lens tells us how effectively the lens
More informationPractical Image and Video Processing Using MATLAB
Practical Image and Video Processing Using MATLAB Chapter 10 Neighborhood processing What will we learn? What is neighborhood processing and how does it differ from point processing? What is convolution
More informationModule 6 STILL IMAGE COMPRESSION STANDARDS
Module 6 STILL IMAGE COMPRESSION STANDARDS Lesson 16 Still Image Compression Standards: JBIG and JPEG Instructional Objectives At the end of this lesson, the students should be able to: 1. Explain the
More informationFilters. Materials from Prof. Klaus Mueller
Filters Materials from Prof. Klaus Mueller Think More about Pixels What exactly a pixel is in an image or on the screen? Solid square? This cannot be implemented A dot? Yes, but size matters Pixel Dots
More informationStudy guide for Graduate Computer Vision
Study guide for Graduate Computer Vision Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 01003 November 23, 2011 Abstract 1 1. Know Bayes rule. What
More informationAssistant Lecturer Sama S. Samaan
MP3 Not only does MPEG define how video is compressed, but it also defines a standard for compressing audio. This standard can be used to compress the audio portion of a movie (in which case the MPEG standard
More informationECE 2111 Signals and Systems Spring 2012, UMD Experiment 9: Sampling
ECE 2111 Signals and Systems Spring 2012, UMD Experiment 9: Sampling Objective: In this experiment the properties and limitations of the sampling theorem are investigated. A specific sampling circuit will
More informationMidterm Examination CS 534: Computational Photography
Midterm Examination CS 534: Computational Photography November 3, 2015 NAME: SOLUTIONS Problem Score Max Score 1 8 2 8 3 9 4 4 5 3 6 4 7 6 8 13 9 7 10 4 11 7 12 10 13 9 14 8 Total 100 1 1. [8] What are
More informationSignal Processing Techniques for Software Radio
Signal Processing Techniques for Software Radio Behrouz Farhang-Boroujeny Department of Electrical and Computer Engineering University of Utah c 2007, Behrouz Farhang-Boroujeny, ECE Department, University
More informationDouble resolution from a set of aliased images
Double resolution from a set of aliased images Patrick Vandewalle 1,SabineSüsstrunk 1 and Martin Vetterli 1,2 1 LCAV - School of Computer and Communication Sciences Ecole Polytechnique Fédérale delausanne(epfl)
More informationELEC Dr Reji Mathew Electrical Engineering UNSW
ELEC 4622 Dr Reji Mathew Electrical Engineering UNSW Multi-Resolution Processing Gaussian Pyramid Starting with an image x[n], which we will also label x 0 [n], Construct a sequence of progressively lower
More informationOrthonormal bases and tilings of the time-frequency plane for music processing Juan M. Vuletich *
Orthonormal bases and tilings of the time-frequency plane for music processing Juan M. Vuletich * Dept. of Computer Science, University of Buenos Aires, Argentina ABSTRACT Conventional techniques for signal
More informationAdaptive Optimum Notch Filter for Periodic Noise Reduction in Digital Images
Adaptive Optimum Notch Filter for Periodic Noise Reduction in Digital Images Payman Moallem i * and Majid Behnampour ii ABSTRACT Periodic noises are unwished and spurious signals that create repetitive
More informationChrominance Assisted Sharpening of Images
Blekinge Institute of Technology Research Report 2004:08 Chrominance Assisted Sharpening of Images Andreas Nilsson Department of Signal Processing School of Engineering Blekinge Institute of Technology
More informationLecture Notes 11 Introduction to Color Imaging
Lecture Notes 11 Introduction to Color Imaging Color filter options Color processing Color interpolation (demozaicing) White balancing Color correction EE 392B: Color Imaging 11-1 Preliminaries Up till
More informationRefined Slanted-Edge Measurement for Practical Camera and Scanner Testing
Refined Slanted-Edge Measurement for Practical Camera and Scanner Testing Peter D. Burns and Don Williams Eastman Kodak Company Rochester, NY USA Abstract It has been almost five years since the ISO adopted
More informationCSC 320 H1S CSC320 Exam Study Guide (Last updated: April 2, 2015) Winter 2015
Question 1. Suppose you have an image I that contains an image of a left eye (the image is detailed enough that it makes a difference that it s the left eye). Write pseudocode to find other left eyes in
More informationAliasing and Antialiasing. What is Aliasing? What is Aliasing? What is Aliasing?
What is Aliasing? Errors and Artifacts arising during rendering, due to the conversion from a continuously defined illumination field to a discrete raster grid of pixels 1 2 What is Aliasing? What is Aliasing?
More information+ a(t) exp( 2πif t)dt (1.1) In order to go back to the independent variable t, we define the inverse transform as: + A(f) exp(2πif t)df (1.
Chapter Fourier analysis In this chapter we review some basic results from signal analysis and processing. We shall not go into detail and assume the reader has some basic background in signal analysis
More informationAn Evaluation of MTF Determination Methods for 35mm Film Scanners
An Evaluation of Determination Methods for 35mm Film Scanners S. Triantaphillidou, R. E. Jacobson, R. Fagard-Jenkin Imaging Technology Research Group, University of Westminster Watford Road, Harrow, HA1
More informationDefense Technical Information Center Compilation Part Notice
UNCLASSIFIED Defense Technical Information Center Compilation Part Notice ADPO 11345 TITLE: Measurement of the Spatial Frequency Response [SFR] of Digital Still-Picture Cameras Using a Modified Slanted
More informationSampling and Reconstruction
Sampling and Reconstruction Peter Rautek, Eduard Gröller, Thomas Theußl Institute of Computer Graphics and Algorithms Vienna University of Technology Motivation Theory and practice of sampling and reconstruction
More informationImage Processing Final Test
Image Processing 048860 Final Test Time: 100 minutes. Allowed materials: A calculator and any written/printed materials are allowed. Answer 4-6 complete questions of the following 10 questions in order
More informationImage Enhancement in spatial domain. Digital Image Processing GW Chapter 3 from Section (pag 110) Part 2: Filtering in spatial domain
Image Enhancement in spatial domain Digital Image Processing GW Chapter 3 from Section 3.4.1 (pag 110) Part 2: Filtering in spatial domain Mask mode radiography Image subtraction in medical imaging 2 Range
More informationOn Contrast Sensitivity in an Image Difference Model
On Contrast Sensitivity in an Image Difference Model Garrett M. Johnson and Mark D. Fairchild Munsell Color Science Laboratory, Center for Imaging Science Rochester Institute of Technology, Rochester New
More information06: Thinking in Frequencies. CS 5840: Computer Vision Instructor: Jonathan Ventura
06: Thinking in Frequencies CS 5840: Computer Vision Instructor: Jonathan Ventura Decomposition of Functions Taylor series: Sum of polynomials f(x) =f(a)+f 0 (a)(x a)+ f 00 (a) 2! (x a) 2 + f 000 (a) (x
More informationAnnouncements. Image Processing. What s an image? Images as functions. Image processing. What s a digital image?
Image Processing Images by Pawan Sinha Today s readings Forsyth & Ponce, chapters 8.-8. http://www.cs.washington.edu/education/courses/49cv/wi/readings/book-7-revised-a-indx.pdf For Monday Watt,.3-.4 (handout)
More informationLecture 7 Frequency Modulation
Lecture 7 Frequency Modulation Fundamentals of Digital Signal Processing Spring, 2012 Wei-Ta Chu 2012/3/15 1 Time-Frequency Spectrum We have seen that a wide range of interesting waveforms can be synthesized
More informationDemosaicing Algorithm for Color Filter Arrays Based on SVMs
www.ijcsi.org 212 Demosaicing Algorithm for Color Filter Arrays Based on SVMs Xiao-fen JIA, Bai-ting Zhao School of Electrical and Information Engineering, Anhui University of Science & Technology Huainan
More informationThermal tuning of volume Bragg gratings for high power spectral beam combining
Thermal tuning of volume Bragg gratings for high power spectral beam combining Derrek R. Drachenberg, Oleksiy Andrusyak, Ion Cohanoschi, Ivan Divliansky, Oleksiy Mokhun, Alexei Podvyaznyy, Vadim Smirnov,
More informationIN A TYPICAL digital camera, the optical image formed
360 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 14, NO. 3, MARCH 2005 Adaptive Homogeneity-Directed Demosaicing Algorithm Keigo Hirakawa, Student Member, IEEE and Thomas W. Parks, Fellow, IEEE Abstract
More informationLast Lecture. photomatix.com
Last Lecture photomatix.com Today Image Processing: from basic concepts to latest techniques Filtering Edge detection Re-sampling and aliasing Image Pyramids (Gaussian and Laplacian) Removing handshake
More informationIn-line digital holographic interferometry
In-line digital holographic interferometry Giancarlo Pedrini, Philipp Fröning, Henrik Fessler, and Hans J. Tiziani An optical system based on in-line digital holography for the evaluation of deformations
More informationMatlab (see Homework 1: Intro to Matlab) Linear Filters (Reading: 7.1, ) Correlation. Convolution. Linear Filtering (warm-up slide) R ij
Matlab (see Homework : Intro to Matlab) Starting Matlab from Unix: matlab & OR matlab nodisplay Image representations in Matlab: Unsigned 8bit values (when first read) Values in range [, 255], = black,
More informationAn Effective Directional Demosaicing Algorithm Based On Multiscale Gradients
79 An Effectie Directional Demosaicing Algorithm Based On Multiscale Gradients Prof S Arumugam, Prof K Senthamarai Kannan, 3 John Peter K ead of the Department, Department of Statistics, M. S Uniersity,
More information