CEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt.
|
|
- Sylvia Hubbard
- 5 years ago
- Views:
Transcription
1 CEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt. Session 7 Pixels and Image Filtering Mani Golparvar-Fard Department of Civil and Environmental Engineering 329D, Newmark Civil Engineering Lab mgolpar@illinois.edu Department of Civil and Environmental Engineering, University of Illinois at Urbana-Champaign
2 Outline What we have learned so far: Image formation Camera Calibration and Single View Metrology Introduction to Pixels and Image Filtering Review of lighting Reflection and absorption What is image filtering and how do we do it? Color models (if time allows) Reading: [FP] Chapters 7,8 Some slides in this lecture are courtesy to Prof. S. Savarese, Prof. D. Hoiem, prof F. Li, prof S. Lazebnik, and various other lecturers CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 2
3 From the 3D to 2D P = [x,y,z] p = [x,y] 3D world Image Let s now focus on 2D Extract building blocks CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 3
4 Extract useful building blocks 4 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
5 The big picture Feature Detection e.g. DoG Feature Description e.g. SIFT database of local descriptors Matching / Indexing / Detection CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 5
6 Images as functions We can think of an image as a function f, from R 2 to R: Defined over a rectangle, with a finite range: f: [a, b] [c, d] [,255] f( x, y ) gives the intensity at position ( x, y ) A color image: Source: S. Seitz r( x, y) f ( x, y) g( x, y) b ( x, y) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 6
7 Images as functions 7 Source: S. Seitz CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
8 Images as functions Images are usually digital (discrete): Sample the 2D space on a regular grid The image can now be represented as a matrix of integer values pixel Source: S. Seitz CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 8
9 Pixels and Reflection Models Quick Overview CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 9
10 Reflection models Albedo: fraction of light that is reflected Determines color (amount reflected at each wavelength) Very low albedo (hard to see shape) Higher albedo Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
11 Reflection models Specular reflection: mirror-like Light reflects at incident angle Reflection color = incoming light color Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
12 Reflection models Diffuse reflection Light scatters in all directions (proportional to cosine with surface normal) Observed intensity is independent of viewing direction Reflection color depends on light color and albedo Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 2
13 Surface orientation and light intensity Amount of light that hits surface from distant point source depends on angle between surface normal and source 2 I x = ρ x S N(x) Credit: D. Hoiem prop to cosine of relative angle CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 3
14 Reflection models Lambertian: reflection all diffuse Mirrored: reflection all specular Glossy: reflection mostly diffuse, some specular Specularities Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 4
15 Questions How many light sources are in the scene? How could I estimate the color of the camera s flash? Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 5
16 The plight of the poor pixel A pixel s brightness is determined by Light source (strength, direction, color) Surface orientation Surface material and albedo Reflected light and shadows from surrounding surfaces Gain on the sensor A pixel s brightness tells us nothing by itself 6 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
17 Basis for interpreting intensity images Key idea: for nearby scene points, most factors do not change much The information is mainly contained in local differences of brightness 7 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
18 Darkness = Large Difference in Neighboring Pixels 8 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
19 Next few classes: different views of filtering Image filters in spatial domain Filter is a mathematical operation of a grid of numbers Smoothing, sharpening, measuring texture Image filters in the frequency domain Filtering is a way to modify the frequencies of images Denoising, sampling, image compression Templates and Image Pyramids Filtering is a way to match a template to the image Detection, coarse-to-fine registration 9 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
20 The raster image (pixel matrix) Credit: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 2
21 Image filtering Image filtering: compute function of local neighborhood at each position Linear filtering: function is a weighted sum/difference of pixel values Credit: D. Hoiem Really important! Enhance images Denoise, resize, increase contrast, etc. Extract information from images Texture, edges, distinctive points, etc. Detect patterns Template matching CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 2
22 Convolution Let f be the image and g be the kernel. The output of convolving f with g is denoted by f * g. ( f g)[ m, n] k, l f [ k, l] g[ m k, n Weighted product of f(k,l) by g(-(k,l))) computed at different locations m,n l] MATLAB: conv2 vs. filter2 (also imfilter) f 22 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
23 Example: box filter g[, ] Slide credit: David Lowe (UBC) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 23
24 Image filtering g[, ] f [.,.] h[.,.] Credit: S. Seitz h[ m, n] g[ k, l] k, l f [ m k, n l] CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 24
25 Image filtering g[, ] f [.,.] h[.,.] Credit: S. Seitz h[ m, n] g[ k, l] k, l f [ m k, n l] CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 25
26 Image filtering g[, ] f [.,.] h[.,.] Credit: S. Seitz h[ m, n] g[ k, l] k, l f [ m k, n l] CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 26
27 Image filtering g[, ] f [.,.] h[.,.] Credit: S. Seitz h[ m, n] g[ k, l] k, l f [ m k, n l] CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 27
28 Image filtering g[, ] f [.,.] h[.,.] Credit: S. Seitz h[ m, n] g[ k, l] f [ m k, n l] 28 k, l
29 Image filtering g[, ] f [.,.] h[.,.] ? 9 Credit: S. Seitz h[ m, n] g[ k, l] f [ m k, n l] 29 k, l
30 Image filtering g[, ] f [.,.] h[.,.] ? Credit: S. Seitz h[ m, n] g[ k, l] f [ m k, n l] 3 k, l
31 Image filtering g[, ] f [.,.] h[.,.] h[ m, n] g[ k, l] f [ m k, n l] 3 k, l Credit: S. Seitz
32 Example: box filter Kernel k with positive entries, that sum to. g[, ] Notice: all weights are equal Slide credit: David Lowe (UBC) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 32
33 Smoothing with box filter 33
34 Practice with linear filters? Original 34 Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
35 Practice with linear filters Original Filtered (no change) Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 35
36 Practice with linear filters? Original Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 36
37 Practice with linear filters Original Shifted left By pixel Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 37
38 Practice with linear filters 2 -? Original (Note that filter sums to ) 38 Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
39 Practice with linear filters 2 - Original Sharpening filter - Accentuates differences with local average Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 39
40 Sharpening Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 4
41 Other filters Sobel Source: D. Hoiem Vertical Edge (absolute value) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 4
42 Other filters Sobel Source: D. Hoiem Horizontal Edge (absolute value) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 42
43 Basic gradient filters Horizontal Gradient Vertical Gradient - - or - or - 43 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
44 How could we synthesize motion blur? theta = 3; len = 2; fil = imrotate(ones(, len), theta, 'bilinear'); fil = fil / sum(fil(:)); figure(2), imshow(imfilter(im, fil)); 44 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
45 Filtering vs. Convolution g=filter f=image 2d filtering h=filter2(g,f); or h=imfilter(f,g); h[ m, n] g[ k, l] k, l f [ m k, n l] 2d convolution h=conv2(g,f); h[ m, n] g[ k, l] k, l f [ m k, n l] 45 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
46 Key properties of linear filters Linearity: filter(f + f 2 ) = filter(f ) + filter(f 2 ) Shift invariance: same behavior regardless of pixel location filter(shift(f)) = shift(filter(f)) Any linear, shift-invariant operator can be represented as a convolution 46 Source: S. Lazebnik CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
47 More properties Commutative: a * b = b * a Conceptually no difference between filter and signal Associative: a * (b * c) = (a * b) * c Often apply several filters one after another: (((a * b ) * b 2 ) * b 3 ) This is equivalent to applying one filter: a * (b * b 2 * b 3 ) Distributes over addition: a * (b + c) = (a * b) + (a * c) Scalars factor out: ka * b = a * kb = k (a * b) Identity: unit impulse e = [,,,, ], a * e = a Source: S. Lazebnik CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 47
48 Important filter: Gaussian Spatially-weighted average x 5, = Slide credit: Christopher Rasmussen CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 48
49 Smoothing with Gaussian filter 49 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
50 Smoothing with box filter 5 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
51 Gaussian filters Remove high-frequency components from the image (low-pass filter) Images become more smooth Convolution with self is another Gaussian So can smooth with small-width kernel, repeat, and get same result as larger-width kernel would have Convolving two times with Gaussian kernel of width σ is same as convolving once with kernel of width σ 2 Separable kernel Factors into product of two D Gaussians Source: K. Grauman CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 5
52 Separability of the Gaussian filter 52 Source: D. Lowe CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
53 Separability example 2D filtering (center location only) The filter factors into a product of D filters: Perform filtering along rows: * = Followed by filtering along the remaining column: * = Source: K. Grauman CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 53
54 Separability Why is separability useful in practice? 54 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
55 Some practical matters 55 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
56 Practical matters How big should the filter be? Values at edges should be near zero important! Rule of thumb for Gaussian: set filter half-width to about 3 σ 56 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
57 Practical matters What about near the edge? the filter window falls off the edge of the image need to extrapolate methods: clip filter (black) wrap around copy edge reflect across edge 57 Source: S. Marschner CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
58 Practical matters methods (MATLAB): clip filter (black): imfilter(f, g, ) wrap around: imfilter(f, g, circular ) copy edge: imfilter(f, g, replicate ) reflect across edge: imfilter(f, g, symmetric ) 58 Source: S. Marschner CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
59 Practical matters What is the size of the output? MATLAB: filter2(g, f, shape) shape = full : output size is sum of sizes of f and g shape = same : output size is same as f shape = valid : output size is difference of sizes of f and g g full same valid g g g g g f f f g g g g g g Source: S. Lazebnik CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 59
60 A little more about color 6 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
61 Digital Color Images Bayer Filter CMOS sensor 6 Source: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
62 Color Image R G B 62 Source: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
63 Images in Matlab Images represented as a matrix Suppose we have a NxM RGB image called im im(,,) = top-left pixel value in R-channel im(y, x, b) = y pixels down, x pixels to right in the b th channel im(n, M, 3) = bottom-right pixel in B-channel imread(filename) returns a uint8 image (values to 255) Convert to double format (values to ) with im2double row column G R B 63 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
64 Color spaces How can we represent color? Source: D. Hoiem CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 64
65 Color spaces: RGB Default color space,, R (G=,B=),, G (R=,B=),, Some drawbacks Strongly correlated channels Non-perceptual Image from: B (R=,G=) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 65
66 Color spaces: HSV Intuitive color space H (S=,V=) S (H=,V=) V (H=,S=) 66 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
67 Color spaces: YCbCr Fast to compute, good for compression, used by TV Y= Y=.5 Y (Cb=.5,Cr=.5) Cr Cb Y= Cb (Y=.5,Cr=.5) Cr (Y=.5,Cb=5) 67 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
68 Color spaces: CIE L*a*b* Perceptually uniform color space L (a=,b=) a (L=65,b=) Luminance = brightness Chrominance = color b (L=65,a=) CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 68
69 Which contains more information? (a) intensity ( channel) (b) chrominance (2 channels) 69 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
70 Most information in intensity Source: D. Hoiem Only color shown constant intensity CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 7
71 Most information in intensity Source: D. Hoiem Only intensity shown constant color CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 72
72 Most information in intensity Source: D. Hoiem Original image CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23 73
73 Important Take Home Messages Image is a matrix of numbers (light intensities at different orientations) Interpretted mainly through local comparisons = Linear filtering is sum of dot product at each position Can smooth, sharpen, translate (among many other uses) Attend to details: filter size, extrapolation, cropping Color spaces beyond RGB sometimes useful 74 CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. Mani Golparvar-Fard, 23
Motion illusion, rotating snakes
Motion illusion, rotating snakes Image Filtering 9/4/2 Computer Vision James Hays, Brown Graphic: unsharp mask Many slides by Derek Hoiem Next three classes: three views of filtering Image filters in spatial
More information02/02/10. Image Filtering. Computer Vision CS 543 / ECE 549 University of Illinois. Derek Hoiem
2/2/ Image Filtering Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Questions about HW? Questions about class? Room change starting thursday: Everitt 63, same time Key ideas from last
More informationImage Filtering in Spatial domain. Computer Vision Jia-Bin Huang, Virginia Tech
Image Filtering in Spatial domain Computer Vision Jia-Bin Huang, Virginia Tech Administrative stuffs Lecture schedule changes Office hours - Jia-Bin (44 Whittemore Hall) Friday at : AM 2: PM Office hours
More information>>> from numpy import random as r >>> I = r.rand(256,256);
WHAT IS AN IMAGE? >>> from numpy import random as r >>> I = r.rand(256,256); Think-Pair-Share: - What is this? What does it look like? - Which values does it take? - How many values can it take? - Is it
More information>>> from numpy import random as r >>> I = r.rand(256,256);
WHAT IS AN IMAGE? >>> from numpy import random as r >>> I = r.rand(256,256); Think-Pair-Share: - What is this? What does it look like? - Which values does it take? - How many values can it take? - Is it
More informationMotivation: Image denoising. How can we reduce noise in a photograph?
Linear filtering Motivation: Image denoising How can we reduce noise in a photograph? Moving average Let s replace each pixel with a weighted average of its neighborhood The weights are called the filter
More informationMotivation: Image denoising. How can we reduce noise in a photograph?
Linear filtering Motivation: Image denoising How can we reduce noise in a photograph? Moving average Let s replace each pixel with a weighted average of its neighborhood The weights are called the filter
More informationFourier analysis of images
Fourier analysis of images Intensity Image Fourier Image Slides: James Hays, Hoiem, Efros, and others http://sharp.bu.edu/~slehar/fourier/fourier.html#filtering Signals can be composed + = http://sharp.bu.edu/~slehar/fourier/fourier.html#filtering
More informationCSCI 1290: Comp Photo
CSCI 29: Comp Photo Fall 28 @ Brown University James Tompkin Many slides thanks to James Hays old CS 29 course, along with all of its acknowledgements. Things I forgot on Thursday Grads are not required
More informationSampling and Reconstruction
Sampling and Reconstruction Many slides from Steve Marschner 15-463: Computational Photography Alexei Efros, CMU, Fall 211 Sampling and Reconstruction Sampled representations How to store and compute with
More informationProf. Feng Liu. Winter /10/2019
Prof. Feng Liu Winter 29 http://www.cs.pdx.edu/~fliu/courses/cs4/ //29 Last Time Course overview Admin. Info Computer Vision Computer Vision at PSU Image representation Color 2 Today Filter 3 Today Filters
More informationHistograms and Color Balancing
Histograms and Color Balancing 09/14/17 Empire of Light, Magritte Computational Photography Derek Hoiem, University of Illinois Administrative stuff Project 1: due Monday Part I: Hybrid Image Part II:
More informationMotion illusion, rotating snakes
Motion illusion, rotating snakes Previous classes Computer vision overview Mathematics of pinhole camera Sensors and light Recap: projection X t x K R 1 1 0 0 0 1 33 32 31 23 22 21 13 12 11 0 0 z y x t
More informationImage Filtering and Gaussian Pyramids
Image Filtering and Gaussian Pyramids CS94: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 27 Limitations of Point Processing Q: What happens if I reshuffle all pixels within
More informationCS 4501: Introduction to Computer Vision. Filtering and Edge Detection
CS 451: Introduction to Computer Vision Filtering and Edge Detection Connelly Barnes Slides from Jason Lawrence, Fei Fei Li, Juan Carlos Niebles, Misha Kazhdan, Allison Klein, Tom Funkhouser, Adam Finkelstein,
More informationOversubscription. Sorry, not fixed yet. We ll let you know as soon as we can.
Bela Borsodi Bela Borsodi Oversubscription Sorry, not fixed yet. We ll let you know as soon as we can. CS 143 James Hays Continuing his course many materials, courseworks, based from him + previous staff
More informationWaitlist. We ll let you know as soon as we can. Biggest issue is TAs
Bela Borsodi Bela Borsodi Waitlist We ll let you know as soon as we can. Biggest issue is TAs CS 143 James Hays Many materials, courseworks, based from him + previous TA staff serious thanks! Textbook
More informationMidterm is on Thursday!
Midterm is on Thursday! Project presentations are May 17th, 22nd and 24th Next week there is a strike on campus. Class is therefore cancelled on Tuesday. Please work on your presentations instead! REVIEW
More informationImage filtering, image operations. Jana Kosecka
Image filtering, image operations Jana Kosecka - photometric aspects of image formation - gray level images - point-wise operations - linear filtering Image Brightness values I(x,y) Images Images contain
More informationCapturing light and color
Capturing light and color Friday, 10/02/2017 Antonis Argyros e-mail: argyros@csd.uoc.gr Szeliski 2.2, 2.3, 3.1 1 Recap from last lecture Pinhole camera model Perspective projection Focal length and depth/field
More informationLight and Color. Computer Vision Jia-Bin Huang, Virginia Tech. Empire of Light, 1950 by Rene Magritte
Light and Color Computer Vision Jia-Bin Huang, Virginia Tech Empire of Light, 1950 by Rene Magritte Administrative stuffs Signed up Piazza discussion board? Search for Teammates! Sample final project ideas
More informationCapturing Light in man and machine
Capturing Light in man and machine CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2014 Etymology PHOTOGRAPHY light drawing / writing Image Formation Digital Camera
More informationImages and Filters. EE/CSE 576 Linda Shapiro
Images and Filters EE/CSE 576 Linda Shapiro What is an image? 2 3 . We sample the image to get a discrete set of pixels with quantized values. 2. For a gray tone image there is one band F(r,c), with values
More informationCapturing Light in man and machine
Capturing Light in man and machine CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2015 Etymology PHOTOGRAPHY light drawing / writing Image Formation Digital Camera
More informationVision Review: Image Processing. Course web page:
Vision Review: Image Processing Course web page: www.cis.udel.edu/~cer/arv September 7, Announcements Homework and paper presentation guidelines are up on web page Readings for next Tuesday: Chapters 6,.,
More informationMatlab (see Homework 1: Intro to Matlab) Linear Filters (Reading: 7.1, ) Correlation. Convolution. Linear Filtering (warm-up slide) R ij
Matlab (see Homework : Intro to Matlab) Starting Matlab from Unix: matlab & OR matlab nodisplay Image representations in Matlab: Unsigned 8bit values (when first read) Values in range [, 255], = black,
More informationLinear Filters Tues Sept 1 Kristen Grauman UT Austin. Announcements. Plan for today 8/31/2015. Image noise Linear filters. Convolution / correlation
8/3/25 Linear Filters Tues Sept Kristen Grauman UT Austin Announcements Piazza for assinment questions A due Friday Sept 4. Submit on Canvas. Plan for today Imae noise Linear filters Examples: smoothin
More informationSampling and Reconstruction
Sampling and Reconstruction Salvador Dali, Dali from the Back Painting Gala from the Back Eternalized by Six Virtual Corneas Provisionally Reflected by Six Real Mirrors Many slides from Steve Marschner,
More informationRobert Collins CSE486, Penn State. Lecture 3: Linear Operators
Lecture : Linear Operators Administrivia I have put some Matlab image tutorials on Angel. Please take a look if you are unfamiliar with Matlab or the image toolbox. I have posted Homework on Angel. It
More informationCapturing Light in man and machine
Capturing Light in man and machine CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2016 Textbook http://szeliski.org/book/ General Comments Prerequisites Linear algebra!!!
More informationTemplates and Image Pyramids
Templates and Image Pyramids 09/07/17 Computational Photography Derek Hoiem, University of Illinois Why does a lower resolution image still make sense to us? What do we lose? Image: http://www.flickr.com/photos/igorms/136916757/
More informationColor Space 1: RGB Color Space. Color Space 2: HSV. RGB Cube Easy for devices But not perceptual Where do the grays live? Where is hue and saturation?
Color Space : RGB Color Space Color Space 2: HSV RGB Cube Easy for devices But not perceptual Where do the grays live? Where is hue and saturation? Hue, Saturation, Value (Intensity) RBG cube on its vertex
More informationEE482: Digital Signal Processing Applications
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu EE482: Digital Signal Processing Applications Spring 2014 TTh 14:30-15:45 CBC C222 Lecture 15 Image Processing 14/04/15 http://www.ee.unlv.edu/~b1morris/ee482/
More informationCS534 Introduction to Computer Vision. Linear Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University
CS534 Introduction to Computer Vision Linear Filters Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What are Filters Linear Filters Convolution operation Properties of Linear Filters
More informationImage Processing. Adam Finkelstein Princeton University COS 426, Spring 2019
Image Processing Adam Finkelstein Princeton University COS 426, Spring 2019 Image Processing Operations Luminance Brightness Contrast Gamma Histogram equalization Color Grayscale Saturation White balance
More informationIMAGE PROCESSING: AREA OPERATIONS (FILTERING)
IMAGE PROCESSING: AREA OPERATIONS (FILTERING) N. C. State University CSC557 Multimedia Computing and Networking Fall 2001 Lecture # 13 IMAGE PROCESSING: AREA OPERATIONS (FILTERING) N. C. State University
More informationImage Enhancement II: Neighborhood Operations
Image Enhancement II: Neighborhood Operations Image Enhancement:Spatial Filtering Operation Idea: Use a mask to alter piel values according to local operation Aim: De)-Emphasize some spatial requencies
More informationTemplates and Image Pyramids
Templates and Image Pyramids 09/06/11 Computational Photography Derek Hoiem, University of Illinois Project 1 Due Monday at 11:59pm Options for displaying results Web interface or redirect (http://www.pa.msu.edu/services/computing/faq/autoredirect.html)
More informationAchim J. Lilienthal Mobile Robotics and Olfaction Lab, AASS, Örebro University
Achim J. Lilienthal Mobile Robotics and Olfaction Lab, Room T29, Mo, -2 o'clock AASS, Örebro University (please drop me an email in advance) achim.lilienthal@oru.se 4.!!!!!!!!! Pre-Class Reading!!!!!!!!!
More informationDigital Image Processing
Digital Image Processing Part : Image Enhancement in the Spatial Domain AASS Learning Systems Lab, Dep. Teknik Room T9 (Fr, - o'clock) achim.lilienthal@oru.se Course Book Chapter 3-4- Contents. Image Enhancement
More informationComputer Vision Lecture 3
Demo Haribo Classification Computer Vision Lecture 3 Linear Filters 3..25 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Code available on the class website... 3
More informationDigital Image Processing
Digital Image Processing Part 2: Image Enhancement Digital Image Processing Course Introduction in the Spatial Domain Lecture AASS Learning Systems Lab, Teknik Room T26 achim.lilienthal@tech.oru.se Course
More informationDigital Image Processing. Digital Image Fundamentals II 12 th June, 2017
Digital Image Processing Digital Image Fundamentals II 12 th June, 2017 Image Enhancement Image Enhancement Types of Image Enhancement Operations Neighborhood Operations on Images Spatial Filtering Filtering
More informationImage Processing for feature extraction
Image Processing for feature extraction 1 Outline Rationale for image pre-processing Gray-scale transformations Geometric transformations Local preprocessing Reading: Sonka et al 5.1, 5.2, 5.3 2 Image
More informationLast Lecture. photomatix.com
Last Lecture photomatix.com Today Image Processing: from basic concepts to latest techniques Filtering Edge detection Re-sampling and aliasing Image Pyramids (Gaussian and Laplacian) Removing handshake
More informationComputers and Imaging
Computers and Imaging Telecommunications 1 P. Mathys Two Different Methods Vector or object-oriented graphics. Images are generated by mathematical descriptions of line (vector) segments. Bitmap or raster
More informationLast Lecture. photomatix.com
Last Lecture photomatix.com HDR Video Assorted pixel (Single Exposure HDR) Assorted pixel Assorted pixel Pixel with Adaptive Exposure Control light attenuator element detector element T t+1 I t controller
More informationCircular averaging filter (pillbox) Approximates the two-dimensional Laplacian operator. Laplacian of Gaussian filter
Image Processing Toolbox fspecial Create predefined 2-D filter Syntax h = fspecial( type) h = fspecial( type,parameters) Description h = fspecial( type) creates a two-dimensional filter h of the specified
More informationStudy guide for Graduate Computer Vision
Study guide for Graduate Computer Vision Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 01003 November 23, 2011 Abstract 1 1. Know Bayes rule. What
More informationLec 05 - Linear Filtering & Edge Detection
ECE 484 Digital Image Processing Lec 05 - Linear Filtering & Edge Detection Zhu Li Dept of CSEE, UMKC Office: FH560E, Email: lizhu@umkc.edu, Ph: x 2346. http://l.web.umkc.edu/lizhu Z. Li, ECE 484 Digital
More informationTonemapping and bilateral filtering
Tonemapping and bilateral filtering http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 6 Course announcements Homework 2 is out. - Due September
More informationCS6670: Computer Vision Noah Snavely. Administrivia. Administrivia. Reading. Last time: Convolution. Last time: Cross correlation 9/8/2009
CS667: Computer Vision Noah Snavely Administrivia New room starting Thursday: HLS B Lecture 2: Edge detection and resampling From Sandlot Science Administrivia Assignment (feature detection and matching)
More informationMidterm Examination CS 534: Computational Photography
Midterm Examination CS 534: Computational Photography November 3, 2015 NAME: SOLUTIONS Problem Score Max Score 1 8 2 8 3 9 4 4 5 3 6 4 7 6 8 13 9 7 10 4 11 7 12 10 13 9 14 8 Total 100 1 1. [8] What are
More informationLecture 3: Linear Filters
Signal Denoising Lecture 3: Linear Filters Math 490 Prof. Todd Wittman The Citadel Suppose we have a noisy 1D signal f(x). For example, it could represent a company's stock price over time. In order to
More informationNumerical Derivatives See also T&V, Appendix A.2 Gradient = vector of partial derivatives of image I(x,y) = [di(x,y)/dx, di(x,y)/dy]
I have put some Matlab image tutorials on Angel. Please take a look i you are unamiliar with Matlab or the image toolbox. Lecture : Linear Operators Administrivia I have posted Homework on Angel. It is
More informationAnnouncements. Image Processing. What s an image? Images as functions. Image processing. What s a digital image?
Image Processing Images by Pawan Sinha Today s readings Forsyth & Ponce, chapters 8.-8. http://www.cs.washington.edu/education/courses/49cv/wi/readings/book-7-revised-a-indx.pdf For Monday Watt,.3-.4 (handout)
More informationComputer Graphics (Fall 2011) Outline. CS 184 Guest Lecture: Sampling and Reconstruction Ravi Ramamoorthi
Computer Graphics (Fall 2011) CS 184 Guest Lecture: Sampling and Reconstruction Ravi Ramamoorthi Some slides courtesy Thomas Funkhouser and Pat Hanrahan Adapted version of CS 283 lecture http://inst.eecs.berkeley.edu/~cs283/fa10
More informationChapter 3 Image Enhancement in the Spatial Domain. Chapter 3 Image Enhancement in the Spatial Domain
It makes all the difference whether one sees darkness through the light or brightness through the shadows. - David Lindsay 3.1 Background 76 3.2 Some Basic Gray Level Transformations 78 3.3 Histogram Processing
More informationImage Processing by Bilateral Filtering Method
ABHIYANTRIKI An International Journal of Engineering & Technology (A Peer Reviewed & Indexed Journal) Vol. 3, No. 4 (April, 2016) http://www.aijet.in/ eissn: 2394-627X Image Processing by Bilateral Image
More informationSampling and reconstruction
Sampling and reconstruction CS 5625 Lecture 6 Lecture 6 1 Sampled representations How to store and compute with continuous functions? Common scheme for representation: samples write down the function s
More informationSampling and reconstruction
Sampling and reconstruction Week 10 Acknowledgement: The course slides are adapted from the slides prepared by Steve Marschner of Cornell University 1 Sampled representations How to store and compute with
More informationLecture 19: Depth Cameras. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011)
Lecture 19: Depth Cameras Kayvon Fatahalian CMU 15-869: Graphics and Imaging Architectures (Fall 2011) Continuing theme: computational photography Cheap cameras capture light, extensive processing produces
More informationLecture 2: Color, Filtering & Edges. Slides: S. Lazebnik, S. Seitz, W. Freeman, F. Durand, D. Forsyth, D. Lowe, B. Wandell, S.Palmer, K.
Lecture 2: Color, Filtering & Edges Slides: S. Lazebnik, S. Seitz, W. Freeman, F. Durand, D. Forsyth, D. Lowe, B. Wandell, S.Palmer, K. Grauman Color What is color? Color Camera Sensor http://www.photoaxe.com/wp-content/uploads/2007/04/camera-sensor.jpg
More informationSampling and Reconstruction
Sampling and reconstruction COMP 575/COMP 770 Fall 2010 Stephen J. Guy 1 Review What is Computer Graphics? Computer graphics: The study of creating, manipulating, and using visual images in the computer.
More informationImage analysis. CS/CME/BIOPHYS/BMI 279 Fall 2015 Ron Dror
Image analysis CS/CME/BIOPHYS/BMI 279 Fall 2015 Ron Dror A two- dimensional image can be described as a function of two variables f(x,y). For a grayscale image, the value of f(x,y) specifies the brightness
More informationCSCI 1290: Comp Photo
CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. Canny edge detector 1. Filter image with x,
More informationContinued. Introduction to Computer Vision CSE 252a Lecture 11
Continued Introduction to Computer Vision CSE 252a Lecture 11 The appearance of colors Color appearance is strongly affected by (at least): Spectrum of lighting striking the retina other nearby colors
More informationProf. Vidya Manian Dept. of Electrical and Comptuer Engineering
Image Processing Intensity Transformations Chapter 3 Prof. Vidya Manian Dept. of Electrical and Comptuer Engineering INEL 5327 ECE, UPRM Intensity Transformations 1 Overview Background Basic intensity
More informationTable of contents. Vision industrielle 2002/2003. Local and semi-local smoothing. Linear noise filtering: example. Convolution: introduction
Table of contents Vision industrielle 2002/2003 Session - Image Processing Département Génie Productique INSA de Lyon Christian Wolf wolf@rfv.insa-lyon.fr Introduction Motivation, human vision, history,
More informationFiltering Images in the Spatial Domain Chapter 3b G&W. Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah
Filtering Images in the Spatial Domain Chapter 3b G&W Ross Whitaker (modified by Guido Gerig) School of Computing University of Utah 1 Overview Correlation and convolution Linear filtering Smoothing, kernels,
More informationProf. Feng Liu. Winter /09/2017
Prof. Feng Liu Winter 2017 http://www.cs.pdx.edu/~fliu/courses/cs410/ 01/09/2017 Today Course overview Computer vision Admin. Info Visual Computing at PSU Image representation Color 2 Big Picture: Visual
More informationImage Processing: An Overview
Image Processing: An Overview Sebastiano Battiato, Ph.D. battiato@dmi.unict.it Program Image Representation & Color Spaces Image files format (Compressed/Not compressed) Bayer Pattern & Color Interpolation
More informationImage Processing COS 426
Image Processing COS 426 What is a Digital Image? A digital image is a discrete array of samples representing a continuous 2D function Continuous function Discrete samples Limitations on Digital Images
More informationImage Filtering. Median Filtering
Image Filtering Image filtering is used to: Remove noise Sharpen contrast Highlight contours Detect edges Other uses? Image filters can be classified as linear or nonlinear. Linear filters are also know
More informationImage Enhancement using Histogram Equalization and Spatial Filtering
Image Enhancement using Histogram Equalization and Spatial Filtering Fari Muhammad Abubakar 1 1 Department of Electronics Engineering Tianjin University of Technology and Education (TUTE) Tianjin, P.R.
More informationImage acquisition. Midterm Review. Digitization, line of image. Digitization, whole image. Geometric transformations. Interpolation 10/26/2016
Image acquisition Midterm Review Image Processing CSE 166 Lecture 10 2 Digitization, line of image Digitization, whole image 3 4 Geometric transformations Interpolation CSE 166 Transpose these matrices
More informationBBM 413 Fundamentals of Image Processing. Erkut Erdem Dept. of Computer Engineering Hacettepe University. Point Operations Histogram Processing
BBM 413 Fundamentals of Image Processing Erkut Erdem Dept. of Computer Engineering Hacettepe University Point Operations Histogram Processing Today s topics Point operations Histogram processing Today
More informationBBM 413 Fundamentals of Image Processing. Erkut Erdem Dept. of Computer Engineering Hacettepe University. Point Operations Histogram Processing
BBM 413 Fundamentals of Image Processing Erkut Erdem Dept. of Computer Engineering Hacettepe University Point Operations Histogram Processing Today s topics Point operations Histogram processing Today
More informationCIS581: Computer Vision and Computational Photography Homework: Cameras and Convolution Due: Sept. 14, 2017 at 3:00 pm
CIS58: Computer Vision and Computational Photography Homework: Cameras and Convolution Due: Sept. 4, 207 at 3:00 pm Instructions This is an individual assignment. Individual means each student must hand
More informationBBM 413! Fundamentals of! Image Processing!
BBM 413! Fundamentals of! Image Processing! Today s topics" Point operations! Histogram processing! Erkut Erdem" Dept. of Computer Engineering" Hacettepe University" "! Point Operations! Histogram Processing!
More informationComputer Graphics Fundamentals
Computer Graphics Fundamentals Jacek Kęsik, PhD Simple converts Rotations Translations Flips Resizing Geometry Rotation n * 90 degrees other Geometry Rotation n * 90 degrees other Geometry Translations
More informationCAP 5415 Computer Vision. Marshall Tappen Fall Lecture 1
CAP 5415 Computer Vision Marshall Tappen Fall 21 Lecture 1 Welcome! About Me Interested in Machine Vision and Machine Learning Happy to chat with you at almost any time May want to e-mail me first Office
More informationMultimedia Systems Giorgio Leonardi A.A Lectures 14-16: Raster images processing and filters
Multimedia Systems Giorgio Leonardi A.A.2014-2015 Lectures 14-16: Raster images processing and filters Outline (of the following lectures) Light and color processing/correction Convolution filters: blurring,
More informationFrequencies and Color
Frequencies and Color Alexei Efros, CS280, Spring 2018 Salvador Dali Gala Contemplating the Mediterranean Sea, which at 30 meters becomes the portrait of Abraham Lincoln, 1976 Spatial Frequencies and
More informationDigital Image Processing. Lecture 5 (Enhancement) Bu-Ali Sina University Computer Engineering Dep. Fall 2009
Digital Image Processing Lecture 5 (Enhancement) Bu-Ali Sina University Computer Engineering Dep. Fall 2009 Outline Image Enhancement in Spatial Domain Histogram based methods Histogram Equalization Local
More informationImage features: Histograms, Aliasing, Filters, Orientation and HOG. D.A. Forsyth
Image features: Histograms, Aliasing, Filters, Orientation and HOG D.A. Forsyth Simple color features Histogram of image colors in a window Opponent color representations R-G B-Y=B-(R+G)/2 Intensity=(R+G+B)/3
More informationFilters. Materials from Prof. Klaus Mueller
Filters Materials from Prof. Klaus Mueller Think More about Pixels What exactly a pixel is in an image or on the screen? Solid square? This cannot be implemented A dot? Yes, but size matters Pixel Dots
More informationComputer Vision, Lecture 3
Computer Vision, Lecture 3 Professor Hager http://www.cs.jhu.edu/~hager /4/200 CS 46, Copyright G.D. Hager Outline for Today Image noise Filtering by Convolution Properties of Convolution /4/200 CS 46,
More informationFilip Malmberg 1TD396 fall 2018 Today s lecture
Today s lecture Local neighbourhood processing Convolution smoothing an image sharpening an image And more What is it? What is it useful for? How can I compute it? Removing uncorrelated noise from an image
More informationThinking in Frequency
Thinking in Frequency Computer Vision Brown James Hays Slides: Hoiem, Efros, and others Recap of Wednesday linear filtering convolution differential filters filter types boundary conditions. Review: questions
More informationCvision 2. António J. R. Neves João Paulo Silva Cunha. Bernardo Cunha. IEETA / Universidade de Aveiro
Cvision 2 Digital Imaging António J. R. Neves (an@ua.pt) & João Paulo Silva Cunha & Bernardo Cunha IEETA / Universidade de Aveiro Outline Image sensors Camera calibration Sampling and quantization Data
More informationPractical Image and Video Processing Using MATLAB
Practical Image and Video Processing Using MATLAB Chapter 10 Neighborhood processing What will we learn? What is neighborhood processing and how does it differ from point processing? What is convolution
More informationImage acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor
Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the
More informationVisual Perception. Overview. The Eye. Information Processing by Human Observer
Visual Perception Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview Last Class Introduction to DIP/DVP applications and examples Image as a function Concepts
More informationLec 04: Image Filtering and Edge Features
Image Analysis & Retrieval CS/EE 559 Special Topics (Class Ids: 44873, 44874) Fall 26, M/W 4-5:5pm@Bloch 2 Lec 4: Image Filtering and Edge Features Zhu Li Dept of CSEE, UMKC Office: FH56E, Email: lizhu@umkc.edu,
More informationColor Image Processing
Color Image Processing Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Color Used heavily in human vision. Visible spectrum for humans is 400 nm (blue) to 700
More informationIntroduction to Color Science (Cont)
Lecture 24: Introduction to Color Science (Cont) Computer Graphics and Imaging UC Berkeley Empirical Color Matching Experiment Additive Color Matching Experiment Show test light spectrum on left Mix primaries
More informationColor Image Processing
Color Image Processing Jesus J. Caban Outline Discuss Assignment #1 Project Proposal Color Perception & Analysis 1 Discuss Assignment #1 Project Proposal Due next Monday, Oct 4th Project proposal Submit
More information06: Thinking in Frequencies. CS 5840: Computer Vision Instructor: Jonathan Ventura
06: Thinking in Frequencies CS 5840: Computer Vision Instructor: Jonathan Ventura Decomposition of Functions Taylor series: Sum of polynomials f(x) =f(a)+f 0 (a)(x a)+ f 00 (a) 2! (x a) 2 + f 000 (a) (x
More informationLecture Notes 11 Introduction to Color Imaging
Lecture Notes 11 Introduction to Color Imaging Color filter options Color processing Color interpolation (demozaicing) White balancing Color correction EE 392B: Color Imaging 11-1 Preliminaries Up till
More information