Computational Photography: Interactive Imaging and Graphics
|
|
- Adela Newton
- 5 years ago
- Views:
Transcription
1 Computational Photography: Interactive Imaging and Graphics Jesus J Caban, PhD Outline 1. Finish talking about the class 2. Image Formation 3. Assignment #1 $&
2 Computational Photography! ()*+,-./)0.1&+2)-)34.+25&67&.0&8*843603& &.48.&.-& -28& /)0&):&9)*+,-84& ;&6*.38&+4) ;&.0<& 9)*+,-84&=676)0>&! Computer Vision Image Processing Graphics Computational Photography CMSC 691 will cover topics / concepts not necessarily inside the CP area. Syllabus '&
3 Other Topics! Image Warping! Feature extraction! Merge images! Texture Analysis! MRF! Segmentation (Grabcut)! Object recognition! Video compression! Image retrieval! Animation! Medical Image Processing! Volume Rendering! Image Features (SIFT)! Edge detection! Image Quality! 3D reconstruction! Gesture Recognition Final Project! Draft Proposal (10%)! Revised Proposal (10%)! Literature survey (20%)! Final paper (40%)! Final presentation (20%)?&
4 How to select your project?! Find something you like! Try to make something related to your thesis / dissertation! Read some of the papers / topics in advance Image Formation CMSC
5 Digital Images! A digital image is a 2D Intensity function f(x,y)! x and y are spatial coordinates! the amplitude of function f is called the intensity! Each discrete sample of the intensity function is referred to as a picture element or pixel! Can view intensity values as a height map using intensity values as the distance along Z-axis Digital Image Representation Issues! Typical grayscale images has 256 Grayscale values! 512x512 pixels requires over a! million bytes of storage! Image formation is inherently a noisy process that maps a continuous function to a discrete set of samples! Images and course terminology! f(x,y) the intensity at a point in the world (radiometry)! f(u,v) measured intensity on the real image plane (non discrete)! f(i,j) intensity value at a pixel location i,j (digitized) (x,y) (u,v) -f (i,j) A&
6 Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6 The Geometry of Image Formation! Describes the projection of 3D to 2D! Typical Assumptions! Ideal pinhole lens! Light travels in straight lines! Various types of projections! Orthographic! Perspective! Spherical! Oblique! isometric Pinhole Camera B&
7 Orthographic Projection P P O Q Q! Used for engineering drawings, architectural diagrams! Preserves measurement accuracy! All views are the same scale Perspective Projection Q f O P P Q! More realistic! Has some issues C&
8 Equivalent Image Geometries! Consider case with object on optical axis! More convenient geometry, with an upright image! Both are equivalent mathematically Perspective Projection Equations (X-Z Plane) P(x,y,z) -f (u,v) By similar triangles: #&
9 Perspective Projection Equations (Y-Z Plane) By similar triangles: The perspective Transform Equations! Given a point in the 3D world! The two equations transform a world coordinate (x,y,z) into image coordinate (u,v)! Notice:! Position on the image plane is related to depth.! (u,v) are scaled equally based on focal length and depth!&
10 Perspective Projection! Viewing rays are not parallel, but converge to the image center! Each point in the image corresponds to a particular direction defined by a ray from the point through the pinhole.! Vanishing points are a property of the parallel foreshortening of image structure under perspective projection Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6 $%&
11 Image Formation In The Eye! Muscles within the eye can be used to change the shape of the lens allowing us focus on objects that are near or far away! An image is focused onto the retina causing rods and cones to become excited which ultimately send signals to the brain Why lens?! Assume a continuous series of properly arranged glass pieces that focus light to a single point. This is know as a lens. The lens takes multiple paths of light from a single source and focuses them only a single point on the image plane (retina)! The pinhole structures allows the world to be focused onto photoreceptive plane! Incoming point light source illuminates retina at only one point $$&
12 Brightness Adaptation & Discrimination! The human visual system can perceive approximately different light intensity levels! However, at any one time we can only discriminate between a much smaller number brightness adaptation! Similarly, the perceived intensity of a region is related to the light intensities of the regions surrounding it Brightness Adaptation & Discrimination (cont ) For more great illusion examples take a look at: $'&
13 Optical Illusions! Our visual systems play lots of interesting tricks on us Reflected Light! The colours that we perceive are determined by the nature of the light reflected from an object! For example, if white light is shone onto a green object most wavelengths are absorbed, while green light is reflected from the object White Light Colours Absorbed Green Light $?&
14 Introduction to Radiometry! Radiometry: measurement of electromagnetic radiation! what the brightness of the point will be! Brightness: informal notion used to describe both scene and image brightness! Scene brightness: related to energy flux emitted (radiated) from a surface! Irradiance: image brightness: related to energy flux incident on the image plane! Image intensity is an under-constrained problem Image Intensities source sensor normal Need to consider light propagation in a cone surface element Image intensities = f ( normal, surface reflectance, illumination ) $@&
15 Radiance source sensor normal surface element Surface Radiance: 2 (watts / m steradian ) Radiance: power per unit foreshortened area emitted into a unit solid angle. L depends on direction Surface can radiate into whole hemisphere. L depends on reflectance properties of surface. Some Observations about Radiance! Function of several properties! Total irradiance (Light Flux (power) incident per unit surface area.)! Surface properties (reflectance as a function of wavelength)! Radiance measures power per unit foreshorten area into a solid angle (watts/square meter)! Total watts (on a light bulb for example) are emitted through 4 PI radians! Lumens (another measure of illumination strength) are related to radiance What about Bi-Directional Reflectance Distribution (BRDF)? $A&
16 Different Scatter Types Backscattering (sun behind observer) of a soybean field. By Don Deering Forwardscattering (sun opposite observer) of a soybean field. Note specular reflection. Left: backscattering (sun behind observer). Right: forwardscattering (sun opposite observer) $B&
17 Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6 Image Sensing! Incoming energy lands on a sensor material responsive to that type of energy and this generates a voltage! Collections of sensors are arranged to capture images Imaging Sensor Line of Image Sensors Array of Image Sensors $C&
18 Charge-coupled device (CCD)! Invented at AT&T Bell Labs back in 1969.! Boyle and Smith received the 2009 Nobel Prize for Physics for their work on CCDs.! Basic operation: 1. Image projected through a lens onto the capacitor array 2. Each capacitor accumulates an electric charge proportional to the light intensity at that location 3. A control circuit causes each capacitor to transfer its contents to its neighbor 4. The last capacitor dumps its charge into a charge amplifier which converts the charge into a voltage 5. The entire array is converted to a sequence of voltages. CCD Filter Each pixel contains a Bayer filter (50% green, 25% red, 25% blue) Bayer pattern mimics the human eye (more rod cells which are sensitive to green) Some cameras can output the Bayer pattern image. Color resolution is lower than the luminance resolution $#&
19 CCDs 3CCDs and Filters! Three-CCDs is another (better) color separation method. Each of the CCDs respond to a particular color.! Disadvantages:! Distortion! intensity of ray, etc. Complementary metal-oxide semiconductor (CMOS)! CMOS! Array of pixel sensors! Each pixel sensor contains a photodetector and an active amplifier! Solves the speed and scalability issues! Consumes less power than a CCD! Less image lag! Can be fabricated much cheaper! Can support image processing functions within the same circuit! Mostly used for cellphones, webcams, security cameras, etc. $!&
20 Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6 Image Acquisition! Images are typically generated by illuminating a scene and absorbing the energy reflected by the objects in that scene Similar concept for CT, X-ray, ultrasound, etc '%&
21 Image Sampling And Quantization! A digital sensor can only measure a limited number of samples at a discrete set of energy levels! Quantization is the process of converting a continuous analogue signal into a digital representation of this signal Sampling: Spatial Domain! = '$&
22 Image Sampling And Quantization Image Sampling And Quantization (cont )! Remember that a digital image is always only an approximation of a real world scene ''&
23 Image Sampling Example original image sampled by a factor of 2 sampled by a factor of 4 sampled by a factor of 8 Sampling and Reconstruction! = '?&
24 Sampling Theorem! This result if known as the Sampling Theorem and is due to Claude Shannon who first discovered it in 1949 A signal can be reconstructed from its samples without loss of information, if the original signal has no frequencies above 1/2 the Sampling frequency! For a given bandlimited function, the rate at which it must be sampled is called the Nyquist Frequency Quantization! The process of constraining / mapping a continuous function to a discrete set of values '@&
25 Image Quantization Example! 256 gray levels (8bits/pixel) 32 gray levels (5 bits/pixel) 16 gray levels (4 bits/pixel)! 8 gray levels (3 bits/pixel) 4 gray levels (2 bits/pixel) 2 gray levels (1 bit/pixel) Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6 'A&
26 PGM format! A popular format for grayscale images (8 bits/pixel)! Closely-related formats are:! PBM (Portable Bitmap), for binary images (1 bit/pixel)! PPM (Portable Pixelmap), for color images (24 bits/pixel) o ASCII or binary (raw) storage ASCI Binary Compression! A 5MP image (e.g 2580x2048) can use 5.3MB+! RAW12: 7.9MB! RAW10: 6.6MB! RAW8: 5.3MB! JPEG: 1.5MB! Full-motion video! 1min at 640x480 => 1.66GB 'B&
27 Approaches to Compression! Redundancy reduction! Remove redundancies in signal to reconstruct a signal of higher information content per bit! Irrelevancy reduction! Omit part of the signal not required by observer! The human visual system may not register small changes in gray values Two main schools of image compression! Lossless! After decompression, reconstructed image is numerically identical to original image! Can only achieve a small amount of compression! Lossy! Discards components of the signal that are known to be redundant! Signal is therefore changed from input! Capable of higher compression rates 'C&
28 Typical Image Coder Source Encoder Quantizer Entropy Encoder Source Encoder Discrete Fourier Transform (DFT) Discrete Cosine Transform (DCT) Discrete Wavelet Transform (DWT) Output Signal Quantizer: Reduce the number of bits needed to store pre-encoded signal Many-to-one: lossy Scalar quantization (SQ): quantize each coefficient Vector quantization (VQ): quantize group of coefficients Entropy Encoder: Further compress quantized values in a lossless manner Build a probability model of each quantized value Re-encode signal based on these probabilities Most commonly used encoders: Huffman, RLE JPEG Block Diagram 8x8 blocks Source Image B G R DCT-based encoding FDCT Quantizer Entropy Encoder Compressed image data Table Table '#&
29 Example Difference BMP (Bitmap)! Use 3 bytes per pixel, one each for R, G, and B! Can represent up to 2 24 = 16.7 million colors! No entropy coding! File size in bytes = 3*length*height, which can be very large! Can use fewer than 8 bits per color, but you need to store the color palette! Performs well with ZIP, RAR, etc. '!&
30 GIF (Graphics Interchange Format)! Can use up to 256 colors from 24-bit RGB color space! If source image contains more than 256 colors, need to reprocess image to fewer colors! Suitable for simpler images such as logos and textual graphics, not so much for photographs! Uses LZW lossless data compression Formation of a Digital Image! Steps: 1. World: reality / geometry 2. Optics: focus light from world onto sensor 3. Sensor: convert light to electrical energy 4. Signal: representation of incident light as continuous electrical energy 5. Digitizer: converts continuous signal to discrete signals 6. Digital Representation: final representation of reality in computer memory (i,j) 6?%&
31 Summary: Image Formation Single-lens Reflex (SLR) Camera! Light comes through lens! Reflected by the mirror! Projected on a focusing screen! Goes through a condensing lends! Reflected by a pentaprism! Shows in the viewfinder! When click:! Mirror moves upwards! Shutter opens! Image projected to sensor?$&
32 Point-and-shoot camera Camera settings 1. Shutter speed 2. Aperture 3. ISO?'&
33 Shutter speed! Term used to discuss exposure time! Length of time a camera s shutter is open! The exposure is proportional to the duration of light reaching the image sensor. Shutter speed??&
34 Aperture! Before light reaches film, it must pass through an opening called an aperture.! The aperture is like a pupil! You can control the aperture by setting the F-Stop Balancing Shutter and Aperture?@&
35 Depth of Field ISO! Indication of how sensitive a film was to light! Lower the number the less sensitivity the camera is to light and the finer the grain in the shots you are taking! Higher ISO setting are generally used in darker situations to get faster shutter speeds, however the cost is noisier shots! Rule of thumb:! ISO : good for very bright outdoor conditions! ISO : is best used in indoors where light is not as bright as outdoors! ISO >800: very dark conditions and often causes a lot of noise?a&
36 ISO Conclusion Image Formation (i,j)?b&
37 Homework #1 What about an image-base coin counter??c&
38 1 Dime 1 Penny 2 Nickels 2 Quarters Total: 71 cents 5 pennys 2 nickels 1 dime 6 quarters Total: $1.75?#&
39 Assumptions and Requirements! Distance between the camera and coins constant! Size (e.g radius) of each individual penny, nickel, dime, quarter very similar (± 3-4 pixels)! Use OpenCV to complete the project! Can use C, C++, Java, or Python! Only you have to test your program in 10/23 images?!&
40 Acknowledgements! Some of the images and diagrams have been taken from the Gonzalez et al, Digital Image Processing
Digital Imaging Rochester Institute of Technology
Digital Imaging 1999 Rochester Institute of Technology So Far... camera AgX film processing image AgX photographic film captures image formed by the optical elements (lens). Unfortunately, the processing
More informationDigital Image Processing
Digital Image Processing Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr Images taken from: R. Gonzalez and R. Woods. Digital Image Processing, Prentice Hall, 2008. Digital Image Processing
More informationDigital Image Fundamentals. Digital Image Processing. Human Visual System. Contents. Structure Of The Human Eye (cont.) Structure Of The Human Eye
Digital Image Processing 2 Digital Image Fundamentals Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr Those who wish to succeed must ask the right preliminary questions Aristotle Images
More informationDigital Image Fundamentals. Digital Image Processing. Human Visual System. Contents. Structure Of The Human Eye (cont.) Structure Of The Human Eye
Digital Image Processing 2 Digital Image Fundamentals Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr Images taken from: R. Gonzalez and R. Woods. Digital Image Processing, Prentice Hall,
More informationCamera Image Processing Pipeline: Part II
Lecture 14: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements
More informationCourse Objectives & Structure
Course Objectives & Structure Digital imaging is at the heart of science, medicine, entertainment, engineering, and communications. This course provides an introduction to mathematical tools for the analysis
More informationDigital Image Processing
Digital Image Processing Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr Images taken from: R. Gonzalez and R. Woods. Digital Image Processing, Prentice Hall, 2008. Digital Image Processing
More informationDr. Shahanawaj Ahamad. Dr. S.Ahamad, SWE-423, Unit-06
Dr. Shahanawaj Ahamad 1 Outline: Basic concepts underlying Images Popular Image File formats Human perception of color Various Color Models in use and the idea behind them 2 Pixels -- picture elements
More informationIMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics
IMAGE FORMATION Light source properties Sensor characteristics Surface Exposure shape Optics Surface reflectance properties ANALOG IMAGES An image can be understood as a 2D light intensity function f(x,y)
More informationCameras. CSE 455, Winter 2010 January 25, 2010
Cameras CSE 455, Winter 2010 January 25, 2010 Announcements New Lecturer! Neel Joshi, Ph.D. Post-Doctoral Researcher Microsoft Research neel@cs Project 1b (seam carving) was due on Friday the 22 nd Project
More informationDigital Image Processing
Digital Image Processing Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr Images taken from: R. Gonzalez and R. Woods. Digital Image Processing, Prentice Hall, 2008. Digital Image Processing
More informationHuman Visual System. Digital Image Processing. Digital Image Fundamentals. Structure Of The Human Eye. Blind-Spot Experiment.
Digital Image Processing Digital Imaging Fundamentals Christophoros Nikou cnikou@cs.uoi.gr 4 Human Visual System The best vision model we have! Knowledge of how images form in the eye can help us with
More informationColorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.
Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Sensors and Image Formation Imaging sensors and models of image formation Coordinate systems Digital
More informationOverview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image
Camera & Color Overview Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Book: Hartley 6.1, Szeliski 2.1.5, 2.2, 2.3 The trip
More informationImages with (a) coding redundancy; (b) spatial redundancy; (c) irrelevant information
Images with (a) coding redundancy; (b) spatial redundancy; (c) irrelevant information 1992 2008 R. C. Gonzalez & R. E. Woods For the image in Fig. 8.1(a): 1992 2008 R. C. Gonzalez & R. E. Woods Measuring
More informationImage acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor
Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the
More informationIntorduction to light sources, pinhole cameras, and lenses
Intorduction to light sources, pinhole cameras, and lenses Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 01003 October 26, 2011 Abstract 1 1 Analyzing
More informationChapter 9 Image Compression Standards
Chapter 9 Image Compression Standards 9.1 The JPEG Standard 9.2 The JPEG2000 Standard 9.3 The JPEG-LS Standard 1IT342 Image Compression Standards The image standard specifies the codec, which defines how
More informationEC-433 Digital Image Processing
EC-433 Digital Image Processing Lecture 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such as a monochrome or color TV camera)
More information15110 Principles of Computing, Carnegie Mellon University
1 Last Time Data Compression Information and redundancy Huffman Codes ALOHA Fixed Width: 0001 0110 1001 0011 0001 20 bits Huffman Code: 10 0000 010 0001 10 15 bits 2 Overview Human sensory systems and
More informationImage Perception & 2D Images
Image Perception & 2D Images Vision is a matter of perception. Perception is a matter of vision. ES Overview Introduction to ES 2D Graphics in Entertainment Systems Sound, Speech & Music 3D Graphics in
More informationGeneral Imaging System
General Imaging System Lecture Slides ME 4060 Machine Vision and Vision-based Control Chapter 5 Image Sensing and Acquisition By Dr. Debao Zhou 1 2 Light, Color, and Electromagnetic Spectrum Penetrate
More informationCamera Image Processing Pipeline: Part II
Lecture 13: Camera Image Processing Pipeline: Part II Visual Computing Systems Today Finish image processing pipeline Auto-focus / auto-exposure Camera processing elements Smart phone processing elements
More informationCSC 170 Introduction to Computers and Their Applications. Lecture #3 Digital Graphics and Video Basics. Bitmap Basics
CSC 170 Introduction to Computers and Their Applications Lecture #3 Digital Graphics and Video Basics Bitmap Basics As digital devices gained the ability to display images, two types of computer graphics
More informationLecture 2 Digital Image Fundamentals. Lin ZHANG, PhD School of Software Engineering Tongji University Fall 2016
Lecture 2 Digital Image Fundamentals Lin ZHANG, PhD School of Software Engineering Tongji University Fall 2016 Contents Elements of visual perception Light and the electromagnetic spectrum Image sensing
More informationImages and Graphics. 4. Images and Graphics - Copyright Denis Hamelin - Ryerson University
Images and Graphics Images and Graphics Graphics and images are non-textual information that can be displayed and printed. Graphics (vector graphics) are an assemblage of lines, curves or circles with
More informationME 6406 MACHINE VISION. Georgia Institute of Technology
ME 6406 MACHINE VISION Georgia Institute of Technology Class Information Instructor Professor Kok-Meng Lee MARC 474 Office hours: Tues/Thurs 1:00-2:00 pm kokmeng.lee@me.gatech.edu (404)-894-7402 Class
More informationCapturing Light in man and machine. Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al.
Capturing Light in man and machine Some figures from Steve Seitz, Steve Palmer, Paul Debevec, and Gonzalez et al. 15-463: Computational Photography Alexei Efros, CMU, Fall 2005 Image Formation Digital
More informationSensors and Sensing Cameras and Camera Calibration
Sensors and Sensing Cameras and Camera Calibration Todor Stoyanov Mobile Robotics and Olfaction Lab Center for Applied Autonomous Sensor Systems Örebro University, Sweden todor.stoyanov@oru.se 20.11.2014
More information15110 Principles of Computing, Carnegie Mellon University
1 Overview Human sensory systems and digital representations Digitizing images Digitizing sounds Video 2 HUMAN SENSORY SYSTEMS 3 Human limitations Range only certain pitches and loudnesses can be heard
More informationWhy learn about photography in this course?
Why learn about photography in this course? Geri's Game: Note the background is blurred. - photography: model of image formation - Many computer graphics methods use existing photographs e.g. texture &
More informationCompression and Image Formats
Compression Compression and Image Formats Reduce amount of data used to represent an image/video Bit rate and quality requirements Necessary to facilitate transmission and storage Required quality is application
More informationImage Acquisition Hardware. Image Acquisition and Representation. CCD Camera. Camera. how digital images are produced
Image Acquisition Hardware Image Acquisition and Representation how digital images are produced how digital images are represented photometric models-basic radiometry image noises and noise suppression
More informationlecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response
lecture 24 image capture - photography: model of image formation - image blur - camera settings (f-number, shutter speed) - exposure - camera response - application: high dynamic range imaging Why learn
More informationUnit 1: Image Formation
Unit 1: Image Formation 1. Geometry 2. Optics 3. Photometry 4. Sensor Readings Szeliski 2.1-2.3 & 6.3.5 1 Physical parameters of image formation Geometric Type of projection Camera pose Optical Sensor
More informationIntroduction to Visual Perception & the EM Spectrum
, Winter 2005 Digital Image Fundamentals: Visual Perception & the EM Spectrum, Image Acquisition, Sampling & Quantization Monday, September 19 2004 Overview (1): Review Some questions to consider Elements
More informationReview. Introduction to Visual Perception & the EM Spectrum. Overview (1):
Overview (1): Review Some questions to consider Winter 2005 Digital Image Fundamentals: Visual Perception & the EM Spectrum, Image Acquisition, Sampling & Quantization Tuesday, January 17 2006 Elements
More informationImage Acquisition and Representation. Camera. CCD Camera. Image Acquisition Hardware
Image Acquisition and Representation Camera Slide 1 how digital images are produced how digital images are represented Slide 3 First photograph was due to Niepce of France in 1827. Basic abstraction is
More informationImage Acquisition and Representation
Image Acquisition and Representation how digital images are produced how digital images are represented photometric models-basic radiometry image noises and noise suppression methods 1 Image Acquisition
More informationCPSC 425: Computer Vision
1 / 55 CPSC 425: Computer Vision Instructor: Fred Tung ftung@cs.ubc.ca Department of Computer Science University of British Columbia Lecture Notes 2015/2016 Term 2 2 / 55 Menu January 7, 2016 Topics: Image
More informationColor Image Processing
Color Image Processing Jesus J. Caban Outline Discuss Assignment #1 Project Proposal Color Perception & Analysis 1 Discuss Assignment #1 Project Proposal Due next Monday, Oct 4th Project proposal Submit
More informationImage Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3
Image Formation Dr. Gerhard Roth COMP 4102A Winter 2015 Version 3 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance
More informationImage Acquisition and Representation. Image Acquisition Hardware. Camera. how digital images are produced how digital images are represented
Image Acquisition and Representation Slide 1 how digital images are produced how digital images are represented Slide 3 Note a digital camera represents a camera system with a built-in digitizer. photometric
More informationAssistant Lecturer Sama S. Samaan
MP3 Not only does MPEG define how video is compressed, but it also defines a standard for compressing audio. This standard can be used to compress the audio portion of a movie (in which case the MPEG standard
More informationA CAMERA IS A LIGHT TIGHT BOX
HOW CAMERAS WORK A CAMERA IS A LIGHT TIGHT BOX Pinhole Principle All contemporary cameras have the same basic features A light-tight box to hold the camera parts and recording material A viewing system
More informationDr F. Cuzzolin 1. September 29, 2015
P00407 Principles of Computer Vision 1 1 Department of Computing and Communication Technologies Oxford Brookes University, UK September 29, 2015 September 29, 2015 1 / 73 Outline of the Lecture 1 2 Basics
More informationDigital Media. Lecture 4: Bitmapped images: Compression & Convolution Georgia Gwinnett College School of Science and Technology Dr.
Digital Media Lecture 4: Bitmapped images: Compression & Convolution Georgia Gwinnett College School of Science and Technology Dr. Mark Iken Bitmapped image compression Consider this image: With no compression...
More informationIntroduction to Digital Photography
Introduction to Digital Photography A CAMERA IS A LIGHT TIGHT BOX All contemporary cameras have the same basic features A light-tight box to hold the camera parts and recording material A viewing system
More informationImages and Colour COSC342. Lecture 2 2 March 2015
Images and Colour COSC342 Lecture 2 2 March 2015 In this Lecture Images and image formats Digital images in the computer Image compression and formats Colour representation Colour perception Colour spaces
More informationImage Processing - Intro. Tamás Szirányi
Image Processing - Intro Tamás Szirányi The path of light through optics A Brief History of Images 1558 Camera Obscura, Gemma Frisius, 1558 A Brief History of Images 1558 1568 Lens Based Camera Obscura,
More informationCHARGE-COUPLED DEVICE (CCD)
CHARGE-COUPLED DEVICE (CCD) Definition A charge-coupled device (CCD) is an analog shift register, enabling analog signals, usually light, manipulation - for example, conversion into a digital value that
More informationDigital Asset Management 2. Introduction to Digital Media Format
Digital Asset Management 2. Introduction to Digital Media Format 2010-09-09 Content content = essence + metadata 2 Digital media data types Table. File format used in Macromedia Director File import File
More informationCGT 511. Image. Image. Digital Image. 2D intensity light function z=f(x,y) defined over a square 0 x,y 1. the value of z can be:
Image CGT 511 Computer Images Bedřich Beneš, Ph.D. Purdue University Department of Computer Graphics Technology Is continuous 2D image function 2D intensity light function z=f(x,y) defined over a square
More informationColor & Compression. Robin Strand Centre for Image analysis Swedish University of Agricultural Sciences Uppsala University
Color & Compression Robin Strand Centre for Image analysis Swedish University of Agricultural Sciences Uppsala University Outline Color Color spaces Multispectral images Pseudocoloring Color image processing
More informationDesign of a digital holographic interferometer for the. ZaP Flow Z-Pinch
Design of a digital holographic interferometer for the M. P. Ross, U. Shumlak, R. P. Golingo, B. A. Nelson, S. D. Knecht, M. C. Hughes, R. J. Oberto University of Washington, Seattle, USA Abstract The
More informationPhotography Help Sheets
Photography Help Sheets Phone: 01233 771915 Web: www.bigcatsanctuary.org Using your Digital SLR What is Exposure? Exposure is basically the process of recording light onto your digital sensor (or film).
More informationMegapixels and more. The basics of image processing in digital cameras. Construction of a digital camera
Megapixels and more The basics of image processing in digital cameras Photography is a technique of preserving pictures with the help of light. The first durable photograph was made by Nicephor Niepce
More informationVC 14/15 TP2 Image Formation
VC 14/15 TP2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline Computer Vision? The Human Visual System
More informationDigital Image Fundamentals
Digital Image Fundamentals Computer Science Department The University of Western Ontario Presenter: Mahmoud El-Sakka CS2124/CS2125: Introduction to Medical Computing Fall 2012 October 31, 2012 1 Objective
More informationVC 16/17 TP2 Image Formation
VC 16/17 TP2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Hélder Filipe Pinto de Oliveira Outline Computer Vision? The Human Visual
More informationChapter 36. Image Formation
Chapter 36 Image Formation Image of Formation Images can result when light rays encounter flat or curved surfaces between two media. Images can be formed either by reflection or refraction due to these
More informationA Digital Camera Glossary. Ashley Rodriguez, Charlie Serrano, Luis Martinez, Anderson Guatemala PERIOD 6
A Digital Camera Glossary Ashley Rodriguez, Charlie Serrano, Luis Martinez, Anderson Guatemala PERIOD 6 A digital Camera Glossary Ivan Encinias, Sebastian Limas, Amir Cal Ivan encinias Image sensor A silicon
More informationFundamentals of Multimedia
Fundamentals of Multimedia Lecture 2 Graphics & Image Data Representation Mahmoud El-Gayyar elgayyar@ci.suez.edu.eg Outline Black & white imags 1 bit images 8-bit gray-level images Image histogram Dithering
More informationChapter 36. Image Formation
Chapter 36 Image Formation Notation for Mirrors and Lenses The object distance is the distance from the object to the mirror or lens Denoted by p The image distance is the distance from the image to the
More informationOverview. Image formation - 1
Overview perspective imaging Image formation Refraction of light Thin-lens equation Optical power and accommodation Image irradiance and scene radiance Digital images Introduction to MATLAB Image formation
More informationVC 11/12 T2 Image Formation
VC 11/12 T2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline Computer Vision? The Human Visual System
More informationCh. 3: Image Compression Multimedia Systems
4/24/213 Ch. 3: Image Compression Multimedia Systems Prof. Ben Lee (modified by Prof. Nguyen) Oregon State University School of Electrical Engineering and Computer Science Outline Introduction JPEG Standard
More informationMULTIMEDIA SYSTEMS
1 Department of Computer Engineering, Faculty of Engineering King Mongkut s Institute of Technology Ladkrabang 01076531 MULTIMEDIA SYSTEMS Pk Pakorn Watanachaturaporn, Wt ht Ph.D. PhD pakorn@live.kmitl.ac.th,
More information2.1. General Purpose Run Length Encoding Relative Encoding Tokanization or Pattern Substitution
2.1. General Purpose There are many popular general purpose lossless compression techniques, that can be applied to any type of data. 2.1.1. Run Length Encoding Run Length Encoding is a compression technique
More informationUNIT 7B Data Representa1on: Images and Sound. Pixels. An image is stored in a computer as a sequence of pixels, picture elements.
UNIT 7B Data Representa1on: Images and Sound 1 Pixels An image is stored in a computer as a sequence of pixels, picture elements. 2 1 Resolu1on The resolu1on of an image is the number of pixels used to
More informationRaster Image File Formats
Raster Image File Formats 1995-2016 Josef Pelikán & Alexander Wilkie CGG MFF UK Praha pepca@cgg.mff.cuni.cz http://cgg.mff.cuni.cz/~pepca/ 1 / 35 Raster Image Capture Camera Area sensor (CCD, CMOS) Colours:
More informationChapter 2: Digital Image Fundamentals. Digital image processing is based on. Mathematical and probabilistic models Human intuition and analysis
Chapter 2: Digital Image Fundamentals Digital image processing is based on Mathematical and probabilistic models Human intuition and analysis 2.1 Visual Perception How images are formed in the eye? Eye
More informationDigital Image Processing Introduction
Digital Processing Introduction Dr. Hatem Elaydi Electrical Engineering Department Islamic University of Gaza Fall 2015 Sep. 7, 2015 Digital Processing manipulation data might experience none-ideal acquisition,
More informationImage Formation. World Optics Sensor Signal. Computer Vision. Introduction to. Light (Energy) Source. Surface Imaging Plane. Pinhole Lens.
Image Formation Light (Energy) Source Surface Imaging Plane Pinhole Lens World Optics Sensor Signal B&W Film Color Film TV Camera Silver Density Silver density in three color layers Electrical Today Optics:
More informationImage Formation and Capture
Figure credits: B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, A. Theuwissen, and J. Malik Image Formation and Capture COS 429: Computer Vision Image Formation and Capture Real world Optics Sensor Devices
More informationDIGITAL IMAGE PROCESSING (COM-3371) Week 2 - January 14, 2002
DIGITAL IMAGE PROCESSING (COM-3371) Week 2 - January 14, 22 Topics: Human eye Visual phenomena Simple image model Image enhancement Point processes Histogram Lookup tables Contrast compression and stretching
More informationCommunication Graphics Basic Vocabulary
Communication Graphics Basic Vocabulary Aperture: The size of the lens opening through which light passes, commonly known as f-stop. The aperture controls the volume of light that is allowed to reach the
More informationImage Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1
Image Formation Dr. Gerhard Roth COMP 4102A Winter 2014 Version 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance
More informationQ A bitmap file contains the binary on the left below. 1 is white and 0 is black. Colour in each of the squares. What is the letter that is reve
R 25 Images and Pixels - Reading Images need to be stored and processed using binary. The simplest image format is for an image to be stored as a bitmap image. Bitmap images are made up of picture elements
More informationIntroduction
Introduction Lecturer: Dr. Hossam Hassan Email : hossameldin.hassan@eng.asu.edu.eg Computers and Systems Engineering Essential Books 1. Digital Image Processing Rafael Gonzalez and Richard Woods, Third
More informationOFFSET AND NOISE COMPENSATION
OFFSET AND NOISE COMPENSATION AO 10V 8.1 Offset and fixed pattern noise reduction Offset variation - shading AO 10V 8.2 Row Noise AO 10V 8.3 Offset compensation Global offset calibration Dark level is
More informationLENSES. INEL 6088 Computer Vision
LENSES INEL 6088 Computer Vision Digital camera A digital camera replaces film with a sensor array Each cell in the array is a Charge Coupled Device light-sensitive diode that converts photons to electrons
More informationCS 376b Computer Vision
CS 376b Computer Vision 09 / 03 / 2014 Instructor: Michael Eckmann Today s Topics This is technically a lab/discussion session, but I'll treat it as a lecture today. Introduction to the course layout,
More informationUNIT 7C Data Representation: Images and Sound
UNIT 7C Data Representation: Images and Sound 1 Pixels An image is stored in a computer as a sequence of pixels, picture elements. 2 1 Resolution The resolution of an image is the number of pixels used
More informationImage Formation: Camera Model
Image Formation: Camera Model Ruigang Yang COMP 684 Fall 2005, CS684-IBMR Outline Camera Models Pinhole Perspective Projection Affine Projection Camera with Lenses Digital Image Formation The Human Eye
More informationF-number sequence. a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity,
1 F-number sequence a change of f-number to the next in the sequence corresponds to a factor of 2 change in light intensity, 0.7, 1, 1.4, 2, 2.8, 4, 5.6, 8, 11, 16, 22, 32, Example: What is the difference
More informationCS 262 Lecture 01: Digital Images and Video. John Magee Some material copyright Jones and Bartlett
CS 262 Lecture 01: Digital Images and Video John Magee Some material copyright Jones and Bartlett 1 Overview/Questions What is digital information? What is color? How do pictures get encoded into binary
More informationImage and Video Processing
Image and Video Processing () Image Representation Dr. Miles Hansard miles.hansard@qmul.ac.uk Segmentation 2 Today s agenda Digital image representation Sampling Quantization Sub-sampling Pixel interpolation
More informationCSCE 763: Digital Image Processing
CSCE 763: Digital Image Processing Spring 2018 Yan Tong Department of Computer Science and Engineering University of South Carolina Today s Agenda Welcome Tentative Syllabus Topics covered in the course
More informationDigital Image Processing
Part 1: Course Introduction Achim J. Lilienthal AASS Learning Systems Lab, Dep. Teknik Room T1209 (Fr, 11-12 o'clock) achim.lilienthal@oru.se Course Book Chapters 1 & 2 2011-04-05 Contents 1. Introduction
More informationTSBB09 Image Sensors 2018-HT2. Image Formation Part 1
TSBB09 Image Sensors 2018-HT2 Image Formation Part 1 Basic physics Electromagnetic radiation consists of electromagnetic waves With energy That propagate through space The waves consist of transversal
More informationApplications of Optics
Nicholas J. Giordano www.cengage.com/physics/giordano Chapter 26 Applications of Optics Marilyn Akins, PhD Broome Community College Applications of Optics Many devices are based on the principles of optics
More informationHybrid Coding (JPEG) Image Color Transform Preparation
Hybrid Coding (JPEG) 5/31/2007 Kompressionsverfahren: JPEG 1 Image Color Transform Preparation Example 4: 2: 2 YUV, 4: 1: 1 YUV, and YUV9 Coding Luminance (Y): brightness sampling frequency 13.5 MHz Chrominance
More informationB.Digital graphics. Color Models. Image Data. RGB (the additive color model) CYMK (the subtractive color model)
Image Data Color Models RGB (the additive color model) CYMK (the subtractive color model) Pixel Data Color Depth Every pixel is assigned to one specific color. The amount of data stored for every pixel,
More informationCPSC 4040/6040 Computer Graphics Images. Joshua Levine
CPSC 4040/6040 Computer Graphics Images Joshua Levine levinej@clemson.edu Lecture 04 Displays and Optics Sept. 1, 2015 Slide Credits: Kenny A. Hunt Don House Torsten Möller Hanspeter Pfister Agenda Open
More informationUnit 1 DIGITAL IMAGE FUNDAMENTALS
Unit 1 DIGITAL IMAGE FUNDAMENTALS What Is Digital Image? An image may be defined as a two-dimensional function, f(x, y), where x and y are spatial (plane) coordinates, and the amplitude of f at any pair
More informationComputer Vision Introduction or
Computer Vision Introduction http://www.ugrad.cs.jhu.edu/~cs461 or http://cirl.lcsr.jhu.edu/vision_syllabus Professor Hager http://www.cs.jhu.edu/~hager Outline for Today Outline and Organization of the
More informationModule 6 STILL IMAGE COMPRESSION STANDARDS
Module 6 STILL IMAGE COMPRESSION STANDARDS Lesson 16 Still Image Compression Standards: JBIG and JPEG Instructional Objectives At the end of this lesson, the students should be able to: 1. Explain the
More informationBasic principles of photography. David Capel 346B IST
Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse
More informationChapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing
Chapters 1 & 2 Chapter 1: Photogrammetry Definitions and applications Conceptual basis of photogrammetric processing Transition from two-dimensional imagery to three-dimensional information Automation
More information