PRACTICAL IMAGE AND VIDEO PROCESSING USING MATLAB

Transcription

1 PRACTICAL IMAGE AND VIDEO PROCESSING USING MATLAB OGE MARQUES Florida Atlantic University *IEEE IEEE PRESS WWILEY A JOHN WILEY & SONS, INC., PUBLICATION

2 CONTENTS LIST OF FIGURES LIST OF TABLES FOREWORD PREFACE ACKNOWLEDGMENTS xxi xxxix xli xliii xlix PART I IMAGE PROCESSING 1 INTRODUCTION AND OVERVIEW Motivation / Basic Concepts and Terminology / Examples of Typical Image Processing Operations / Components of a Digital Image Processing System / Machine Vision Systems / Resources / Problems / 18 2 IMAGE PROCESSING BASICS Digital Image Representation / Binary (1-Bit) Images / 23 vii

3 V I II CONTENTS Gray-Level (8-Bit) Images / Color Images / Compression / Image File Formats / Basic Terminology / Overview of Image Processing Operations / Global (Point) Operations / Neighborhood-Oriented Operations / Operations Combining Multiple Images / Operations in a Transform Domain / 32 3 MATLAB BASICS Introduction to MATLAB / Basic Elements of MATLAB / Working Environment / Data Types / Array and Matrix Indexing in MATLAB / Standard Arrays / Command-Line Operations / Programming Tools: Scripts and Functions / M-Files / Operators / Important Variables and Constants / Number Representation / Flow Control / Code Optimization / Input and Output / Graphics and Visualization / Tutorial 3.1: MATLAB a Guided Tour / Tutorial 3.2: MATLAB Data Structures / Tutorial 3.3: Programming in MATLAB / Problems / 59 4 THE IMAGE PROCESSING TOOLBOX AT A GLANCE The Image Processing Toolbox: an Overview / Essential Functions and Features / Displaying Information About an Image File / Reading an Image File / 64

4 CONTENTS ix Data Classes and Data Conversions / Displaying the Contents of an Image / Exploring the Contents of an Image / Writing the Resulting Image onto a File / Tutorial 4.1: MATLAB Image Processing Toolbox a Guided Tour / Tutorial 4.2: Basic Image Manipulation / Problems / 80 5 IMAGE SENSING AND ACQUISITION Introduction / Light, Color, and Electromagnetic Spectrum / Light and Electromagnetic Spectrum / Types of Images / Light and Color Perception / Color Encoding and Representation / Image Acquisition / Image Sensors / Camera Optics / Image Digitization / Sampling / Quantization / Spatial and Gray-Level Resolution / Problems / ARITHMETIC AND LOGIC OPERATIONS Arithmetic Operations. Fundamentals and Applications / Addition / Subtraction / Multiplication and Division / Combining Several Arithmetic Operations / Logic Operations: Fundamentals and Applications / Tutorial 6.1: Arithmetic Operations / Tutorial 6.2: Logic Operations and Region of Interest Processing / Problems / 122

5 X CONTENTS 7 GEOMETRIC OPERATIONS Introduction / Mapping and Affine Transformations / Interpolation Methods / The Need for Interpolation / A Simple Approach to Interpolation / Zero-Order (Nearest-Neighbor) Interpolation / First-Order (Bilinear) Interpolation / Higher Order Interpolations / Geometric Operations Using MATLAB / Zooming, Shrinking, and Resizing / Translation / Rotation / Cropping / Flipping / Other Geometric Operations and Applications / Warping / Nonlinear Image Transformations / Morphing / Seam Carving / Image Registration / Tutorial 7.1: Image Cropping, Resizing, Flipping, and Rotation / Tutorial 7.2: Spatial Transformations and Image Registration / Problems / GRAY-LEVEL TRANSFORMATIONS Introduction / Overview of Gray-level (Point) Transformations / Examples of Point Transformations / Contrast Manipulation / Negative / Power Law (Gamma) Transformations / Log Transformations / Piecewise Linear Transformations / Specifying the Transformation Function / Tutorial 8.1: Gray-level Transformations / Problems / 169

6 CONTENTS Xi 9 HISTOGRAM PROCESSING Image Histogram: Definition and Example / Computing Image Histograms / Interpreting Image Histograms / Histogram Equalization / Direct Histogram Specification / Other Histogram Modification Techniques / Histogram Sliding / Histogram Stretching / Histogram Shrinking / Tutorial 9.1: Image Histograms / Tutorial 9.2: Histogram Equalization and Specification / Tutorial 9.3: Other Histogram Modification Techniques / Problems / NEIGHBORHOOD PROCESSING Neighborhood Processing / Convolution and Correlation / Convolution in the One-Dimensional Domain / Convolution in the Two-Dimensional Domain / Correlation / Dealing with Image Borders / Image Smoothing (Low-pass Filters) / Mean Filter / Variations / Gaussian Blur Filter / Median and Other Nonlinear Filters / Image Sharpening (High-pass Filters) / The Laplacian / Composite Laplacian Mask / Directional Difference Filters / Unsharp Masking / High-Boost Filtering / Region of Interest Processing / Combining Spatial Enhancement Methods / Tutorial 10.1: Convolution and Correlation / Tutorial 10.2: Smoothing Filters in the Spatial Domain / 225

7 xii CONTENTS 10.9 Tutorial 10.3: Sharpening Filters in the Spatial Domain / Problems / FREQUENCY-DOMAIN FILTERING Introduction / Fourier Transform: the Mathematical Foundation / Basic Concepts / The 2D Discrete Fourier Transform: Mathematical Formulation / Summary of Properties of the Fourier Transform / Other Mathematical Transforms / Low-pass Filtering / Ideal LPF / Gaussian LPF / Butterworth LPF / High-pass Filtering / Ideal HPF / Gaussian HPF / Butterworth HPF / High-Frequency Emphasis / Tutorial 11.1: 2D Fourier Transform / Tutorial 11.2: Low-pass Filters in the Frequency Domain / Tutorial 11.3: High-pass Filters in the Frequency Domain / Problems / IMAGE RESTORATION Modeling of the Image Degradation and Restoration Problem / Noise and Noise Models / Selected Noise Probability Density Functions / Noise Estimation / Noise Reduction Using Spatial-domain Techniques / Mean Filters / Order Statistic Filters / Adaptive Filters / Noise Reduction Using Frequency-domain Techniques / Periodic Noise / Bandreject Filter / Bandpass Filter / 281

8 CONTE NTS XIII Notch Filter / Image Deblurring Techniques / Wiener Filtering / Tutorial 12.1: Noise Reduction Using Spatial-domain Techniques / Problems / MORPHOLOGICAL IMAGE PROCESSING Introduction / Fundamental Concepts and Operations / The Structuring Element / Dilation and Erosion / Dilation / Erosion / Compound Operations / Opening / Closing / Hit-or-Miss Transform / Morphological Filtering / Basic Morphological Algorithms / Boundary Extraction / Region Filling / Extraction and Labeling of Connected Components / Grayscale Morphology / Dilation and Erosion / Opening and Closing / Top-Hat and Bottom-Hat Transformations / Tutorial 13.1: Binary Morphological Image Processing / Tutorial 13.2: Basic Morphological Algorithms / Problems / EDGE DETECTION Formulation of the Problem / Basic Concepts / First-order Derivative Edge Detection / Second-order Derivative Edge Detection / Laplacian of Gaussian / The Canny Edge Detector / 347

9 xiv CONTENTS 14.6 Edge Linking and Boundary Detection / The Hough Transform / Tutorial 14.1: Edge Detection / Problems / IMAGE SEGMENTATION Introduction / Intensity-based Segmentation / Image Thresholding / Global Thresholding / The Impact of Illumination and Noise an Thresholding / Local Thresholding / Region-based Segmentation / Region Growing / Region Splitting and Merging / Watershed Segmentation / The Distance Transform / Tutorial 15.1: Image Thresholding / Problems / COLOR IMAGE PROCESSING The Psychophysics of Color / Basic Concepts / The CIE XYZ Chromaticity Diagram / Perceptually Uniform Color Spaces / ICC Profiles / Color Models / The RGB Color Model / The CMY and CMYK Color Models / The HSV Color Model / The YIQ (NTSC) Color Model / The YCbCr Color Model / Representation of Color Images in MATLAB / RGB Images / Indexed Images / Pseudocolor Image Processing / Intensity Slicing / 406

10 CONTENTS XV Gray Level to Color Transformations / Pseudocoloring in the Frequency Domain / Full-color Image Processing / Color Transformations / Histogram Processing / Color Image Smoothing and Sharpening / Color Noise Reduction / Color-Based Image Segmentation / Color Edge Detection / Tutorial 16.1: Pseudocolor Image Processing / Tutorial 16.2: Full-color Image Processing / Problems / IMAGE COMPRESSION AND CODING Introduction / Basic Concepts / Redundancy / Image Encoding and Decoding Model / Lossless and Lossy Compression Techniques / Lossless Compression Techniques / Lossy Compression Techniques / Image Compression Standards / Binary Image Compression Standards / Continuous Tone Still Image Compression Standards / JPEG / JPEG 2000 / JPEG-LS / Image Quality Measures / Subjective Quality Measurement / Objective Quality Measurement / Tutorial 17.1: Image Compression / FEATURE EXTRACTION AND REPRESENTATION Introduction / Feature Vectors and Vector Spaces / Invariance and Robustness / Binary Object Features / 450

11 xvi CONTENTS Area / Centroid / Axis of Least Second Moment / Projections / Euler Number / Perimeter / Thinness Ratio / Eccentricity / Aspect Ratio / Moments / Boundary Descriptors / Chain Code, Freeman Code, and Shape Number / Signatures / Fourier Descriptors / Histogram-based (Statistical) Features / Texture Features / Tutorial 18.1: Feature Extraction and Representation / Problems / VISUAL PATTERN RECOGNITION Introduction / Fundamentals / Design and Implementation of a Visual Pattern Classifier / Patterns and Pattern Classes / Data Preprocessing / Training and Test Sets / Confusion Matrix / System Errors / Hit Rates, False Alarm Rates, and ROC Curves / Precision and Recall / Distance and Similarity Measures / Statistical Pattern Classification Techniques / Minimum Distance Classifier / k-nearest Neighbors Classifier / Bayesian Classifier / Tutorial 19.1: Pattern Classification / Problems / 497

12 CONTENTS xvii PART II VIDEO PROCESSING 20 VIDEO FUNDAMENTALS Basic Concepts and Terminology / Monochrome Analog Video / Analog Video Raster / Blanking Intervals / Synchronization Signals / Spectral Content of Composite Monochrome Analog Video / Color in Video / Analog Video Standards / NTSC / PAL / SECAM / HDTV / Digital Video Basics / Advantages of Digital Video / Parameters of a Digital Video Sequence / The Audio Component / Analog-to-Digital Conversion / Color Representation and Chroma Subsampling / Digital Video Formats and Standards / The Rec. 601 Digital Video Format / The Common Intermediate Format / The Source Intermediate Format / Video Compression Techniques and Standards / Video Compression Standards, Codecs, and Containers / Video Processing in MATLAB / Reading Video Files / Processing Video Files / Playing Video Files / Writing Video Files / Tutorial 20.1: Basic Digital Video Manipulation in MATLAB / Tutorial 20.2: Working with YUV Video Data / Problems / 539

13 xviii CONTENTS 21 VIDEO SAMPLING RATE AND STANDARDS CONVERSION Video Sampling / Sampling Rate Conversion / Standards Conversion / Deinterlacing / Conversion between PAL and NTSC Signals / Color Space Conversion / Aspect Ratio Conversion / :2 Pull-Down / Tutorial 21.1: Line Down-Conversion / Tutorial 21.2: Deinterlacing / Tutorial 21.3: NTSC to PAL Conversion / Tutorial 21.4: 3:2 Pull-Down / Problems / DIGITAL VIDEO PROCESSING TECHNIQUES AND APPLICATIONS Fundamentals of Motion Estimation and Motion Compensation / General Methodologies in Motion Estimation / Motion Representation / Motion Estimation Criteria / Optimization Methods / Motion Estimation Algorithms / Exhaustive Search Block Matching Algorithm / Fast Algorithms / Hierarchical Block Matching Algorithm / Phase Correlation Method / Video Enhancement and Noise Reduction / Noise Reduction in Video / Interframe Filtering Techniques / Case Study: Object Segmentation and Tracking in the Presence of Complex Background / Tutorial 22.1: Block-based Motion Estimation / Tutorial 22.2: Intraframe and Interframe Filtering Techniques / Problems / 589

14 CONTENTS xix Appendix A: HUMAN VISUAL PERCEPTION 591 A.1 Introduction / 591 A.2 The Human Eye / 592 A.3 Characteristics of Human Vision / 596 A.3.1 Resolution, Viewing Distance, and Viewing Angle / 596 A.3.2 Detail and Sharpness Perception / 598 A.3.3 Optical Transfer Function and Modulation Transfer Function / 599 A.3.4 Brightness Perception / 600 A.3.5 Contrast Ratio and Contrast Sensitivity Function / 603 A.3.6 Perception of Motion / 605 A.3.7 Spatiotemporal Resolution and Frequency Response / 606 A.3.8 Masking / 608 A.4 Implications and Applications of Knowledge about the Human Visual System / 609 Appendix B: GUI DEVELOPMENT 611 B.1 Introduction / 611 B.2 GUI File Structure / 611 B.3 Passing System Control / 613 B.4 The UserData Object / 615 B.5 A Working GUI Demo / 616 B.6 Concluding Remarks / 618 REFERENCES 619 INDEX 627