Periodic Comparison Method for Defects Inspection of TFT-LCD Panel

Similar documents
Machine Vision for the Life Sciences

CUDA 를활용한실시간 IMAGE PROCESSING SYSTEM 구현. Chang Hee Lee

PCB Fault Detection by Image Processing Tools: A Review

Maturity Detection of Fruits and Vegetables using K-Means Clustering Technique

Smart Vision Chip Fabricated Using Three Dimensional Integration Technology

Image Recognition for PCB Soldering Platform Controlled by Embedded Microchip Based on Hopfield Neural Network

Automatic Crack Detection on Pressed panels using camera image Processing

Research on 3-D measurement system based on handheld microscope

MEASURING HEAD-UP DISPLAYS FROM 2D TO AR: SYSTEM BENEFITS & DEMONSTRATION Presented By Matt Scholz November 28, 2018

Automatic Licenses Plate Recognition System

Algorithm for Detection and Elimination of False Minutiae in Fingerprint Images

Malaysian Car Number Plate Detection System Based on Template Matching and Colour Information

Automatic mura detection based on thresholding the fused normalized first and second derivatives in four directions

Integrated Digital System for Yarn Surface Quality Evaluation using Computer Vision and Artificial Intelligence

Iris Recognition using Histogram Analysis

New Spatial Filters for Image Enhancement and Noise Removal

Bare PCB Inspection and Sorting System

AN ADAPTIVE MORPHOLOGICAL FILTER FOR DEFECT DETECTION IN EDDY

Image Manipulation Detection using Convolutional Neural Network

ME 6406 MACHINE VISION. Georgia Institute of Technology

Number Plate Detection with a Multi-Convolutional Neural Network Approach with Optical Character Recognition for Mobile Devices

CHAPTER-4 FRUIT QUALITY GRADATION USING SHAPE, SIZE AND DEFECT ATTRIBUTES

LED Backlight Driving Circuits and Dimming Method

Quality Control of PCB using Image Processing

A smooth tracking algorithm for capacitive touch panels

Analog Circuit for Motion Detection Applied to Target Tracking System

Detection of Bare PCB Defects by Image Subtraction Method using Machine Vision

FPGA based Real-time Automatic Number Plate Recognition System for Modern License Plates in Sri Lanka

Experiments with An Improved Iris Segmentation Algorithm

Automatic optical measurement of high density fiber connector

Design of High-Precision Infrared Multi-Touch Screen Based on the EFM32

Elemental Image Generation Method with the Correction of Mismatch Error by Sub-pixel Sampling between Lens and Pixel in Integral Imaging

Touchless Fingerprint Recognization System

LCOS Devices for AR Applications

Automated License Plate Recognition for Toll Booth Application

An ambient-light sensor system with startup. correction, LTPS TFT, LCD

Implementation of Barcode Localization Technique using Morphological Operations

Face Detection System on Ada boost Algorithm Using Haar Classifiers

An Improved Bernsen Algorithm Approaches For License Plate Recognition

Vehicle Detection using Images from Traffic Security Camera

This paper is part of the following report: UNCLASSIFIED

NSERC Summer Project 1 Helping Improve Digital Camera Sensors With Prof. Glenn Chapman (ENSC)

Intelligent Nighttime Video Surveillance Using Multi-Intensity Infrared Illuminator

Restoration of Degraded Historical Document Image 1

Adaptive Fingerprint Binarization by Frequency Domain Analysis

AUTOMATIC INSPECTION SYSTEM FOR CMOS CAMERA DEFECT. Byoung-Wook Choi*, Kuk Won Ko**, Kyoung-Chul Koh***, Bok Shin Ahn****

The study of combining hive-grid target with sub-pixel analysis for measurement of structural experiment

Simultaneous Capturing of RGB and Additional Band Images Using Hybrid Color Filter Array

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

Electronically tunable fabry-perot interferometers with double liquid crystal layers

Volume 7, Issue 5, May 2017

Preprocessing and Segregating Offline Gujarati Handwritten Datasheet for Character Recognition

PRODUCT GUIDE Vision software from the world leader.

Digital Imaging Systems for Historical Documents

Background. Computer Vision & Digital Image Processing. Improved Bartlane transmitted image. Example Bartlane transmitted image

Iris Recognition using Hamming Distance and Fragile Bit Distance

APPLICATION OF COMPUTER VISION FOR DETERMINATION OF SYMMETRICAL OBJECT POSITION IN THREE DIMENSIONAL SPACE

PERFORMANCE CHARACTERIZATION OF AMORPHOUS SILICON DIGITAL DETECTOR ARRAYS FOR GAMMA RADIOGRAPHY

Real Time Yarn Characterization and Data Compression Using Wavelets. INVESTIGATORS : Moon W. Suh, Warren Jasper and Jae L.

Fuzzy Logic Based Robot Navigation In Uncertain Environments By Multisensor Integration

A Training Based Approach for Vehicle Plate Recognition (VPR)

Proceedings of the 6th WSEAS International Conference on Multimedia Systems & Signal Processing, Hangzhou, China, April 16-18, 2006 (pp )

Simple Impulse Noise Cancellation Based on Fuzzy Logic

License Plate Localisation based on Morphological Operations

Applications of Flash and No-Flash Image Pairs in Mobile Phone Photography

Research on Pupil Segmentation and Localization in Micro Operation Hu BinLiang1, a, Chen GuoLiang2, b, Ma Hui2, c

Color Image Segmentation in RGB Color Space Based on Color Saliency

FEATURE. Adaptive Temporal Aperture Control for Improving Motion Image Quality of OLED Display

Defense Technical Information Center Compilation Part Notice

Trichroic prism assembly for separating and recombining colors in a compact projection display

Image Processing and Particle Analysis for Road Traffic Detection

THREE DIMENSIONAL FLASH LADAR FOCAL PLANES AND TIME DEPENDENT IMAGING

A New Auto Exposure System to Detect High Dynamic Range Conditions Using CMOS Technology

Session 9.1 SID2010 May 25 th, Sep Lyu Jae Jin. Samsung Electronics

SURVEILLANCE SYSTEMS WITH AUTOMATIC RESTORATION OF LINEAR MOTION AND OUT-OF-FOCUS BLURRED IMAGES. Received August 2008; accepted October 2008

Detection and Verification of Missing Components in SMD using AOI Techniques

Implementation of Adaptive Coded Aperture Imaging using a Digital Micro-Mirror Device for Defocus Deblurring

Rotation/ scale invariant hybrid digital/optical correlator system for automatic target recognition

The End of Thresholds: Subwavelength Optical Linewidth Measurement Using the Flux-Area Technique

Automatic Locating the Centromere on Human Chromosome Pictures

Available online at ScienceDirect. Ehsan Golkar*, Anton Satria Prabuwono

Weld gap position detection based on eddy current methods with mismatch compensation

AUTOMATIC ATIC PCB DEFECT DETECTION USING IMAGE SUBTRACTION METHOD

Filtering and Processing IR Images of PV Modules

Night-time pedestrian detection via Neuromorphic approach

Congress Best Paper Award

Supplementary Figure 1. Schematic setup for preparation of a splay aligned film. (i)

A moment-preserving approach for depth from defocus

Research of an Algorithm on Face Detection

Using Frequency-weighted data fusion to improve performance of digital charge amplifier

Detail preserving impulsive noise removal

Effects of the Unscented Kalman Filter Process for High Performance Face Detector

8.2 IMAGE PROCESSING VERSUS IMAGE ANALYSIS Image processing: The collection of routines and

Surface Defect Detection for Some Ghanaian Textile Fabrics using Moire Interferometry

Global and Local Quality Measures for NIR Iris Video

Lane Detection in Automotive

ELECTRICAL CONTROL DESIGN FOR DRIVING SYSTEM OF SERVO MOTOR

Development of an optical inspection platform for surface defect detection in touch panel glass

Automatic Ground Truth Generation of Camera Captured Documents Using Document Image Retrieval

Implementation of Band Pass Filter for Homomorphic Filtering Technique

Transcription:

Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 279 Periodic Comparison Method for Defects Inspection of TFT-LCD Panel KYONG-MIN LEE*, MOON SOO CHANG**, POOGYEON PARK*** Division of Electrical and Computer Engineering, Pohang University of Science and Technology, Pohang, 790-784, KOREA e-mail : *yiren@postech.ac.kr, **gravi@postech.ac.kr, ***ppg@posteck.ac.kr Abstract: - In this paper, we propose a novel defects inspection algorithm for TFT-LCD panels. We first compensate the distorted image caused by poor illumination circumstances, and compare it with the reference pattern to inspect the arrangement of the pattern on the panel. Based on the reference frame, an error value image map that shows the distribution of defects is finally obtained. The simulation example shows that our algorithm not only inspects the LCD defects well, but also is robust to the 1-pixel error. Key-Words: - comparison, defect, etching transistor, inspection, pattern, PCRF, TFT-LCD 1 Introduction Recently, the Liquid-Crystal Displays (LCD) device using Thin-Film Transistors (TFTs) is to find a large market as display devices for personal computers and TV. It is now important to reduce the fabrication cost and improve the quality of goods. Thus, automatic defect inspection systems become more important in industrial production lines. These defect inspections are used not only in TFTs but also in other fields like web material, which can be divided into two classes. One is uniform, which is a region defect that differs from the background. Therefore, simple algorithms are developed such as threshold method, tracking, and delta tracker to be used to detect the defects [7, 8]. Another is textured with methods such as subtraction [8], template matching, Fourier transform, 1D AR (One-Dimensional Auto Regression) [7, 9], fuzzy logic [10], neural network [11], and Cellular Neural Network [12]-[15], etc. With these methods, many papers have proposed to detect the defects of color filter in the TFT-LCD panel [1, 2]. They used the image subtraction. ( fuzzy neural network approach [3, 4], defect detection method based on saliency map model [5], etc ) The advance of TFT-LCD panel technology causes a constraint with optical limitation to defect an inspection image system. The pattern size of TFTs is becoming smaller and the inspection image areas are becoming larger than before.. Therefore, the system is required to have both high precision and high speed [17]. Due to this situation, several methods have been studied, but they need precise image alignment without 1-pixel error [18]-[20]. However, when TFT-LCD panel image is inspected, it cannot avoid slightly distorted or rotated misalignment. Many researches have overcome this impractical problem by using an advanced method without high precision image [21]. But the more complex methods require the more computational cost. In this paper, we are interested in defect inspection in the area of etching transistor part of TFT-LCD panel. But there are a few papers in this area. In [16], a pattern matching method is used for inspection of etching transistor part of TFT-LCD. We introduce a new inspection method named PCRF, which has a simple calculation method.. The outline of this paper is as follows. Section 2 describes the acquirement environment of etching. Section 3 proposes the new PCRF algorithm. Section 4 presents simulations and results. Finally, conclusions are summarized in the last section. 2 Environment of Image Acquisition As the TFT-LCD becomes larger, a high resolution inspection system is required. But, practical issues, such as cost of production, lead us to find more efficient algorithms that work well with relatively low resolution images. 2.1 Illumination The inspected image containing etching transistors is distorted by light source illumination. This uneven

Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 280 illumination causes fatal errors in the defect inspection method. The center of the image is brighter than the edge as shown in Fig.7. Fig.7 is taken from an inspection system of TFT-LCD production line. 2.2 Characteristics of TFT-LCD Panel Image A TFT-LCD panel has numerous cells that consist of etching transistor. We could obtain similar sequential images because environment of acquisition is hardly changed. Since, each cell on the image is almost identical, we could know the size and the shape of cells.. The inspected image (Fig.7) has many 1-pixel errors, caused by low resolution. Owing to the environment of acquisition, the corresponding line of two transistor cells is not exactly identical as shown in Fig..1. A line in Fig.1 (a) has 2-pixel in widths, but not in Fig.1 (b). 3.2 Pattern Search To decrease the searching time, we shall resize the inspected image by half though sampling method. Next, we obtain the start point by using reference pattern image in restricted searching area with preliminary image information such as repetition period, total image size and cell size. Then we can obtain the precise location of repeated pattern image using template matching (shaded region in Fig.2 (b)).. Since we know the repetition period a priori, we only need to search small expected regions instead of the whole image area (shaded region in Fig.2 (c)). Finally, we can obtain the starting points of the pattern in the whole region (circles in Fig.3). (a) 2-pixel line (b) 1-pixel line Fig.1 ±1 Pixel Error 3 Proposed Algorithm In 3.1, we compensate the distorted image that is introduced in Section 2.1. Then, we compare the compensated image with the reference pattern to inspect the arrangement of the patterns that are located periodically by the characteristics of TFT-LCD panel. Finally, we find the defects by comparison method in Section 3.3. 3.1 Compensation of Illumination The poor illumination makes the inspected image useless in raw as shown in Fig.7. To solve the problem, we first obtain the gray level of 1-pixel line from the inspected image (Fig.9 (a)). The higher the value, the brighter the image. Here, the red line is a polynomial curve generated in the least mean squares sense. We calculate the average of the curve and utilize it as a reference axis to reverse the curve. Then, we can obtain compensated image Fig.9 (b) by adding the result to the original image. Fig.2 Pattern Searching Method Fig.3 Starting Point of The Pattern

Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 281 3.3 Generation of Reference Frame When each pattern is compared, low resolution image causes many problems. For example, the 1-pixel error value can be bigger than the real defect value. To avoid this problem, we need a kind of region-dependant threshold values. Now, we shall design a method that generates them instantly for given images. First, we should collect some clean patterns which do not include any defect. Next, we calculate the difference of each collected image. The reference frame is calculated by the following equation. I th (x,y) = max (I i (x,y) I j (x,y)), (1) i, j = 1,2,, n where I th is the reference frame for comparison, and I k is k-th clean image.. There are n clean images. Unfortunately, they have 1-pixel errors by nature and we have to modify them. Prior to the comparison, we shall blur the reference frame to make the image robust to the 1-pixel errors.. There are many blurring methods available in the literature and we have used the Gaussian filter in MATLAB. (a) Error pixel (b) 1-pixel error Eliminated Fig.5 Indicate Defect of Image 4 Simulation We compare the simple comparison method, which subtracts the clean image from the original image, with the proposed method. Since the simple comparison method is too sensitive to the 1-pixel errors, it overestimates them as LCD defects and even does not find the real defects correctly. However, our method finds all the defects and filters out the 1-pixel errors clearly. (a) Original image (a) Before blurring (b) After blurring Fig.4 Reference Frame After generating the blurred reference frame I th, each repeated cell of the inspected image, T i, is compared to one of the clean image, I, and the error value image map, E-map, is calculated by the following operation. Here, p indicates an appropriate constant value that is dependant upon the target images. If abs (I(x, y) T i (x, y)) > p*i th (x, y) Then, E-map i (x, y) = true Else Then, E-map i (x, y) = false End We remark that the 1-pixel errors in Fig.5 (a) should be discarded since they may come from the environment of acquisition, i.e. mechanical or optical errors. Finally, we obtain the defects as shown in Fig.5 (b). (b) Inspected result by the simple comparison (c) Inspected result by the proposed comparison Fig.6 Results of Inspection 5 Conclusion In this paper, we proposed a novel defects inspection algorithm for TFT-LCD panels. We first compensated the distorted image caused by poor illumination circumstances, and compared it with the reference pattern to inspect the arrangement of the pattern on the panel. Based on the reference frame, an error value

Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 282 image map that shows the distribution of defects was finally obtained. The simulation example showed that our algorithm not only inspects the LCD defects well, but also is robust to the 1-pixel error.. Acknowledgements This work was supported by the center for Broadband OFDM Mobile Access (BrOMA) at POSTECH through the ITRC program of the Korean MIC, supervised by IITA. (IITA-2006-C1090-0603- 0037) References: [1] J. H. Kim, S. Ahn, J. W. Jeon, and J. E. Byun, A High-speed High-resolution Vision System for the Inspection of TFT LCD, Proceedings, ISIE 2001, IEEE International Symposium, vol.1, 2001, pp.101-105. [2] K. Nakashima, Hybrid Inspection System for LCD Color Filter Panels, 10th International Conference on Instrumentation and Measurement Technology, Hamamatsu, Japan, 1994, pp. 689-692. [3] C. L. Chang, H. H. Chang, C. P. Hsu, An intelligent defect inspection technique for color filter, Proceedings of the 2005 IEEE International Conference on Mechatronics, Tiwan, 2005. [4] Y. Zhang, J. Zhang, A fuzzy neural network approach for quantitative evaluation of mura in TFT-LCD, Neural Networks and Brain, 2005. ICNN&B '05, Vol.1, 2005, pp.424-427. [5] K. B. Lee, M. S. Ko, J. J. Lee, T. M. Koo, K. H. Park, Defect Detection Method for TFT-LCD Panel Based on Saliency Map Model, TENCON 2004. 2004 IEEE Region 10 Conference, Vol..A, 2004, pp.223-226. [6] S. H. Hajimowlana, R. Muscedere, G. A. Jullien, and J. W. Roberts, An In-Camera Data Stream Processing System for Defect Detection, Real-Time Imaging, Vol.5, 1999, pp.23-34. [7] T. S. Newman and A. K. Jain, A Surbey of Automated Visual Inspection, Computer Vision and Image Understanding, Vol.61, No.2, 1995, pp.231-262. [8] A. Materka and M. Stzelecki, Texture Analysis Methods A Review, COST BII report, Brussels, 1998. [9] S. H. Hajimowlana, R. Muscedere, G. A. Julien, and J. W. Roverts, Defect Inspection in Web Inspection Using Fuzzy Fusion, IEEE International Symposium. On Circuits and Systems, 2000, pp.718-721. [10] J. Iivarinen and J. Rauhamaa, Surface Inspection of Web Using Self-Organiaing Map, Proc.of SPIE, Vol.3522, 1998, pp.96-103. [11] V. Preciado, D. Guinea, R. Montufar, and J. Vicente, Real-time Inspection of Metal Laminates by means of CNN s, Proc. Of SPIE, Vol.4301, No.39, 2001. [12] D. Guinea, A. Gordaliza, J. Vicente, and M. C. Garcia-Alegre, CNN based Visual Processing for Industrial Inspection, Proc. of SPIE, Vol.3966, No.45, 2000. [13] R. Perfetti and L. Terzoli, Analogic CNN algorithms for Textile Applications, Int. J. Circuit Theory Appl.., Vol.28, 2000, pp.77-85. [14] C. T. Lin, C. L. Chang, and W. C. Cheng, A Recurrent Fuzzy Cellular Neural Network System with Automatic Structure and Template Learning, IEEE Trans. On Circuits and Systems-I, Vol.51, No.5, 2004, pp.1024-1035. [15] C. M. Tseng, C. W. Tsai, C. S. Lin, Y. C. Lu, C. C. Hung, Automatic Inspection of Etching Transistors in TFT-LCD Panel, Proceedings of the 2005 IEEE International Conference on Mechatronics, Taiwan, 2005. [16] B. E. Dom and V. Brecher, Recent advances in the automatic inspection of integrated circuits for pattern defects, Machine Vision and Applications, No.8, 1995, pp.5-19. [17] M. Darboux, A. Falut, J.L. Jacquot and C. Doche, Automated system for submicrometer defect detection on patterned wafers, Proc. SPIE, Vol.1138, 1989, pp.172-177. [18] T. Hiroi, S. Maeda, H. Kubota, K. Watanabe and Y. Nakagawa, Precise Visual Inspection for LSI Wafer Patterns Using Subpixel Image Alignment, Proceedings of 2nd IEEE Workshop on Applications of Computer Vision, 1994, pp.26-34. [19] S. Maeda, T. Hiroi, H. Makihira and H. Kubora, Automated visual inspection of LSI wafer patterns using a derivative-polarity comparison algorithm, Applications of Digital Image Processing ⅩⅣ, Vol.1567, 1991, pp.100-109. [20] H. Onishi, Y. Sasa, K. Nagai, S. Tatsumi, A pattern defect inspection method by parallel grayscale image comparison without precise image alignment, IECON 02, Vol.3, 2002, pp.2208-2213.

Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, Hangzhou, China, April 15-17, 2007 283 Fig.7 Inspected Image Fig.8 Compensated Image (a) Pixel value of inspected image (b) Compensated pixel value Fig.9 Analysis of Inspected Image