MOTION estimation plays an important role in video
|
|
- Dennis Fleming
- 5 years ago
- Views:
Transcription
1 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY Kalman Filtering Based Rate-Constrained Motion Estimation for Very Low Bit Rate Video Coding Chung-Ming Kuo, Shu-Chiang Chung, and Po-Yi Shih Abstract The rate-constrained (R-D) motion estimation techniques have been presented to improve the conventional block-matching algorithm by using a joint rate and distortion criterion. This paper presents two motion estimation algorithms using Kalman filter to further enhance the performance of the conventional R-D motion estimation at a relative low computational cost. The Kalman filter exploits the correlation of block motion to achieve higher precision of motion estimation and compensation. In the first algorithm, the Kalman filter is utilized as a postprocessing to raise the motion compensation accuracy of the conventional R-D motion estimation. In the second algorithm, the Kalman filter is embedded into the optimization process of R-D motion estimation by defining a new R-D criterion. It further improves the rate-distortion performance significantly. Index Terms Kalman filter, motion model, R-D motion estimation. I. INTRODUCTION MOTION estimation plays an important role in video coding systems [1] [7], such as H.26x and MPEG-x, with significant improvement in bit rate reduction. Among the various motion estimation approaches, the block-matching algorithm (BMA) is the most popular one due to its simplicity and reasonable performance. In BMA, an image frame is divided into nonoverlapping rectangular blocks with equal or variable block sizes, and all pixels in each block are assumed to have the same motion. The motion vector (MV) of a block is estimated by searching for its best match within a search window in the previous frame. The distortion between the current block and each searching block is employed as a matching criterion. The resulting MV is used to generate a motion compensated prediction block. The motion compensated prediction difference blocks (called residue blocks) and the MVs are encoded and sent to the decoder. In high-quality applications, the bit rate for MVs,, is much less than that for residues, ; thus, can be neglected in MV estimation. However, in low- or very low- bit rate applications such as videoconference and videophone, the percentage of MV bit rate is increased when overall rate budget decreases. Thus, the coding of MVs takes up a significant portion of the bandwidth [9]. Then in very low Manuscript received August 3, 2003; revised January 9, This work was supported by National Science Council of Taiwan, R.O.C., under Grant NSC E , and in part by I-Shou University under Grant ISU This paper was recommended by Associate Editor H. Sun. C.-M. Kuo and S.-C. Chung are with the Department of Information Engineering, I-Shou University, Kaoshiung 840, Taiwan, R.O.C. ( kuocm@isu.edu.tw; d @stmail.isu.edu.tw). P.-Y. Shih is with the VIA Technologies Inc., Hsin-Chu 300, Taiwan, R.O.C. ( PoyiShih@via.com.tw). Digital Object Identifier /TCSVT bit rate compression, the motion compensation must consider the assigned MV rate simultaneously. Thus, a joint rate and distortion (R-D) optimal motion estimation has been developed to achieve the trade-off between MV coding and residue coding [8] [16]. In [13], a global optimum R-D motion estimation scheme is developed. The scheme achieves significant improvement of performance, but it employs Viterbi algorithm for optimization, which is very complicated and results in a significant time delay. In [14], a local optimum R-D motion estimation criterion was presented. It effectively reduces the complexity at the cost of performance degradation. In this paper, we will propose two Kalman filter-based methods to improve the conventional R-D motion estimation, which are referred to as enhanced algorithm and embedded algorithm, respectively. In the enhanced algorithm, the Kalman filter is employed as a post processing of MV, which extends the integer-pixel accuracy of MV to fractional-pixel accuracy, thus enhancing the performance of motion compensation. Because the Kalman filter exists in both encoder and decoder, the method achieves higher compensation quality without increasing the bit rate for MV. In the embedded algorithm, the Kalman filter is applied directly during the process of optimization of motion estimation. Since the R-D motion estimation consider compensation error (distortion) and bit rate simultaneously, when Kalman filter is applied the distortion will be reduced, and thus lowering the cost function. Therefore, the new algorithm can improve distortion and bit rate simultaneously. However, the rate constraint used in this paper is a general criterion for motion estimation. Thus, the approaches we proposed can be combined with existing advanced motion estimation algorithms such as overlapped block motion compensation (OBMC) [17], [18], and those recommended in H.264 or MPEG-4 AVC [19], [20]. The paper is organized as follows. A brief review of the related works is presented in Section II. In Section III, we derive the enhanced R-D motion estimation based on the Kalman filter. In Section IV, we describe how to embed the Kalman filter into the R-D optimization process of motion estimation. Simulation results are presented in Section V and finally the conclusions are given in Section VI. II. REVIEW OF RELATED WORKS A. Kalman Filter The Kalman filtering algorithm estimates the states of a system from noisy measurement [21], [22]. There are two /$ IEEE
2 4 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 major features in a Kalman filter. One is that its mathematical formulation is described in terms of state-space representation, and the other is that its solution is computed recursively. It consists of two consecutive stages: prediction and updating. We summarize the Kalman filter algorithm as follows: Predicted equation (1) Measurement equation (2) where and are state and measurement vector at time., and are state transition, measurement and driving matrices, respectively. Generally, we assume that and are white Gaussian with, and for all,. Let, and be initial conditions. Prediction (see equations (3) and (4) at the bottom of the page.) Updating (see equations (5) (7) at the bottom of the page.) The is the error covariance matrix that is associated with the state estimate.itisdefined as This matrix provides a statistical measure of the uncertainty in. The superscripts and denote before and after measurement, respectively. B. R-D Motion Estimation In conventional motion estimation, a major consideration is to reduce the motion compensated prediction error such that the coding rate for the prediction error can be reduced. This is true for high-rate applications because the bit rate for MV is only a very small part of all transmission rates. However, in low bit rate or very low bit rate situation, is a significant part in all available rate budget. For this reason, should be considered into the process of motion estimation. Therefore, the criterion of motion estimation must be modified accordingly. In 1994, Bernd Girod addressed this problem first. He proposed a theoretical framework for rate-constrained motion estimation, and a new region based motion estimation scheme [12]. (8) Fig. 1. Generic hybrid video coding system. In motion compensated hybrid coding, the bit rate can be divided into the displacement vector field, the prediction error, and additional side information. The very accurate motion compensation is not the key to a better picture quality at low or very low bit rates. So, the problem of optimally allocating a limited rate budget to the displacement vector field and the motion-compensated prediction error is addressed. In 1998, Chen and Willson have conferred this point again [13], and analyzed this issue thoroughly. They explained a new estimation criterion in detail, and proposed a new rate-constrained motion estimation for general video coding system. Since the performance of video compression is according to not only motion compensation but also the rate budget, which is include bit rate for MV and bit rate for prediction error. Therefore, The optimal solution can then be searched for throughout the convex hull of all possible R-D pairs by minimizing the total Lagrangian cost function given by (9) where is the quantization parameter for blocks, respectively. This approach, however, is computationally intensive, involving a joint optimization between motion estimation/compensation and prediction residual coding schemes. By (9), we see that the dicrete cosine transform (DCT) and quantization operations must be performed on an MV candidate basis in order to obtain and. The significant computations make the scheme unacceptable for most practical implementations, no matter what software or hardware. Thus, they State prediction (3) Prediction-error covariance (4) State updating (5) Updating-error covariance (6) Kalman gain matrix (7)
3 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 5 Fig. 2. Block diagram of the proposed enhanced R-D motion estimation algorithm. simplify (9) by only considering motion estimation error and bit rate for MV. Assume a frame is partitioned into block sets. Let be the MV estimated for block. Then the motion field of a frame is described by the -tuple vector,. The joint R-D optimization can be interpreted as finding a MV field that minimizes the distortion under a given rate constraint, which can be formulated by the Lagrange multiplier method as follows: (10) where is the Lagrange multiplier, and and are the motion-compensated distortion and the number of bits associated with MV of the block, respectively. In most video coding standards, the MVs of blocks are differentially coded using Huffman code. Thus, the blocks are coded dependently. However, this simplification has two evident defects: 1) it is still too complex and 2) the performance is degraded. In the same year, Coban and Merserau proposed different scheme on the RD optimal problem [14]. They think that (10) is a principle for global optimal of R-D problem, but it is difficult in implementation. They supposed, if each block is coded independently, the solution (10) can be reduced to minimizing the Lagrangian cost function of each block, i.e., (11) In order to simplify the problem, although the MVs are coded differentially, the blocks will be treated as if they are being coded independently. This will lead to a locally optimal, globally sub-optimal solution. By this way, the framework of R-D optimal motion estimation is close to of conventional motion estimation. Although it saves computation by ignoring the relation of blocks, it reduces the overall performance. III. ENHANCED R-D MOTIOIN ESTIMATION USING KALMAN FILTER The R-D motion estimation often yields smooth MV fields, as compared with conventional BMAs [13], [14]. In other words, the resulting MVs are highly correlated. In this work, we try to fully exploit the correlation of MVs by using the Kalman filter. This is motivated by our previous works [23], [24], in which
4 6 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 Fig. 3. Block diagram of the proposed embedded R-D motion estimation algorithm. the Kalman filter is combined with the conventional BMAs to improve the estimate accuracy of MVs. In [1], a generic hybrid video coding system is depicted in Fig. 1. Fig. 2 shows the block diagram of the proposed motion estimation technique, which consists of two cascaded stages: measurement of MV and Kalman filtering. We employ a R-D fast search scheme [9] [11], [13] [15] to obtain the measured MV. Then we model the MVs and generate the predicted MV utilizing the inter-block correlation. Based on the measured and predicted MVs, a Kalman filter is applied to obtain an optimal estimate of MV. For the sake of simplicity in implementation, we employ the first-order AR (autoregressive) model to characterize the MV correlation. The MV of the block at location of the -th frame is denoted by, and its two components in horizontal and vertical directions are modeled as (12) (13) where and represent the model error components. In order to derive the state-space representation, the time indexes and are used to represent the current block location, and the left-neighbor block location, respectively. Consequently, the state-space representation of (12) and (13) are (14) or (15) where we let,, and. The error components, and, are assumed to be Gaussian distribution with zero mean and the same variance. The measurement equations for the horizontal and vertical directions are expressed by (16) where, denote two measurement error components with the same variance. In general, the model error and measurement error may be colored noises. We can model each colored noise by a low-order difference equation that is excited by white Gaussian noise, and augment the states associated colored noise models to the original state space representation. Finally, we apply the recursive filter to the augmented system. However, the procedure requires considerable computational complexity and is not
5 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 7 TABLE I COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE CIF-CLAIR 100 FRAMES UNDER 15 FRAMES/S TABLE II COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE CIF- SALESMAN 100 FRAMES UNDER 15 FRAMES/S TABLE III COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- FOREMAN 100 FRAMES UNDER 10 FRAMES/S suitable for our application. Moreover, in this paper, the measurements are obtained by the R-D fast search algorithm [14], in which the blocks are processed independently. Thus, we can assume that the measurement error is independent. For simplicity but without loss of generality, the prediction error and measurement error are assumed to be zero-mean Gaussian distribution with the same variances and, respectively. In the above equations, the measurement matrix is constant, and state transition matrix can be estimated by the least square method. Since the motion field for low bit rate applications is rather smooth, we assume that and are with fixed values. The proposed algorithm is summarized as follows. Step 1) Measure MV. Measure the MV of a moving block, by any R-D search algorithms [9] [11], [13] [15]. Encode the MV by H.263 Huffman table [6], [7]. Step 2) Kalman filtering a) The predicted MV is obtained by b) Calculate prediction-error covariance by
6 8 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 TABLE IV COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- MOTHER & DAUGHTER 120 FRAMES UNDER 10 FRAMES/S TABLE V COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- MOTHER & DAUGHTER 120 FRAMES UNDER 10 FRAMES/S TABLE VI COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- MOTHER & DAUGHTER 120 FRAMES UNDER 10 FRAMES/S c) Obtain Kalman gain by d) The MV estimate is updated by This is the final estimate output. e) Calculate the filtering-error covariance by Step 3) Go to Step 1 for next block. In the above algorithm, the optimal estimate is usually real, thus yielding fractional-pixel accuracy estimate. The conventional BMA can also obtain the fractional-pixel MV by increasing resolution with interpolation and matching higherresolution data on the new sampling grid. However, this not only increases computational complexity significantly, but also raises overhead bit rate for MV. On the contrast, the required computational overhead is much lower than that of the conventional BMA with fractional-pixel matching. In addition, using the same Kalman filter as in the encoder, the decoder can estimate the fractional part of MV by receiving integer MV. In summary, the new method achieves fractional pixel performance with the same bit rate for MV as an integer-search BMA, at the cost of a small increase of computational load at the decoder. The detail analysis of computational complexity will be given in Section V. Furthermore, because the Kalman filter is independent with motion estimation, it can be combined with any existing R-D motion estimation scheme with performance improvement. IV. KALMAN FILTER EMBEDDED R-D MOTION ESTIMATION The main feature of the above enhanced scheme is to obtain fractional pixel accuracy of MV with estimation instead of ac-
7 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 9 TABLE VII COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- CARPHONE 120 FRAMES UNDER 10 FRAMES/S TABLE VIII COMPARISONS OF COMPRESSION PERFORMANCE, IN TERMS OF PSNR, OVERALL BIT RATE, AND MV BIT RATE FOR VARIOUS MOTION ESTIMATION ALGORITHMS USING THE QCIF- CARPHONE 120 FRAMES UNDER 10 FRAMES/S TABLE IX EXTRA COMPUTATION REQUIRED BY KALMAN FILTERING FOR EACH ALGORITHM tual searching. Hence, no extra bit rate is needed for the fractional part of MV. However, because the enhanced algorithm does not involve the estimation process of MV, the obtained MV is not optimum from viewpoint of distortion. To address the problem, we develop a new R-D motion estimation, in which the Kalman filter is included into the estimation process of R-D scheme. We refer to it as Kalman filter embedded R-D motion estimation and describe the details in the following. The cost function of Kalman filter embedded R-D motion estimation can be formulated as (17) The is a distortion of Kalman filter-based motion compensation. It is obtained by Kalman filtering the integer-point MV and the resulting floating-point MV is used to generate motion compensation prediction. In such case, the MV is represented in integer-point, but it can generate motion compensation with fractional pixel accuracy. Therefore, the assigned bit rate for MV is not affected by, but the total cost function is reduced due to the accuracy increase in compensation. Fig. 3 is the block diagram of the embedded algorithm. For simplicity, we select (11) as the criterion for motion estimation. The Kalman filter embedded R-D motion estimation algorithm is summarized as follows. Step 1) Kalman filter-based motion estimation a) Select a location in the search range and denote it as a candidate measurement of MV. b) Apply the Kalman filter to using the procedure of Step 2 in the previous section. Then we obtain an optimal estimate of MV, which is with fractional accuracy. Calculate the distortion according to the. Step 2) Calculate the bit rate of the MV according to the H.263 Huffman table [6], [7]. Notice that transmission MV is, which is an integer; thus the required bit rate of MV is not affected by Kalman filter. Step 3) Using (17), we calculate the cost function. If the best match is found, go to Step 4; otherwise, go back to Step 1 to select the next location for estimation. Step 4) Go to Step 1 for next block. In the enhanced algorithm, the Kalman filter is not applied during the block searching. It is only used to enhance the performance when MV is obtained by R-D motion estimation. Therefore, the Kalman filter can be viewed as a post processing of
8 10 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 Fig. 4. Comparisons of PSNR performance using the QCIF-Froeman sequence, 120 frames at 10 frames/s, fixed coding bit rate at 2000 bits. Block size =82 8, search range =[015; 16]. motion estimation. However, in the embedded algorithm, the Kalman filter is applied for every block searching by employing the joint R-D. Thus, it can be considered as a new R-D motion estimation approach. Since it includes the Kalman filter into the optimization process, the embedded method performs better than the enhanced version at the cost of computational complexity. the well-known bilinear interpolation is adopted to generate a motion compensated prediction frame. A Huffman codebook adopted from H.263 standard was used in the coding of 2-D differentially coded MVs. The various algorithms were compared in terms of R-D performance. The common peak signal-to-noise ratio (PSNR) measure defined in the following was selected to evaluate distortion performance V. SIMULATION RESULTS The performance of the proposed RD-motion estimation with Kalman filter (RD-Kalman) was evaluated using a set of standard image sequences including Forman, Mother and Daughter, Carphone, Salesman and Claire. All sequences are with CIF ( ) or QCIF ( ) resolution and frame rate of 10 Hz. Since the RD-Kalman motion estimation has fractional pel accuracy, the results are compared with the conventional RD algorithm and MSE-optimal scheme with both integer and half-pixel accuracy. The block size and search range for CIF format and block size (or 8 8) and search range for QCIF format were chosen, respectively. The conventional RD and RD-Kalman adopted the same motion estimation strategy as that in [13]. Specifically, for the current block, the MVs of the left-neighbor block and up-neighbor block, and the MV obtained with MSE criterion, were selected as the predicted search center, and then a small search of 3 3 is performed. For the KF-based motion estimation, the parameters are chosen experimentally as follows: the model coefficients, model error variance, measurement error variance, initial error covariance, and initial state. It is evident that from [19], the estimated MVs are real values rather than integer. The displaced pixels may not be on the sampling grid. Therefore, (18) Moreover, rate performance was evaluated by the number of bits required to encode an image frame or a motion field. The Lagrange multiplier, which controls the overall performance in the R-D sense, is a very important parameter. Generally, an iterative method is needed to determine the value of. However, it is very computational expensive. As pointed out in [14], for typical video coding applications is insensitive to different frames of a video sequence; thus a constant of 20 is adopted in our simulations. The simulation was carried out by incorporating various motion estimation algorithms into an H.263 based motion compensated DCT video coding system. To be fair in the comparisons, we fixed the overall coding bit rate at 4000 bits per frame for CIF-Claire and CIF-Salesman. For QCIF format, two block sizes are conducted for each sequence, which are assigned two different bit rates per frame, respectively. The bit rates preset are 2000 bits (8 8) and 1600 bits (16 16) for Forman, 1400 bits and 1000 bits for Mother & Daughter, and 2000 bits and 1400 bits for Carphone, respectively. The averaged results for 100 frames of CIF format sequences are summarized in Tables I and II. The Kalman-based R-D motion estimation approach outperformed the MSE-optimal and conventional RD algorithms in terms of PSNR. Since
9 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 11 Fig. 5. Comparisons of PSNR performance using the QCIF-Froeman sequence, 120 frames at 10 frames/s, fixed coding bit rate at 2000 bits. Block size =16216, search range =[031; 32]. Fig. 6. Comparisons of PSNR using the QCIF-Mother & Daughter sequence, 200 frames at 10 frames/s, fixed coding bit rate at 2000 bits. Block size =82 8, search range =[015; 16]. the Kalman filter has fractional pel accuracy with the rates of integer MV, it achieves significant PSNR improvement, as expected. When the integer-based Kalman filter is compared to the motion estimation methods in half pixel accuracy, it still achieves better PSNR, but not so significantly. We found that the Kalman filter with half pixel accuracy performs better slightly than that with integer pixel accuracy. This may be due to the limitation of bilinear interpolation; i.e., the accuracy improvement is saturated when too many interpolations are performed. The performance may be further enhanced with the advanced interpolation filters [25], [26]. However, it is not a major issue in our paper. At the same bit rate level and integer pixel accuracy, the enhanced algorithm achieved an average of 1.23 db gain over MSE-optimal and 0.34 db gain over the conventional RD. The embedded version achieved an average of 1.77 db gain over MSE-optimal, and 0.88 db gain over the conventional RD. Note that the new methods have lower bit rate. Tables III VIII summarized the average results for QCIF format sequences. For both block sizes of and 8 8, the Kalman filter-based
10 12 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 Fig. 7. Comparisons of PSNR performance using QCIF-Mother and Daughter sequence, 200 frames at 10 frames/s, fixed coding bit rate at 1400 bits. Block size =16216, search range =[031; 32]. Fig. 8. Comparisons of PSNR performance using the QCIF-Carphone sequence, 120 frames at 10 frames/s, fixed coding bit rate at 2000 bits. Block size =82 8, search range =[015; 16]. R-D motion estimation approaches achieve significant PSNR improvement. Particularly, the embedded Kalman R-D algorithm achieves the best performance due to its ability in reduction of MV rate as well as the compensation distortion. Figs. 4 9 compare the MSE-Optimal, conventional R-D, enhanced Kalman R-D and embedded Kalman R-D schemes with both integer and half pixel accuracy in terms of PSNR with approximately fixed bit rate for each sequence, respectively. Figs compare these algorithms in terms of bit rate with approximately fixed PSNR for each sequence, respectively. As expected, the results indicate that the proposed schemes achieve better R-D performance. The MV fields generated by various algorithms are shown in Figs , respectively. The test sequences contain mainly small rotation and camera panning. As expected, the proposed algorithm produces smoother motion fields because of the filtering effect of Kalman filter. Analysis of Computational Complexity: Consider the case that a block size is, the maximum displacement is p, and the matching criterion is mean absolute difference (MAD), i.e.,
11 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 13 Fig. 9. Comparisons of PSNR performance using the QCIF-Carphone sequence, 120 frames at 10 frames/s, fixed coding bit rate at 1400 bits. Block size = , search range =[031; 32]. Fig. 10. Comparisons of bit rate performance using the CIF-Salesman sequence, 120 frames at 10 frames/s, fixed average PSNR full search at db, half pixel search at db, half pixel RD at db, half pixel RD with KF(En) at db, half pixel RD with KF(Em) at db, RD-Optimal at db, RD with KF(En) at db, and RD with KF(Em) at db. where is the pixel intensity at the location of block in the current frame, and is the pixel intensity at the location with the displacement in the previous frame. The full search algorithm (FSA) requires search locations. Each search location corresponds to one MAD computation, which consists of additions and absolute operations. Therefore, the total computation is additions and absolute operations. In general, the Kalman filtering is computationally expensive. However, in our application, the computational complexity is relative small because the calculation of Kalman filtering can be significantly simplified. We evaluate the required calculations for Kalman filtering as follows. The Kalman filtering contains two stages: prediction and updating. In our application, the state transition matrix, driven matrix and measurement matrix are all 2 2 identity matrix. The covariance of model and measurement error is 2 2 diagonal matrix with the same constant value and, respectively. For simplicity, we denote the addition and multiplication as and, respectively. Prediction:
12 14 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 Fig. 11. Comparisons of bit rate performance using the QCIF-Mother and Daughter sequence, 200 frames at 10 frames/s, fixed average PSNR full search at db, half pixel search at db, half pixel RD at db, half pixel RD with KF(En) at db, half pixel RD with KF(Em) at db, RD-Optimal at db, RD with KF(En) at db, and RD with KF(Em) at db. Fig. 12. Comparisons of bit rate performance using the QCIF-Carphone sequence, 120 frames at 10 frames/s, fixed average PSNR Full Search at db, Half Pixel Search at db, Half Pixel RD at db, Half Pixel RD with KF(En) at db, Half Pixel RD with KF(Em) at db, RD-Optimal at db, RD with KF(En) at db, and RD with KF(Em) at db. No calculation is needed The is 2 2 diagonal matrix with. Thus, can be expressed as It contains only two additions. Updating: The is the covariance matrix, i.e.,, which is 2 2 diagonal matrix with. The expansion of is Thus we have and. It contains only (here, division is regarded as multiplication) and Obviously the calculation contains and.
13 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 15 (a) (a) (b) (b) (c) (c) (d) Fig. 13. (a) Motion field estimated by the conventional MSE-Optimal scheme on the CIF- Claire sequence frame 15. The PSNR quality is db and it requires 1980 bits to encode using the H.263 Huffman codebook. (b) Motion field estimated by the Michael C. Chen proposed RD-Optimal scheme on the CIF-Claire sequence frame 15. The PSNR quality is db and it requires 1378 bits to encode using the H.263 Huffman codebook. (c) Motion field estimated by the R-D Optimal with Enhanced Algorithm on the QIF-Claire sequence frame 15. The PSNR quality is db and it requires 1378 bits to encode using the H.263 Huffman codebook. (d) Motion field estimated by the R-D Optimal with Embedded Algorithm on the CIF-Claire sequence frame 15. The PSNR quality is db and it requires 1030 bits to encode using the H.263 Huffman codebook. Finally, we consider the calculation of (d) Fig. 14. (a) Motion field estimated by the conventional MSE-Optimal scheme on the CIF- Salesman sequence frame 07. The PSNR quality is db and it requires 1246 bits to encode using the H.263 Huffman codebook. (b) Motion field estimated by the Half Pixel with RD-Optimal scheme on the CIF- Salesman sequence frame 07. The PSNR quality is db and it requires 1095 bits to encode using the H.263 Huffman codebook. (c) Motion field estimated by the Half Pixel RD with Enhanced Algorithm scheme on the CIF-Salesman sequence frame 07. The PSNR quality is db and it requires 1095 bits to encode using the H.263 Huffman codebook. (d) Motion field estimated by the Half Pixel RD with Embedded Algorithm scheme on the CIF-Salesman sequence frame 07. The PSNR quality is db and it requires 1016 bits to encode using the H.263 Huffman codebook. Obviously the calculation of can be simplified as and
14 16 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 (a) (a) (b) (b) (c) (c) (d) Fig. 15. (a) Motion field estimated by the conventional Half Pixel scheme on the QCIF- Foreman sequence frame 204. The PSNR quality is db and it requires 1230 bits to encode using the H.263 Huffman codebook. (b) Motion field estimated by the Half Pixel with RD-Optimal on the QCIF-Foreman sequence frame 204. The PSNR quality is db and it requires 1158 bits to encode using the H.263 Huffman codebook. (c) Motion field estimated by the Half Pixel RD with Enhanced Algorithm scheme on the QCIF-Foreman sequence frame 204. The PSNR quality is db and it requires 1158 bits to encode using the H.263 Huffman codebook. (d) Motion field estimated by the Half Pixel RD with Embedded Algorithm scheme on the QCIF-Foreman sequence frame 204. The PSNR quality is db and it requires 889 bits to encode using the H.263 Huffman codebook. (d) Fig. 16. (a) Motion field estimated by the conventional Half Pixel scheme on the QCIF- Mother and Daughter sequence frame 28. The PSNR quality is db and it requires 1476 bits to encode using the H.263 Huffman codebook (b) Motion field estimated by the Half Pixel with RD-Optimal scheme on the QCIF- Mother & Daughter sequence frame 28. The PSNR quality is db and it requires 1112 bits to encode using the H.263 Huffman codebook. (c) Motion field estimated by the Half Pixel RD with Enhanced Algorithm scheme on the QCIF- Mother and Daughter sequence frame 28. The PSNR quality is db and it requires 1120 bits to encode using the H.263 Huffman codebook. (d) Motion field estimated by the Half Pixel RD with Embedded Algorithm scheme on the QCIF- Mother & Daughter frame 28. The PSNR quality is db and it requires 868 bits to encode using the H.263 Huffman codebook... The calculation contains and Since the computation is combined the and components simultaneously. We assumed that the two components use
15 KUO et al.: KALMAN FILTERING BASED RATE-CONSTRAINED MOTION ESTIMATION FOR VERY LOW BIT RATE VIDEO CODING 17 (a) pixel, the bilinear interpolation requires and, so a block with size need and. The computational complexity of enhanced algorithm is different from that of embedded algorithm, since the filtering operation is performed once per block for the former, but once for each search location for the latter. In the decoder, there is a same Kalman filter, therefore, it performs one Kalman filtering operation after the MVs received no matter what enhanced or embedded algorithms. The extra computational load required for the proposed algorithms is summarized in Table IX. It indicates the extra computation introduced by the proposed method is small. VI. CONCLUSION (b) (c) In this paper, we have presented two efficient Kalman filterbased R-D motion estimation algorithms in which a simple 1-D Kalman filter is applied to improve the performance of conventional RD motion estimation. Since equivalent Kalman filters are used in both encoder and decoder, no extra information bit for MV is needed to send to the decoder. The new algorithm achieves significantly PSNR gain with only a slight increase of complexity. The enhanced algorithm is a post processing, and can be easily combined with any conventional R-D motion estimation schemes. The embedded algorithm is a new R-D motion estimation algorithm that can more effectively exploit the correlation of block motion. In the future, we will develop an adaptive scheme to further improve the performance motion compensation. In addition, the combinations with variable block size and OBMC searching, and the investigation of robust transmission, are interesting issues and will be studied in the future. ACKNOWLEDGMENT The authors would like to thank the anonymous reviewers for their valuable comments and suggestions. REFERENCES (d) Fig. 17. (a) Motion field estimated by the conventional Half Pixel scheme on the QCIF- Carphone sequence frame 60. The PSNR quality is db and it requires 1302 bits to encode using the H.263 Huffman codebook. (b) Motion field estimated by the Half Pixel with RD-Optimal scheme on the QCIF- Carphone sequence frame 60. The PSNR quality is db and it requires 1132 bits to encode using the H.263 Huffman codebook. (c) Motion field estimated by the Half Pixel RD with Enhanced Algorithm scheme on the QCIF-Carphone sequence frame 60. The PSNR quality is db and it requires 1132 bits to encode using the H.263 Huffman codebook. (d) Motion field estimated by the Half Pixel RD with Embedded Algorithm on the QCIF-Carphone sequence frame 60. The PSNR quality is db and it requires 830 bits to encode using the H.263 Huffman codebook. the same Kalman filter, therefore, the actual computation is only half of the above analysis. For embedded algorithm, we must calculate the distortion function for each searching. Thus, the interpolation is necessary. For each [1] J. R. Jain and A. K. Jain, Displacement measurement and its application in interframe image coding, IEEE Trans. Commun., vol. 29, no. 12, pp , Dec [2] T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, Motion-compensated interframe coding for video conferencing, in Proc. NTC81, New Orleans, LA, 1981, pp. C [3] R. Srinivasan and K. Rao, Predictive coding based on efficient motion estimation, IEEE Trans. Commun., vol. 33, no. 8, pp , Aug [4] MPEG-4 Visual Fixed Draft International Standard,, ISO/IEC , [5] MPEG-4 Video Verification Model Version 18.0, MPEG Video Group, ISO/IEC JTC1/SC29/WG11 N3908, [6] Video Coding for Low Bitrate Communication, ITU Telecom. Standardization sector of ITU, ITU-T Recommendation H.263, [7] Video Coding for Low Bitrate Communication, ITU Telecom. Standardization sector of ITU, Draft ITU-T Rec. H.263 Version 2, [8] H. li, A. Lundmark, and R. Forchheimer, Image sequence coding at very low-bit bitrates: A review, IEEE Trans. Image Process., vol. 3, no. 9, pp , Sep [9] T. Wiegand, M. Lightstone, D. Mukherjee, T. G. Cambell, and S. K. Mitra, Rate- distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard, IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 2, pp , Apr
16 18 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 [10] F. Kossentini, Y.-W. Lee, M. J. T. Smith, and R. K. Ward, Predictive RD optimized motion estimation for very low bit rate video coding, IEEE J. Sel. Areas Commun., vol. 15, no. 6, pp , Dec [11] D. T. Hoang, P. M. Long, and J. S. Vitter, Efficient cost measure for motion estimation at low bit rate, IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp , Aug [12] B. Girod, Rate-constrained motion estimation, Proc. SPIE Visual Commun. Image Process., vol. 2308, pp , Nov [13] M. C. Chen and A. N. Willson, Rate-distortion optimal motion estimation algorithm for motion-compensated transform video coding, IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 3, pp , Apr [14] M. Z. Coban and R. M. Mersereau, A fast exhaustive search algorithm for rate-constrained motion estimation, IEEE Trans. Image Process., vol. 7, no. 5, pp , May [15] J. C. H. Ju, Y. K. Chen, and S. Y. Kung, A fast rate-optimized motion estimation algorithm for low-bit rate video coding, IEEE Trans. Circuis Syst. Video Technol., vol. 9, no. 7, pp , Oct [16] Y. Y. Sheila and S. Hemami, Generalized rate-distortion optimization for motion-compensated video coders, IEEE Trans. Circuis Syst. Video Technol., vol. 10, no. 6, pp , Sep [17] M. T. Orchard and G. J. Sullivan, Overlapped block motion compensation: An estimation-theoretic approach, IEEE Trans. Image Process., vol. 3, no. 5, pp , Sep [18] J. K. Su and R. M. Mersereau, Motion estimation methods for overlapped block motion compensation, IEEE Trans. Image Process., vol. 9, no. 6, pp , Sep [19] Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 ISO/IEC AVC) Joint Video Team (JVT),, Doc. JVT-G050, [20] T. Wiegand, G. Sullivan, G. Bjøntegaard, and A. Luthra, Overview of the H.264/AVC video coding standard, IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp , Jul [21] C. K. Chui and G. Chen, Kalman Filtering With Real-Time Applications, ser. Springer Series in Information Sciences. New York: Springer, 1987, vol. 17. [22] M. S. Grewal and A. P. Andrews, Kalman Filtering Theory and Practice. Englewood Cliffs, NJ: Prentice-Hall, [23] C. M. Kuo, C. H. Hsieh, Y. D. Jou, H. C. Lin, and P. C. Lu, Motion estimation for video compression using Kalman filtering, IEEE Trans. Broadcast., vol. 42, no. 2, pp , Jun [24] C. M. Kuo, C. H. Hsieh, H. C. Lin, and P. C. Lu, Motion estimation algorithm with Kalman filter, Electron. Lett., vol. 30, no. 7, pp , Jul [25] T. Wedi and H. G. Musmann, Motion- and aliasing-compensated prediction for hybrid video coding, IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp , Jul [26] T. Wedi, Adaptive interpolation filter for motion compensated prediction, in Proc IEEE Int. Conf. Image Process., vol. 2, Sep , 2002, pp. II-509 II-512. Chung-Ming Kuo received the B.S. degree from the Chinese Naval Academy, Kaohsiung, Taiwan, R.O.C., in 1982, and the M.S. and Ph.D. degrees from Chung Cheng Institute of Technology, Taiwan, R.O.C., in 1988 and 1994, respectively, all in electrical engineering. From 1988 to 1991, he was an Instructor in the Department of Electrical Engineering, Chinese Naval Academy, where he became an Associate Professor in January From 2000 to 2003, he was an Associate Professor in the Department of Information Engineering, I-Shou University, Kaoshiung, Taiwan, R.O.C., and became Professor in February His research interests include video compression and image/video retrieving, multimedia signal processing, and optimal estimation. Shu-Chiang Chung received the B.S. and M.S. degrees in system engineering from Chung Cheng Institute of Technology, Taiwan, R.O.C., in 1983 and 1994, respectively. He is currently working toward the Ph.D. degree at I-Shou University, Kaohsiung, Taiwan, R.O.C. From 1994 to 1999, he was an Instructor at the Chinese Naval Academy, Kaohsiung, Taiwan, R.O.C. In November 1999, he joined the Naval Shipbuilding and Development Center as a Researcher with the Department of Information Systems. His research interests include video coding, image processing, digit signal processing, and optimal estimation. Po-Yi Shih received the B.S. degree in 2001 and the M.S. degree in information engineering in 2003, both from I-Shou University, Kaohsiung, Taiwan, R.O.C. In 2003, he joined the VIA Technologies, Inc., Hsin-Chu, Taiwan, R.O.C., where he is involved in research and design of video encoder and decoder systems. His current research interests include video coding, image processing, and optimal estimation.
Motion- and Aliasing-Compensated Prediction for Hybrid Video Coding
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 577 Motion- and Aliasing-Compensated Prediction for Hybrid Video Coding Thomas Wedi and Hans Georg Musmann Abstract
More informationABSTRACT 1. INTRODUCTION IDCT. motion comp. prediction. motion estimation
Hybrid Video Coding Based on High-Resolution Displacement Vectors Thomas Wedi Institut fuer Theoretische Nachrichtentechnik und Informationsverarbeitung Universitaet Hannover, Appelstr. 9a, 167 Hannover,
More informationFast Mode Decision using Global Disparity Vector for Multiview Video Coding
2008 Second International Conference on Future Generation Communication and etworking Symposia Fast Mode Decision using Global Disparity Vector for Multiview Video Coding Dong-Hoon Han, and ung-lyul Lee
More informationVideo Encoder Optimization for Efficient Video Analysis in Resource-limited Systems
Video Encoder Optimization for Efficient Video Analysis in Resource-limited Systems R.M.T.P. Rajakaruna, W.A.C. Fernando, Member, IEEE and J. Calic, Member, IEEE, Abstract Performance of real-time video
More informationUNEQUAL POWER ALLOCATION FOR JPEG TRANSMISSION OVER MIMO SYSTEMS. Muhammad F. Sabir, Robert W. Heath Jr. and Alan C. Bovik
UNEQUAL POWER ALLOCATION FOR JPEG TRANSMISSION OVER MIMO SYSTEMS Muhammad F. Sabir, Robert W. Heath Jr. and Alan C. Bovik Department of Electrical and Computer Engineering, The University of Texas at Austin,
More informationA HIGH PERFORMANCE HARDWARE ARCHITECTURE FOR HALF-PIXEL ACCURATE H.264 MOTION ESTIMATION
A HIGH PERFORMANCE HARDWARE ARCHITECTURE FOR HALF-PIXEL ACCURATE H.264 MOTION ESTIMATION Sinan Yalcin and Ilker Hamzaoglu Faculty of Engineering and Natural Sciences, Sabanci University, 34956, Tuzla,
More informationNew Algorithms and FPGA Implementations for Fast Motion Estimation In H.264/AVC
Slide 1 of 50 New Algorithms and FPGA Implementations for Fast Motion Estimation In H.264/AVC Prof. Tokunbo Ogunfunmi, Department of Electrical Engineering, Santa Clara University, CA 95053, USA Presented
More informationDirection-Adaptive Partitioned Block Transform for Color Image Coding
Direction-Adaptive Partitioned Block Transform for Color Image Coding Mina Makar, Sam Tsai Final Project, EE 98, Stanford University Abstract - In this report, we investigate the application of Direction
More informationPower-Distortion Optimized Mode Selection for Transmission of VBR Videos in CDMA Systems
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 51, NO. 4, APRIL 2003 525 Power-Distortion Optimized Mode Selection for Transmission of VBR Videos in CDMA Systems Il-Min Kim, Member, IEEE, Hyung-Myung Kim, Senior
More informationDELAY-POWER-RATE-DISTORTION MODEL FOR H.264 VIDEO CODING
DELAY-POWER-RATE-DISTORTION MODEL FOR H. VIDEO CODING Chenglin Li,, Dapeng Wu, Hongkai Xiong Department of Electrical and Computer Engineering, University of Florida, FL, USA Department of Electronic Engineering,
More informationPerformance Evaluation of H.264 AVC Using CABAC Entropy Coding For Image Compression
Conference on Advances in Communication and Control Systems 2013 (CAC2S 2013) Performance Evaluation of H.264 AVC Using CABAC Entropy Coding For Image Compression Mr.P.S.Jagadeesh Kumar Associate Professor,
More informationH.264-Based Resolution, SNR and Temporal Scalable Video Transmission Systems
Proceedings of the 6th WSEAS International Conference on Multimedia, Internet & Video Technologies, Lisbon, Portugal, September 22-24, 26 59 H.264-Based Resolution, SNR and Temporal Scalable Video Transmission
More informationAn improved hybrid fast mode decision method for H.264/AVC intra coding with local information
DOI 10.1007/s11042-013-1388-x An improved hybrid fast mode decision method for H.264/AVC intra coding with local information Changnian Chen Jiazhong Chen Tao Xia Zengwei Ju Lai-Man Po Springer Science+Business
More informationLow-Complexity Bayer-Pattern Video Compression using Distributed Video Coding
Low-Complexity Bayer-Pattern Video Compression using Distributed Video Coding Hu Chen, Mingzhe Sun and Eckehard Steinbach Media Technology Group Institute for Communication Networks Technische Universität
More informationMLP for Adaptive Postprocessing Block-Coded Images
1450 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 10, NO. 8, DECEMBER 2000 MLP for Adaptive Postprocessing Block-Coded Images Guoping Qiu, Member, IEEE Abstract A new technique
More informationA High-Throughput Memory-Based VLC Decoder with Codeword Boundary Prediction
1514 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 10, NO. 8, DECEMBER 2000 A High-Throughput Memory-Based VLC Decoder with Codeword Boundary Prediction Bai-Jue Shieh, Yew-San Lee,
More informationNarrow-Band Interference Rejection in DS/CDMA Systems Using Adaptive (QRD-LSL)-Based Nonlinear ACM Interpolators
374 IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 52, NO. 2, MARCH 2003 Narrow-Band Interference Rejection in DS/CDMA Systems Using Adaptive (QRD-LSL)-Based Nonlinear ACM Interpolators Jenq-Tay Yuan
More informationInformation Hiding in H.264 Compressed Video
Information Hiding in H.264 Compressed Video AN INTERIM PROJECT REPORT UNDER THE GUIDANCE OF DR K. R. RAO COURSE: EE5359 MULTIMEDIA PROCESSING, SPRING 2014 SUBMISSION Date: 04/02/14 SUBMITTED BY VISHNU
More informationAdaptive Deblocking Filter
614 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 Adaptive Deblocking Filter Peter List, Anthony Joch, Jani Lainema, Gisle Bjøntegaard, and Marta Karczewicz
More informationAnalysis and Improvement of Image Quality in De-Blocked Images
Vol.2, Issue.4, July-Aug. 2012 pp-2615-2620 ISSN: 2249-6645 Analysis and Improvement of Image Quality in De-Blocked Images U. SRINIVAS M.Tech Student Scholar, DECS, Dept of Electronics and Communication
More informationH.264 Video with Hierarchical QAM
Prioritized Transmission of Data Partitioned H.264 Video with Hierarchical QAM B. Barmada, M. M. Ghandi, E.V. Jones and M. Ghanbari Abstract In this Letter hierarchical quadrature amplitude modulation
More informationADAPTIVE channel equalization without a training
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 53, NO. 9, SEPTEMBER 2005 1427 Analysis of the Multimodulus Blind Equalization Algorithm in QAM Communication Systems Jenq-Tay Yuan, Senior Member, IEEE, Kun-Da
More informationPractical Content-Adaptive Subsampling for Image and Video Compression
Practical Content-Adaptive Subsampling for Image and Video Compression Alexander Wong Department of Electrical and Computer Eng. University of Waterloo Waterloo, Ontario, Canada, N2L 3G1 a28wong@engmail.uwaterloo.ca
More informationInternational Journal of Advancedd Research in Biology, Ecology, Science and Technology (IJARBEST)
Gaussian Blur Removal in Digital Images A.Elakkiya 1, S.V.Ramyaa 2 PG Scholars, M.E. VLSI Design, SSN College of Engineering, Rajiv Gandhi Salai, Kalavakkam 1,2 Abstract In many imaging systems, the observed
More informationAudio Signal Compression using DCT and LPC Techniques
Audio Signal Compression using DCT and LPC Techniques P. Sandhya Rani#1, D.Nanaji#2, V.Ramesh#3,K.V.S. Kiran#4 #Student, Department of ECE, Lendi Institute Of Engineering And Technology, Vizianagaram,
More informationBit-depth scalable video coding with new interlayer
RESEARCH Open Access Bit-depth scalable video coding with new interlayer prediction Jui-Chiu Chiang *, Wan-Ting Kuo and Po-Han Kao Abstract The rapid advances in the capture and display of high-dynamic
More informationAN ERROR LIMITED AREA EFFICIENT TRUNCATED MULTIPLIER FOR IMAGE COMPRESSION
AN ERROR LIMITED AREA EFFICIENT TRUNCATED MULTIPLIER FOR IMAGE COMPRESSION K.Mahesh #1, M.Pushpalatha *2 #1 M.Phil.,(Scholar), Padmavani Arts and Science College. *2 Assistant Professor, Padmavani Arts
More informationSimple Impulse Noise Cancellation Based on Fuzzy Logic
Simple Impulse Noise Cancellation Based on Fuzzy Logic Chung-Bin Wu, Bin-Da Liu, and Jar-Ferr Yang wcb@spic.ee.ncku.edu.tw, bdliu@cad.ee.ncku.edu.tw, fyang@ee.ncku.edu.tw Department of Electrical Engineering
More information410 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 2, FEBRUARY A. Background /$ IEEE
410 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 2, FEBRUARY 2010 Unequal Power Allocation for JPEG Transmission Over MIMO Systems Muhammad Farooq Sabir, Member, IEEE, Alan Conrad Bovik, Fellow,
More informationRegion Adaptive Unsharp Masking Based Lanczos-3 Interpolation for video Intra Frame Up-sampling
Region Adaptive Unsharp Masking Based Lanczos-3 Interpolation for video Intra Frame Up-sampling Aditya Acharya Dept. of Electronics and Communication Engg. National Institute of Technology Rourkela-769008,
More informationRECENTLY, there has been an increasing interest in noisy
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 52, NO. 9, SEPTEMBER 2005 535 Warped Discrete Cosine Transform-Based Noisy Speech Enhancement Joon-Hyuk Chang, Member, IEEE Abstract In
More informationOverview of Code Excited Linear Predictive Coder
Overview of Code Excited Linear Predictive Coder Minal Mulye 1, Sonal Jagtap 2 1 PG Student, 2 Assistant Professor, Department of E&TC, Smt. Kashibai Navale College of Engg, Pune, India Abstract Advances
More informationA Near Optimal Deblocking Filter for H.264 Advanced Video Coding
A Near Optimal Deblocking Filter for H.264 Advanced Video Coding Shen-Yu Shih Cheng-Ru Chang Youn-Long Lin Department of Computer Science National Tsing Hua University Hsin-Chu, Taiwan 300 Tel : +886-3-573-1072
More informationISSN: Seema G Bhateja et al, International Journal of Computer Science & Communication Networks,Vol 1(3),
A Similar Structure Block Prediction for Lossless Image Compression C.S.Rawat, Seema G.Bhateja, Dr. Sukadev Meher Ph.D Scholar NIT Rourkela, M.E. Scholar VESIT Chembur, Prof and Head of ECE Dept NIT Rourkela
More informationPerformance Analysis of Maximum Likelihood Detection in a MIMO Antenna System
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 50, NO. 2, FEBRUARY 2002 187 Performance Analysis of Maximum Likelihood Detection in a MIMO Antenna System Xu Zhu Ross D. Murch, Senior Member, IEEE Abstract In
More informationComprehensive scheme for subpixel variable block-size motion estimation
Journal of Electronic Imaging 20(1), 013014 (Jan Mar 2011) Comprehensive scheme for subpixel variable block-size motion estimation Ying Zhang The Hong Kong Polytechnic University Department of Electronic
More informationAdaptive Digital Video Transmission with STBC over Rayleigh Fading Channels
2012 7th International ICST Conference on Communications and Networking in China (CHINACOM) Adaptive Digital Video Transmission with STBC over Rayleigh Fading Channels Jia-Chyi Wu Dept. of Communications,
More informationScalable Fast Rate-Distortion Optimization for H.264/AVC
Hindawi Publishing Corporation EURASIP Journal on Applied Signal Processing Volume 26, Article ID 37175, Pages 1 1 DOI 1.1155/ASP/26/37175 Scalable Fast Rate-Distortion Optimization for H.264/AVC Feng
More informationA Modified Image Coder using HVS Characteristics
A Modified Image Coder using HVS Characteristics Mrs Shikha Tripathi, Prof R.C. Jain Birla Institute Of Technology & Science, Pilani, Rajasthan-333 031 shikha@bits-pilani.ac.in, rcjain@bits-pilani.ac.in
More informationJPEG Image Transmission over Rayleigh Fading Channel with Unequal Error Protection
International Journal of Computer Applications (0975 8887 JPEG Image Transmission over Rayleigh Fading with Unequal Error Protection J. N. Patel Phd,Assistant Professor, ECE SVNIT, Surat S. Patnaik Phd,Professor,
More informationEnhanced DCT Interpolation for better 2D Image Up-sampling
Enhanced Interpolation for better 2D Image Up-sampling Aswathy S Raj MTech Student, Department of ECE Marian Engineering College, Kazhakuttam, Thiruvananthapuram, Kerala, India Reshmalakshmi C Assistant
More informationORTHOGONAL frequency division multiplexing (OFDM)
IEEE TRANSACTIONS ON BROADCASTING, VOL. 50, NO. 3, SEPTEMBER 2004 335 Modified Selected Mapping Technique for PAPR Reduction of Coded OFDM Signal Seung Hee Han, Student Member, IEEE, and Jae Hong Lee,
More informationInterpolation-free sub-pixel motion estimation using optimal adaptive Kalman filtering technique: a survey
Journal of Engineering Technolog Interpolation-free sub-piel motion estimation using optimal adaptive Kalman filtering technique: a surve Esinder A. Aele* a, Sanja B. Dho b a,b Center for VLSI and Nanotechnolog,
More informationA Novel Approach of Compressing Images and Assessment on Quality with Scaling Factor
A Novel Approach of Compressing Images and Assessment on Quality with Scaling Factor Umesh 1,Mr. Suraj Rana 2 1 M.Tech Student, 2 Associate Professor (ECE) Department of Electronic and Communication Engineering
More informationDepartment of Electronic Engineering FINAL YEAR PROJECT REPORT
Department of Electronic Engineering FINAL YEAR PROJECT REPORT BEngECE-2009/10-- Student Name: CHEUNG Yik Juen Student ID: Supervisor: Prof.
More informationEfficient Bit-Plane Coding Scheme for Fine Granular Scalable Video Coding
Efficient Bit-Plane Coding Scheme for Fine Granular Scalable Video Coding Seung-Hwan Kim, Yo-Sung Ho Gwangju Institute of Science and Technology (GIST), 1 Oryong-dong, Buk-gu, Gwangju 500-712, Korea Received
More informationFong, WC; Chan, SC; Nallanathan, A; Ho, KL. Ieee Transactions On Image Processing, 2002, v. 11 n. 10, p
Title Integer lapped transforms their applications to image coding Author(s) Fong, WC; Chan, SC; Nallanathan, A; Ho, KL Citation Ieee Transactions On Image Processing, 2002, v. 11 n. 10, p. 1152-1159 Issue
More informationDesign of High-Performance Intra Prediction Circuit for H.264 Video Decoder
JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, VOL.9, NO.4, DECEMBER, 2009 187 Design of High-Performance Intra Prediction Circuit for H.264 Video Decoder Jihye Yoo, Seonyoung Lee, and Kyeongsoon Cho
More informationREVERSIBLE data hiding, or lossless data hiding, hides
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 10, OCTOBER 2006 1301 A Reversible Data Hiding Scheme Based on Side Match Vector Quantization Chin-Chen Chang, Fellow, IEEE,
More informationMULTIPATH fading could severely degrade the performance
1986 IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 53, NO. 12, DECEMBER 2005 Rate-One Space Time Block Codes With Full Diversity Liang Xian and Huaping Liu, Member, IEEE Abstract Orthogonal space time block
More informationColor Filter Array Interpolation Using Adaptive Filter
Color Filter Array Interpolation Using Adaptive Filter P.Venkatesh 1, Dr.V.C.Veera Reddy 2, Dr T.Ramashri 3 M.Tech Student, Department of Electrical and Electronics Engineering, Sri Venkateswara University
More informationIN MANY industrial applications, ac machines are preferable
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 46, NO. 1, FEBRUARY 1999 111 Automatic IM Parameter Measurement Under Sensorless Field-Oriented Control Yih-Neng Lin and Chern-Lin Chen, Member, IEEE Abstract
More informationIEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 50, NO. 12, DECEMBER
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 50, NO. 12, DECEMBER 2002 1865 Transactions Letters Fast Initialization of Nyquist Echo Cancelers Using Circular Convolution Technique Minho Cheong, Student Member,
More informationA Novel Method for Enhancing Satellite & Land Survey Images Using Color Filter Array Interpolation Technique (CFA)
A Novel Method for Enhancing Satellite & Land Survey Images Using Color Filter Array Interpolation Technique (CFA) Suma Chappidi 1, Sandeep Kumar Mekapothula 2 1 PG Scholar, Department of ECE, RISE Krishna
More informationMULTICARRIER communication systems are promising
1658 IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 52, NO. 10, OCTOBER 2004 Transmit Power Allocation for BER Performance Improvement in Multicarrier Systems Chang Soon Park, Student Member, IEEE, and Kwang
More informationHamming net based Low Complexity Successive Cancellation Polar Decoder
Hamming net based Low Complexity Successive Cancellation Polar Decoder [1] Makarand Jadhav, [2] Dr. Ashok Sapkal, [3] Prof. Ram Patterkine [1] Ph.D. Student, [2] Professor, Government COE, Pune, [3] Ex-Head
More informationCompression and Image Formats
Compression Compression and Image Formats Reduce amount of data used to represent an image/video Bit rate and quality requirements Necessary to facilitate transmission and storage Required quality is application
More informationGENERIC CODE DESIGN ALGORITHMS FOR REVERSIBLE VARIABLE-LENGTH CODES FROM THE HUFFMAN CODE
GENERIC CODE DESIGN ALGORITHMS FOR REVERSIBLE VARIABLE-LENGTH CODES FROM THE HUFFMAN CODE Wook-Hyun Jeong and Yo-Sung Ho Kwangju Institute of Science and Technology (K-JIST) Oryong-dong, Buk-gu, Kwangju,
More informationBEING wideband, chaotic signals are well suited for
680 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 51, NO. 12, DECEMBER 2004 Performance of Differential Chaos-Shift-Keying Digital Communication Systems Over a Multipath Fading Channel
More informationOn the Estimation of Interleaved Pulse Train Phases
3420 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 48, NO. 12, DECEMBER 2000 On the Estimation of Interleaved Pulse Train Phases Tanya L. Conroy and John B. Moore, Fellow, IEEE Abstract Some signals are
More informationA Sliding Window PDA for Asynchronous CDMA, and a Proposal for Deliberate Asynchronicity
1970 IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 51, NO. 12, DECEMBER 2003 A Sliding Window PDA for Asynchronous CDMA, and a Proposal for Deliberate Asynchronicity Jie Luo, Member, IEEE, Krishna R. Pattipati,
More informationThe ITU-T Video Coding Experts Group (VCEG) and
378 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 3, MARCH 2005 Analysis, Fast Algorithm, and VLSI Architecture Design for H.264/AVC Intra Frame Coder Yu-Wen Huang, Bing-Yu
More informationINTERSYMBOL interference (ISI) is a significant obstacle
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 53, NO. 1, JANUARY 2005 5 Tomlinson Harashima Precoding With Partial Channel Knowledge Athanasios P. Liavas, Member, IEEE Abstract We consider minimum mean-square
More informationError Resilient Coding Based on Reversible Data Hiding and Redundant Slice
20 Sixth International Conference on Image and Graphics Error Resilient Coding Based on Reversible Data Hiding and Redundant Slice Jiajia Xu,Weiming Zhang,Nenghai Yu,Feng Zhu,Biao Chen MOE-Microsoft Key
More informationFOR HIGH SPEED LOW POWER APPLICATIONS USING RADIX-4 MODIFIED BOOTH ENCODER
International Journal of Advancements in Research & Technology, Volume 4, Issue 6, June -2015 31 A SPST BASED 16x16 MULTIPLIER FOR HIGH SPEED LOW POWER APPLICATIONS USING RADIX-4 MODIFIED BOOTH ENCODER
More informationOVER THE REAL-TIME SELECTIVE ENCRYPTION OF AVS VIDEO CODING STANDARD
Author manuscript, published in "EUSIPCO'10: 18th European Signal Processing Conference, Aalborg : Denmark (2010)" OVER THE REAL-TIME SELECTIVE ENCRYPTION OF AVS VIDEO CODING STANDARD Z. Shahid, M. Chaumont
More informationTHE INCREASING demand for video signal communication
720 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 7, NO. 5, MAY 1998 A Bayes Decision Test for Detecting Uncovered- Background and Moving Pixels in Image Sequences Kristine E. Matthews, Member, IEEE, and
More informationLossless Image Watermarking for HDR Images Using Tone Mapping
IJCSNS International Journal of Computer Science and Network Security, VOL.13 No.5, May 2013 113 Lossless Image Watermarking for HDR Images Using Tone Mapping A.Nagurammal 1, T.Meyyappan 2 1 M. Phil Scholar
More informationQuality Assessment of Deblocked Images Changhoon Yim, Member, IEEE, and Alan Conrad Bovik, Fellow, IEEE
88 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 1, JANUARY 2011 Quality Assessment of Deblocked Images Changhoon Yim, Member, IEEE, and Alan Conrad Bovik, Fellow, IEEE Abstract We study the efficiency
More informationFOURIER analysis is a well-known method for nonparametric
386 IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, VOL. 54, NO. 1, FEBRUARY 2005 Resonator-Based Nonparametric Identification of Linear Systems László Sujbert, Member, IEEE, Gábor Péceli, Fellow,
More informationABSTRACT. We investigate joint source-channel coding for transmission of video over time-varying channels. We assume that the
Robust Video Compression for Time-Varying Wireless Channels Shankar L. Regunathan and Kenneth Rose Dept. of Electrical and Computer Engineering, University of California, Santa Barbara, CA 93106 ABSTRACT
More informationLocal prediction based reversible watermarking framework for digital videos
Local prediction based reversible watermarking framework for digital videos J.Priyanka (M.tech.) 1 K.Chaintanya (Asst.proff,M.tech(Ph.D)) 2 M.Tech, Computer science and engineering, Acharya Nagarjuna University,
More informationA new quad-tree segmented image compression scheme using histogram analysis and pattern matching
University of Wollongong Research Online University of Wollongong in Dubai - Papers University of Wollongong in Dubai A new quad-tree segmented image compression scheme using histogram analysis and pattern
More information6/29 Vol.7, No.2, February 2012
Synthesis Filter/Decoder Structures in Speech Codecs Jerry D. Gibson, Electrical & Computer Engineering, UC Santa Barbara, CA, USA gibson@ece.ucsb.edu Abstract Using the Shannon backward channel result
More informationSPEECH enhancement has many applications in voice
1072 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 45, NO. 8, AUGUST 1998 Subband Kalman Filtering for Speech Enhancement Wen-Rong Wu, Member, IEEE, and Po-Cheng
More informationAchievable-SIR-Based Predictive Closed-Loop Power Control in a CDMA Mobile System
720 IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 51, NO. 4, JULY 2002 Achievable-SIR-Based Predictive Closed-Loop Power Control in a CDMA Mobile System F. C. M. Lau, Member, IEEE and W. M. Tam Abstract
More informationImage De-Noising Using a Fast Non-Local Averaging Algorithm
Image De-Noising Using a Fast Non-Local Averaging Algorithm RADU CIPRIAN BILCU 1, MARKKU VEHVILAINEN 2 1,2 Multimedia Technologies Laboratory, Nokia Research Center Visiokatu 1, FIN-33720, Tampere FINLAND
More informationAPPLICATIONS OF DSP OBJECTIVES
APPLICATIONS OF DSP OBJECTIVES This lecture will discuss the following: Introduce analog and digital waveform coding Introduce Pulse Coded Modulation Consider speech-coding principles Introduce the channel
More informationPARALLEL coupled-line filters are widely used in microwave
2812 IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, VOL. 53, NO. 9, SEPTEMBER 2005 Improved Coupled-Microstrip Filter Design Using Effective Even-Mode and Odd-Mode Characteristic Impedances Hong-Ming
More informationImplementation of CAVLD Architecture Using Binary Tree Structures and Data Hiding for H.264/AVC Using CAVLC & Exp-Golomb Codeword Substitution
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IMPACT FACTOR: 5.258 IJCSMC,
More informationNew Lossless Image Compression Technique using Adaptive Block Size
New Lossless Image Compression Technique using Adaptive Block Size I. El-Feghi, Z. Zubia and W. Elwalda Abstract: - In this paper, we focus on lossless image compression technique that uses variable block
More informationComplexity modeling for context-based adaptive binary arithmetic coding (CABAC) in H.264/AVC decoder
Complexity modeling for context-based adaptive binary arithmetic coding (CABAC) in H.264/AVC decoder Szu-Wei Lee and C.-C. Jay Kuo Ming Hsieh Department of Electrical Engineering and Signal and Image Processing
More informationDESIGN & IMPLEMENTATION OF FIXED WIDTH MODIFIED BOOTH MULTIPLIER
DESIGN & IMPLEMENTATION OF FIXED WIDTH MODIFIED BOOTH MULTIPLIER 1 SAROJ P. SAHU, 2 RASHMI KEOTE 1 M.tech IVth Sem( Electronics Engg.), 2 Assistant Professor,Yeshwantrao Chavan College of Engineering,
More informationA Novel 3-D Color Histogram Equalization Method With Uniform 1-D Gray Scale Histogram Ji-Hee Han, Sejung Yang, and Byung-Uk Lee, Member, IEEE
506 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 2, FEBRUARY 2011 A Novel 3-D Color Histogram Equalization Method With Uniform 1-D Gray Scale Histogram Ji-Hee Han, Sejung Yang, and Byung-Uk Lee,
More informationTransmit Power Allocation for BER Performance Improvement in Multicarrier Systems
Transmit Power Allocation for Performance Improvement in Systems Chang Soon Par O and wang Bo (Ed) Lee School of Electrical Engineering and Computer Science, Seoul National University parcs@mobile.snu.ac.r,
More informationNSC E
NSC91-2213-E-011-119- 91 08 01 92 07 31 92 10 13 NSC 912213 E 011 119 NSC 91-2213 E 036 020 ( ) 91 08 01 92 07 31 ( ) - 2 - 9209 28 A Per-survivor Kalman-based prediction filter for space-time coded systems
More informationE LECTROOPTICAL(EO)modulatorsarekeydevicesinoptical
286 JOURNAL OF LIGHTWAVE TECHNOLOGY, VOL. 26, NO. 2, JANUARY 15, 2008 Design and Fabrication of Sidewalls-Extended Electrode Configuration for Ridged Lithium Niobate Electrooptical Modulator Yi-Kuei Wu,
More informationA Hybrid Synchronization Technique for the Frequency Offset Correction in OFDM
A Hybrid Synchronization Technique for the Frequency Offset Correction in OFDM Sameer S. M Department of Electronics and Electrical Communication Engineering Indian Institute of Technology Kharagpur West
More informationQuantized Coefficient F.I.R. Filter for the Design of Filter Bank
Quantized Coefficient F.I.R. Filter for the Design of Filter Bank Rajeev Singh Dohare 1, Prof. Shilpa Datar 2 1 PG Student, Department of Electronics and communication Engineering, S.A.T.I. Vidisha, INDIA
More informationArtifacts Reduced Interpolation Method for Single-Sensor Imaging System
2016 International Conference on Computer Engineering and Information Systems (CEIS-16) Artifacts Reduced Interpolation Method for Single-Sensor Imaging System Long-Fei Wang College of Telecommunications
More informationEfficient Image Compression Technique using JPEG2000 with Adaptive Threshold
Efficient Image Compression Technique using JPEG2000 with Adaptive Threshold Md. Masudur Rahman Mawlana Bhashani Science and Technology University Santosh, Tangail-1902 (Bangladesh) Mohammad Motiur Rahman
More informationSNR Scalability, Multiple Descriptions, and Perceptual Distortion Measures
SNR Scalability, Multiple Descriptions, Perceptual Distortion Measures Jerry D. Gibson Department of Electrical & Computer Engineering University of California, Santa Barbara gibson@mat.ucsb.edu Abstract
More informationSPACE TIME coding for multiple transmit antennas has attracted
486 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 3, MARCH 2004 An Orthogonal Space Time Coded CPM System With Fast Decoding for Two Transmit Antennas Genyuan Wang Xiang-Gen Xia, Senior Member,
More informationImprovements of Demosaicking and Compression for Single Sensor Digital Cameras
Improvements of Demosaicking and Compression for Single Sensor Digital Cameras by Colin Ray Doutre B. Sc. (Electrical Engineering), Queen s University, 2005 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF
More informationReversible Data Hiding in JPEG Images Based on Adjustable Padding
Reversible Data Hiding in JPEG Images Based on Adjustable Padding Ching-Chun Chang Department of Computer Science University of Warwick United Kingdom Email: C.Chang.@warwick.ac.uk Chang-Tsun Li School
More informationComparative Study of Different Wavelet Based Interpolation Techniques
Comparative Study of Different Wavelet Based Interpolation Techniques 1Computer Science Department, Centre of Computer Science and Technology, Punjabi University Patiala. 2Computer Science Department,
More information3432 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 53, NO. 10, OCTOBER 2007
3432 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 53, NO 10, OCTOBER 2007 Resource Allocation for Wireless Fading Relay Channels: Max-Min Solution Yingbin Liang, Member, IEEE, Venugopal V Veeravalli, Fellow,
More informationATIME-INTERLEAVED analog-to-digital converter
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 53, NO. 4, APRIL 2006 299 A Background Timing-Skew Calibration Technique for Time-Interleaved Analog-to-Digital Converters Chung-Yi Wang,
More informationExact Synthesis of Broadband Three-Line Baluns Hong-Ming Lee, Member, IEEE, and Chih-Ming Tsai, Member, IEEE
140 IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, VOL. 57, NO. 1, JANUARY 2009 Exact Synthesis of Broadband Three-Line Baluns Hong-Ming Lee, Member, IEEE, and Chih-Ming Tsai, Member, IEEE Abstract
More informationCombining Multipath and Single-Path Time-Interleaved Delta-Sigma Modulators Ahmed Gharbiya and David A. Johns
1224 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 55, NO. 12, DECEMBER 2008 Combining Multipath and Single-Path Time-Interleaved Delta-Sigma Modulators Ahmed Gharbiya and David A.
More information