( 12 ) United States Patent

Transcription

1 ( 12 ) United States Patent Yu et al ( 54 ) ELECTRONIC SYSTEM AND IMAGE PROCESSING METHOD ( 71 ) Applicant : SAMSUNG ELECTRONICS CO, LTD, Suwon - si ( KR ) ( 72 ) Inventors : Jaewon Yu, Yongin - si ( KR ) ; Ki - Chrl Park, Hwaseong - si ( KR ) TOMMUNOGLU UNTUK PENTIN US B2 ( 10 ) Patent No : US 9, 854, 218 B2 ( 45 ) Date of Patent : Dec 26, 2017 ( 56 ) References Cited U S PATENT DOCUMENTS 7, 646, 976 B2 1 / 2010 Kurosawa GO2B 7 / / 213 8, 035, 584 B2 10 / 2011 Jung B Choi et al B Seok et al 8, 970, 468 B2 3 / 2015 Albrecht G09G 5 / / B Furuta 9, 191, 640 B1 11 / 2015 Huang ( 73 ) Assignee : SAMSUNG ELECTRONICS CO, LTD, Suwon - si ( KR ) H04N 9 / 73 ( ) Notice : Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U S C 154 ( b ) by 0 days A Jung A Choi et al A Kim et al AL 5 / 2013 Seok et al Al 6 / 2014 Tamura 2014 / AL 8 / 2014 Furuta ( 21 ) Appl No : 14 / 966, 002 FOREIGN PATENT DOCUMENTS ( 22 ) Filed : Dec 11, 2015 ( 65 ) ( 65 ) Prior Publication Data US 2016 / A1 Aug 18, 2016 ( 30 ) Foreign Application Priority Data Feb 13, 2015 ( KR ) ( 51 ) Int Ci H04N 9 / 73 ( ) ( 52 ) U S CI CPC H04N 9 / 735 ( ) ( 58 ) Field of Classification Search CPC H04N 9 / 73 ; H04N 9 / 735 ; H04N 5 / 225 ; HO4N 5 / 76 USPC 348 / , 361, See application file for complete search history KR B1 5 / 2006 KR A KR B1 7 / 2012 cited by examiner Primary Examiner Yogesh Aggarwal ( 74 ) Attorney, Agent, or Firm Sughrue Mion, PLLC ( 57 ) ABSTRACT An image processing method includes receiving an image including a plurality of pixels, compensating a color tem perature of at least one pixel included in the image according to a color of the at least one pixel ; and outputting the image according to a result of the compensating, wherein the compensating includes : measuring a color temperature of the image ; and applying a color temperature compensation value to the at least one pixel based on the measured color temperature and the color of the at least one pixel 19 Claims, 13 Drawing Sheets Color Temperature Measurement Part Camera Module Preprocessing Part White Balance Part Postprocessing Part 500 LUT - L4YYYYYYYYYYYYYYYYYYYYYYYYY

2 w w w w w w w w U S Patent Dec 26, 2017 Sheet 1 of 13 US 9, 854, 218 B2 600 Postprocessing Part 300 Color Temperature Measurement Part 400 White Balance Part 500 LUT FIG Preprocessing Part Camera Module

3 U S Patent Dec 26, 2017 Sheet 2 of 13 US 9, 854, 218 B2 FIG 2 Color temperature Color Compensation value of color temperature 4000K K Yellow - 100K 4000K K Red + 100K 5000K K Yellow - 200K

4 U S Patent Dec 26, 2017 Sheet 3 of 13 US 9, 854, 218 B2 FIG 3 Start Receive image Preprocess image 5120 Compensate color temperature of each pixel of image according to color of each pixel of image R 130 Postprocess image Output image - S150 End

5 U S Patent Dec 26, 2017 Sheet 4 of 13 US 9, 854, 218 B2 FIG 4 S130 Measure color temperature of image 5210 Apply compensation value of color temperature to each pixel of image according to measured color temperature and color of each pixel of image - S220

6 U S Patent Dec 26, 2017 Sheet 5 of 13 US 9, 854, 218 B2 Start FIG 5 S220 Receive pixel Analyze color of pixel 5320 X S330 Color of pixel in LUT? Yes S340 Apply compensation value of color temperature to pixel No N Apply measured color temperature to pixel S350 Last pixel? 0 End Yes S360

7 atent Dec 26, 2017 Sheet 6 of 13 US 9, 854, 218 B2 FIG 6 Start antone Receive pixel D : : RS4 Analyze color of pixel 5420 $ 430 No Color of pixel in LUT? Yes S440 Apply compensation value of color temperature to pixel S450 Calculate compensation value of color temperature Apply calculated compensation value of color temperature to pixel Last pixel? End Yes S470 $ 460

8 U S Patent Dec 26, 2017 Sheet 7 of 13 US 9, 854, 218 B2 FIG 7 Green Yellow Cyan Red Blue Magenta

9 atent Dec 26, 2017 Sheet 8 of 13 US 9, 854, 218 B2 510 Compensation value of color temperature - 80K - 90K - 100K - 110K - 200K 100K Color Yellow Yellow Yellow Yellow Yellow Red FIG 8 Color temperature 4000K ~ 5000K 4000K K 5000K K 4000K ~ 5000K 5000K K 4000K K Luminance A Lux B Lux A Lux B Lux C Lux D Lux Outdoor / Indoor Outdoor Outdoor Indoor Indoor Outdoor Indoor

10 U S Patent Dec 26, 2017 Sheet 9 of 13 US 9, 854, 218 B2 FIG 9 $ 130 Start Measure color temperature of image 5510 Measure luminance of image S520 Determine whether image is shot outdoor or indoor S530 Apply compensation value of color temperature to each pixel of image according to measured color temperature, color of each pixel of image, measured luminance, and whether image is shot outdoor or indoor S540 End

11 : : atent Dec 26, 2017 Sheet 10 of 13 US 9, 854, 218 B RF Chip ??????? DIORF Slave PHY GPS 3290 Bridge chip de 3264 UWB 3262 WLAN Application Processor 3260 Wimax MIP DigRF PHY 3140 DigRF Master CSI Host ISPADES H DSI Host SER 3150 Camera Serial interface Display Serial Interface 11 : SER DES bururuwwwwwwwwwwwwwwww! 3235 CSI Device DSI Device _ 3230 Image Sensor Display 3100 Speaker ww MICK Embedded / Cardio Storage Working Memory FIG 10 w

12 atent Dec 26, 2017 Sheet 11 of 13 US 9, 854, 218 B2 FIG FIG

13 U S Patent Dec 26, 2017 Sheet 12 of 13 US 9, 854, 218 B2 FIG ALLA FIG

14 U S Patent Dec 26, 2017 Sheet 13 of 13 US 9, 854, 218 B2 FIG

15 US 9, 854, 218 B2 ELECTRONIC SYSTEM AND IMAGE one pixel exists in a look up table ; and in response to PROCESSING METHOD determining that the color of the at least one pixel exists in the look up table, determining the color temperature com CROSS - REFERENCE TO RELATED pensation value corresponding to the color and the measured APPLICATION 5 color temperature of the at least one pixel by using the look up table and applying the determined color temperature This application claims priority from Korean Patent compensation value to the at least one pixel Application No , filed on Feb 13, 2015 A color temperature of the at least one pixel may be in the Korean Intellectual Property Office, the disclosure of determined as a value obtained by compensating the mea which is hereby incorporated in its entirety by reference 10 sured color temperature of the at least one pixel based on the color temperature compensation value BACKGROUND The applying the color temperature compensation value may further include : in response to determining that the Systems, apparatuses, and methods consistent with exem - color of the at least one pixel does not exist in the look up plary embodiments relate to an electronic system and an 15 table, determining the measured color temperature of the at image processing method, and more particularly, to an least one pixel as a color temperature of the at least one electronic system including an image signal processing pixel device compensating a white balance of an image and an The applying the color temperature compensation value image processing method thereof may further include in response to determining that the color As a digital technology develops, a digital camera capable 20 of the at least one pixel does not exist in the look up table, of shooting an image without a film is being rapidly devel - calculating the color temperature compensation value cor oped responding to the color of the at least one pixel ; and applying The core of a digital camera may include an image sensor the calculated color temperature compensation value to the unit that captures an image, or an image processing unit that at least one pixel processes a digital signal Due to a difference in image 25 The calculating may include calculating the color tem quality and a color of a digital camera and those of a film perature compensation value based on color temperature camera, a study and an improvement in an image processing compensation values of at least two colors stored in the look field of the digital camera are needed In particular, a color up table and based on a location of the color of the at least processing for a natural color reproduction is the core in an one pixel with respect to the two colors stored in the look up image processing field 30 table When shooting the same subject using a digital image In response to determining that the color of the at least one device such as a digital still camera, a digital video camera, pixel does not exist in the look up table, the color tempera etc, an apparent color shot becomes different depending on ture compensation value corresponding to the color of the at various light source conditions such as a solar light, cloudy least one pixel may be determined based on the color weather, white lightning, fluorescent lightning, etc Since a 35 temperature compensation values of the at least two colors human eye adapts itself to a light source to feel white as ston white, the human eye does not feel unnaturalness However, The applying the color temperature compensation value in a digital image device, color temperature sufficiently may further include determining whether the at least one responds to KGB components included in different light pixel is a last pixel among the plurality of pixels of the sources If the color temperature is high, the color is repro - 40 image, and in response to determining that the at least one duced as white tinged with blue If the color temperature is pixel is not the last pixel, receiving another pixel among the low, the color is reproduced as white tinged with red plurality of pixels of the image and compensating a color Thus, even in the case that color temperature is changed, temperature of the another pixel according to a color of the it is desirable to maintain a white balance To achieve this, another pixel it is controlled such that in an achromatic color subject, an 45 The compensating may further include performing at least RGB ratio is always constant or color difference signals R - Y, one of : measuring brightness of the at least one pixel ; and B - Y become always substantially zero Performance of that determining whether the image is captured indoors or out function is called a white balance correction That is, in doors white tinged with blue, gain of R ( red ) is increased more The applying the color temperature compensation value than gain of B ( blue ), and in white tinged with red, gain of 50 may include applying the color temperature compensation B ( blue ) is increased more than gain of R ( red ) value to the at least one pixel based on at least one from among the measured color temperature of the at least one SUMMARY pixel, the color of the at least one pixel, the measured brightness of the at least one pixel, and whether the image One or more exemplary embodiments provide an image 55 is captured indoors or outdoors processing method The image processing method may The image processing method may further include prior to include receiving an image including a plurality of pixels ; performing the compensating, performing a preprocessing compensating a color temperature of at least one pixel operation on the image ; and after performing the compen included in the image according to a color of the at least one sating, performing a post - processing operation on the image pixel ; and outputting the image according to a result of the 60 According to an aspect of another exemplary embodi compensating, wherein the compensating includes : measur - ment, there is an electronic system including : a camera ing a color temperature of the image ; and applying a color configured to capture an image including a plurality of temperature compensation value to the at least one pixel pixels, a color temperature measurer configured to measure based on the measured color temperature and the color of the a color temperature of at least one pixel of the image ; a look at least one pixel 65 up table configured to store a color temperature compensa The applying may include : analyzing the color of the at tion value according to the color temperature and a color of least one pixel ; determining whether the color of the at least the at least one pixel ; and a white balance adjuster config

16 US 9, 854, 218 B2 ured to compensate the color temperature of the at least one FIGS 11 through 15 illustrate examples of a multimedia pixel of the image by using the look up table device including an electronic system in accordance with The white balance adjuster may be further configured to nts apply the color temperature compensation value to the at least one pixel of the image DETAILED DESCRIPTION The look up table may be further configured to store the color temperature compensation value based on at least one Reference will now be made in detail to exemplary of brightness of an environment in which the image is embodiments, examples of which are illustrated in the measured and whether the image is captured indoors or accompanying drawings The exemplary embodiments are outdoors 10 merely provided to fully describe the present inventive The white balance adjuster may be further configured to concept to one of ordinary skill in the art to which the compensate the color temperature of the at least one pixel of present inventive concept pertains As the present inventive the image based on the at least one of the brightness of the concept allows for various changes and numerous exem environment in which the image is measured and whether plary embodiments, particular exemplary embodiments will the image is captured indoors or outdoors, by using the look 15 be illustrated in the drawings and described in detail in the up table written description However, this is not intended to limit the According to an aspect of still another exemplary embodi - present inventive concept to particular modes of practice, ment, there is provided an image signal processing apparatus and it will be understood that all changes, equivalents, and including : a preprocessing module configured to perform a substitutes that do not depart from the spirit and technical preprocessing operation on an image ; a color temperature 20 scope of the present inventive concept are encompassed in measurer configured to measure a color temperature of at the present inventive concept Like reference numerals refer least one pixel of the image ; a white balance adjuster to like elements throughout Sizes of components in the configured to compensate the color temperature of the at drawings may be exaggerated for clarity As used herein, the least one pixel of the image based on a color and the color term and / or includes any and all combinations of one or temperature of the at least one pixel ; and a post - processing 25 more of the associated listed items Expressions such as at module configured to perform a post - processing operation least one of," when preceding a list of elements, modify the on the compensated image entire list of elements and do not modify the individual The image signal processing apparatus may further elements of the list include a look up table configured to store a color tempera The terms used in the present specification are merely ture compensation value based on the color and the color 30 used to describe particular exemplary embodiments, and are temperature of the at least one pixel not intended to limit the present inventive concept An The white balance adjuster may be further configured to expression used in the singular encompasses the expression correct a white balance of the at least one pixel by using the of the plural, unless it has a clearly different meaning in the look up table context In the present specification, it is to be understood The white balance adjuster may be further configured to 35 that the terms such as including, having, and compris apply the color temperature compensation value to the at ing are intended to indicate the existence of the features, least one pixel of the image numbers, operations, actions, components, parts, or combi The white balance adjuster may be further configured to nations thereof disclosed in the specification, and are not compensate the color temperature of the at least one pixel of intended to preclude the possibility that one or more other the image based on brightness of the at least one pixel 40 features, numbers, operations, actions, components, parts, or combinations thereof may exist or may be added BRIEF DESCRIPTION OF THE FIGURES While such terms as " first," " second," etc, may be used to describe various components, such components must not The above and / or other aspects will become more appar - be limited to the above terms The above terms are used only ent by describing certain exemplary embodiments with 45 to distinguish one component from another For example, reference to the accompanying drawings within the scope of the present inventive concept, a first FIG 1 is a block diagram of an electronic system in component may be referred to as a second component, and accordance with an exemplary embodiment vice versa FIG 2 is a drawing illustrating a look up table of FIG 1 Unless defined otherwise, all terms used in the description in accordance with an exemplary embodiment 50 including technical or scientific terms have the same mean FIG 3 is a flowchart illustrating an image processing ing as commonly understood by one of ordinary skill in the method of an image signal processing device in accordance art to which the present inventive concept pertains It will be with an exemplary embodiment further understood that terms, such as those defined in FIG 4 is a flowchart illustrating operation S130 of FIG commonly used dictionaries, should be interpreted as having 3 in accordance with an exemplary embodiment 55 a meaning that is consistent with their meaning in the FIG 5 is a flowchart illustrating operation S220 of FIG context of the related art, and should not be interpreted as 4 in accordance with an exemplary embodiment having ideal or excessively formal meanings unless it is FIG 6 is a flowchart illustrating operation S220 of FIG clearly defined in the specification 4 in accordance with another exemplary embodiment FIG 1 is a block diagram of an electronic system in FIG 7 is a drawing illustrating a circular color space 60 accordance with an exemplary embodiment FIG 8 is a drawing illustrating a look up table of FIG 1 Referring to FIG 1, an electronic system 10 may include in accordance with another exemplary embodiment a camera module ( or camera ) 100 and an image signal FIG 9 is a flowchart illustrating operation S130 of FIG processing device 110 The image signal processing device 3 in accordance with another exemplary embodiment 110 may include a preprocessing part 200, a color tempera FIG 10 is a block diagram illustrating an electronic 65 ture measurement part ( or color temperature measurer ) 300, system including an image signal processing device in a white balance part ( or white balance adjuster ) 400, a look accordance with an exemplary embodiment up table ( LUT ) 500, and a post - processing part 600

17 US 9, 854, 218 B2 The camera module 100 may include a portable camera can be increased by compensating a suitable color tempera and / or a shooting device built in a portable terminal, a ture in accordance with color at every pixel notebook, a computer, etc FIG 2 is a drawing illustrating a look up table of FIG 1 The camera module 100 can shoot a subject and convert in accordance with an exemplary embodiment an image shot into an electrical signal The camera module 5 Referring to FIGS 1 and 2, a color temperature and a 100 may include a shooting lens into which a light reflected color temperature compensation value according to color are from the subject enters, a color filter for filtering a light of stored in the LUT 500 a specific wavelength range among lights that enter the In the case where a color temperature of a measured shooting lens and an image sensor for converting filtered image belongs to a range of 4000 K K and a color of light into an electrical signal The camera module 100 may 10 a first pixel to be compensated with respect to the color generate a digital image including a plurality of pixels Each temperature is yellow, a color temperature compensation pixel may include red, green and blue data value may be K The white balance part 400 can The preprocessing part 200 performs a preprocessing process a color temperature being applied to the first pixel by operation on an image received from the camera module a value obtained by subtracting 100 K from the color 100 The preprocessing operation may include a series of 15 temperature of the measured image data processing procedure that is performed before a white In the case where a color temperature of a measured balance correction is performed The preprocessing part 200 image belongs to a range of 4000 K K and a color of can illustratively perform a lens shading correction ( LSC ), a a second pixel to be compensated with respect to the color chromatic aberration correction, a Gamma correction and a temperature is red, a color temperature compensation value color interpolation of an image However, the preprocessing 20 may be 100 K The white balance part 400 can process part 200 is not limited thereto and the preprocessing part 200 color temperature being applied to the second pixel by a may perform parts of the processing procedures described as value obtained by adding 100 K to the color temperature of an illustration and the remaining part may be performed in the measured image the post - processing part 600 As described above, even if a color temperature of the The color temperature measurement part 300 analyzes an 25 measured image is the same or is within the same range, a image to measure a color temperature of the image The different color temperature compensation value may be color temperature measurement part 300 can convert the applied if colors of the first and second pixels are different measured color temperature of the image into an electrical from each other signal In FIG 1, the color temperature measurement part In the case where a color temperature of a measured 300 analyzes an image received from the camera module 30 image belongs to a range of 5000 K K and a color of 100 to measure a color temperature of the image In another a third pixel to be compensated with respect to the color exemplary embodiment, the color temperature measurement temperature is yellow, a color temperature compensation part 300 may analyze an image preprocessed in the prepro - value may be K The white balance part 400 can cessing part 200 to measure a color temperature of the process a color temperature being applied to the third pixel image 35 by a value obtained by subtracting 200 K from the color The white balance part 400 can correct a white balance of temperature of the measured image preprocessed image The white balance part 400 can correct As described above, even if colors of the first and third a white balance of an image with reference to color tem - pixels are the same, a different color temperature compen perature information measured in the color temperature sation value may be applied if color temperatures of the measurement part 300 and the look up table ( LUT ) measured image are different from each other Specifically, the white balance part 400 analyzes an image FIG 3 is a flowchart illustrating an image processing by each pixel to determine a color of each pixel The white method of an image signal processing device in accordance balance part 400 reads out a color temperature compensation with an exemplary embodiment value according to a color of each pixel from the LUT 500 Referring to FIGS 1 and 3, an image shot in the camera to compensate a color temperature of corresponding pixels 45 module 100 is received ( S110 ) Next, a preprocessing opera The white balance part 400 can apply a color temperature tion is performed on the image ( S120 ) compensation value according to color to each pixel of the A color temperature of each pixel is compensated accord image ing to a color of each pixel of the image ( S130 ) A color In an exemplary embodiment, the LUT 500 stores a color temperature compensation is performed on each pixel of the temperature compensation value according to a color tem - 50 image perature of an image and a color of each pixel The LUT 500 A post - processing operation is performed on the color may be stored in a nonvolatile memory temperature compensated image ( S140 ) The post - processed The post - processing part 600 performs a post - processing image is output ( S150 ) operation on a color temperature compensated image The According to an image processing method of an image post - processing operation may include a series of data 55 signal processing device in accordance with an exemplary processing procedure that is performed after a white balance embodiment, a color reproduction rate of an image can be correction is performed The post - processing part 600 can increased by suitably compensating a color temperature in perform noise attenuation However, the post - processing accordance with color at each pixel part 600 is not limited thereto and can perform a part of FIG 4 is a flowchart illustrating operation S130 of FIG processing procedures to be performed in the preprocessing 60 3 in accordance with an exemplary embodiment part 200 Referring to FIGS 1 through 4, operation S130 includes Since an RGB characteristic of each channel of an image operations S210 and $ 220 sensor of the camera module 100 is different from a human In operation S210, a color temperature of an image is eye, a color temperature according to color may appear measured Operation S210 may be performed in the color different According to an electronic system including an 65 temperature compensation part 300 image signal processing device in accordance with exem - In operation S220, a compensation value of the color plary embodiments, a color reproduction rate of an image temperature may be applied to each pixel of the image

18 US 9, 854, 218 B2 according to a color temperature of the measured image and cyan, blue, and magenta In FIG 7, red is set to 0, and a color of each pixel of the image In Operation S220, a color yellow, green, cyan, blue and magenta are sequentially temperature of a measured image and a color temperature represented with every 60 of angle increase in a counter compensation value corresponding to a color of each pixel clockwise direction from the red of the image are read out from the LUT 500, and the read out 5 It is assumed that a color temperature compensation value color temperature compensation value is applied to each according to the typical colors illustrated in FIG 7 is stored pixel in the LUT 500 of FIGS 1 and 2 That is, a color temperature FIG 5 is a flowchart illustrating operation S220 of FIG compensation value according to red, yellow, green, cyan, 4 in accordance with an exemplary embodiment blue, and magenta may be stored in the LUT 500 However, Referring to FIGS 1 through 5, operation S220 includes 10 a color temperature compensation value according to colors operations S310 through S360 other than the typical colors may not be stored in the LUT In operation S310, an image is received by a pixel unit In 500 For example, a color temperature compensation value operation S320, a color of an input pixel among pixels according to a color X1 of an input pixel may not be stored included in the image is analyzed Then, a color of the in the LUT 500 analyzed input pixel is checked in the LUT 500 ( S330 ) If 15 The color temperature compensation value according to the number of colors stored in the LUT 500 is increased, the color X1 of the input pixel may be calculated based on more accurate color temperature compensation is possible color temperature compensation values of two typical colors but a memory capacity occupied by the LUT 500 needs to stored in the LUT 500 and based on a location of the color increase Thus, the LUT 500 may not store color temperature X1 of the input pixel between two typical colors The color compensation values with respect to all of possible colors 20 X1 of the input pixel is positioned between the two typical that exist in the natural world colors That is, a value corresponding to the location of the In operation S330, if a color of the analyzed input pixel color X1 of the input pixel between two typical colors is exists in the LUT 500, the procedure proceeds to operation calculated from the color temperature compensation values S340 In operation S340, a color temperature compensation of the two typical colors The location of the color X1 of the value corresponding to the analyzed color of the input pixel 25 input pixel between two typical colors is determined through and the measured color temperature of the image are applied a distance between the color X1 of the input pixel and the to the input pixel The color temperature of the input pixel two typical colors or an angle of the color X1 of the input may be determined as a value obtained by compensating the pixel with respect to the two typical colors color temperature of the measured image with the color The color temperature compensation value according to temperature compensation value 30 the color X1 of the measured input pixel is determined as a In operation S330, if the color of the analyzed input pixel value among the color temperature compensation values of does not exist in the LUT 500, the procedure proceeds to the two typical colors operation S350 In operation S350, the color temperature of It is assumed that the color X1 of the input pixel is a color the measured image is determined as a color temperature of between red and yellow It is also assumed that a color the input pixel 35 temperature of a measured image is within a range of 4000 Next, in operation S360, it is determined whether the K K A distance between red and the color X1 of the input pixel is the last pixel among the pixels included in the input pixel may be the same as a distance between yellow image If the input pixel is the last pixel among the pixels and color X1 of the input pixel That is, the color X1 of the included in the image, operation S220 is finished If the input input pixel may be set to 30 in the color space of FIG 7 pixel is not the last pixel among the pixels making an image, 40 Referring to FIGS 2 and 7, the color temperature com the procedure proceeds to operation S310 to repeat opera - pensation value of the color X1 of the input pixel may have tions S310 through S360 That is, another pixel among the a value corresponding to an intermediate value between 100 pixels included in the image is received and a color tem - K which is a color temperature compensation value when perature compensation is performed with respect to the the color of the input pixel X1 is red and K which is received pixel 45 a color temperature compensation value when the color of FIG 6 is a flowchart illustrating operation S220 of FIG the input pixel X1 is yellow Thus, the color temperature 4 in accordance with another exemplary embodiment compensation value of the color X1 of the input pixel may Referring to FIGS 1 through 4 and 6, operation S220 be calculated as 0 K includes operations S410 through S470 FIG 8 is a drawing illustrating a look up table of FIG 1 Since operations S410 through S440 and operation S in accordance with another exemplary embodiment illustrated in FIG 6 are substantially the same as operations Referring to FIGS 1 and 8, a look up table ( LUT ) 510 can S340 through S360, a detailed description thereof is omitted further store various conditions or factors to set a color In operation S430, if the color of the analyzed input pixel temperature compensation value compared with the LUT does not exist in the LUT 500, the procedure proceeds to 500 of FIG 2 The LUT 510 can store a color temperature operation S450 In operation S450, a color temperature 55 of an image, a color of each pixel, information on whether compensation value with respect to the color of the analyzed an image is shot indoors or outdoors, and a color tempera input pixel is calculated Operation S450 will be described ture compensation value according to brightness of an further in detail with reference to FIG 7 environment in which an image is measured In operation S460, the calculated color temperature com Thus, according to an image processing method of an pensation value is applied to the input pixel A color tem - 60 image signal processing device including the LUT 510 of perature of the input pixel may be determined as a value FIG 8, more accurate color temperature compensation is obtained by compensating a color temperature of the mea - possible and thereby a color reproduction rate of an image sured image based on the calculated color temperature shot can be increased compensation value FIG 9 is a flowchart illustrating operation S130 of FIG FIG 7 is a drawing illustrating a circular color space In 65 3 in accordance with another exemplary embodiment FIG 7, six typical colors are represented for illustrative Referring to FIGS 1, 3, 8 and 9, operation S130 includes purposes The typical colors may include red, yellow, green, operations S510 through S540

19 US 9, 854, 218 B2 10 In operation S510, a color temperature of an image is 3240 and the PHY 3140 of the application processor 3100 measured Operation S510 may be performed in the color can exchange data with each other by a DigFRF interface temperature measurement part 300 suggested by the MIPI alliance In operation S520, brightness of the image is measured The electronic system 3000 may further include a work Brightness of an environment in which the image is mea - 5 ing memory 3250 and an embedded / card storage 3255 The sured can be determined through the measured brightness of working memory 3250 and the embedded / card storage 3255 the image In operation S530, it is determined whether the can store data provided from the application processor 3100 image is measured ( or captured ) indoors or outdoors Opera - Further, data stored in the working memory 3250 and the tion S530 can be determined through a wavelength spectrum embedded / card storage 3255 may be provided to the appli and / or brightness of the measured image 10 cation processor 3100 In operation S540, a color temperature compensation The working memory 3250 can temporarily store data value may be applied to each pixel of an image according to processed or to be processed by the application processor a color temperature of the measured image, a color of each 3100 The working memory 3250 may include a volatile pixel of the image, brightness of the measured image and / or memory such as a static random access memory ( RAM ), a whether the image is shot indoors or outdoors Operation 15 dynamic random access memory ( DRAM ), a synchronous S540 may be performed in the white balance part 400 In dynamic random access memory ( SDRAM ), etc or a non operation S540, a color temperature compensation value volatile memory such as a flash memory, a parameter corresponding to a color temperature of the measured image, random access memory ( PRAM ), a magnetoresistive ran a color of each pixel of the image, brightness of the dom access memory ( MRAM ), a resistive random access measured image, and / or whether the image is shot indoors or 20 memory ( ReRAM ), a ferroelectric random access memory outdoors is read out from the LUT 510, and the color ( FRAM ), etc The embedded / card storage 3255 can store temperature compensation value that is read out may be data regardless of whether power supply is supplied applied to a corresponding pixel The electronic system 3000 can communicate with an FIG 10 is a block diagram illustrating an electronic external system through a communication module ( or com system including an image signal processing device in 25 municator ) such as world interoperability for microwave accordance with an exemplary embodiment An electronic access ( Wimax ) 3260, a wireless local area network system 3000 may be embodied by a data processing device ( WLAN ) 3262, an ultra wideband ( UWB ) 3264, etc The capable of using or supporting an interface suggested by a electronic system 3000 may further include a speaker 3270 mobile industry processor interface ( MIPI ) alliance For and a microphone 3275 for processing voice information example, the electronic system 3000 may be embodied by a 30 The electronic system 3000 may further include a global portable communication terminal, a personal digital assis - positioning system ( GPS ) device 3280 for processing loca tant ( PDA ), a portable media player ( PMP ), a smart phone, tion information The electronic system 3000 may further or a wearable device include a bridge chip 3290 for managing a connection to The electronic system 3000 may include an application peripheral devices processor 3100, a display 3220, and an image sensor FIGS 11 through 15 illustrate examples of a multimedia The application processor 3100 may include a DigRF master device including an electronic system in accordance with an 3110, a display serial interface ( DSI ) host 3120, a camera exemplary embodiment serial interface ( CSI ) host 3130, a physical hierarchy ( PHY ) The image signal processing device in accordance with an 3140, and an image signal processing device 3150 exemplary embodiment may be applied to various multime The DSI host 3120 can communicate with a DSI device 40 dia devices including an image processing function For 3225 of the display 3220 according to the DSI For example, example, the image signal processing device in accordance an optical serializer SER may be embodied in the DSI host with an exemplary embodiment may be applied to a mobile 3120 Also, for example, an optical deserializer DES may be phone or smart phone 1000, a tablet or smart tablet 1100, a embodied in the DSI device 3225 notebook computer 1200, a television or smart television The CSI host 3130 can communicate with a CSI device and a digital camera or digital camcorder 1400 as 3235 of the image sensor 3230 according to the CSI For illustrated in FIGS 11 through 15 respectively example, an optical deserializer DES may be embodied in According to an electronic system and an image process the CSI host 3130 Also, for example, an optical serializer ing method in accordance with exemplary embodiments, a SER may be embodied in the CSI device 3235 color reproduction rate of an image can be increased by The image signal processing device 3150 can communi - 50 compensating a suitable color temperature in accordance cate with the CSI host 3130 through a memory ( for instance, with color at each pixel a working memory 3250 or the application processor 3100 ) At least one of the components, elements or units repre and a bus The image signal processing device 3150 can sented by a block as illustrated in FIGS 1 and 10 may be apply a color temperature compensation value according to embodied as various numbers of hardware, software and / or color to all of the pixels of the image 55 firmware structures that execute respective functions In FIG 10, the application processor 3100 includes the described above, according to an exemplary embodiment image signal processing device 3150 However, in an alter - For example, at least one of these components, elements or native exemplary embodiment, at least a portion of the units may use a direct circuit structure, such as a memory, image signal processing device 3150 may be included in the processing, logic, a look - up table, etc that may execute the image sensor 3230 In this case, the image sensor 3230 can 60 respective functions through controls of one or more micro apply a color temperature compensation value to all of the processors or other control apparatuses Also, at least one of pixels of the image these components, elements or units may be specifically The electronic system 3000 can further include a radio embodied by a module, a program, or a part of code, which frequency ( RF ) chip 3240 that communicates with the contains one or more executable instructions for performing application processor 3100 The RF chip 3240 may include 65 specified logic functions Also, at least one of these com a physical hierarchy ( PHY ) 3242, a DigRF slave 3244, and ponents, elements or units may further include a processor an antenna 3246 For example, the PHY 3242 of the RF chip such as a central processing unit ( CPU ) that performs the

20 US 9, 854, 218 B2 12 respective functions, a microprocessor, or the like Further, and based on a location of the color of the at least one pixel although a bus is not illustrated in the above block diagrams, with respect to the at least two colors stored in the look up communication between the components, elements or units table may be performed through the bus Functional aspects of the 6 The image processing method of claim 5, wherein in above exemplary embodiments may be implemented in 5 response to determining that the color of the at least one algorithms that execute on one or more processors Further pixel does not exist in the look up table, the color tempera more, the components, elements or units represented by a ture compensation value corresponding to the color of the at block or processing steps may employ any number of related art techniques for electronics configuration, signal process least one pixel is determined based on the color temperature compensation values of the at least two colors stored in the ing and / or control, data processing and the like Although a few embodiments have been shown and look up table described, it would be appreciated by those skilled in the art 7 The image processing method of claim 1, wherein the that changes may be made in the exemplary embodiments applying the color temperature compensation value further without departing from the principles and spirit of the comprises : disclosure, the scope of which is defined in the claims and 15 determining whether the at least one pixel is a last pixel their equivalents among the plurality of pixels of the image, and What is claimed is : in response to determining that the at least one pixel is not 1 An image processing method comprising : the last pixel, receiving another pixel among the plu receiving an image comprising a plurality of pixels ; rality of pixels of the image and compensating a color compensating a color temperature of at least one pixel of 20 temperature of the another pixel according to a color of the image according to a color of the at least one pixel ; the another pixel and 8 The image processing method of claim 1, wherein the outputting the image according to a result of the compen compensating further comprises performing at least one of : sating, measuring brightness of the at least one pixel ; and wherein the compensating comprises : 25 determining whether the image is captured indoors or measuring a color temperature of the at least one pixel ; outdoors and 9 The image processing method of claim 8, wherein the applying a color temperature compensation value to the applying the color temperature compensation value com at least one pixel based on the measured color prises applying the color temperature compensation value to temperature and the color of the at least one pixel, 30 the at least one pixel based on at least one from among the and measured color temperature of the at least one pixel, the wherein the applying comprises : color of the at least one pixel, the measured brightness of the analyzing the color of the at least one pixel ; at least one pixel, and whether the image is captured indoors determining whether the color of the at least one pixelor outdoors exists in a look up table ; and The image processing method of claim 1, further in response to determining that the color of the at least comprising : one pixel exists in the look up table, determining the prior to performing the compensating, performing a pre color temperature compensation value correspond processing operation on the image ; and ing to the color and the measured color temperature after performing the compensating, performing a post of the at least one pixel by using the look up table and 40 processing operation on the image applying the determined color temperature compen - 11 The image processing method of claim 1, wherein the sation value to the at least one pixel color temperature compensation value varies according to 2 The image processing method of claim 1, wherein the the measured color temperature and the color of the at least color temperature of the at least one pixel is determined as one pixel a value obtained by compensating the measured color tem An electronic system comprising : perature of the at least one pixel based on the color tem - a camera configured to capture an image comprising a perature compensation value plurality of pixels ; 3 The image processing method of claim 1, wherein the a color temperature measurer configured to measure a applying the color temperature compensation value further color temperature of at least one pixel of the image ; comprises : 50 a look up table configured to store a color temperature in response to determining that the color of the at least one compensation value for adjusting the color tempera pixel does not exist in the look up table, determining ture, according to the color temperature and a color of the measured color temperature of the at least one pixel the at least one pixel ; and as the color temperature of the at least one pixel a white balance adjuster configured to read out the color 4 The image processing method of claim 1, wherein the 55 temperature compensation value corresponding to the applying the color temperature compensation value further measured color temperature and the color of the at least comprises : one pixel from the look up table to compensate the in response to determining that the color of the at least one color temperature of the at least one pixel of the image pixel does not exist in the look up table, calculating the 13 The electronic system of claim 12, wherein the white color temperature compensation value corresponding 60 balance adjuster is further configured to apply the color temperature compensation value to the at least one pixel of to the color of the at least one pixel ; and applying the calculated color temperature compensation the image value to the at least one pixel 14 The electronic system of claim 12, wherein the look 5 The image processing method of claim 4, wherein the up table is further configured to store the color temperature calculating comprises calculating the color temperature 65 compensation value based on at least one of brightness of an compensation value based on color temperature compensa - environment in which the image is measured and whether tion values of at least two colors stored in the look up table the image is captured indoors or outdoors

21 US 9, 854, 218 B The electronic system of claim 14, wherein the white one pixel from the look up table to compensate the balance adjuster is further configured to compensate the color temperature of the at least one pixel of the image ; color temperature of the at least one pixel of the image based and on the at least one of the brightness of the environment in a post - processing module configured to perform a post which the image is measured and whether the image is 5 processing operation on the image of which the color captured indoors or outdoors, by using the look up table temperature of the at least one pixel is compensated 16 An image signal processing apparatus comprising : 17 The image signal processing apparatus of claim 16, wherein the white balance adjuster is further configured to a preprocessing module configured to perform a prepro correct a white balance of the at least one pixel by using the cessing operation on an image ; look up table a color temperature measurer configured to measure a 18 The image signal processing apparatus of claim 16 color temperature of at least one pixel of the image ; wherein the white balance adjuster is further configured to a look up table configured to store a color temperature apply the color temperature compensation value to the at compensation value for adjusting the color tempera least one pixel of the image ture, according to the color temperature and a color of The image signal processing apparatus of claim 16, the at least one pixel ; wherein the white balance adjuster is further configured to a white balance adjuster configured to read out the color compensate the color temperature of the at least one pixel of temperature compensation value corresponding to the the image based on brightness of the at least one pixel measured color temperature and the color of the at least