How dehazing works: a simple explanation

Transcription

1 digikam darktable RawTherapee GIMP Luminance HDR Search Editing photos with free, open-source software Blog New? Start here Free guides 150+ practice exercises Competitions About How dehazing works: a simple explanation by freethatphoto posted in: Programming, Tutorial 2 25 NOV 2015 One of the coolest new features of Lightroom is the dehaze slider, a button that seemingly magically strips away haze (mist, fog, smog, etc.) and reveals what it was obscuring. However, it s not magic. In fact, the methods for dehazing a photo are often fairly simple (but clever). In this post, we ll see how dehazing works by going through through a method described in this research paper: html, pdf. In doing so, we ll cover the following topics: What is haze? How do we teach a computer to tell which parts of photo are hazy? How do we remove haze from the photo? Search Search Follow Top Posts & Pages Installing digikam in Ubuntu without installing every KDE dependency Installing darktable 2.0 Building a $200 Linux photo 1 von :34

2 editing computer What is haze? We see objects from the light reflected off them: A hazy photograph by David LaCivita (original RAW) But that s not all we see. Some of this light will get absorbed or scattered by the air that it is passing through. In addition, ambient light will bounce of these air particles and be reflected back to your camera. Most of the time this is not a big problem. However, if the air is full of additional particles such as water droplets (fog) or soot particles (smog), then visibility will decrease. This occurs because the haze stops the light from the original 2 von :34

3 object, and replaces it with additional reflected light. Dehazing a photo requires a couple of steps: 1. Figure out how hazy each pixel is. 2. Figure out the colour of the light reflected by haze. 3. Remove the haze colour from each pixel in proportion to how hazy that pixel is. Light reflected due to haze has a particular colour: the colour of the ambient light that is reflecting. This colour should be fairly constant over the whole picture, so if we can calculate it, we can just remove that constant value from every pixel. Determining how hazy each pixel is causes a bit more of a headache. The method I describe here uses a clever technique called the dark channel. The dark channel i.e. a map of haze What is the dark channel? The inventors of the method have a succinct description: The dark channel is based on the statistics of haze-free outdoor images. We find that, in most of the local regions which do not cover the sky, it is very often that some pixels (called dark pixels ) have very low intensity in at least one color (rgb) channel Therefore, these dark pixels can directly provide accurate estimation of the haze s transmission. Let s break this down and see how we go from a photo to a dark channel. Each pixel in the original image will have red, green, and blue colour values associated with it. In an 8-bit picture, like 3 von :34

4 most JPGs, these will vary between 0 and 255. Each of these is a called a colour channel. High values mean more intensity in that colour. In normal pictures with no haze, most small regions of the picture will have a low value for one of these colours, due to shadows, naturally dark objects, or colourful things (with a low value in another colour). However, the ambient light reflected by haze will have fairly high values in all three colours. To calculate the dark channel, we take every pixel in the image and look at the region surrounding it (i.e. a square of pixels centred on the pixel of interest). We calculate the minimum intensity colour at each pixel in the square, and then we find which of these is the lowest in the whole square. This is the dark channel value for the original pixel. In other words we pick the lowest colour value of all the colours in all the surrounding pixels. You will note that we have gone from a colour photo composed of three colour channels to an image with just one channel. This will be a black-and-white (technically greyscale ) image. Here s what the dark channel looks like for David LaCivita s landscape: 4 von :34

5 The dark channel Just as predicted, the haze free foreground has very low dark channel values in each square, whereas the hazy region has much lighter values. Calculating the atmospheric light Now that we know which pixels are hazy, we want to know the colour of the light that is being reflected by these pixels. This is called the atmospheric (or ambient) light. The RGB values of the atmospheric light are basically the RGB values of the haziest pixels. This is where the haze is opaque, so all the colour is from reflected atmospheric light (rather than from the objects behind the haze). Unfortunately we can t just take the brightest pixel in the original image as the ambient light, because the brightest pixel might be from something in the foreground (e.g. a washed out reflection). The authors of the paper point out a clever way to get the ambient light using the dark channel. 1. The lightest regions of the dark channel correspond to the haziest part of the original image. 2. If we select the brightest 0.1% of the dark channel we will get the haziest pixels. 3. Switching back to the original RGB values of these same pixels, we can take the brightest as the atmospheric light. Transmission: how much light gets through the haze The final thing we need is the transmission. This is an estimate of how much of the light from the original object is making it through the haze at each pixel. The calculation of this is a little technical (for the mathematically minded, it is explained in the paper linked above). Essentially it will look opposite to the dark channel picture (i.e. hazy parts of the image have lower transmission values): 5 von :34

6 The transmission map Poof and the haze is gone With an estimate of the transmission and the atmospheric/ambient light we can recover the original image. Again, this step involves some maths, but essentially the atmospheric light is subtracted from each pixel in proportion to the transmission at that pixel. The results (from my fairly basic Python implementation): 6 von :34

7 You will note that there are some imperfections. The dehazed image. Move mouse over to see the original hazy photo For example the picture has a blocky/streaky texture most noticeable in the halo around the foreground. This is due to the pixel areas we used to estimate the dark channel (you can see the same blockiness in the darkchannel and transmission pictures). We can get around this by smoothing out the transmission map (the authors of the paper use a method called soft matting). These are the basics of how dehazing works. In a future post I will dig into the details more thoroughly. Want to read more tutorials like this? You can get new tutorials from FreeThatPhoto.com delivered straight to your inbox: Address Submit Share this: 7 von :34

8 dehaze, programming, tutorial Similar Posts What s the best resolution to upload to Facebook? I took several pictures of my family s Christmas gathering this year, and put them on... 8 von :34

9 2 Responses priya January 7, 2016 Reply Thank you for giving a good section. 1) Can you please explain how the.1 % of brightest pixel is selected from dark channel?? 2) In step 2 we selected the.1 % of brightest pixe, then why the below step required. Switching back to the original RGB values of these same pixels, we can take the brightest as the atmospheric light. freethatphoto January 12, 2016 Reply Priya, thanks for your comment. 1) The darkchannel has only a single value for each pixel (it is a grey scale channel). So, the brightest pixels are those with the highest values. There are many ways to implement an algorithm to get the brightest 0.1%. For example, I did it by sorting the pixels according to darkchannel value, selecting the brightest 0.1%, and then returning the indices of each of these pixels. 2) Remember that these are the brightest pixels in the darkchannel, not in the RGB channels. These correspond to the haziest pixels (we hope). As they are hazy, their RGB values will be the colour of the light reflected from haze particles, i.e. the atmospheric light s RGB values. In other words, we use the darkchannel to select the haziest pixels, and then we return to the RGB channels to get the colour of atmospheric light from these pixels. Let me know if you have further questions. Leave a Reply 9 von :34

10 FYI This website is not affiliated with any photo editor or product. Some links may earn a small commission - which covers part of the hosting costs. Useful links Home About Contact 10 von :34

11 Free That Photo 11 von :34