Wavelengths and Colors Ankit Mohan MAS.131/531 Fall 2009
Epsilon over time (Multiple photos) Prokudin-Gorskii, Sergei Mikhailovich, 1863-1944, photographer. Congress.
Epsilon over time (Bracketing) Image courtesy of shannonpatrick17 on Flickr. Color wheel used in DLP projectors
Epsilon over sensors 3CCD imaging system for color capture Images: Left Wikipedia User:Cburnett. Upper right Wikipedia User:Xingbo. License CC BY-SA. This content is ecluded from our Creative Commons license. For more information, see http://ocw.mit.edu/fairuse. Lower right, public domain image by Dick Lyons.
Epsilon over piels Bayer Mosaicing for color capture Images: Wikipedia. Wikipedia User:Cburnett. License CC BY-SA. This content is ecluded from our Creative Commons license. For more information, see http://ocw.mit.edu/fairuse. Demosaicing to interpolate a full color, high resolution image Source: Wikipedia Wikipedia User:Cburnett. License CC BY-SA. This content is ecluded from our Creative Commons license. For more information, see http://ocw.mit.edu/fairuse.
Color sensing in Digital Cameras Nikon dichroic mirrors Foveon X3 sensor Image: Wikipedia. Wikipedia User:Anoneditor. License CC BY-SA. This content is ecluded from our Creative Commons license. For more information, see http://ocw.mit.edu/fairuse.
Electromagnetic spectrum Visible Light: ~400-700 nm wavelength Source: NASA
Spectroscope [http://en.wikipedia.org/wiki/spectroscopy] Images: Left Wikipedia User:Kkmurray. Right Wikipedia User:Deglr6328. License CC BY-SA. This content is ecluded from our Creative Commons license. For more information, see http://ocw.mit.edu/fairuse.
Multispectral Imaging Image removed due to copyright restrictions. In Klemas Remote Sensing and Geospatial Technologies for Coastal Ecosystem Assessment. Edited by Xiaojun Yang. Springer, 2009. Preview in Google Books.
Multispectral Scanning (data cube) Diagram removed due to copyright restrictions.
Thermal Imaging [http://www.cas.sc.edu/geog/rslab/551] Glass is opaque; use Germanium lenses Set of Thermal Imaging photos removed due to copyright restrictions.
Thermal Imaging Courtesy of Paul Falstad. Used with permission. [http://www.falstad.com/thermal] Two photos removed due to copyright restrictions. [Pavlidis et al., Nature 2002]
Near Infrared Photography Four photos removed due to copyright restrictions.
Remote Sensing Images removed due to copyright restrictions.
Quartz lenses UV photography [http://www.naturfotograf.com] Si flower photos removed due to copyright restrictions.
CIE 1931 Chromaticity Diagram
Fied color primaries G srgb color space Fuji Velvia 50 film Nikon D70 camera R B
Outside the Color Gamut G R =? G =? R B =? B
Colorimetric or Photometric mapping G R 0.0 R B
Wide Color Gamut G 400nm 550nm 700nm R Wide Gamut vs. High Power B
Adaptive Color Primaries
Arbitrary white 1D signal I A B C I 400nm 550nm 700nm
Pinhole Camera C I B I A Object Image Pinhole
C B I A Object Lens L 1 Pinhole
C B I A Object Lens L 1 Prism Pinhole
Prism Spectral Light Field
Light-Field Placing a 1D screen in a 2D light-field gives a 1D projection in a direction perpendicular to the screen.
Prism I Screen I p
Prism I I p
I Prism t= p I t
Prism Lens L 2 I t S
Prism Lens L 2 I t t S
Prism Lens L 2 I t t R t S
Sensor plane (t=t s ) t t S I p
Rainbow plane (t=t R ) p All rays of the a given wavelength, from all points in the scene, converge to a unique point in the R-plane. I t t R
Rainbow plane (t=t R ) I p I 400nm 550nm 700nm I
Rainbow plane (t=t R ) I p I 400nm 550nm 700nm I
Rainbow plane (t=t R ) I p I R 400nm 550nm 700nm I I B 400nm 550nm 700nm
Rainbow plane (t=t R ) position t t R
Mask in the Rainbow plane X 0 t t R 1
Mask in the Rainbow plane 0 t t R
Mask in the Rainbow plane 0 t t R t S I p
Mask in the Rainbow plane 0 t t R t S I p
Mask in the Rainbow plane 0 t t R t S I p
Mask in the Rainbow plane 0 0 t t R t S I p
Rainbow plane (t=t R ) Control the spectral sensitivity of the sensor by placing an appropriate grayscale masks in the R-plane. t t R t S
Scene C Pinhole Lens L 1 Lens L 2 Sensor B A Prism or Diffraction Grating R-plane mask
Scene Pinhole Lens L 1 Lens L 1 Lens L 2 Sensor Prism or Diffraction Grating R-plane mask
Scene Aperture and Lens L 1 Lens L 2 Sensor Prism or Diffraction Grating R-plane mask
Diffraction R-plane Lens L 1 Grating Lens L 2 mask Sensor Mohan, A., R. Raskar, and J. Tumblin. Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors. Proceedings of Eurographics 2008.
Test Setup Agile Spectrum Camera
m() 400nm 550nm No Mask 700nm m() 400nm 550nm 700nm Two opaque stripes One opaque stripe m() 400nm 550nm 700nm
m() 400nm 550nm 700nm Mohan et al. Eurographics 2008.
m() 400nm 550nm 700nm
Lens L 1 Diffraction Grating Lens L 2 R-plane mask Screen Mohan et al. Eurographics 2008.
Metamers White Illumination Monochromatic Illumination Mohan et al. Eurographics 2008.
Traditional three primary projector Mohan et al. Eurographics 2008. Agile-spectrum projector
Traditional three primary projector P y time
Adaptive primary projector P y time
Deuteranope red/green color blindness White light Deuteranope simulation Magenta light Mohan et al. Eurographics 2008.
Limitations Relatively coarse control due to crude setup with off-the-shelf components. Diffraction artifacts. Small F-number of the objective lens (we used ~f/16). Chromatic artifacts in out-of-focus regions for the projector.
Improved design Future work Mask instead of pinhole at L 1 Mask and Lens L 1 Better optics (LCD/DMD) and calibration Applications Adaptive color primaries Stereo projector Diffraction R-plane Grating Lens L 2 mask Sensor I 400nm B l G l R I l B r G r R r 550nm Left eye 700nm 400nm 550nm Right eye 700nm
Overlapping Light Fields Prism ( 0, 0 ) B A
Overlapping Light Fields Prism B A
Diffuse, fronto-parallel case Prism B A
Blurred Light Fields Prism B A Convolution of spectral light field with a bo filter
Pinhole multi-spectral camera Pinhole Scene C B A 2 Lens L 1 0 1 Prism Light field camera
Rainbow multi-spectral camera Scene C A Lens L 1 Linear Variable Interference Filter Light field camera
Mask based multi-spectral camera Scene C A Lens L 1 Mask, m() Prism Light field camera
MIT OpenCourseWare http://ocw.mit.edu MAS.531 Computational Camera and Photography Fall 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.