CS148: Introduction to Computer Graphics and Imaging. Displays. Topics. Spatial resolution Temporal resolution Tone mapping. Display technologies

Similar documents
The Science Seeing of process Digital Media. The Science of Digital Media Introduction

Visual Perception. Jeff Avery

Visual Perception. human perception display devices. CS Visual Perception

CS 450: COMPUTER GRAPHICS REVIEW: RASTER IMAGES SPRING 2016 DR. MICHAEL J. REALE

Computer Graphics. - Display and Imaging Devices - Hendrik Lensch. Computer Graphics WS07/08 Display and Imaging Devices

CPSC 4040/6040 Computer Graphics Images. Joshua Levine

Lecture 1: image display and representation

Multimedia Systems Color Space Mahdi Amiri March 2012 Sharif University of Technology

Visual Perception. Readings and References. Forming an image. Pinhole camera. Readings. Other References. CSE 457, Autumn 2004 Computer Graphics

Camera Image Processing Pipeline: Part II

Mahdi Amiri. March Sharif University of Technology

Colour. Electromagnetic Spectrum (1: visible is very small part 2: not all colours are present in the rainbow!) Colour Lecture!

Camera Image Processing Pipeline: Part II

Getting light to imager. Capturing Images. Depth and Distance. Ideal Imaging. CS559 Lecture 2 Lights, Cameras, Eyes

Images and Displays. Lecture Steve Marschner 1

Colour. Cunliffe & Elliott, Chapter 8 Chapman & Chapman, Digital Multimedia, Chapter 5. Autumn 2016 University of Stirling

Colour. Why/How do we perceive colours? Electromagnetic Spectrum (1: visible is very small part 2: not all colours are present in the rainbow!

Visual Perception. Overview. The Eye. Information Processing by Human Observer

The Photoreceptor Mosaic

Visual Perception of Images

Vision. The eye. Image formation. Eye defects & corrective lenses. Visual acuity. Colour vision. Lecture 3.5

The Human Visual System. Lecture 1. The Human Visual System. The Human Eye. The Human Retina. cones. rods. horizontal. bipolar. amacrine.

Images. CS 4620 Lecture Kavita Bala w/ prior instructor Steve Marschner. Cornell CS4620 Fall 2015 Lecture 38

Images and Displays. CS4620 Lecture 15

Reading. 1. Visual perception. Outline. Forming an image. Optional: Glassner, Principles of Digital Image Synthesis, sections

Spatial Vision: Primary Visual Cortex (Chapter 3, part 1)

Further reading. 1. Visual perception. Restricting the light. Forming an image. Angel, section 1.4

The Special Senses: Vision

Color Science. CS 4620 Lecture 15

Raster Graphics. Overview קורס גרפיקה ממוחשבת 2008 סמסטר ב' What is an image? What is an image? Image Acquisition. Image display 5/19/2008.

קורס גרפיקה ממוחשבת 2008 סמסטר ב' Raster Graphics 1 חלק מהשקפים מעובדים משקפים של פרדו דוראנד, טומס פנקהאוסר ודניאל כהן-אור

Visual Optics. Visual Optics - Introduction

Color Science. What light is. Measuring light. CS 4620 Lecture 15. Salient property is the spectral power distribution (SPD)

Vision and Color. Reading. Optics, cont d. Lenses. d d f. Brian Curless CSE 557 Autumn Good resources:

Vision and Color. Brian Curless CSE 557 Autumn 2015

Vision and Color. Reading. Optics, cont d. Lenses. d d f. Brian Curless CSEP 557 Fall Good resources:

Vision and Color. Brian Curless CSEP 557 Fall 2016

Capturing Light in man and machine

The eye, displays and visual effects

Color. Chapter 6. (colour) Digital Multimedia, 2nd edition

Vision and Color. Reading. The lensmaker s formula. Lenses. Brian Curless CSEP 557 Autumn Good resources:

What is an image? Images and Displays. Representative display technologies. An image is:

Capturing Light in man and machine

LECTURE III: COLOR IN IMAGE & VIDEO DR. OUIEM BCHIR

Dr. Shahanawaj Ahamad. Dr. S.Ahamad, SWE-423, Unit-06

Imaging Instruments (part I)

Chapter 20 Human Vision

Human Vision and Human-Computer Interaction. Much content from Jeff Johnson, UI Wizards, Inc.

The Human Visual System!

What is an image? Bernd Girod: EE368 Digital Image Processing Pixel Operations no. 1. A digital image can be written as a matrix

Color Reproduction. Chapter 6

Color and Perception. CS535 Fall Daniel G. Aliaga Department of Computer Science Purdue University

Color and perception Christian Miller CS Fall 2011

Frequencies and Color

Image Formation and Capture

Life Science Chapter 2 Study Guide

Output Devices - Visual

4K Resolution, Demystified!

Human Visual System. Prof. George Wolberg Dept. of Computer Science City College of New York

Vision Science I Exam 2 31 October 2016

Spatial Vision: Primary Visual Cortex (Chapter 3, part 1)

25 Questions. All are multiple choice questions. 4 will require an additional written response explaining your answer.

Chapter 3 Optical Systems

COLOR and the human response to light

Capturing Light in man and machine

CS 428: Fall Introduction to. Image formation Color and perception. Andrew Nealen, Rutgers, /8/2010 1

Early Visual Processing: Receptive Fields & Retinal Processing (Chapter 2, part 2)

Image Representations, Colors, & Morphing. Stephen J. Guy Comp 575

Digital Image Processing

Lecture 2 Digital Image Fundamentals. Lin ZHANG, PhD School of Software Engineering Tongji University Fall 2016

Digital Image Fundamentals. Digital Image Processing. Human Visual System. Contents. Structure Of The Human Eye (cont.) Structure Of The Human Eye

Digital Image Fundamentals. Digital Image Processing. Human Visual System. Contents. Structure Of The Human Eye (cont.) Structure Of The Human Eye

Visual Imaging and the Electronic Age Color Science

Digital Image Processing

The human visual system

Retina. Convergence. Early visual processing: retina & LGN. Visual Photoreptors: rods and cones. Visual Photoreptors: rods and cones.

COLOR. and the human response to light

icam06, HDR, and Image Appearance

CS101 Lecture 12: Digital Images. What You ll Learn Today

Color & Graphics. Color & Vision. The complete display system is: We'll talk about: Model Frame Buffer Screen Eye Brain

We have already discussed retinal structure and organization, as well as the photochemical and electrophysiological basis for vision.

Capturing light and color

Sensation and Perception

Image and video processing (EBU723U) Colour Images. Dr. Yi-Zhe Song

Introduction to Multimedia Computing

Realistic Image Synthesis

Feeding human senses through Immersion

Introduction & Colour

Lecture 3: Grey and Color Image Processing

Graphics and Image Processing Basics

Reading. Foley, Computer graphics, Chapter 13. Optional. Color. Brian Wandell. Foundations of Vision. Sinauer Associates, Sunderland, MA 1995.

Prof. Feng Liu. Winter /09/2017

Image Display and Perception

High Dynamic Range Imaging

Achromatic and chromatic vision, rods and cones.

Sensation notices Various stimuli Of what is out there In reality

COLOR. Elements of color. Visible spectrum. The Fovea. Lecture 3 October 30, Ingela Nyström 1. There are three types of cones, S, M and L

COLOR. Elements of color. Visible spectrum. The Human Visual System. The Fovea. There are three types of cones, S, M and L. r( λ)

Reading. Lenses, cont d. Lenses. Vision and color. d d f. Good resources: Glassner, Principles of Digital Image Synthesis, pp

HW- Finish your vision book!

Transcription:

CS148: Introduction to Computer Graphics and Imaging Displays Topics Spatial resolution Temporal resolution Tone mapping Display technologies

Resolution World is continuous, digital media is discrete Three aspects: Spatial resolution (x, y) Physical limits: pixel size and display size Human limits: photoreceptor density Temporal resolution (t) Physical limits: film speed, channel bandwidth Human limits: neuronal response time Color and intensity resolution Physical limits: color pigments, 1-bit vs n-bit tones Human limits: just-noticeable differences Spatial Resolution

Contrast Sensitivity Function Maximum sensitiviy @ 4 cycles/degree Maximum resolving power @ 60 cycles/deg = 1 arcmin

Visual Acuity / Snellen Chart 20/20 vision = 1 arcmin ~1/16 at 20 Monitor viewing range: ~1/100 at 3 Photoreceptor Density in the Retina Rods: 100 million total Cones (3 subtypes L, M, S): 5 million total Fovea Size of photoreceptors: ~1 um Angular resolution: S: 10 arcmins L, M: 0.5 arcmins Periphery 10 um

Display Resolution History Date Format and Technology Bandwidth Rate 1980 1024 x 768 x 60Hz, CRT 0.14 GB 1988 1280 x 1024 x 72Hz, CRT 0.29 GB 1.1 1996 1920 x 1080 x 72Hz, HD CRT 0.60 GB 1.1 2001 3840 x 2400 x 56Hz, active LCD 1.55 GB 1.2 Compound annual growth rate = 1.1 Rate of increase slow compared to CPU, disk,... Slide from K. Akeley IBM T221 Resolution: 3840 x 2400 (QXGA) Size: 21.5 x 17.3 (204 dpi)

PowerWall UC-Davis PowerWall Resolution: 3 * 1280 x 2 * 1024 = 3040 x 2048 Size: 18 x 9 (18dpi)

iphone 4 Retinal Display OsiriX Radiological Viewer Resolution: 960 x 640 Size: 3.5 diagonal (326 dpi) Temporal Resolution

Temporal Resolution Critical flicker fusion rate High ambient light, large field of view: 80 Hz Low ambient light, 20-30 Hz Frames per second (FPS) Film (double framed) TV (interlaced) Computer (progressive) 24 FPS 30 FPS 60-75 FPS Tone Reproduction

Real World = High Dynamic Range 18.0 15116 1907 1.0 46.2 The absolute amount of light of the marked pixels CS148 Lecture 13 Pat Hanrahan, Fall 2010 Perception of Intensities Sensation (S) vs. Intensity (I) Stevens Power Law: S = I p Sense Exponent Lightness 0.33 Smell 0.55 Loudness 0.60 Taste 0.80 Length 1.00 Heaviness 1.45 B = I 1/3 CS148 Lecture 13 Pat Hanrahan, Fall 2010

Contrast = Max/Min World: Possible: 100,000,000,000:1 Typical: 100,000:1 People: 100:1 Adapt to the ambient light level CS148 Lecture 13 Pat Hanrahan, Fall 2010 Estimating Gamma CS148 Lecture 13 Pat Hanrahan, Fall 2010

Displays are Nonlinear I = g(v V b ) γ Monitor:! = 2.5 ~ Pixel Value The amount of light (intensity) produced is a power function of the input value (voltage) CS148 Lecture 13 Pat Hanrahan, Fall 2010 Monitor + Perception = Linear FB Monitor Perception ~Linear Amazing coincidence! CS148 Lecture 13 Pat Hanrahan, Fall 2010

Displays have Limited Dynamic Range World: Possible: 100,000,000,000:1 Typical: 100,000:1 People: 100:1 Media: Printed page: 10:1 Displays: 80:1 (1000:1) Typical viewing conditions: 5:1 CS148 Lecture 13 Pat Hanrahan, Fall 2010 Correcting Exposure Rancho de Taos, Taos, NM Pat Hanrahan Photoshop demonstration CS148 Lecture 13 Pat Hanrahan, Fall 2010

Tone Mapping Problem: Image has a higher dynamic range than the display (100,000:1 maps down to 20:1) Solutions: 1. Linear map (min -> 0, max -> 255) Bad: Independent of absolute brightness 2. Logarithmic map Models camera exposure Roughly maps into perceptual space CS148 Lecture 13 Pat Hanrahan, Fall 2010 Tone Reproduction Algorithms Linear map Logarithmic map CS148 Lecture 13 Pat Hanrahan, Fall 2010

Better Tone Reproduction Algorithms Adaptive histogram With glare, contrast, blur CS148 Lecture 13 Pat Hanrahan, Fall 2010 Display Technologies

Cathode Ray Tube Phosphors Delta Gun Inline

Screen Mask Plasma

Liquid Crystal Displays Liquid Crystal Displays

3D TV - LCD Shutter Glasses http://www.reghardware.com Double Frame Rate to 120 Hz Alternate Left and Right Eyes Responsive Workbench

LCD Displays RGBW PenTile

Dynamic Micro-Mirror Device (DMD) Digital Light Processing (TI) - DLP

ebooks Kindle

Electronic Ink (Reflective Display)

Things to Remember Physics Limits of materials and fabrication Perception Human limits: properties of the eye and brain Spatial resolution Temporal resolution Tone reproduction