ME 6406 MACHINE VISION. Georgia Institute of Technology

Size: px
Start display at page:

Download "ME 6406 MACHINE VISION. Georgia Institute of Technology"

Transcription

1 ME 6406 MACHINE VISION Georgia Institute of Technology

2 Class Information Instructor Professor Kok-Meng Lee MARC 474 Office hours: Tues/Thurs 1:00-2:00 pm (404) Class Website Notes, Homework submissions, links, etc

3 Prerequisites Graduate Standing MATLAB proficiency Required for homework submission Image Processing Toolbox Available in computer labs MRDC 2104, 2105 Library commons

4 Recommended Texts Digital Image Processing using Matlab, R. C. Gonzalez, R. E. Woods and S. Eddins, Prentice Hall, 2004 Digital Image Processing, R. C. Gonzalez and R. E. Woods, Prentice Hall, 3 rd Edition, 2008

5 Evaluation Policy 4 Homeworks (20% each) Electronic submission to T-square Individual submission 2 In-class Midterms (10% each)

6 Course Description Design of algorithms for vision systems for manufacturing, farming, construction and the service industries. Image processing, optics, illumination and feature representation.

7 What is Machine Vision? The process of acquiring one or more images, using an optical sensing device, and subsequent processing and analysis so that decisions can be made Machine vision encompasses computer science, optics, mechanical engineering, and industrial automation

8 What is Machine Vision? Machine Vision Context of industrial applications Integration with sensing & control theory Illumination regulation Computer Vision Field in general Image Processing Operation that produces images from images

9 What is Machine Vision? Human (Biological) vs Machine Vision Qualitative vs Quantitative People can rely on inference systems and assumptions for comprehension Computers do not 'see' in the same way that human beings are able to Examine individual pixels of images, processing them and attempting to develop conclusions in a consistent manner Spectral limitations of human vision (only visible spectrum) Passive vs Active (we rely on external illumination to see)

10 A & B are of different gray shades? Human Perception

11 A Machine Vision System Sensor Image Acquisition Pre-processing & Enhancement Decision Making Image Analysis Feature Extraction A B

12 Image Acquisition Vision properties Physics (Optics) Illumination Sensors Image representation Binary Grayscale Color Binary/ Grayscale IP Binarization Thresholding Geometry Area Position Orientation Edge/line detection Spatial filters /masks Color IP RGB, HSI, CMY Principal component analysis Feature Extraction Model-based Vision Hough Transform Circle Line Generalized Matching Similar Triangles Templates Scale-space filtering Curvature Morphology Algorithms/ operations Translation Reflection Complement Difference Dilation Erosion Pre- Processing & Enhancement Histogram Equalization Segmentation Labeling Camera Model/ Calibration 2D Image 3D world correspondence Intrinsic para Focal length,etc Extrinsic para Coordinate transformation matrix,etc Hands-eye calibration Geometrical Methods Geometry of multiple views & reconstruction Point Estimation Pose Estimation Image Analysis Neural Network Classifier Basics Sigmoid function Training algorithms Learning rules Weights updates Applications Motion Motion field Visual servoing

13 Image Acquisition (Hardware) Video Camera TV-based RS-170 standard (30 fps) Decision Frame Grabber Computer Program (processing) Video Buffer Computer Memory (RAM) Smart Cameras External Controller

14 Image Formation Image sensor CCD, CID, CMOS, vidicon tube (visible spectrum) X-ray, MRI, sonar, thermal, etc Sensor arrangement single/array/area Optics Pin-hole camera Thin lens equation Illumination & lighting Surface texture & reflectance Objects Background Light source sensor Optics reflectance OBJECT Captured image

15 Illumination Surfaces Diffuse Appear equally bright from all viewing directions Absorbs no light Paper & matte paints Specular Incident angle = reflected angle mirrors Retroreflective Returns most of incident radiation in the direction close to where it originated 3M s Scotchlite

16 Retroreflective Characteristics 3M Scotchlite Relative reflectance compared to flat white surface

17 Retroreflective illumination Object-Diffuse Background-Retroreflective

18 Retroreflective illumination Object-Retroreflective Background-Diffuse

19 Sensor Device Arrangement Single pixel Line of pixels 2-Dimension area of pixels

20 Sensor Device Arrangement Image acquisition using single, line sensor configurations

21 Image Sensors Charge-Coupled Device (CCD) Complementary metal oxide semiconductor (CMOS) or Active pixel sensor (APS) Charge Injection Device (CID) Similar to CCD except in the way the electric charge is transferred before it is recorded CMOS Vidicon tube Cathode ray tube technology CCD Photonics Spectra 2001

22 CCD Architecture Full-frame transfer Row-by-row Non-uniform exposure brighter Uniform exposure Pixel-by-pixel Mechanical shutter Simultaneous acquisition and reading Frame-transfer output Register darker clock Electronic shutter Duplicate array so that image can be read slowly from the storage region while a new image is exposing in active area output STORAGE Register clock Interline transfer 1 pixel transfer from image to storage Imaging area is reduced 50% output Register clock

23 Optics Pinhole camera The most basic/elementary imaging device Projection of image without lens Hole size Smaller: better focus, darker image Larger: blurred image, Brighter image Issues: Low-light accumulation capability Light diffraction Bending of light as it passes an aperture DeMenthon, 2000

24 The Optical Lens Optical lens allow creation of a brighter image by converging light DeMenthon, 2000

25 Thin Lens Equation f o =f i ideal lens, By similar triangles, do zo fi d f z i o i z z f f f i o i o 2 Focal Length, f z i Z z f i o z z f i o Z f z f f f o i i o Z z f z o Z Ideal thin lens equation fo fi z

26 Lens Imaging Points at other distances are imaged as little circles (red) By ideal lens equation: Blur circle definition z z f & similar triangles, d f f d z z z z f z f d z z z d Blur size decreases with focal length f=0, blur is a point z z z ' To attain a clear image, diameter of blur circle is less than resolution of imaging device

Exercise questions for Machine vision

Exercise questions for Machine vision Exercise questions for Machine vision This is a collection of exercise questions. These questions are all examination alike which means that similar questions may appear at the written exam. I ve divided

More information

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics

IMAGE FORMATION. Light source properties. Sensor characteristics Surface. Surface reflectance properties. Optics IMAGE FORMATION Light source properties Sensor characteristics Surface Exposure shape Optics Surface reflectance properties ANALOG IMAGES An image can be understood as a 2D light intensity function f(x,y)

More information

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor Image acquisition Digital images are acquired by direct digital acquisition (digital still/video cameras), or scanning material acquired as analog signals (slides, photographs, etc.). In both cases, the

More information

Dr F. Cuzzolin 1. September 29, 2015

Dr F. Cuzzolin 1. September 29, 2015 P00407 Principles of Computer Vision 1 1 Department of Computing and Communication Technologies Oxford Brookes University, UK September 29, 2015 September 29, 2015 1 / 73 Outline of the Lecture 1 2 Basics

More information

Cameras CS / ECE 181B

Cameras CS / ECE 181B Cameras CS / ECE 181B Image Formation Geometry of image formation (Camera models and calibration) Where? Radiometry of image formation How bright? What color? Examples of cameras What is a Camera? A camera

More information

CPSC 4040/6040 Computer Graphics Images. Joshua Levine

CPSC 4040/6040 Computer Graphics Images. Joshua Levine CPSC 4040/6040 Computer Graphics Images Joshua Levine levinej@clemson.edu Lecture 04 Displays and Optics Sept. 1, 2015 Slide Credits: Kenny A. Hunt Don House Torsten Möller Hanspeter Pfister Agenda Open

More information

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science. Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Sensors and Image Formation Imaging sensors and models of image formation Coordinate systems Digital

More information

Introduction. Lighting

Introduction. Lighting &855(17 )8785(75(1'6,10$&+,1(9,6,21 5HVHDUFK6FLHQWLVW0DWV&DUOLQ 2SWLFDO0HDVXUHPHQW6\VWHPVDQG'DWD$QDO\VLV 6,17()(OHFWURQLFV &\EHUQHWLFV %R[%OLQGHUQ2VOR125:$< (PDLO0DWV&DUOLQ#HF\VLQWHIQR http://www.sintef.no/ecy/7210/

More information

CSE 527: Introduction to Computer Vision

CSE 527: Introduction to Computer Vision CSE 527: Introduction to Computer Vision Week 2 - Class 2: Vision, Physics, Cameras September 7th, 2017 Today Physics Human Vision Eye Brain Perspective Projection Camera Models Image Formation Digital

More information

General Imaging System

General Imaging System General Imaging System Lecture Slides ME 4060 Machine Vision and Vision-based Control Chapter 5 Image Sensing and Acquisition By Dr. Debao Zhou 1 2 Light, Color, and Electromagnetic Spectrum Penetrate

More information

Unit 1: Image Formation

Unit 1: Image Formation Unit 1: Image Formation 1. Geometry 2. Optics 3. Photometry 4. Sensor Readings Szeliski 2.1-2.3 & 6.3.5 1 Physical parameters of image formation Geometric Type of projection Camera pose Optical Sensor

More information

ROBOT VISION. Dr.M.Madhavi, MED, MVSREC

ROBOT VISION. Dr.M.Madhavi, MED, MVSREC ROBOT VISION Dr.M.Madhavi, MED, MVSREC Robotic vision may be defined as the process of acquiring and extracting information from images of 3-D world. Robotic vision is primarily targeted at manipulation

More information

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image

Overview. Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Camera & Color Overview Pinhole camera model Projective geometry Vanishing points and lines Projection matrix Cameras with Lenses Color Digital image Book: Hartley 6.1, Szeliski 2.1.5, 2.2, 2.3 The trip

More information

MEM455/800 Robotics II/Advance Robotics Winter 2009

MEM455/800 Robotics II/Advance Robotics Winter 2009 Admin Stuff Course Website: http://robotics.mem.drexel.edu/mhsieh/courses/mem456/ MEM455/8 Robotics II/Advance Robotics Winter 9 Professor: Ani Hsieh Time: :-:pm Tues, Thurs Location: UG Lab, Classroom

More information

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2015 Version 3 Image Formation Dr. Gerhard Roth COMP 4102A Winter 2015 Version 3 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance

More information

Introduction to Computer Vision

Introduction to Computer Vision Introduction to Computer Vision CS / ECE 181B Thursday, April 1, 2004 Course Details HW #0 and HW #1 are available. Course web site http://www.ece.ucsb.edu/~manj/cs181b Syllabus, schedule, lecture notes,

More information

Sensors and Sensing Cameras and Camera Calibration

Sensors and Sensing Cameras and Camera Calibration Sensors and Sensing Cameras and Camera Calibration Todor Stoyanov Mobile Robotics and Olfaction Lab Center for Applied Autonomous Sensor Systems Örebro University, Sweden todor.stoyanov@oru.se 20.11.2014

More information

ECU 3040 Digital Image Processing

ECU 3040 Digital Image Processing ECU 3040 Digital Image Processing Dr. Praveen Sankaran Department of ECE NIT Calicut January 8, 2015 Ground Rules Grading Policy: Projects 20 Exam 1 15 Exam 2 15 Exam 3 50 Letter Grading:Absolute Textbook:

More information

EC-433 Digital Image Processing

EC-433 Digital Image Processing EC-433 Digital Image Processing Lecture 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such as a monochrome or color TV camera)

More information

Computer Vision. The Pinhole Camera Model

Computer Vision. The Pinhole Camera Model Computer Vision The Pinhole Camera Model Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2017/2018 Imaging device

More information

Image Formation. Light from distant things. Geometrical optics. Pinhole camera. Chapter 36

Image Formation. Light from distant things. Geometrical optics. Pinhole camera. Chapter 36 Light from distant things Chapter 36 We learn about a distant thing from the light it generates or redirects. The lenses in our eyes create images of objects our brains can process. This chapter concerns

More information

Goal of this Section. Capturing Reflectance From Theory to Practice. Acquisition Basics. How can we measure material properties? Special Purpose Tools

Goal of this Section. Capturing Reflectance From Theory to Practice. Acquisition Basics. How can we measure material properties? Special Purpose Tools Capturing Reflectance From Theory to Practice Acquisition Basics GRIS, TU Darmstadt (formerly University of Washington, Seattle Goal of this Section practical, hands-on description of acquisition basics

More information

Practical Image and Video Processing Using MATLAB

Practical Image and Video Processing Using MATLAB Practical Image and Video Processing Using MATLAB Chapter 1 Introduction and overview What will we learn? What is image processing? What are the main applications of image processing? What is an image?

More information

SUPER RESOLUTION INTRODUCTION

SUPER RESOLUTION INTRODUCTION SUPER RESOLUTION Jnanavardhini - Online MultiDisciplinary Research Journal Ms. Amalorpavam.G Assistant Professor, Department of Computer Sciences, Sambhram Academy of Management. Studies, Bangalore Abstract:-

More information

NON UNIFORM BACKGROUND REMOVAL FOR PARTICLE ANALYSIS BASED ON MORPHOLOGICAL STRUCTURING ELEMENT:

NON UNIFORM BACKGROUND REMOVAL FOR PARTICLE ANALYSIS BASED ON MORPHOLOGICAL STRUCTURING ELEMENT: IJCE January-June 2012, Volume 4, Number 1 pp. 59 67 NON UNIFORM BACKGROUND REMOVAL FOR PARTICLE ANALYSIS BASED ON MORPHOLOGICAL STRUCTURING ELEMENT: A COMPARATIVE STUDY Prabhdeep Singh1 & A. K. Garg2

More information

Displacement Measurement of Burr Arch-Truss Under Dynamic Loading Based on Image Processing Technology

Displacement Measurement of Burr Arch-Truss Under Dynamic Loading Based on Image Processing Technology 6 th International Conference on Advances in Experimental Structural Engineering 11 th International Workshop on Advanced Smart Materials and Smart Structures Technology August 1-2, 2015, University of

More information

Image and Multidimensional Signal Processing

Image and Multidimensional Signal Processing Image and Multidimensional Signal Processing Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ Digital Image Fundamentals 2 Digital Image Fundamentals

More information

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS

6.098 Digital and Computational Photography Advanced Computational Photography. Bill Freeman Frédo Durand MIT - EECS 6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Bill Freeman Frédo Durand MIT - EECS Administrivia PSet 1 is out Due Thursday February 23 Digital SLR initiation? During

More information

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1

Image Formation. Dr. Gerhard Roth. COMP 4102A Winter 2014 Version 1 Image Formation Dr. Gerhard Roth COMP 4102A Winter 2014 Version 1 Image Formation Two type of images Intensity image encodes light intensities (passive sensor) Range (depth) image encodes shape and distance

More information

Acquisition Basics. How can we measure material properties? Goal of this Section. Special Purpose Tools. General Purpose Tools

Acquisition Basics. How can we measure material properties? Goal of this Section. Special Purpose Tools. General Purpose Tools Course 10 Realistic Materials in Computer Graphics Acquisition Basics MPI Informatik (moving to the University of Washington Goal of this Section practical, hands-on description of acquisition basics general

More information

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics Chapters 1-3 Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation Radiation sources Classification of remote sensing systems (passive & active) Electromagnetic

More information

LENSES. INEL 6088 Computer Vision

LENSES. INEL 6088 Computer Vision LENSES INEL 6088 Computer Vision Digital camera A digital camera replaces film with a sensor array Each cell in the array is a Charge Coupled Device light-sensitive diode that converts photons to electrons

More information

Chapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing

Chapters 1 & 2. Definitions and applications Conceptual basis of photogrammetric processing Chapters 1 & 2 Chapter 1: Photogrammetry Definitions and applications Conceptual basis of photogrammetric processing Transition from two-dimensional imagery to three-dimensional information Automation

More information

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics

Chapters 1-3. Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation. Chapter 3: Basic optics Chapters 1-3 Chapter 1: Introduction and applications of photogrammetry Chapter 2: Electro-magnetic radiation Radiation sources Classification of remote sensing systems (passive & active) Electromagnetic

More information

CS 376b Computer Vision

CS 376b Computer Vision CS 376b Computer Vision 09 / 03 / 2014 Instructor: Michael Eckmann Today s Topics This is technically a lab/discussion session, but I'll treat it as a lecture today. Introduction to the course layout,

More information

Computer Vision. Howie Choset Introduction to Robotics

Computer Vision. Howie Choset   Introduction to Robotics Computer Vision Howie Choset http://www.cs.cmu.edu.edu/~choset Introduction to Robotics http://generalrobotics.org What is vision? What is computer vision? Edge Detection Edge Detection Interest points

More information

Digital Imaging Rochester Institute of Technology

Digital Imaging Rochester Institute of Technology Digital Imaging 1999 Rochester Institute of Technology So Far... camera AgX film processing image AgX photographic film captures image formed by the optical elements (lens). Unfortunately, the processing

More information

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS

SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 - COMPUTERIZED IMAGING Section I: Chapter 2 RADT 3463 Computerized Imaging 1 SECTION I - CHAPTER 2 DIGITAL IMAGING PROCESSING CONCEPTS RADT 3463 COMPUTERIZED IMAGING Section I: Chapter 2 RADT

More information

Image Processing & Projective geometry

Image Processing & Projective geometry Image Processing & Projective geometry Arunkumar Byravan Partial slides borrowed from Jianbo Shi & Steve Seitz Color spaces RGB Red, Green, Blue HSV Hue, Saturation, Value Why HSV? HSV separates luma,

More information

Homogeneous Representation Representation of points & vectors. Properties. Homogeneous Transformations

Homogeneous Representation Representation of points & vectors. Properties. Homogeneous Transformations From Last Class Homogeneous Transformations Combines Rotation + Translation into one single matri multiplication Composition of Homogeneous Transformations Homogeneous Representation Representation of

More information

Computer Vision Slides curtesy of Professor Gregory Dudek

Computer Vision Slides curtesy of Professor Gregory Dudek Computer Vision Slides curtesy of Professor Gregory Dudek Ioannis Rekleitis Why vision? Passive (emits nothing). Discreet. Energy efficient. Intuitive. Powerful (works well for us, right?) Long and short

More information

VC 16/17 TP2 Image Formation

VC 16/17 TP2 Image Formation VC 16/17 TP2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Hélder Filipe Pinto de Oliveira Outline Computer Vision? The Human Visual

More information

Cameras. CSE 455, Winter 2010 January 25, 2010

Cameras. CSE 455, Winter 2010 January 25, 2010 Cameras CSE 455, Winter 2010 January 25, 2010 Announcements New Lecturer! Neel Joshi, Ph.D. Post-Doctoral Researcher Microsoft Research neel@cs Project 1b (seam carving) was due on Friday the 22 nd Project

More information

Image Formation and Camera Design

Image Formation and Camera Design Image Formation and Camera Design Spring 2003 CMSC 426 Jan Neumann 2/20/03 Light is all around us! From London & Upton, Photography Conventional camera design... Ken Kay, 1969 in Light & Film, TimeLife

More information

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object.

Cameras. Shrinking the aperture. Camera trial #1. Pinhole camera. Digital Visual Effects Yung-Yu Chuang. Put a piece of film in front of an object. Camera trial #1 Cameras Digital Visual Effects Yung-Yu Chuang scene film with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Put a piece of film in front of an object. Pinhole camera

More information

A 3D Multi-Aperture Image Sensor Architecture

A 3D Multi-Aperture Image Sensor Architecture A 3D Multi-Aperture Image Sensor Architecture Keith Fife, Abbas El Gamal and H.-S. Philip Wong Department of Electrical Engineering Stanford University Outline Multi-Aperture system overview Sensor architecture

More information

Pixel CCD RASNIK. Kevan S Hashemi and James R Bensinger Brandeis University May 1997

Pixel CCD RASNIK. Kevan S Hashemi and James R Bensinger Brandeis University May 1997 ATLAS Internal Note MUON-No-180 Pixel CCD RASNIK Kevan S Hashemi and James R Bensinger Brandeis University May 1997 Introduction This note compares the performance of the established Video CCD version

More information

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera

Cameras. Outline. Pinhole camera. Camera trial #1. Pinhole camera Film camera Digital camera Video camera Outline Cameras Pinhole camera Film camera Digital camera Video camera Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/3/6 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

More information

8.2 IMAGE PROCESSING VERSUS IMAGE ANALYSIS Image processing: The collection of routines and

8.2 IMAGE PROCESSING VERSUS IMAGE ANALYSIS Image processing: The collection of routines and 8.1 INTRODUCTION In this chapter, we will study and discuss some fundamental techniques for image processing and image analysis, with a few examples of routines developed for certain purposes. 8.2 IMAGE

More information

Checkerboard Tracker for Camera Calibration. Andrew DeKelaita EE368

Checkerboard Tracker for Camera Calibration. Andrew DeKelaita EE368 Checkerboard Tracker for Camera Calibration Abstract Andrew DeKelaita EE368 The checkerboard extraction process is an important pre-preprocessing step in camera calibration. This project attempts to implement

More information

X-RAY COMPUTED TOMOGRAPHY

X-RAY COMPUTED TOMOGRAPHY X-RAY COMPUTED TOMOGRAPHY Bc. Jan Kratochvíla Czech Technical University in Prague Faculty of Nuclear Sciences and Physical Engineering Abstract Computed tomography is a powerful tool for imaging the inner

More information

ECEN 4606, UNDERGRADUATE OPTICS LAB

ECEN 4606, UNDERGRADUATE OPTICS LAB ECEN 4606, UNDERGRADUATE OPTICS LAB Lab 3: Imaging 2 the Microscope Original Version: Professor McLeod SUMMARY: In this lab you will become familiar with the use of one or more lenses to create highly

More information

Image Formation and Capture

Image Formation and Capture Figure credits: B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, A. Theuwissen, and J. Malik Image Formation and Capture COS 429: Computer Vision Image Formation and Capture Real world Optics Sensor Devices

More information

Midterm Examination CS 534: Computational Photography

Midterm Examination CS 534: Computational Photography Midterm Examination CS 534: Computational Photography November 3, 2015 NAME: SOLUTIONS Problem Score Max Score 1 8 2 8 3 9 4 4 5 3 6 4 7 6 8 13 9 7 10 4 11 7 12 10 13 9 14 8 Total 100 1 1. [8] What are

More information

Announcement A total of 5 (five) late days are allowed for projects. Office hours

Announcement A total of 5 (five) late days are allowed for projects. Office hours Announcement A total of 5 (five) late days are allowed for projects. Office hours Me: 3:50-4:50pm Thursday (or by appointment) Jake: 12:30-1:30PM Monday and Wednesday Image Formation Digital Camera Film

More information

Studying of Reflected Light Optical Laser Microscope Images Using Image Processing Algorithm

Studying of Reflected Light Optical Laser Microscope Images Using Image Processing Algorithm IRAQI JOURNAL OF APPLIED PHYSICS Fatema H. Rajab Al-Nahrain University, College of Engineering, Department of Laser and Optoelectronic Engineering Studying of Reflected Light Optical Laser Microscope Images

More information

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction

Image formation - Cameras. Grading & Project. About the course. Tentative Schedule. Course Content. Students introduction About the course Instructors: Haibin Ling (hbling@temple, Wachman 35) Hours Lecture: Tuesda 5:3-8:pm, TTLMAN 43B Office hour: Tuesda 3: - 5:pm, or b appointment Textbook Computer Vision: Models, Learning,

More information

CSCE 763: Digital Image Processing

CSCE 763: Digital Image Processing CSCE 763: Digital Image Processing Spring 2018 Yan Tong Department of Computer Science and Engineering University of South Carolina Today s Agenda Welcome Tentative Syllabus Topics covered in the course

More information

Introduction

Introduction Introduction Lecturer: Dr. Hossam Hassan Email : hossameldin.hassan@eng.asu.edu.eg Computers and Systems Engineering Essential Books 1. Digital Image Processing Rafael Gonzalez and Richard Woods, Third

More information

EE 392B: Course Introduction

EE 392B: Course Introduction EE 392B Course Introduction About EE392B Goals Topics Schedule Prerequisites Course Overview Digital Imaging System Image Sensor Architectures Nonidealities and Performance Measures Color Imaging Recent

More information

HDR videos acquisition

HDR videos acquisition HDR videos acquisition dr. Francesco Banterle francesco.banterle@isti.cnr.it How to capture? Videos are challenging: We need to capture multiple frames at different exposure times and everything moves

More information

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros

Cameras. Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26. with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Cameras Digital Visual Effects, Spring 2008 Yung-Yu Chuang 2008/2/26 with slides by Fredo Durand, Brian Curless, Steve Seitz and Alexei Efros Camera trial #1 scene film Put a piece of film in front of

More information

Acquisition and representation of images

Acquisition and representation of images Acquisition and representation of images Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Methods for mage Processing academic year 2017 2018 Electromagnetic radiation λ = c ν

More information

Vision 1. Physical Properties of Light. Overview of Topics. Light, Optics, & The Eye Chaudhuri, Chapter 8

Vision 1. Physical Properties of Light. Overview of Topics. Light, Optics, & The Eye Chaudhuri, Chapter 8 Vision 1 Light, Optics, & The Eye Chaudhuri, Chapter 8 1 1 Overview of Topics Physical Properties of Light Physical properties of light Interaction of light with objects Anatomy of the eye 2 3 Light A

More information

CHAPTER 4 LOCATING THE CENTER OF THE OPTIC DISC AND MACULA

CHAPTER 4 LOCATING THE CENTER OF THE OPTIC DISC AND MACULA 90 CHAPTER 4 LOCATING THE CENTER OF THE OPTIC DISC AND MACULA The objective in this chapter is to locate the centre and boundary of OD and macula in retinal images. In Diabetic Retinopathy, location of

More information

WHITE PAPER. Guide to CCD-Based Imaging Colorimeters

WHITE PAPER. Guide to CCD-Based Imaging Colorimeters Guide to CCD-Based Imaging Colorimeters How to choose the best imaging colorimeter CCD-based instruments offer many advantages for measuring light and color. When configured effectively, CCD imaging systems

More information

Optical basics for machine vision systems. Lars Fermum Chief instructor STEMMER IMAGING GmbH

Optical basics for machine vision systems. Lars Fermum Chief instructor STEMMER IMAGING GmbH Optical basics for machine vision systems Lars Fermum Chief instructor STEMMER IMAGING GmbH www.stemmer-imaging.de AN INTERNATIONAL CONCEPT STEMMER IMAGING customers in UK Germany France Switzerland Sweden

More information

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008

CS559: Computer Graphics. Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008 CS559: Computer Graphics Lecture 2: Image Formation in Eyes and Cameras Li Zhang Spring 2008 Today Eyes Cameras Light Why can we see? Visible Light and Beyond Infrared, e.g. radio wave longer wavelength

More information

Modeling and Synthesis of Aperture Effects in Cameras

Modeling and Synthesis of Aperture Effects in Cameras Modeling and Synthesis of Aperture Effects in Cameras Douglas Lanman, Ramesh Raskar, and Gabriel Taubin Computational Aesthetics 2008 20 June, 2008 1 Outline Introduction and Related Work Modeling Vignetting

More information

Solution Set #2

Solution Set #2 05-78-0 Solution Set #. For the sampling function shown, analyze to determine its characteristics, e.g., the associated Nyquist sampling frequency (if any), whether a function sampled with s [x; x] may

More information

Intro to Digital SLR and ILC Photography Week 1 The Camera Body

Intro to Digital SLR and ILC Photography Week 1 The Camera Body Intro to Digital SLR and ILC Photography Week 1 The Camera Body Instructor: Roger Buchanan Class notes are available at www.thenerdworks.com Course Outline: Week 1 Camera Body; Week 2 Lenses; Week 3 Accessories,

More information

Color Image Processing

Color Image Processing Color Image Processing Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Color Used heavily in human vision. Visible spectrum for humans is 400 nm (blue) to 700

More information

Digital Image Processing

Digital Image Processing Part 1: Course Introduction Achim J. Lilienthal AASS Learning Systems Lab, Dep. Teknik Room T1209 (Fr, 11-12 o'clock) achim.lilienthal@oru.se Course Book Chapters 1 & 2 2011-04-05 Contents 1. Introduction

More information

Basic principles of photography. David Capel 346B IST

Basic principles of photography. David Capel 346B IST Basic principles of photography David Capel 346B IST Latin Camera Obscura = Dark Room Light passing through a small hole produces an inverted image on the opposite wall Safely observing the solar eclipse

More information

Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems

Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems Design of Temporally Dithered Codes for Increased Depth of Field in Structured Light Systems Ricardo R. Garcia University of California, Berkeley Berkeley, CA rrgarcia@eecs.berkeley.edu Abstract In recent

More information

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen

Image Formation and Capture. Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen Image Formation and Capture Acknowledgment: some figures by B. Curless, E. Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen Image Formation and Capture Real world Optics Sensor Devices Sources of Error

More information

Computational Photography and Video. Prof. Marc Pollefeys

Computational Photography and Video. Prof. Marc Pollefeys Computational Photography and Video Prof. Marc Pollefeys Today s schedule Introduction of Computational Photography Course facts Syllabus Digital Photography What is computational photography Convergence

More information

VC 14/15 TP2 Image Formation

VC 14/15 TP2 Image Formation VC 14/15 TP2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline Computer Vision? The Human Visual System

More information

Light. Path of Light. Looking at things. Depth and Distance. Getting light to imager. CS559 Lecture 2 Lights, Cameras, Eyes

Light. Path of Light. Looking at things. Depth and Distance. Getting light to imager. CS559 Lecture 2 Lights, Cameras, Eyes CS559 Lecture 2 Lights, Cameras, Eyes These are course notes (not used as slides) Written by Mike Gleicher, Sept. 2005 Adjusted after class stuff we didn t get to removed / mistakes fixed Light Electromagnetic

More information

What will be on the midterm?

What will be on the midterm? What will be on the midterm? CS 178, Spring 2014 Marc Levoy Computer Science Department Stanford University General information 2 Monday, 7-9pm, Cubberly Auditorium (School of Edu) closed book, no notes

More information

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13

Projection. Readings. Szeliski 2.1. Wednesday, October 23, 13 Projection Readings Szeliski 2.1 Projection Readings Szeliski 2.1 Müller-Lyer Illusion by Pravin Bhat Müller-Lyer Illusion by Pravin Bhat http://www.michaelbach.de/ot/sze_muelue/index.html Müller-Lyer

More information

MAV-ID card processing using camera images

MAV-ID card processing using camera images EE 5359 MULTIMEDIA PROCESSING SPRING 2013 PROJECT PROPOSAL MAV-ID card processing using camera images Under guidance of DR K R RAO DEPARTMENT OF ELECTRICAL ENGINEERING UNIVERSITY OF TEXAS AT ARLINGTON

More information

Name: Date: Math in Special Effects: Try Other Challenges. Student Handout

Name: Date: Math in Special Effects: Try Other Challenges. Student Handout Name: Date: Math in Special Effects: Try Other Challenges When filming special effects, a high-speed photographer needs to control the duration and impact of light by adjusting a number of settings, including

More information

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1

Projection. Announcements. Müller-Lyer Illusion. Image formation. Readings Nalwa 2.1 Announcements Mailing list (you should have received messages) Project 1 additional test sequences online Projection Readings Nalwa 2.1 Müller-Lyer Illusion Image formation object film by Pravin Bhat http://www.michaelbach.de/ot/sze_muelue/index.html

More information

Photons and solid state detection

Photons and solid state detection Photons and solid state detection Photons represent discrete packets ( quanta ) of optical energy Energy is hc/! (h: Planck s constant, c: speed of light,! : wavelength) For solid state detection, photons

More information

Digital image processing. Árpád BARSI BME Dept. Photogrammetry and Geoinformatics

Digital image processing. Árpád BARSI BME Dept. Photogrammetry and Geoinformatics Digital image processing Árpád BARSI BME Dept. Photogrammetry and Geoinformatics barsi.arpad@epito.bme.hu Part 1: (5/12/) Theory of image processing Part 2: (12/12/) Practice with software examples Main

More information

DIGITAL IMAGE PROCESSING

DIGITAL IMAGE PROCESSING DIGITAL IMAGE PROCESSING Lecture 1 Introduction Tammy Riklin Raviv Electrical and Computer Engineering Ben-Gurion University of the Negev 2 Introduction to Digital Image Processing Lecturer: Dr. Tammy

More information

APPLICATION OF COMPUTER VISION FOR DETERMINATION OF SYMMETRICAL OBJECT POSITION IN THREE DIMENSIONAL SPACE

APPLICATION OF COMPUTER VISION FOR DETERMINATION OF SYMMETRICAL OBJECT POSITION IN THREE DIMENSIONAL SPACE APPLICATION OF COMPUTER VISION FOR DETERMINATION OF SYMMETRICAL OBJECT POSITION IN THREE DIMENSIONAL SPACE Najirah Umar 1 1 Jurusan Teknik Informatika, STMIK Handayani Makassar Email : najirah_stmikh@yahoo.com

More information

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0

TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TRUESENSE SPARSE COLOR FILTER PATTERN OVERVIEW SEPTEMBER 30, 2013 APPLICATION NOTE REVISION 1.0 TABLE OF CONTENTS Overview... 3 Color Filter Patterns... 3 Bayer CFA... 3 Sparse CFA... 3 Image Processing...

More information

DIGITAL IMAGING. Handbook of. Wiley VOL 1: IMAGE CAPTURE AND STORAGE. Editor-in- Chief

DIGITAL IMAGING. Handbook of. Wiley VOL 1: IMAGE CAPTURE AND STORAGE. Editor-in- Chief Handbook of DIGITAL IMAGING VOL 1: IMAGE CAPTURE AND STORAGE Editor-in- Chief Adjunct Professor of Physics at the Portland State University, Oregon, USA Previously with Eastman Kodak; University of Rochester,

More information

Applications of Optics

Applications of Optics Nicholas J. Giordano www.cengage.com/physics/giordano Chapter 26 Applications of Optics Marilyn Akins, PhD Broome Community College Applications of Optics Many devices are based on the principles of optics

More information

Fundamentals of CMOS Image Sensors

Fundamentals of CMOS Image Sensors CHAPTER 2 Fundamentals of CMOS Image Sensors Mixed-Signal IC Design for Image Sensor 2-1 Outline Photoelectric Effect Photodetectors CMOS Image Sensor(CIS) Array Architecture CIS Peripherals Design Considerations

More information

ECEN. Spectroscopy. Lab 8. copy. constituents HOMEWORK PR. Figure. 1. Layout of. of the

ECEN. Spectroscopy. Lab 8. copy. constituents HOMEWORK PR. Figure. 1. Layout of. of the ECEN 4606 Lab 8 Spectroscopy SUMMARY: ROBLEM 1: Pedrotti 3 12-10. In this lab, you will design, build and test an optical spectrum analyzer and use it for both absorption and emission spectroscopy. The

More information

Machine Vision for the Life Sciences

Machine Vision for the Life Sciences Machine Vision for the Life Sciences Presented by: Niels Wartenberg June 12, 2012 Track, Trace & Control Solutions Niels Wartenberg Microscan Sr. Applications Engineer, Clinical Senior Applications Engineer

More information

Color Image Processing

Color Image Processing Color Image Processing Jesus J. Caban Outline Discuss Assignment #1 Project Proposal Color Perception & Analysis 1 Discuss Assignment #1 Project Proposal Due next Monday, Oct 4th Project proposal Submit

More information

Enhanced Shape Recovery with Shuttered Pulses of Light

Enhanced Shape Recovery with Shuttered Pulses of Light Enhanced Shape Recovery with Shuttered Pulses of Light James Davis Hector Gonzalez-Banos Honda Research Institute Mountain View, CA 944 USA Abstract Computer vision researchers have long sought video rate

More information

Computer Vision. Thursday, August 30

Computer Vision. Thursday, August 30 Computer Vision Thursday, August 30 1 Today Course overview Requirements, logistics Image formation 2 Introductions Instructor: Prof. Kristen Grauman grauman @ cs TAY 4.118, Thurs 2-4 pm TA: Sudheendra

More information

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros

Acquisition. Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros Acquisition Some slides from: Yung-Yu Chuang (DigiVfx) Jan Neumann, Pat Hanrahan, Alexei Efros Image Acquisition Digital Camera Film Outline Pinhole camera Lens Lens aberrations Exposure Sensors Noise

More information

Image Capture and Problems

Image Capture and Problems Image Capture and Problems A reasonable capture IVR Vision: Flat Part Recognition Fisher lecture 4 slide 1 Image Capture: Focus problems Focus set to one distance. Nearby distances in focus (depth of focus).

More information

Digital Image Processing COSC 6380/4393

Digital Image Processing COSC 6380/4393 Digital Image Processing COSC 6380/4393 Lecture 2 Aug 24 th, 2017 Slides from Dr. Shishir K Shah, Rajesh Rao and Frank (Qingzhong) Liu 1 Instructor TA Digital Image Processing COSC 6380/4393 Pranav Mantini

More information