Vision III. How We See Things (short version) Overview of Topics. From Early Processing to Object Perception
|
|
- Cornelia Blair
- 5 years ago
- Views:
Transcription
1 Vision III From Early Processing to Object Perception Chapter 10 in Chaudhuri 1 1 Overview of Topics Beyond the retina: 2 pathways to V1 Subcortical structures (LGN & SC) Object & Face recognition Primary visual cortex: Lines, direction, colour M vs. P pathways: Movement vs. Particulars How We See Things (short version) RGCs: Dot detectors V1: Line orientation, motion, colour V4: Shapes Temporal lobe: Objects & Faces 2 3
2 Fundamental Concept: Brain Organization Schemes Dorsal vs. Ventral Streams Dorsal stream mainly involved in motion processing (the where pathway ) Ventral mainly involved in processing identity of objects (the what pathway ) Will focus on ventral here, which takes most of its input from P pathway (more later) 4 5 From Eye To Brain Contralaterality in Vision One might think info from left eye goes to right brain & vice versa, but no. Instead... Information from left half of visual field goes (first) to right half of brain & vice versa That is, everything to the left of what you re fixating goes to the right hemisphere (first), and vice versa. 6 7
3 Contralaterality in Vision Nasal halves of retinas (close to nose): Capture light from temporal half of visual field Send signals across to contralateral side of brain Temporal halves of retinas (close to temples): Capture light from nasal half of visual field Send signals along to ipsilateral side of brain Primary Visual Cortex (V1) 8 9 Optic Tract Optic Radiations Optic Tract Optic Tract Optic Radiations Optic Radiations Primary Visual Cortex (V1) 9 Primary Visual Cortex (V1) 9
4 Nasal Visual Field Temporal Retina Ipsilateral Hemisphere Temporal Visual Field Nasal Retina Contralateral Hemisphere Optic Tract Optic Tract Optic Radiations Optic Radiations Primary Visual Cortex (V1) 9 Primary Visual Cortex (V1) 10 Temporal Visual Field Nasal Retina Contralateral Hemisphere Temporal Visual Field Nasal Retina Contralateral Hemisphere Optic Tract Optic Tract Optic Radiations Optic Radiations Primary Visual Cortex (V1) 10 Primary Visual Cortex (V1) 10
5 Optic Tract Optic Tract Optic Radiations Optic Radiations Primary Visual Cortex (V1) 11 Primary Visual Cortex (V1) 11 Optic Tract Optic Tract Optic Radiations Optic Radiations Primary Visual Cortex (V1) 11 Primary Visual Cortex (V1) 11
6 Foveal Representation Optic Tract Is the fovea split, with info from each half carried to separate hemispheres? No, instead it is represented in both hemispheres Evidence for this is seen in foveal sparing, i.e., continued visual function in fovea after loss of a visual hemifield due to stroke Optic Radiations Primary Visual Cortex (V1) Questions Light from the temporal visual field of the right eye falls on the half of the retina, which sends information to the side of the brain What are the two large streams of visual information that exit V1 and go to the rest of the brain? Two Pathways From Eye To Cortex Geniculocortical pathway: Lateral Geniculate Nucleus (LGN) of thalamus to V1 90% of RGC outputs Tectopulvinar pathway: Superior colliculus (aka tectum ) to Pulvinar nucleus to visual cortex (many parts) 10% of RGC outputs 13 14
7 The LGN As we ve seen, thalamus has nuclei for early sensory processing of all sensory modalities (except smell). LGN is the one for vision A knee-shaped part of the thalamus Has a six-layered structure Does early visual processing (centre-surround RFs) Good example of a module that is organized in layers and columns The LGN The LGN LGN has left and right halves. Each half receives signals from right and left eyes Layers 2, 3, & 5 receive input from the ipsilateral eye Layers 1, 4, & 6 receive input from the contralateral eye C I I C I C See I? I see! I see! 1+4 = 6, not true, so contra ; 2+3 = 5, true, so ipsi LGN layers 1 & 2 are magnocellular, with large neurones Part of the M-pathway, responsible for motion LGN layers 3-6 are parvocellular, with small neurones Part of the P-pathway, responsible for colour and detail 17 18
8 The LGN Laterality: Red: Receive signals from the ipsilateral eye. Blue: Receive signals from the contralateral eye. Pathways (aka Channels) Solid: parvocellular layers. Dotted: magnocellular layers Visual Processing in LGN LGN neurones have centre-surround receptive fields, just like retinal ganglion cells However, LGN cells are more selective, possibly representing some signal processing to reduce noise and produce sharper tuning than RGCs. These cleaned signals are sent on the V Visual Processing in LGN The LGN s connection to V1 goes both ways, with a descending fibre tract This has been found to play a role in attentional modulation Example: After I ask Are there any questions?, likely some of my magno LGN cells are more active (those for upward motion) The LGN s Retinotopic Map Each LGN layer is organized according to a Retinotopic Map Map: Each place on the retina corresponds to a place on the LGN in a systematic fashion Retinotopic: Neurones that are adjacent in LGN have RFs that are adjacent on the retina 21 22
9 Adjacent spots in the visual field correspond to adjacent spots on the retina, which in turn correspond to adjacent spots in the LGN Adjacent spots in the visual field correspond to adjacent spots on the retina, which in turn correspond to adjacent spots in the LGN Adjacent spots in the visual field correspond to adjacent spots on the retina, which in turn correspond to adjacent spots in the LGN Adjacent spots in the visual field correspond to adjacent spots on the retina, which in turn correspond to adjacent spots in the LGN 23 23
10 How do we know this? Single-cell recording experiments in monkeys Recorded from individual neurones with a very fine electrode. For example, our electrode might penetrate the LGN parallel to its surface, thus staying the same layer. Measuring response of LGN neurones, and moving systematically across surface of LGN, we find the receptive fields move systematically across retina
11
12 LGN Location Columns Single-cell recording experiments in monkeys If we instead move the electrode down through the LGN layers, we find the RFs are all the same place That is, the LGN is organized into location columns. i.e., there are columns of neurones that all process information from the same location on retina
13
14 27 27 Questions Superior Colliculus Which layers of the right LGN receive inputs from the left eye? What do we mean when we say the LGN has location columns? What do we mean when we say the LGN has a retinotopic layout? Small branch from the optic tract goes to SC Has retinotopic map of contralateral visual field Signals go from SC to another thalamic nucleus, the pulvinar From there, they go to many parts of the visual cortex 28 29
15 Superior Colliculus V1 SC receives descending signals from visual, auditory and somatosensory cortices SC integrates these to coordinate eye and body movements toward stimuli Example: You hear a loud sound or feel a tap on your shoulder and look automatically in that direction Primary visual cortex = striate cortex = Brodmann Area 17 = Visual Receiving Area = V1 The first cortical area for visual processing The best-understood part of the cortex, thanks to work by such luminaries as Hubel & Weisel, who won a Nobel Prize for research on V Organizational aspects: 6 layered structure Retinotopic map V1 Ocular dominance columns Orientation selectivity columns Cytochrome oxidase blobs Location hypercolumns Layers of V1 Layer 1: No neurones, just fibres from neurones below Layers 2-3: Communicate horizontally with other visual cortical areas Layer 4: Receives inputs from LGN, subdivided into 4A, 4B, 4Cα (receives parvo inputs) & 4Cβ (receives magno) Signals are then sent up/down from here to other layers Layers 5-6: Send descending communications back to subcortical areas (LGN and SC) 32 33
16 Layers of V1 Retinotopic Layout of V1 RFs of adjacent V1 neurones are adjacent on the retina But, this retinotopic mapping is distorted relative to the surface area of the retina Foveal Magnification: Far more V1 neurones have RFs in the fovea than in the periphery i.e., foveal RGCs innervate a far larger area of V1than one would predict based on the area of the fovea Foveal Magnification On The Retina In V1 Foveal Magnification On The Retina In V
17 Foveal Magnification Why does V1 exhibit foveal magnification? One, there are simply more RGCs per unit area of fovea than in the peripheral retina Two, each foveal RGC innervates more cortical neurones Presumably this allows for more complex and precise processing of visual information from fovea Questions What is the role of the SC in vision? Which layer of V1 receives signals from LGN? What is foveal magnification? Why does it occur? Binocularity & Ocular Dominance At the LGN, all neurones are monocular However, at V1, the majority are binocular, taking inputs from both eyes This is the beginning of stereoscopic depth perception Ocular Dominance Most V1 neurones are binocular But most show some preference for one eye or the other The preference varies systematically across the surface of the cortex 39 40
18 Ocular Dominance How Ocular Dominance Comes About Orientation Selectivity Orientation Selectivity Most V1 Neurons have elongated receptive fields These are ON/OFF or OFF/ON, like RGCs Each neurone responds best to a line of light (ON/ OFF) or dark (OFF/ON) of a given orientation 43 44
19 Orientation Selectivity How does orientation selectivity in V1 neurones arise? Hubel & Weisel proposed the model below, where several LGN cells having RFs lined up on the retina--feed into one V1 cell How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields V1 Simple Cell V1 Simple Cell 46 46
20 How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields Retinal Ganglion Cells Retinal Ganglion Cells LGN Cells V1 Simple Cell V1 Simple Cell How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields Retinal Ganglion Cells Retinal Ganglion Cells LGN Cells LGN Cells V1 Simple Cell V1 Simple Cell 46 46
21 How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields Retinal Ganglion Cells Retinal Ganglion Cells LGN Cells LGN Cells V1 Simple Cell V1 Simple Cell How V1 cells are wired to RGCs to produce oriented receptive fields How V1 cells are wired to RGCs to produce oriented receptive fields Retinal Ganglion Cells Retinal Ganglion Cells LGN Cells LGN Cells V1 Simple Cell V1 Simple Cell 47 48
22 + + + How V1 cells are wired to RGCs to produce oriented receptive fields Retinal Ganglion Cells LGN Cells V1 Simple Cell Directional Motion Selectivity Hubel & Weisel also found V1 cells sensitive to the direction of motion of the stimulus These are the first stage in our ability to process moving stimuli Directional Motion Selectivity Schematic of a Reichardt Motion Detector Striate Cortex Simple Cell Delaying Interneuron Striate Cortex Motion-Sensitive Cell (Reichardt Detector) 50 51
23 Schematic of a Reichardt Motion Detector Questions Delaying Interneuron Striate Cortex Simple Cell Striate Cortex Motion-Sensitive Cell (Reichardt Detector) What are three stimulus characteristics that V1 neurones are tuned to? True or false: Orientation-selective cells are all ON/OFF (i.e, excitatory centre/inhibitory surround)? Organization of V1 How are the various cells in V1 organized? Hubel & Weisel proposed the ice cube model, whereby orientation and ocular dominance columns varied independently Also proposed the location hypercolumn, which is a set of all orientation columns and two ocular dominance columns Ice Cube Model of V1 Retina 53 54
24 Ice Cube Model of V1 Ice Cube Model of V1 Retina Retina Ice Cube Model of V1 Ice Cube Model of V1 Retina Retina 54 54
25 Ice Cube Model of V1 Ice Cube Model of V1 Retina Retina Ice Cube Model of V1 Ice Cube Model of V1 Retina While it s accurate as far as it goes, the ice cube model is not complete Motion direction selectivity is not incorporated, nor are colour processing, spatial frequency, or M vs. P channels
26 Cytochrome Oxidase Blobs Interlaced with location hypercolumns are another set of columns that show high neural activity Once were thought to be involved in colour processing and called colour blobs But instead they seem to integrate info from M&P cells M vs. P Channels As noted earlier, two channels start in retina: Magno = movement Parvo = particulars These continue on through V1 to higher visual areas M vs. P: Anatomical Separation M Retina Parasol RGCs Midget RGCs LGN Layers 1-2 Layers 3-6 V1, layer 4 4Cα 4Cβ V1, blobs blob & interblob interblob only Extrastriate MT V4 Pathways Dorsal ( where ) Ventral ( what ) P Complete Separation Partial Separation M vs. P: Functional Differences 58 59
27 Ultimately... M channel projects more to MT (motion processing area) and then to the dorsal stream (= where pathway ) P channel projects more to V4 (form processing area) and then to the ventral stream (= what pathway ) We will now take a closer look at the latter Questions What is a location hypercolumn in V1? The M & P pathways are completely segregated up to what point in the visual system? The Ventral Stream Consists of a network of areas, mostly in the inferior temporal (IT) area, that engage in highlevel vision IT cortex can be divided into 3 zones: Posterior IT (PIT): Complex form processing Central IT (CIT): View invariant processing Anterior IT (AIT): Individuation / configuration / shape-invariant processing Complex Form Processing Tasks (PIT/CIT) Differentiating illumination edges from reflectance edges. Inverse Projection: Determining 3D shape from 2D information Segmentation: Differentiating objects from background and each other. Viewpoint invariance: Objects look different from different viewpoints Shape invariance: Some objects, especially living things, change shape but nonetheless are recognized as the same object. Completion: Objects are often partially occluded, how do we complete the view of a partially-viewed object? 62 63
28 Illumination Edge Reflectance Edge Reflectance Edge Illumination Edge Illumination Edge It is difficult for a computer program (but easy for us) to determine which changes in lightness in this scene are due to properties of different parts of the scene, and which are due to changes in illumination
29 Light Comes From Above Light Comes From Above One assumption the visual system makes in differentiating shadow from reflectance change is that light comes from above. True over our evolutionary history. 65 One assumption the visual system makes in differentiating shadow from reflectance change is that light comes from above. True over our evolutionary history. 65 The Light-from-above Assumption The Light-from-above Assumption 66 67
30 The Light-from-above Assumption Shadows Have Fuzzy Edges 67 Another assumption the visual system makes is that shadows have fuzzy edges (penumbras). 68 Shadows Have Fuzzy Edges Inverse Projection Problem Another assumption the visual system makes is that shadows have fuzzy edges (penumbras). 68 An infinite number of objects can create the same image on the retina. How do we know which one is out there? 69
31 Inverse Projection Rules The brain uses heuristics--rules of thumb that aren t always true--to solve the otherwise impossible inverse projection problem. E.g., A straight line in the 2D image on the retina is a straight line in 3D reality If the tips of two lines meet in 2D, assume they meet at their tips in 3D reality 70 Heuristics Both of these assumptions hold true in most cases, but not all. Both are part of a more general rule that the visual system interprets the 3D world in a stable way, meaning that it will not change with slight changes in POV. 71 Heuristics Heuristics Both of these assumptions hold true in most cases, but not all. Both are part of a more general rule that the visual system interprets the 3D world in a stable way, meaning that it will not change with slight changes in POV. 71 Both of these assumptions hold true in most cases, but not all. Both are part of a more general rule that the visual system interprets the 3D world in a stable way, meaning that it will not change with slight changes in POV. 71
32 Heuristics Inverse Projection Fail Both of these assumptions hold true in most cases, but not all. Both are part of a more general rule that the visual system interprets the 3D world in a stable way, meaning that it will not change with slight changes in POV Your brain makes assumptions about how 2D projections arise from 3D objects In the case of the Devil s Triangle, they not only fail to give you the correct interpretation, they actively prevent you from getting it! 72 Inverse Projection Epic Fail! Segmentation: Which parts of a scene belong to which objects? What is object vs. background? Part of the solution involves gestalt rules such as smoothness heuristics, but part is simple experience. Here Magritte messes with our segmentation heuristic by violating both gestalt rules and our experiences
33 Segmentation Smoothness Heuristic Fail Gestalt heuristics play a role in segmentation: Smoothness: Take the interpretation with the least sharp turns Pragnanz (simplicity): Take the interpretation with the fewest objects and types of objects Smoothness Heuristic Fail Perceptual Segregation: Figure and Ground 76 77
34 Figure-Ground Segmentation Heuristics used to determine which area is figure: Figures are located in the lower part of scene Figures are symmetrical Figures are small, backgrounds are large Figures are vertical Elements that are meaningful (i.e., have been seen as figures before) are figures
35 Figure-Ground Segmentation in V1 Recordings from V1 in the monkey cortex show: Response to area that is figure No response to area that is ground This result is important because: V1 neurones are early in the nervous system It reveals both a feedforward and feedback in the system How a neurone in V1 responds to stimuli presented to its receptive field (green rectangle). (a) The neurone responded when the stimulus on the receptive field is figure. (b) No response when the same pattern on the receptive field is not figure! How a neurone in V1 responds to stimuli presented to its receptive field (green rectangle). (a) The neurone responded when the stimulus on the receptive field is figure. (b) No response when the same pattern on the receptive field is not figure! Questions What are some heuristics the brain uses......to distinguish luminance changes from lightness changes?...to solve the inverse projection problem?...to solve the segmentation problem? 83 84
36 Viewpoint Invariance Viewpoint Invariance Ceci ne sont pas des pipes We recognize objects from different viewpoints, even though pattern of light on retina changes. i.e., there is a -to-one relation between light patterns and objects (and vice versa). Beiderman s RBC and Tarr et al s view-based recognition models both tried to account for this We will see that this is another example of thesis-antithesis-synthesis A B C A B C Human Viewpoint Invariance is Imperfect. Quick: Which pairs show two views of the same object? Human Viewpoint Invariance is Imperfect. Quick: Which pairs show two views of the same object? 87 87
37 A B C A B C Human Viewpoint Invariance is Imperfect. Quick: Which pairs show two views of the same object? Human Viewpoint Invariance is Imperfect. Quick: Which pairs show two views of the same object? Two Viewpoints on Viewpoint Invariance Structural-description models: 3D object representations are based on combinations of 3D volumetric primitives Image-description models: Ability to identify 3D objects comes from sets of stored 2D images from different perspectives Structural Description Models Marr s model proposed a sequence of events using simple geometrical features: Edges (detected via V1 neurones) View-invariant features such as parallel lines, curve polarity, angle type. (PIT, maybe?) Geometrical shapes (again, PIT?) Relations between geometric shapes (CIT?)
38 Structural-Description Models Geons & Objects Recognition-by-components theory by Biederman (developed from Marr s ideas) Volumetric primitives are called geons Theory proposes there are 36 geons that combine to make all 3-D objects Geons include cylinders, rectangular solids, pyramids, etc Structural-Description Models Properties of geons View-invariant: They can be recognized from almost any viewpoint (except rare accidental viewpoints) Discriminability: They can be easily distinguished from one another. Principle of componential recovery - the ability to recognize an object if we can identify its geons It is difficult to identify the object behind the mask because the corners and curves that allow extraction of geons have been obscured
39 Image-Description Models Now that it is possible to identify geons, the object can be identified In contrast to structural description models, image-description models claim that: Ability to identify 3-D objects comes from stored 2-D viewpoints from different perspectives. Evidence for this comes from novel object studies: For a familiar object, view invariance occurs For a novel object, view invariance does not occur Shows that an observer must have the different viewpoints encoded before recognition can occur from all viewpoints Psychophysical curve showing that a monkey is better at identifying the view of the object that was presented during training (arrow). No view invariance. 96 Synthesis Tjan & Legge (1998): View-invariant performance found for simple objects (e.g., geometrical shapes) But not for complex objects (e.g., ameoboids, bent paper-clip objects, etc.) Complexity defined quantitatively via an ideal observer algorithm Recent models incorporate both imagedescription and structural description aspects. 97
40 Completion You Complete Me Completion of partially-viewed objects is based on gestalt heuristics such as smoothness and pragnanz But, as with all heuristics, these sometimes fail. Sometimes we complete things that aren t there... Experience obviously plays an important role You Complete Me
41 Shape Invariance Shape Invariance We have little trouble recognizing this bird as such, despite its many changes in shape A similar problem arises with facial expression Questions Which theory best explains our ability to recognize objects from many views, structural description models or image-description models? What does completion refer to in vision? Face Perception Face processing is a highly complex visual task Faces are quite uniform, but we individuate them with ease Facial expressions are subtle variations in face shape, but we decode them with ease Thought to be subserved by a network of brain areas, some of which are in AIT
42 My Clones? Your face is the same as everybody has the two eyes... nose in the middle, mouth under. It's always the same. Now if you had the two eyes on the same side of the nose, for instance or the mouth at the top that would be some help. - Humpty Dumpty, Through the Looking Glass My Clones? Prosopaganosia An inability to recognize faces Often arises after damage to the AIT, specifically the fusiform face area (FFA) Specific to faces, recognition of other objects is unimpaired
43 Face-Selective Neurones In areas of monkey cortex homologous to FFA, we find cells that respond specifically to faces Perceptual Differences Between Faces & Objects A number of phenomena suggest that faces are processed in a qualitatively different way than other objects Inversion has a disproportionate effect on face recognition Inversion seems to disrupt configural processing in faces but not objects Composite effects exist for faces but not objects Face Inversion Inversion Disrupts Configural Processing A little harder A lot harder Schwaninger, A., Carbon, C.C., & Leder, H. (2003). Expert face processing: Specialization and constraints. In G. Schwarzer & H. Leder (Eds.), Development of Face Processing, pp Göttingen: Hogrefe
44 Inversion Disrupts Configural Processing Inversion Disrupts Configural Processing Schwaninger, A., Carbon, C.C., & Leder, H. (2003). Expert face processing: Specialization and constraints. In G. Schwarzer & H. Leder (Eds.), Development of Face Processing, pp Göttingen: Hogrefe. Schwaninger, A., Carbon, C.C., & Leder, H. (2003). Expert face processing: Specialization and constraints. In G. Schwarzer & H. Leder (Eds.), Development of Face Processing, pp Göttingen: Hogrefe Composite Face Effect Composite Face Effect
45 Questions What is prosopagnosia? When does it occur? What is the composite face effect? 113
Lecture 5. The Visual Cortex. Cortical Visual Processing
Lecture 5 The Visual Cortex Cortical Visual Processing 1 Lateral Geniculate Nucleus (LGN) LGN is located in the Thalamus There are two LGN on each (lateral) side of the brain. Optic nerve fibers from eye
More informationLecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex
Lecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex 1.Vision Science 2.Visual Performance 3.The Human Visual System 4.The Retina 5.The Visual Field and
More informationCortical sensory systems
Cortical sensory systems Motorisch Somatosensorisch Sensorimotor Visuell Sensorimotor Visuell Visuell Auditorisch Olfaktorisch Auditorisch Olfaktorisch Auditorisch Mensch Katze Ratte Primary Visual Cortex
More informationiris pupil cornea ciliary muscles accommodation Retina Fovea blind spot
Chapter 6 Vision Exam 1 Anatomy of vision Primary visual cortex (striate cortex, V1) Prestriate cortex, Extrastriate cortex (Visual association coretx ) Second level association areas in the temporal and
More informationObject Perception. 23 August PSY Object & Scene 1
Object Perception Perceiving an object involves many cognitive processes, including recognition (memory), attention, learning, expertise. The first step is feature extraction, the second is feature grouping
More informationOutline. The visual pathway. The Visual system part I. A large part of the brain is dedicated for vision
The Visual system part I Patrick Kanold, PhD University of Maryland College Park Outline Eye Retina LGN Visual cortex Structure Response properties Cortical processing Topographic maps large and small
More informationStructure and Measurement of the brain lecture notes
Structure and Measurement of the brain lecture notes Marty Sereno 2009/2010!"#$%&'(&#)*%$#&+,'-&.)"/*"&.*)*-'(0&1223 Neural development and visual system Lecture 2 Topics Development Gastrulation Neural
More informationThe Visual System. Computing and the Brain. Visual Illusions. Give us clues as to how the visual system works
The Visual System Computing and the Brain Visual Illusions Give us clues as to how the visual system works We see what we expect to see http://illusioncontest.neuralcorrelate.com/ Spring 2010 2 1 Visual
More informationParvocellular layers (3-6) Magnocellular layers (1 & 2)
Parvocellular layers (3-6) Magnocellular layers (1 & 2) Dorsal and Ventral visual pathways Figure 4.15 The dorsal and ventral streams in the cortex originate with the magno and parvo ganglion cells and
More information3 THE VISUAL BRAIN. No Thing to See. Copyright Worth Publishers 2013 NOT FOR REPRODUCTION
3 THE VISUAL BRAIN No Thing to See In 1988 a young woman who is known in the neurological literature as D.F. fell into a coma as a result of carbon monoxide poisoning at her home. (The gas was released
More informationFundamentals of Computer Vision B. Biological Vision. Prepared By Louis Simard
Fundamentals of Computer Vision 308-558B Biological Vision Prepared By Louis Simard 1. Optical system 1.1 Overview The ocular optical system of a human is seen to produce a transformation of the light
More informationSpatial Vision: Primary Visual Cortex (Chapter 3, part 1)
Spatial Vision: Primary Visual Cortex (Chapter 3, part 1) Lecture 6 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Spring 2019 1 remaining Chapter 2 stuff 2 Mach Band
More information1/21/2019. to see : to know what is where by looking. -Aristotle. The Anatomy of Visual Pathways: Anatomy and Function are Linked
The Laboratory for Visual Neuroplasticity Massachusetts Eye and Ear Infirmary Harvard Medical School to see : to know what is where by looking -Aristotle The Anatomy of Visual Pathways: Anatomy and Function
More informationFundamentals of Computer Vision
Fundamentals of Computer Vision COMP 558 Course notes for Prof. Siddiqi's class. taken by Ruslana Makovetsky (Winter 2012) What is computer vision?! Broadly speaking, it has to do with making a computer
More informationThe visual and oculomotor systems. Peter H. Schiller, year The visual cortex
The visual and oculomotor systems Peter H. Schiller, year 2006 The visual cortex V1 Anatomical Layout Monkey brain central sulcus Central Sulcus V1 Principalis principalis Arcuate Lunate lunate Figure
More informationSpatial coding: scaling, magnification & sampling
Spatial coding: scaling, magnification & sampling Snellen Chart Snellen fraction: 20/20, 20/40, etc. 100 40 20 10 Visual Axis Visual angle and MAR A B C Dots just resolvable F 20 f 40 Visual angle Minimal
More informationChapter Six Chapter Six
Chapter Six Chapter Six Vision Sight begins with Light The advantages of electromagnetic radiation (Light) as a stimulus are Electromagnetic energy is abundant, travels VERY quickly and in fairly straight
More informationPsych 333, Winter 2008, Instructor Boynton, Exam 1
Name: Class: Date: Psych 333, Winter 2008, Instructor Boynton, Exam 1 Multiple Choice There are 35 multiple choice questions worth one point each. Identify the letter of the choice that best completes
More informationRetina. Convergence. Early visual processing: retina & LGN. Visual Photoreptors: rods and cones. Visual Photoreptors: rods and cones.
Announcements 1 st exam (next Thursday): Multiple choice (about 22), short answer and short essay don t list everything you know for the essay questions Book vs. lectures know bold terms for things that
More informationHuman Vision. Human Vision - Perception
1 Human Vision SPATIAL ORIENTATION IN FLIGHT 2 Limitations of the Senses Visual Sense Nonvisual Senses SPATIAL ORIENTATION IN FLIGHT 3 Limitations of the Senses Visual Sense Nonvisual Senses Sluggish source
More informationOutline 2/21/2013. The Retina
Outline 2/21/2013 PSYC 120 General Psychology Spring 2013 Lecture 9: Sensation and Perception 2 Dr. Bart Moore bamoore@napavalley.edu Office hours Tuesdays 11:00-1:00 How we sense and perceive the world
More informationMaps in the Brain Introduction
Maps in the Brain Introduction 1 Overview A few words about Maps Cortical Maps: Development and (Re-)Structuring Auditory Maps Visual Maps Place Fields 2 What are Maps I Intuitive Definition: Maps are
More informationA Primer on Human Vision: Insights and Inspiration for Computer Vision
A Primer on Human Vision: Insights and Inspiration for Computer Vision Guest&Lecture:&Marius&Cătălin&Iordan&& CS&131&8&Computer&Vision:&Foundations&and&Applications& 27&October&2014 detection recognition
More informationThe Physiology of the Senses Lecture 3: Visual Perception of Objects
The Physiology of the Senses Lecture 3: Visual Perception of Objects www.tutis.ca/senses/ Contents Objectives... 2 What is after V1?... 2 Assembling Simple Features into Objects... 4 Illusory Contours...
More informationNeural basis of pattern vision
ENCYCLOPEDIA OF COGNITIVE SCIENCE 2000 Macmillan Reference Ltd Neural basis of pattern vision Visual receptive field#visual system#binocularity#orientation selectivity#stereopsis Kiper, Daniel Daniel C.
More informationTSBB15 Computer Vision
TSBB15 Computer Vision Lecture 9 Biological Vision!1 Two parts 1. Systems perspective 2. Visual perception!2 Two parts 1. Systems perspective Based on Michael Land s and Dan-Eric Nilsson s work 2. Visual
More informationThe eye* The eye is a slightly asymmetrical globe, about an inch in diameter. The front part of the eye (the part you see in the mirror) includes:
The eye* The eye is a slightly asymmetrical globe, about an inch in diameter. The front part of the eye (the part you see in the mirror) includes: The iris (the pigmented part) The cornea (a clear dome
More informationCS 534: Computer Vision
CS 534: Computer Vision Spring 2004 Ahmed Elgammal Dept of Computer Science Rutgers University Human Vision - 1 Human Vision Outline How do we see: some historical theories of vision Human vision: results
More informationVISION. John Gabrieli Melissa Troyer 9.00
VISION John Gabrieli Melissa Troyer 9.00 Objectives Purposes of vision Problems that the visual system has to overcome Neural organization of vision Human Perceptual Abilities Detect a candle, 30 miles
More informationA Primer on Human Vision: Insights and Inspiration for Computer Vision
A Primer on Human Vision: Insights and Inspiration for Computer Vision Guest Lecture: Marius Cătălin Iordan CS 131 - Computer Vision: Foundations and Applications 27 October 2014 detection recognition
More informationThe eye, displays and visual effects
The eye, displays and visual effects Week 2 IAT 814 Lyn Bartram Visible light and surfaces Perception is about understanding patterns of light. Visible light constitutes a very small part of the electromagnetic
More informationAS Psychology Activity 4
AS Psychology Activity 4 Anatomy of The Eye Light enters the eye and is brought into focus by the cornea and the lens. The fovea is the focal point it is a small depression in the retina, at the back of
More informationThe Special Senses: Vision
OLLI Lecture 5 The Special Senses: Vision Vision The eyes are the sensory organs for vision. They collect light waves through their photoreceptors (located in the retina) and transmit them as nerve impulses
More informationIN VISION, AS IN OTHER mental operations, we experience
Chapter 28 Perception of Motion, Depth, and Form 549 28 A Stripes in area 8 Perception of Motion, Depth, and Form lnterblob Blob V2 V The Parvocellular and Magnocellular Pathways Feed nto Two Processing
More informationBiological Vision. Ahmed Elgammal Dept of Computer Science Rutgers University
Biological Vision Ahmed Elgammal Dept of Computer Science Rutgers University Outlines How do we see: some historical theories of vision Biological vision: theories and results from psychology and cognitive
More informationReview, the visual and oculomotor systems
The visual and oculomotor systems Peter H. Schiller, year 2013 Review, the visual and oculomotor systems 1 Basic wiring of the visual system 2 Primates Image removed due to copyright restrictions. Please
More informationFace Perception. The Thatcher Illusion. The Thatcher Illusion. Can you recognize these upside-down faces? The Face Inversion Effect
The Thatcher Illusion Face Perception Did you notice anything odd about the upside-down image of Margaret Thatcher that you saw before? Can you recognize these upside-down faces? The Thatcher Illusion
More informationPERCEIVING MOTION CHAPTER 8
Motion 1 Perception (PSY 4204) Christine L. Ruva, Ph.D. PERCEIVING MOTION CHAPTER 8 Overview of Questions Why do some animals freeze in place when they sense danger? How do films create movement from still
More informationCS510: Image Computation. Ross Beveridge Jan 16, 2018
CS510: Image Computation Ross Beveridge Jan 16, 2018 Class Goals Prepare you to do research in computer vision Provide big picture (comparison to humans) Give you experience reading papers Familiarize
More informationOur visual system always has to compute a solid object given definite limitations in the evidence that the eye is able to obtain from the world, by
Perceptual Rules Our visual system always has to compute a solid object given definite limitations in the evidence that the eye is able to obtain from the world, by inferring a third dimension. We can
More informationChapter 2 Visual Perception: Basic Processes
Cognitve Psychology A Students s Handbook 1. Mai 2002 Chapter 2 Visual Perception: Basic Processes CHAPTER OVERVIEW (SUMMARY) 1. Perceptional organisation: The Gestalt psychologists identified several
More informationSensory and Perception. Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague
Sensory and Perception Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague Our Senses sensation: simple stimulation of a sense organ
More informationHuman Vision and Human-Computer Interaction. Much content from Jeff Johnson, UI Wizards, Inc.
Human Vision and Human-Computer Interaction Much content from Jeff Johnson, UI Wizards, Inc. are these guidelines grounded in perceptual psychology and how can we apply them intelligently? Mach bands:
More informationSlide 4 Now we have the same components that we find in our eye. The analogy is made clear in this slide. Slide 5 Important structures in the eye
Vision 1 Slide 2 The obvious analogy for the eye is a camera, and the simplest camera is a pinhole camera: a dark box with light-sensitive film on one side and a pinhole on the other. The image is made
More informationSensation and Perception. Sensation. Sensory Receptors. Sensation. General Properties of Sensory Systems
Sensation and Perception Psychology I Sjukgymnastprogrammet May, 2012 Joel Kaplan, Ph.D. Dept of Clinical Neuroscience Karolinska Institute joel.kaplan@ki.se General Properties of Sensory Systems Sensation:
More informationSpatial Vision: Primary Visual Cortex (Chapter 3, part 1)
Spatial Vision: Primary Visual Cortex (Chapter 3, part 1) Lecture 6 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017 Eye growth regulation KL Schmid, CF Wildsoet
More informationIntroduction to Visual Perception
The Art and Science of Depiction Introduction to Visual Perception Fredo Durand and Julie Dorsey MIT- Lab for Computer Science Vision is not straightforward The complexity of the problem was completely
More informationOcclusion. Atmospheric Perspective. Height in the Field of View. Seeing Depth The Cue Approach. Monocular/Pictorial
Seeing Depth The Cue Approach Occlusion Monocular/Pictorial Cues that are available in the 2D image Height in the Field of View Atmospheric Perspective 1 Linear Perspective Linear Perspective & Texture
More information1: Definition of an area of visual cortex. 2: Discovery of areas in monkey visual cortex; functional specialisation
M U L T I P L E V I S U A L A R E A S 1: Definition of an area of visual cortex 2: Discovery of areas in monkey visual cortex; functional specialisation 3: Use of imaging to chart areas in human visual
More informationVision V Perceiving Movement
Vision V Perceiving Movement Overview of Topics Chapter 8 in Goldstein (chp. 9 in 7th ed.) Movement is tied up with all other aspects of vision (colour, depth, shape perception...) Differentiating self-motion
More informationVision V Perceiving Movement
Vision V Perceiving Movement Overview of Topics Chapter 8 in Goldstein (chp. 9 in 7th ed.) Movement is tied up with all other aspects of vision (colour, depth, shape perception...) Differentiating self-motion
More informationLecture 14. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Fall 2017
Motion Perception Chapter 8 Lecture 14 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Fall 2017 1 (chap 6 leftovers) Defects in Stereopsis Strabismus eyes not aligned, so diff images fall on
More information7Motion Perception. 7 Motion Perception. 7 Computation of Visual Motion. Chapter 7
7Motion Perception Chapter 7 7 Motion Perception Computation of Visual Motion Eye Movements Using Motion Information The Man Who Couldn t See Motion 7 Computation of Visual Motion How would you build a
More informationLearning Targets. Module 19
Learning Targets Module 19 Visual Organization and Interpretation 19-1 Describe the Gestalt psychologists understanding of perceptual organization, and explain how figure-ground and grouping principles
More information4 Perceiving and Recognizing Objects
4 Perceiving and Recognizing Objects Chapter 4 4 Perceiving and Recognizing Objects Finding edges Grouping and texture segmentation Figure Ground assignment Edges, parts, and wholes Object recognition
More informationPSYC Sensation & Perception Tue/Thu Syllabus : Topics and reading
Instructor : Maxim Volgushev Office : BOUS 133 / BOUS 025 Phone 486-6825 (lab) Office hours: Please make an appointment Email: maxim.volgushev@uconn.edu by email or in the class Textbooks/Reading: 1. (main,
More informationThis question addresses OPTICAL factors in image formation, not issues involving retinal or other brain structures.
Bonds 1. Cite three practical challenges in forming a clear image on the retina and describe briefly how each is met by the biological structure of the eye. Note that by challenges I do not refer to optical
More informationSensation and Perception
Sensation v. Perception Sensation and Perception Chapter 5 Vision: p. 135-156 Sensation vs. Perception Physical stimulus Physiological response Sensory experience & interpretation Example vision research
More informationDomain-Specificity versus Expertise in Face Processing
Domain-Specificity versus Expertise in Face Processing Dan O Shea and Peter Combs 18 Feb 2008 COS 598B Prof. Fei Fei Li Inferotemporal Cortex and Object Vision Keiji Tanaka Annual Review of Neuroscience,
More informationFrog Vision. PSY305 Lecture 4 JV Stone
Frog Vision Template matching as a strategy for seeing (ok if have small number of things to see) Template matching in spiders? Template matching in frogs? The frog s visual parameter space PSY305 Lecture
More informationUnit IV: Sensation & Perception. Module 19 Vision Organization & Interpretation
Unit IV: Sensation & Perception Module 19 Vision Organization & Interpretation Visual Organization 19-1 Perceptual Organization 19-1 How do we form meaningful perceptions from sensory information? A group
More informationVisual Rules. Why are they necessary?
Visual Rules Why are they necessary? Because the image on the retina has just two dimensions, a retinal image allows countless interpretations of a visual object in three dimensions. Underspecified Poverty
More informationVisual System I Eye and Retina
Visual System I Eye and Retina Reading: BCP Chapter 9 www.webvision.edu The Visual System The visual system is the part of the NS which enables organisms to process visual details, as well as to perform
More informationSensation. Our sensory and perceptual processes work together to help us sort out complext processes
Sensation Our sensory and perceptual processes work together to help us sort out complext processes Sensation Bottom-Up Processing analysis that begins with the sense receptors and works up to the brain
More informationBrain Computer Interfaces Lecture 2: Current State of the Art in BCIs
Brain Computer Interfaces Lecture 2: Current State of the Art in BCIs Lars Schwabe Adaptive and Regenerative Software Systems http://ars.informatik.uni-rostock.de 2011 UNIVERSITÄT ROSTOCK FACULTY OF COMPUTER
More information9.01 Introduction to Neuroscience Fall 2007
MIT OpenCourseWare http://ocw.mit.edu 9.01 Introduction to Neuroscience Fall 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Content removed due
More informationColor. Color. Colorfull world IFT3350. Victor Ostromoukhov Université de Montréal. Victor Ostromoukhov - Université de Montréal
IFT3350 Victor Ostromoukhov Université de Montréal full world 2 1 in art history Mondrian 1921 The cave of Lascaux About 17000 BC Vermeer mid-xvii century 3 is one of the most effective visual attributes
More informationIII: Vision. Objectives:
III: Vision Objectives: Describe the characteristics of visible light, and explain the process by which the eye transforms light energy into neural. Describe how the eye and the brain process visual information.
More informationLecture Outline. Basic Definitions
Lecture Outline Sensation & Perception The Basics of Sensory Processing Eight Senses Bottom-Up and Top-Down Processing 1 Basic Definitions Sensation: stimulation of sense organs by sensory input Transduction:
More informationChapter 4. Sensation and Perception 8 th Edition
Chapter 4 Sensation and Perception 8 th Edition Sensation and Perception: The Distinction Sensation : stimulation of sense organs Perception: selection, organization, and interpretation of sensory input
More informationFAQ. Feature detection
Categorization I FAQ Why are we reading about perception in a class about memory? Surprise: A lot of perception is about memory. Top-down effects = context Where does context come from? Perception and
More informationIntroduction Chapter 1 General description of the sensory systems involved in the control of. movement... 17
Table of Content Introduction... 11 Chapter 1 General description of the sensory systems involved in the control of movement... 17 1.1 Visual system and peripheral vision... 17 1.1.1 Anatomy and physiology
More informationThe Human Brain and Senses: Memory
The Human Brain and Senses: Memory Methods of Learning Learning - There are several types of memory, and each is processed in a different part of the brain. Remembering Mirror Writing Today we will be.
More informationChapter 8: Perceiving Motion
Chapter 8: Perceiving Motion Motion perception occurs (a) when a stationary observer perceives moving stimuli, such as this couple crossing the street; and (b) when a moving observer, like this basketball
More informationSpectral colors. What is colour? 11/23/17. Colour Vision 1 - receptoral. Colour Vision I: The receptoral basis of colour vision
Colour Vision I: The receptoral basis of colour vision Colour Vision 1 - receptoral What is colour? Relating a physical attribute to sensation Principle of Trichromacy & metamers Prof. Kathy T. Mullen
More informationA Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang
A Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang Vestibular Responses in Dorsal Visual Stream and Their Role in Heading Perception Recent experiments
More informationVision. Sensation & Perception. Functional Organization of the Eye. Functional Organization of the Eye. Functional Organization of the Eye
Vision Sensation & Perception Part 3 - Vision Visible light is the form of electromagnetic radiation our eyes are designed to detect. However, this is only a narrow band of the range of energy at different
More informationChapter 2: Starting from the very beginning
BEWARE: These are preliminary notes. In the future, they will become part of a textbook on Visual Object Recognition. Chapter 2: Starting from the very beginning Visual input and natural image statistics.
More informationMotion perception PSY 310 Greg Francis. Lecture 24. Aperture problem
Motion perception PSY 310 Greg Francis Lecture 24 How do you see motion here? Aperture problem A detector that only sees part of a scene cannot precisely identify the motion direction or speed of an edge
More informationProcessing streams PSY 310 Greg Francis. Lecture 10. Neurophysiology
Processing streams PSY 310 Greg Francis Lecture 10 A continuous surface infolded on itself. Neurophysiology We are working under the following hypothesis What we see is determined by the pattern of neural
More informationNeuromorphic Implementation of Orientation Hypercolumns. Thomas Yu Wing Choi, Paul A. Merolla, John V. Arthur, Kwabena A. Boahen, and Bertram E.
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: REGULAR PAPERS, VOL. 52, NO. 6, JUNE 2005 1049 Neuromorphic Implementation of Orientation Hypercolumns Thomas Yu Wing Choi, Paul A. Merolla, John V. Arthur,
More informationVictor Ostromoukhov Université de Montréal. Victor Ostromoukhov - Université de Montréal
IFT3355 Victor Ostromoukhov Université de Montréal full world 2 1 in art history Mondrian 1921 The cave of Lascaux About 17000 BC Vermeer mid-xvii century 3 is one of the most effective visual attributes
More informationToday. Pattern Recognition. Introduction. Perceptual processing. Feature Integration Theory, cont d. Feature Integration Theory (FIT)
Today Pattern Recognition Intro Psychology Georgia Tech Instructor: Dr. Bruce Walker Turning features into things Patterns Constancy Depth Illusions Introduction We have focused on the detection of features
More informationPerception: From Biology to Psychology
Perception: From Biology to Psychology What do you see? Perception is a process of meaning-making because we attach meanings to sensations. That is exactly what happened in perceiving the Dalmatian Patterns
More informationThinking About Psychology: The Science of Mind and Behavior 2e. Charles T. Blair-Broeker Randal M. Ernst
Thinking About Psychology: The Science of Mind and Behavior 2e Charles T. Blair-Broeker Randal M. Ernst Sensation and Perception Chapter Module 9 Perception Perception While sensation is the process by
More informationVISUAL NEURAL SIMULATOR
VISUAL NEURAL SIMULATOR Tutorial for the Receptive Fields Module Copyright: Dr. Dario Ringach, 2015-02-24 Editors: Natalie Schottler & Dr. William Grisham 2 page 2 of 38 3 Introduction. The goal of this
More informationbinocular projection by electrophysiological methods. An account of some METHODS
THE PROJECTION OF THE BINOCULAR VISUAL FIELD ON THE OPTIC TECTA OF THE FROG. By R. M. GAZE and M. JACOBSON. From the Department of Physiology, University of Edinburgh. (Received for publication 7th February
More informationSensation and Perception
Page 94 Check syllabus! We are starting with Section 6-7 in book. Sensation and Perception Our Link With the World Shorter wavelengths give us blue experience Longer wavelengths give us red experience
More informationPerceiving Motion and Events
Perceiving Motion and Events Chienchih Chen Yutian Chen The computational problem of motion space-time diagrams: image structure as it changes over time 1 The computational problem of motion space-time
More informationPerception: Pattern and object recognition. Chapter 3
Perception: Pattern and object recognition Chapter 3 Pattern recognition theories How do we interpret lines and patterns as objects? Why is object perception so difficult for computers? Start simple: How
More informationStimulus-dependent position sensitivity in human ventral temporal cortex
Stimulus-dependent position sensitivity in human ventral temporal cortex Rory Sayres 1, Kevin S. Weiner 1, Brian Wandell 1,2, and Kalanit Grill-Spector 1,2 1 Psychology Department, Stanford University,
More informationSegregation of Form, Color, Movement, and Depth: Anatomy, Physiology, and Perception
Segregation of Form, Color, Movement, and Depth: Anatomy, Physiology, and Perception Anatomical and physiological observations in monkeys indicate that the primate visual system consists of several separate
More informationAchromatic and chromatic vision, rods and cones.
Achromatic and chromatic vision, rods and cones. Andrew Stockman NEUR3045 Visual Neuroscience Outline Introduction Rod and cone vision Rod vision is achromatic How do we see colour with cone vision? Vision
More information2 The First Steps in Vision
2 The First Steps in Vision 2 The First Steps in Vision A Little Light Physics Eyes That See light Retinal Information Processing Whistling in the Dark: Dark and Light Adaptation The Man Who Could Not
More informationPerception. What We Will Cover in This Section. Perception. How we interpret the information our senses receive. Overview Perception
Perception 10/3/2002 Perception.ppt 1 What We Will Cover in This Section Overview Perception Visual perception. Organizing principles. 10/3/2002 Perception.ppt 2 Perception How we interpret the information
More informationExtraction of Surface-Related Features in a Recurrent Model of V1-V2 Interactions
Extraction of Surface-Related Features in a Recurrent Model of V1-V2 Interactions Ulrich Weidenbacher*, Heiko Neumann Institute of Neural Information Processing, University of Ulm, Ulm, Germany Abstract
More informationPerception. The process of organizing and interpreting information, enabling us to recognize meaningful objects and events.
Perception The process of organizing and interpreting information, enabling us to recognize meaningful objects and events. Perceptual Ideas Perception Selective Attention: focus of conscious
More informationThe Grand Illusion and Petit Illusions
Bruce Bridgeman The Grand Illusion and Petit Illusions Interactions of Perception and Sensory Coding The Grand Illusion, the experience of a rich phenomenal visual world supported by a poor internal representation
More informationSomatosensory Reception. Somatosensory Reception
Somatosensory Reception Professor Martha Flanders fland001 @ umn.edu 3-125 Jackson Hall Proprioception, Tactile sensation, (pain and temperature) All mechanoreceptors respond to stretch Classified by adaptation
More informationHW- Finish your vision book!
March 1 Table of Contents: 77. March 1 & 2 78. Vision Book Agenda: 1. Daily Sheet 2. Vision Notes and Discussion 3. Work on vision book! EQ- How does vision work? Do Now 1.Find your Vision Sensation fill-in-theblanks
More information