PSYC Sensation & Perception Tue/Thu Syllabus : Topics and reading

Transcription

1 Instructor : Maxim Volgushev Office : BOUS 133 / BOUS 025 Phone (lab) Office hours: Please make an appointment maxim.volgushev@uconn.edu by or in the class Textbooks/Reading: 1. (main, required) Goldstein EB (2007). Sensation & Perception (7th ed.). Thomson-Wadsworth. or: Goldstein EB (2007/2010). Sensation & Perception (8th ed.). Wadsworth (see also ).. 2. (required) PDFs of the lectures (posted after each lecture) at For most of the slides in the pdfs, reference to a source figure, or a similar figure, from the textbook is given, so that you can read the legend and related text. 3. (supplementary, recommended) Wolfe JM et. al., (2006, or 2 nd or 3 rd editions). Sensation & Perception. Sinauer Associates, Inc. ( see ).. Goldstein and Wolfe textbooks are largely overlapping. However, since some material is presented better in one or the other book, I am using figures from both in the lectures... (G7) refers to Goldstein 7 th edition; (G8) refers to Goldstein 8 th edition; (W) refers to Wolfe et. al., For example, G7 5-9; means Goldstein 7 th edition, pages 5 to 9 and 66 to 67. Topics: Exam 1: topics 1, 1a, 2, Introduction (2 lectures) Introduction to perception (G7 5-12; 66-67) G8 5-12; 68 Psychophysics, methods (G ) G W 9-12; 12-13; Neurons (G ) G W Neurons and perception (G ; 62-65) G ; 58-68; W: Method, Brain Imaging (G ) G Keywords for Introduction: Sensation, Perception, Perception as a process Physical world and psychological interpretation Bottom-up and Top-down Methods to study perception Psychophysics; Neurophysiology Recognition, Threshold, Detection, Magnitude estimation Stimulus and sensation: Fechner s, Weber s and Stevens laws Doctrine of specific nerve energies (Müller), Neurons and perception Structure and function of a neuron; Synapses Methods of studying neurons Selective adaptation Signal processing in neuronal networks Convergence, summation, sensitivity, selectivity 1 / 10

2 Tuning curve Receptive field Inhibition, Lateral inhibition Simultaneous contrast, Mach bands Methods of brain imaging; Electroencephalography; Evoked potentials Optical imaging; PET, fmri, BOLD signal Spatial and temporal resolution; Invasive and non-invasive methods 1a. Signal detection (G ) G W Keywords for Signal detection Signal Noise Response criterion: Liberal, Neutral, Conservative Hit, Correct rejection, False alarm, Miss Probability distribution Sensitivity Receiver operating characteristic (ROC) 2. Light and the Eye (2 lectures) Vision, visual system and the light (G ; 29-30; 39-41) G ; 44-47; W Eye optics, Image on the retina (G ) G W The retina (G ) G ; W 30-33; Phototransduction (G ) G ; W Processing in the retina (G ) G ; W Receptive fields (G ) G ; W Keywords for Light and the eye: Light, visible part of electromagnetic waves Functions of the eye; Structure of the eye; Optics of the eye; Image on the retina Accommodation; near point; presbyopia Emmetropia; Myopia; Hyperopia; Astigmatism Fundus of the eye; Optic disc; Fovea Receptors, rods, cones; their distribution on the retina Visual field; Blind spot; Scotoma Retina, Structure and major cell types Absolute threshold, psychophysics Structure of photoreceptors, phototransduction Dark current; cgmp gated channels Transmission photoreceptor bipolar ganglion cell; Ribbon synapses Relation of phototransduction to perception Receptive fields; Center-surround organisation; Lateral inhibition Optimal stimulus; ON and OFF systems; Simultaneous contrast, Mach bands and center-surround receptive fields 2 / 10

3 3. What the visual system can do... (2 lectures) Visual acuity (G ; 75) G ; W 47-54; Gratings and spatial frequencies (G7 : 62-65) G W 50-54; Dark adaptation (G ) G W Color and light (G ; ) G ; W Trichromatic theory (G ) G W Opponent process theory (G ) G W Deficiency/differences of color vision (G ; ) G ; W Color and illumination (G ) G Keywords for What the visual system can do : Visual acuity; visual angle Identification-, Detection-, Resolution- acuity Snellen letters; Landolt rings; Visus Acuity and receptor density; convergence, eccentricity Cortical magnification Acuity in the fovea and periphery Acuity and receptive fields, center-surround organisation, lateral inhibition Sine wave gratings, spatial frequency, phase, contrast Receptive fields and gratings Contrast-sensitivity function; Low-frequency and high-frequency channels; selective adaptation Adaptation, sensory adaptation, dark adaptation Experiment to study dark adaptation Dark adaptation in rods and cones Components of dark adaptation Photochemical components of dark adaptation Cone vision and rode vision Light and color, reflected and absorbed light Features of light and color sensations Trichromatic theory (Young-Helmholtz), 3 types of cones Color-matching experiments; metamers Color coding by 3 types of cones Opponent processes (Hering) Color-opponent receptive fields Simultaneous color contrast; Complementary colors; Additive and subtractive color mixture Illumination and color perception Perception of colors: trichromatic and opponent Diversity of color perception; Deficiency of color perception, Protonopie, Deuteranopie, Tritanopie Ishihara-plate Color sensitivity in animals 3 / 10

4 Exam 2: topics 4, 5, Visual pathways (2 lectures) (G ; 71-91; G ; 34-40; W 54-69) Primary visual pathway, Retina-LGN-cortex (G ) G W54-56 Retina-Superior colliculus (G7 58) G8 75 Cortical magnification (G7 73) G ; W56-58 Retinotopic organisation of visual pathways (G ) G ; W Retinotopy and visual field see lectures Receptive fields in the retina and LGN (G ) G ; W Receptive fields in the visual cortex (G ) G ; W Columnar organisation of the visual cortex (G ) G ; W Plasticity of cortical representations (G , 84-86) G ; Parallel streams in the visual system (G ) G W Representation of objects in the visual system (G , 82-84, 86-90) G ; 91-94; 36-39; W Keywords for Visual pathways primary visual pathway LGN, lateral geniculate nucleus Visual cortex, striate cortex, V1 Superior colliculus Cortical magnification Retinotopy Microelectrode recording Metabolic markers Optical imaging fmri BOLD signal Representation maps on the visual cortex Visual field Scotoma and damage to the visual pathway Receptive fields in the LGN Receptive fields in the cortex Simple, complex, hypercomplex receptive fields Excitatory convergence Orientation selectivity Direction selectivity Orientation map Oculodominance Hierarchical organisation of the visual system Selective adaptation Lateral inhibition Opponent inhibition Cross-orientation inhibition Visual cortex: layers Visual cortex: Columns and hypercolumns Selective rearing Plasticity of cortical representations Critical periods Magnocellular system Parvocellular system 4 / 10

5 Parallel streams Ventral/what stream Dorsal/where/how stream Binding problem 5. Perceiving Objects (2 lectures) (G ; G ; W 74-97) Structuralism and Gestalt psychology (G ) G W Problems of object perception (G ) G Illusory contours (G7 98) G W 77, see lectures Gestalt psychology (G ) G ; W Figure ground segregation (G ) G W Recognition and experience (G ) G W 87 Recognition (G ) G ; ; W Viewpoint invariance (G7 96, 108, 116) G ; 112; W Object identification and categorisation (G ) G ; W Keywords for Perceiving objects Structuralism and Gestalt psychology Problems in perceiving objects Grouping Illusory contours Figure-ground segregation Gestalt grouping laws Gestalt laws of figure segregation Heuristic and algorithmic solutions Psychophysics: Brief stimulus presentation Masking, backward masking Delayed matching to sample Low - Middle High level vision Recognition Global superiority effect Recognition in a context Templates Structural description Viewpoint invariance Categorisation Brain regions and recognition Neuronal activity and recognition 6. Perceiving Depth & Size (2 lectures) (G ; G ; W ) Problems of depth & size perception (G7 168) G8 230 W Depth cues: Oculomotor (G7 169) G8 231 W 138 Depth cues: Monocular (G ) G W Binocular depth perception (G ) G W Neurons and depth perception (G ) G W Combining depth cues, Bayesian approach G8: 119 W Size perception and distance estimation (G ) G Illusions: depth cues and size estimation (G ) G W Perception and effort (G ) G / 10

6 Compare: perception of depth/size to object recognition Compare: size & shape constancies to viewpoint invariance Keywords for Perceiving depth and size Problems of depth & size perception Depth cues Oculomotor cues Monocular cues Binocular cues Stereopsis Disparity Horopter Corresponding regions of the retinae Correspondence problem Binocular receptive fields Stereoscope Random dot stereogram Motion as depth cue Depth cues in natural scenes Combination of cues Manipulating cues, Illusions Ambiguity of cues Bayesian approach Size and distance Retinal image Visual angle Percept-percept coupling Size constancy Shape constancy Breakdown of constancy Distance cues and size Ponzo illusion Mueller-Lyer illusion Moon illusion Horizontal and vertical distance Tabletop illusion Distance and action/effort Exam 3: topics 7, 8, 9, Perceiving Motion (G ; G ; W ) Types of movement leading to motion perception (G ) G W Problems of motion perception (G , ) G W Eye movements, corollary discharge (G ) G W Brain areas and neurons in motion perception (G ) G8 186; W Biological motion (G ) G W Keywords for Perceiving motion Real movement Apparent movement 6 / 10

7 Induced movement Movement aftereffects Motion as a cue for object perception Aperture problem Correspondence problem in motion detection Eye movement: saccades, drift, smooth persuit Corollary discharge Evidence for corollary discharge Motion-sensitive neurons Medial temporal area Moving-dot display Ventral stream Dorsal stream Biological motion Illusionary motion 8. Visual Attention (2 lectures) (G G ; W ) What is attention (G7 122) G8 134 W Attention and perception (G ) G W ; Visual search (G7 134) G8 145 W Feature integration (G , ) G W Detection of changes (G ) G W Keywords for Visual attention Attention Divided attention Selective attention Attention and Perception Reaction time Visual search Target Distractor Pop-out Parallel search Pre-attentive search Sequential search Feature integration Illusory conjunction Binding problem Picture memory Change blindness Temporal structure of attention Inattentional blindness Attention disorder: Neglect 9. Hearing and Speech (3 lectures) (G ; G ; W ) Sound and sound waves (G ) G W ; 227 The Ear (G ) G W Sound encoding (G ) G W , ; W Central processing of sound (G ) G W / 10

8 Sound localization: coordinates and problems (G7 266; 271) G8 292; W Binaural and monaural cues (G ) G W ; Segmentation and grouping of sounds (G ) G W Speech perception: Elements and problems (G ; 289; 290) G W 285 Speech production, articulation (G ) G W Spectrograms, phonems, phonem discrimination (G ) G ; W Brain regions & Speech (G ) G W Keywords for Hearing and speech Sound Sound wave, amplitude and frequency Sound pressure, Sound pressure level, decibell Absolute threshold Audibility threshold Equal-loudness curves Perceivable sound frequencies Pure tones Fundamental frequency Harmonics Complex sounds Power spectrum Loudness Pitch Timbre Outer Ear Middle Ear Inner Ear Auditory canal Eardrum Malleus, Incus, Stapes Oval window, Round window Cochlea Amplification of sound pressure Transduction Basilar membrane Receptors, sensitivity to sound Outer and inner hair cells Travelling wave Resonance frequency Tonotopic representation Place code Frequency code The volley principle Characteristic frequency Frequency tuning Tuning curve Masking Psychophysical tuning curves Psychoacoustics 8 / 10

9 Central auditory structures Cochlear nucleus Superior olivary nucleus Inferior colliculi Medial geniculate nucleus Bilateral connectivity Binaural interaction Auditory cortex (A1) Core area Belt and parabelt area Tonotopic map What and where streams Sound localization and Sound recognition Multimodal cortical areas Plasticity of tonotopic maps Pitch recognition Effect of missing fundamental Sound localization Azimuth, elevation Binaural cues Interaural time difference (ITD) Interaural level difference (ILD) Monaural cue Head-related transfer function Interaction/competition between cues Plasticity of sound localization Acoustic receptive fields Panoramic neurons Auditory stream segregation Auditory grouping Audio-visual interaction Reverberation Speech Phonems Consonants Vowels Sound frequencies in speech Vocal tract Vocal cords Articulation Formants Spectrogram Coarticulation Segmentation Variability of phonems Multiple acoustic cues 9 / 10

10 Categorial perception Language-specific phonems Development and plasticity of phonem discrimination McGurk effect Audio-visual interaction Speech areas in the brain Wernicke s aphasia Broca s aphasia 10. Touch (G ; G ; W ) Somatosensory system (G ) G8 330 W Skin and skin receptors (G ) G W Central pathways and somatotopic map (G ) G W Sensitivity of somatosensory system (G ) G W Active exploration and object perception (G ) G W Keywords for Touch Somatosensory system Proprioception Kinesthesis Cutaneous sensations Skin receptors Merkel, Meissner, Pacinian, Ruffini receptors Receptive field Response adaptation Fast / Slow adapting responses Response to pressure / response to vibration Thermoreceptors Nociceptors Somatotopic map Homunculus Plasticity of representation map Focal dystonia Pressure threshold Two-point threshold Passive touch Active exploration Haptic perception Pop-out Attention to modality Final Exam is cumulative, includes all topics / 10