Insights into High-level Visual Perception
|
|
- Justin O’Brien’
- 5 years ago
- Views:
Transcription
1 Insights into High-level Visual Perception or Where You Look is What You Get Jeff B. Pelz Visual Perception Laboratory Carlson Center for Imaging Science Rochester Institute of Technology
2 Students Roxanne Canosa Jason Babcock Eric Knappenberger Dan Lerner Marianne Lipps (Ph.D. Imaging Science) (MS Color Science) (MS Imaging Science) (BS Imaging Science) (BS Imaging Science)
3 Optical Illusions Reveal the shortcomings of the visual system, and our best effort to make sense from incomplete information
4 Outline 1. What are the fundamental limitations of the visual system?
5 Outline 1. Fundamental limitations 2. What strategies are employed to compensate for those limitations?
6 Outline 1. Fundamental limitations 2. Strategies to compensate for limitations 3. Can we build tools that take advantage of those strategies to inform the design and evaluation of imaging systems?
7 Outline 1. Fundamental limitations 2. Strategies to compensate for limitations 3. Build design and evaluation tools 4. Can we use our understanding of the human visual system to aid design of next-generation computer vision systems?
8 Introduction Visual perception is a complex process that unfolds over time, typically occurring at a level below conscious awareness. People are often unaware of the details of how they perform many tasks, including gathering visual information from the environment. By monitoring the eye movement patterns of observers as they perform a task, we can learn about task strategy and performance.
9 Fundamental Limitations 1. What are the fundamental limitations of the visual system?
10
11
12 The Design of the Visual System There were evolutionary pressures for highacuity vision (human as predator), and a wide field-of-view (human as prey).
13 The Design of the Visual System There were evolutionary pressures for highacuity vision (human as predator), and a wide field-of-view (human as prey). Even if the entire cortex were devoted to vision, there are not sufficient resources to represent a large visual field at high acuity.
14 The Foveal Compromise The solution favored by nature represented a compromise between the two demands. The foveal compromise makes use of: A. Anisotropic sampling of the scene B. Serial execution (task switching) C. Limited internal representations D. Focused attention
15 A. Anisotropic Sampling of the Visual Field The foveal compromise High-acuity central fovea Limited-acuity periphery photoreceptor density periphery center periphery
16 Anisotropic Sampling of the Visual Field + If you can read this you must be cheating.
17 Anisotropic Sampling of the Visual Field The visual field must be sampled by the high-acuity fovea: If you can read this you must be cheating The foveal compromise requires a mechanism for moving the eyes about the scene.
18 Outline 1. Fundamental limitations 2. What strategies are employed to compensate for those limitations?
19 Foveal Compromise: Eye Movements Each eye has three agonistantagonist muscle pairs to rotate the eye horizontally, vertically, and about the optical axis.
20 Types of Eye Movements Smooth pursuit: match object motion Vestibular-ocular response: compensate for self-motion Vergence: merge images at different distances Saccades: move fovea to new location
21 Background: Eye Movement Types Smooth pursuit Vestibular-ocular response Image stabilization Vergence Saccades - Image destabilization: shifts fovea to new image region
22 Destabilizing Eye Movements Saccades Amplitude: < 1 > 45 visual angle Velocity: > 600 /second Frequency: ~ 3-4/second (>150,000/day) Saccades are made to targets requiring high spatial resolution and to the locus of attention.
23 B. Serial Execution: Sequential Sampling
24 Serial Execution: Sequential Sampling
25 Serial Execution: Sequential Sampling
26 Serial Execution: Sequential Sampling
27 Serial Execution: Sequential Sampling
28 Serial Execution: Foveations With each eye movement, the fovea slides under a new portion of the retinal image. A new portion of the image is sampled, but each new sample is centered on the fovea
29 Serial Execution: Foveations
30 Serial Execution: Foveations
31 Serial Execution: Foveations
32 Serial Execution: Foveations
33 C. Internal Representation
34 Internal Representation If a high-acuity internal representation is built up over multiple fixations, it should be easy to detect even small differences between images. A B
35 Internal Representation Following are two versions of the school children, separated by a blank slide. There is a difference between the two; your task is to identify the difference. View them in alternation, trying to find the difference. The difference is clearly visible in the slide at the end.
36 View ~3 sec, then advance A
37 View ~1/2 sec, then continue
38 View ~3 sec, then REVERSE B
39 Compare to previous slide A
40 Limited Neural Resources Something beyond variable acuity is responsible. Deploying attention to different areas in sequence conserves limited resources. Changes to the scene can be made to unattended regions without affecting conscious perception. In nature, such changes usually induce apparent motion, drawing attention to the region.
41 Serial Execution: Eye Movements The limited acuity periphery must be sampled by the high-acuity fovea, resulting in serial data acquisition. The eye movements guiding that acquisition are externally-observable markers of acuity demands, deployment of attention, and perceptual strategies.
42 Serial Execution; Image Preference 3 sec viewing
43 Outline 1. Fundamental limitations 2. Strategies to compensate for limitations 3. Can we build tools that take advantage of those strategies to inform the design and evaluation of imaging systems?
44 Measuring eye movements The Problem: After all, the eye is sitting in a bag of fat in a hole in your head, and there are six big muscles pulling on it. Cornsweet, 1976
45 Measuring eye movements The Solution: Barlow photographed a droplet of mercury placed on the limbus. Translations of the head were minimized by having subjects lie on a stone slab with their heads wedged tightly inside a rigid iron frame Kowler, 1990
46 Measuring eye movements
47 Measuring eye movements Limbus eyetracker Video-based eyetracker
48 Measuring eye movements Scleral eye-coils Dual Purkinje eyetracker
49 Head-mounted eyetracker Infrared / Video Headband-mounted eyetracker
50 Infrared, Video-based Eyetrackers Bright Pupil; On-axis Illumination IR camera IRED
51 Remote eyetracker Infrared / Video Remote-head eyetracker
52 Change Blindness
53 Human Computer Interface
54 Visualization = 250 ms
55
56 Image & Subject Dependence
57 Radiographic Search: Scanpath
58 Radiographic Search: Fixation Density
59 Measuring eye movements These commercially available eyetrackers are restricted to laboratory use. The ability to monitor perception as people perform real tasks in the real world would allow us to ask new kinds of questions.
60 RIT Wearable Eyetracker
61 IR illuminator/ optics module monochrome CMOS eye camera calibration LASER folding mirror hot mirror color CMOS scene camera
62 RIT Wearable Eyetracker
63
64 Fixation Sequence Before Image Capture
65 Complex, Familiar Tasks
66 Outline 1. Fundamental limitations 2. Strategies to compensate for limitations 3. Build design and evaluation tools 4. Can we use our understanding of the human visual system to aid design of next-generation computer vision systems?
67 Motivation Because vision is effortless for humans, computer vision was chosen as an early research domain. Early attempts at computer vision systems attacked the problem by brute force with limited success: Tried Image Understanding on static 2D images ( From Pixels to Predicates )
68 Limited Computational Resources Even in the face of Moore s Law, computers will not have sufficient power in the foreseeable future to solve vision by brute force.
69 Limited Computational Resources Even in the face of Moore s Law, computers will not have sufficient power in the foreseeable future to solve vision by brute force. Computer-based perception faces the same fundamental challenge that human perception did during evolution: limited computational resources
70 The Foveal Compromise The solution favored by nature: A. Anisotropic sampling of the scene B. Serial execution (task switching) C. Limited internal representations D. Focused attention
71 Motivation: Cognitive Science Human Cognition Sensorial Experience High-level Visual Perception Attentional Mechanisms Eye Movements
72 Motivation: Cognitive Science Human Cognition Sensorial Experience High-level Visual Perception Artificial Intelligence Computer Vision Active Vision Attentional Mechanisms Eye Movements
73 Inspiration - Active Vision Active vision was the first step. Unlike traditional approaches to computer vision, active vision systems focused on extracting information from dynamic, 3D scenes. Aloimonos, 1987 Bajcsy, 1988 Ballard, 1989 Brooks, 1991 Vision & UR U Penn
74 Active Vision Inspired by anisotropic, binocular vision in humans, researchers built neuromorphic vision systems that took advantage of active cameras. Vision & UR Humanoid MIT
75 Inspiration - - Active Vision Visual routines were an important component of the Active Vision approach. Pre-defined routines are scheduled and run to extract information when and where it is needed.
76 Perceptual Strategies Limited representation + task-switching Deploying attention and eye movements are controlled below conscious awareness; there must be mechanisms (strategies) that protect us from the constraints of visual perception in the real world - that help us make sense from the incomplete data available.
77 Perceptual strategies Beyond the mechanics of how the eyes move during real tasks, we are interested in strategies that may support the conscious perception that is continuous temporally as well as spatially.
78 Goal - - Strategic Vision Strategic Vision can use high-level, topdown strategies for extracting information from complex environments.
79 Goal - - Strategic Vision Strategic Vision can use high-level, topdown strategies for extracting information from complex environments. One goal of our research is to study human behavior in natural, complex tasks to search for visual routines that emerge under realworld constraints.
80 Perceptual Strategies
81 representations: : Successive Foveations Limited representations
82 representations: : Successive Foveations Limited representations 0 msec
83 representations: : Successive Foveations Limited representations 770 msec
84 representations: : Successive Foveations Limited representations 1400 msec
85 representations: : Successive Foveations Limited representations 2000 msec
86 representations: : Successive Foveations Limited representations 2700 msec
87 representations: : Successive Foveations Limited representations 2800 msec
88 Perceptual Strategies: Look-ahead fixations 2000 msec 800 msec... Intervening tasks look-ahead fixation guiding fixation interaction
89 Perceptual Strategies: Look-ahead fixations Sub-tasks Sequenced look-ahead Fixations 2000 milliseconds 7000 Sub-tasks Interposed look-ahead Fixations 0 milliseconds 5000
90 Perceptual Strategies: Look-ahead fixations Humans employ strategies to ease the computational and memory loads inherent in complex tasks. Look-ahead fixations represent one such strategy: Opportunistic execution of informationgathering visual routines to pre-fetch information needed for future subtasks.
91 Conclusions Monitoring eye movements gives us a window into perception and cognition that can reveal details not available even to the observer. Visual Strategies observed can help us understand how people use vision in their interaction with the world, and perhaps aid in the design of artificial systems that take advantage of this knowledge.
92 Conclusions Tools that monitor subjects eye movements can aid in the design and evaluation of imaging systems. The design of next-generation computer vision systems may be aided by implementing algorithms derived by understanding the strategies employed by the human visual system to compensate for limited computational resources.
93 Questions?
OUTLINE. Why Not Use Eye Tracking? History in Usability
Audience Experience UPA 2004 Tutorial Evelyn Rozanski Anne Haake Jeff Pelz Rochester Institute of Technology 6:30 6:45 Introduction and Overview (15 minutes) During the introduction and overview, participants
More informationCompensating for Eye Tracker Camera Movement
Compensating for Eye Tracker Camera Movement Susan M. Kolakowski Jeff B. Pelz Visual Perception Laboratory, Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623 USA
More informationHow People Take Pictures: Understanding Consumer Behavior through Eye Tracking Before, During, and After Image Capture
SIMG-503 Senior Research How People Take Pictures: Understanding Consumer Behavior through Eye Tracking Before, During, and After Image Capture Final Report Marianne Lipps Visual Perception Laboratory
More informationThe Wearable Eyetracker: A Tool for the Study of High-level Visual Tasks
The Wearable Eyetracker: A Tool for the Study of High-level Visual Tasks February 2003 Jason S. Babcock, Jeff B. Pelz Institute of Technology Rochester, NY 14623 Joseph Peak Naval Research Laboratories
More informationTSBB15 Computer Vision
TSBB15 Computer Vision Lecture 9 Biological Vision!1 Two parts 1. Systems perspective 2. Visual perception!2 Two parts 1. Systems perspective Based on Michael Land s and Dan-Eric Nilsson s work 2. Visual
More informationA Foveated Visual Tracking Chip
TP 2.1: A Foveated Visual Tracking Chip Ralph Etienne-Cummings¹, ², Jan Van der Spiegel¹, ³, Paul Mueller¹, Mao-zhu Zhang¹ ¹Corticon Inc., Philadelphia, PA ²Department of Electrical Engineering, Southern
More informationThe introduction and background in the previous chapters provided context in
Chapter 3 3. Eye Tracking Instrumentation 3.1 Overview The introduction and background in the previous chapters provided context in which eye tracking systems have been used to study how people look at
More informationLecture 8. Human Information Processing (1) CENG 412-Human Factors in Engineering May
Lecture 8. Human Information Processing (1) CENG 412-Human Factors in Engineering May 30 2009 1 Outline Visual Sensory systems Reading Wickens pp. 61-91 2 Today s story: Textbook page 61. List the vision-related
More informationVisual Search using Principal Component Analysis
Visual Search using Principal Component Analysis Project Report Umesh Rajashekar EE381K - Multidimensional Digital Signal Processing FALL 2000 The University of Texas at Austin Abstract The development
More informationTask Dependency of Eye Fixations & the Development of a Portable Eye Tracker
SIMG-503 Senior Research Task Dependency of Eye Fixations & the Development of a Portable Eye Tracker Final Report Jeffrey M. Cunningham Center for Imaging Science Rochester Institute of Technology May
More informationLecture IV. Sensory processing during active versus passive movements
Lecture IV Sensory processing during active versus passive movements The ability to distinguish sensory inputs that are a consequence of our own actions (reafference) from those that result from changes
More informationCSE Thu 10/22. Nadir Weibel
CSE 118 - Thu 10/22 Nadir Weibel Today Admin Teams : status? Web Site on Github (due: Sunday 11:59pm) Evening meetings: presence Mini Quiz Eye-Tracking Mini Quiz on Week 3-4 http://goo.gl/forms/ab7jijsryh
More informationUsing Human Observers' Eye Movements in Automatic Image Classifiers
Using Human Observers' Eye Movements in Automatic Image Classifiers Alejandro Jaimes 1, Jeff Pelz 2, Tim Grabowski 2, Jason Babcock 2, and Shih-Fu Chang 1 1 Dept. of Electrical Engineering, Columbia University,
More informationbetter make it a triple (3 x)
Crown 85: Visual Perception: : Structure of and Information Processing in the Retina 1 lectures 5 better make it a triple (3 x) 1 blind spot demonstration (close left eye) blind spot 2 temporal right eye
More informationSocial Constraints on Animate Vision
Social Constraints on Animate Vision Cynthia Breazeal, Aaron Edsinger, Paul Fitzpatrick, Brian Scassellati, Paulina Varchavskaia MIT Artificial Intelligence Laboratory 545 Technology Square Cambridge,
More informationColor and perception Christian Miller CS Fall 2011
Color and perception Christian Miller CS 354 - Fall 2011 A slight detour We ve spent the whole class talking about how to put images on the screen What happens when we look at those images? Are there any
More informationVisual System I Eye and Retina
Visual System I Eye and Retina Reading: BCP Chapter 9 www.webvision.edu The Visual System The visual system is the part of the NS which enables organisms to process visual details, as well as to perform
More informationInvestigation of Binocular Eye Movements in the Real World
Senior Research Investigation of Binocular Eye Movements in the Real World Final Report Steven R Broskey Chester F. Carlson Center for Imaging Science Rochester Institute of Technology May, 2005 Copyright
More informationGeog183: Cartographic Design and Geovisualization Spring Quarter 2018 Lecture 2: The human vision system
Geog183: Cartographic Design and Geovisualization Spring Quarter 2018 Lecture 2: The human vision system Bottom line Use GIS or other mapping software to create map form, layout and to handle data Pass
More informationYokohama City University lecture INTRODUCTION TO HUMAN VISION Presentation notes 7/10/14
Yokohama City University lecture INTRODUCTION TO HUMAN VISION Presentation notes 7/10/14 1. INTRODUCTION TO HUMAN VISION Self introduction Dr. Salmon Northeastern State University, Oklahoma. USA Teach
More informationColor and Perception
Color and Perception Why Should We Care? Why Should We Care? Human vision is quirky what we render is not what we see Why Should We Care? Human vision is quirky what we render is not what we see Some errors
More informationMotion Perception II Chapter 8
Motion Perception II Chapter 8 Lecture 14 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Spring 2019 Eye movements: also give rise to retinal motion. important to distinguish motion due to
More informationColumn-Parallel Architecture for Line-of-Sight Detection Image Sensor Based on Centroid Calculation
ITE Trans. on MTA Vol. 2, No. 2, pp. 161-166 (2014) Copyright 2014 by ITE Transactions on Media Technology and Applications (MTA) Column-Parallel Architecture for Line-of-Sight Detection Image Sensor Based
More informationHuman Vision and Human-Computer Interaction. Much content from Jeff Johnson, UI Wizards, Inc.
Human Vision and Human-Computer Interaction Much content from Jeff Johnson, UI Wizards, Inc. are these guidelines grounded in perceptual psychology and how can we apply them intelligently? Mach bands:
More informationVisibility, Performance and Perception. Cooper Lighting
Visibility, Performance and Perception Kenneth Siderius BSc, MIES, LC, LG Cooper Lighting 1 Vision It has been found that the ability to recognize detail varies with respect to four physical factors: 1.Contrast
More informationOPTICAL DEMONSTRATIONS ENTOPTIC PHENOMENA, VISION AND EYE ANATOMY
OPTICAL DEMONSTRATIONS ENTOPTIC PHENOMENA, VISION AND EYE ANATOMY The pupil as a first line of defence against excessive light. DEMONSTRATION 1. PUPIL SHAPE; SIZE CHANGE Make a triangular shape with the
More informationVisual Effects of Light. Prof. Grega Bizjak, PhD Laboratory of Lighting and Photometry Faculty of Electrical Engineering University of Ljubljana
Visual Effects of Light Prof. Grega Bizjak, PhD Laboratory of Lighting and Photometry Faculty of Electrical Engineering University of Ljubljana Light is life If sun would turn off the life on earth would
More informationDESIGNING AND CONDUCTING USER STUDIES
DESIGNING AND CONDUCTING USER STUDIES MODULE 4: When and how to apply Eye Tracking Kristien Ooms Kristien.ooms@UGent.be EYE TRACKING APPLICATION DOMAINS Usability research Software, websites, etc. Virtual
More informationPerceptual and Artistic Principles for Effective Computer Depiction. Gaze Movement & Focal Points
Perceptual and Artistic Principles for Effective Computer Depiction Perceptual and Artistic Principles for Effective Computer Depiction Perceptual and Artistic Principles for Effective Computer Depiction
More informationVisual Effects of. Light. Warmth. Light is life. Sun as a deity (god) If sun would turn off the life on earth would extinct
Visual Effects of Light Prof. Grega Bizjak, PhD Laboratory of Lighting and Photometry Faculty of Electrical Engineering University of Ljubljana Light is life If sun would turn off the life on earth would
More informationPart I Introduction to the Human Visual System (HVS)
Contents List of Figures..................................................... List of Tables...................................................... List of Listings.....................................................
More informationVision. Definition. Sensing of objects by the light reflected off the objects into our eyes
Vision Vision Definition Sensing of objects by the light reflected off the objects into our eyes Only occurs when there is the interaction of the eyes and the brain (Perception) What is light? Visible
More informationSensation. Our sensory and perceptual processes work together to help us sort out complext processes
Sensation Our sensory and perceptual processes work together to help us sort out complext processes Sensation Bottom-Up Processing analysis that begins with the sense receptors and works up to the brain
More informationThe Special Senses: Vision
OLLI Lecture 5 The Special Senses: Vision Vision The eyes are the sensory organs for vision. They collect light waves through their photoreceptors (located in the retina) and transmit them as nerve impulses
More informationSeeing and Perception. External features of the Eye
Seeing and Perception Deceives the Eye This is Madness D R Campbell School of Computing University of Paisley 1 External features of the Eye The circular opening of the iris muscles forms the pupil, which
More informationPsych 333, Winter 2008, Instructor Boynton, Exam 1
Name: Class: Date: Psych 333, Winter 2008, Instructor Boynton, Exam 1 Multiple Choice There are 35 multiple choice questions worth one point each. Identify the letter of the choice that best completes
More informationOptical Illusions and Human Visual System: Can we reveal more? Imaging Science Innovative Student Micro-Grant Proposal 2011
Optical Illusions and Human Visual System: Can we reveal more? Imaging Science Innovative Student Micro-Grant Proposal 2011 Prepared By: Principal Investigator: Siddharth Khullar 1,4, Ph.D. Candidate (sxk4792@rit.edu)
More informationHuman Vision. Human Vision - Perception
1 Human Vision SPATIAL ORIENTATION IN FLIGHT 2 Limitations of the Senses Visual Sense Nonvisual Senses SPATIAL ORIENTATION IN FLIGHT 3 Limitations of the Senses Visual Sense Nonvisual Senses Sluggish source
More informationA Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang
A Vestibular Sensation: Probabilistic Approaches to Spatial Perception (II) Presented by Shunan Zhang Vestibular Responses in Dorsal Visual Stream and Their Role in Heading Perception Recent experiments
More informationLecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex
Lecture 4 Foundations and Cognitive Processes in Visual Perception From the Retina to the Visual Cortex 1.Vision Science 2.Visual Performance 3.The Human Visual System 4.The Retina 5.The Visual Field and
More informationIII: Vision. Objectives:
III: Vision Objectives: Describe the characteristics of visible light, and explain the process by which the eye transforms light energy into neural. Describe how the eye and the brain process visual information.
More informationA SIGHT-SPEED HUMAN-COMPUTER INTERACTION FOR AUGMENTED GEOSPATIAL DATA ACQUISITION AND PROCESSING SYSTEMS
In: Stilla U et al (Eds) PIA07. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36 (3/W49B) A SIGHT-SPEED HUMAN-COMPUTER INTERACTION FOR AUGMENTED GEOSPATIAL
More informationVisual Perception. human perception display devices. CS Visual Perception
Visual Perception human perception display devices 1 Reference Chapters 4, 5 Designing with the Mind in Mind by Jeff Johnson 2 Visual Perception Most user interfaces are visual in nature. So, it is important
More informationVision and Color. Reading. Optics, cont d. Lenses. d d f. Brian Curless CSEP 557 Fall Good resources:
Reading Good resources: Vision and Color Brian Curless CSEP 557 Fall 2016 Glassner, Principles of Digital Image Synthesis, pp. 5-32. Palmer, Vision Science: Photons to Phenomenology. Wandell. Foundations
More informationVision and Color. Brian Curless CSEP 557 Fall 2016
Vision and Color Brian Curless CSEP 557 Fall 2016 1 Reading Good resources: Glassner, Principles of Digital Image Synthesis, pp. 5-32. Palmer, Vision Science: Photons to Phenomenology. Wandell. Foundations
More informationPERCEIVING MOVEMENT. Ways to create movement
PERCEIVING MOVEMENT Ways to create movement Perception More than one ways to create the sense of movement Real movement is only one of them Slide 2 Important for survival Animals become still when they
More information3D Space Perception. (aka Depth Perception)
3D Space Perception (aka Depth Perception) 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information is available to support this process? Interaction
More informationVision and Color. Reading. The lensmaker s formula. Lenses. Brian Curless CSEP 557 Autumn Good resources:
Reading Good resources: Vision and Color Brian Curless CSEP 557 Autumn 2017 Glassner, Principles of Digital Image Synthesis, pp. 5-32. Palmer, Vision Science: Photons to Phenomenology. Wandell. Foundations
More informationthe human chapter 1 Traffic lights the human User-centred Design Light Vision part 1 (modified extract for AISD 2005) Information i/o
Traffic lights chapter 1 the human part 1 (modified extract for AISD 2005) http://www.baddesigns.com/manylts.html User-centred Design Bad design contradicts facts pertaining to human capabilities Usability
More informationMotion perception PSY 310 Greg Francis. Lecture 24. Aperture problem
Motion perception PSY 310 Greg Francis Lecture 24 How do you see motion here? Aperture problem A detector that only sees part of a scene cannot precisely identify the motion direction or speed of an edge
More informationRetina. Convergence. Early visual processing: retina & LGN. Visual Photoreptors: rods and cones. Visual Photoreptors: rods and cones.
Announcements 1 st exam (next Thursday): Multiple choice (about 22), short answer and short essay don t list everything you know for the essay questions Book vs. lectures know bold terms for things that
More informationHuman Senses : Vision week 11 Dr. Belal Gharaibeh
Human Senses : Vision week 11 Dr. Belal Gharaibeh 1 Body senses Seeing Hearing Smelling Tasting Touching Posture of body limbs (Kinesthetic) Motion (Vestibular ) 2 Kinesthetic Perception of stimuli relating
More informationDigital Image Processing COSC 6380/4393
Digital Image Processing COSC 6380/4393 Lecture 2 Aug 24 th, 2017 Slides from Dr. Shishir K Shah, Rajesh Rao and Frank (Qingzhong) Liu 1 Instructor TA Digital Image Processing COSC 6380/4393 Pranav Mantini
More informationRetinal stray light originating from intraocular lenses and its effect on visual performance van der Mooren, Marie Huibert
University of Groningen Retinal stray light originating from intraocular lenses and its effect on visual performance van der Mooren, Marie Huibert IMPORTANT NOTE: You are advised to consult the publisher's
More informationEye Tracking Observers During Color Image Evaluation Tasks
Eye Tracking Observers During Color Image Evaluation Tasks Jason S. Babcock B.S. Imaging and Photographic Technology Rochester Institute of Technology (2000) A thesis submitted for partial fulfillment
More informationSMALL VOLUNTARY MOVEMENTS OF THE EYE*
Brit. J. Ophthal. (1953) 37, 746. SMALL VOLUNTARY MOVEMENTS OF THE EYE* BY B. L. GINSBORG Physics Department, University of Reading IT is well known that the transfer of the gaze from one point to another,
More informationRoboCup. Presented by Shane Murphy April 24, 2003
RoboCup Presented by Shane Murphy April 24, 2003 RoboCup: : Today and Tomorrow What we have learned Authors Minoru Asada (Osaka University, Japan), Hiroaki Kitano (Sony CS Labs, Japan), Itsuki Noda (Electrotechnical(
More informationThe eye, displays and visual effects
The eye, displays and visual effects Week 2 IAT 814 Lyn Bartram Visible light and surfaces Perception is about understanding patterns of light. Visible light constitutes a very small part of the electromagnetic
More informationThe Visual System. Computing and the Brain. Visual Illusions. Give us clues as to how the visual system works
The Visual System Computing and the Brain Visual Illusions Give us clues as to how the visual system works We see what we expect to see http://illusioncontest.neuralcorrelate.com/ Spring 2010 2 1 Visual
More informationVision and Color. Reading. Optics, cont d. Lenses. d d f. Brian Curless CSE 557 Autumn Good resources:
Reading Good resources: Vision and Color Brian Curless CSE 557 Autumn 2015 Glassner, Principles of Digital Image Synthesis, pp. 5-32. Palmer, Vision Science: Photons to Phenomenology. Wandell. Foundations
More informationVision and Color. Brian Curless CSE 557 Autumn 2015
Vision and Color Brian Curless CSE 557 Autumn 2015 1 Reading Good resources: Glassner, Principles of Digital Image Synthesis, pp. 5-32. Palmer, Vision Science: Photons to Phenomenology. Wandell. Foundations
More informationCSE Tue 10/23. Nadir Weibel
CSE 118 - Tue 10/23 Nadir Weibel Today Admin Project Assignment #3 Mini Quiz Eye-Tracking Wearable Trackers and Quantified Self Project Assignment #3 Mini Quiz on Week 3 On Google Classroom https://docs.google.com/forms/d/16_1f-uy-ttu01kc3t0yvfwut2j0t1rge4vifh5fsiv4/edit
More informationVision. PSYCHOLOGY (8th Edition, in Modules) David Myers. Module 13. Vision. Vision
PSYCHOLOGY (8th Edition, in Modules) David Myers PowerPoint Slides Aneeq Ahmad Henderson State University Worth Publishers, 2007 1 Vision Module 13 2 Vision Vision The Stimulus Input: Light Energy The
More informationFeeding human senses through Immersion
Virtual Reality Feeding human senses through Immersion 1. How many human senses? 2. Overview of key human senses 3. Sensory stimulation through Immersion 4. Conclusion Th3.1 1. How many human senses? [TRV
More informationFigure 1 HDR image fusion example
TN-0903 Date: 10/06/09 Using image fusion to capture high-dynamic range (hdr) scenes High dynamic range (HDR) refers to the ability to distinguish details in scenes containing both very bright and relatively
More informationObject Perception. 23 August PSY Object & Scene 1
Object Perception Perceiving an object involves many cognitive processes, including recognition (memory), attention, learning, expertise. The first step is feature extraction, the second is feature grouping
More informationSE4D03 Computer User Interfaces
SE4D03 Computer User Interfaces The Science of Visualization continued Visual Attention Attention comes in two types of considerations: 1. Low-level as considered below, and 2. High-level as considered
More informationPatents of eye tracking system- a survey
Patents of eye tracking system- a survey Feng Li Center for Imaging Science Rochester Institute of Technology, Rochester, NY 14623 Email: Fxl5575@cis.rit.edu Vision is perhaps the most important of the
More informationThe Human Visual System. Lecture 1. The Human Visual System. The Human Eye. The Human Retina. cones. rods. horizontal. bipolar. amacrine.
Lecture The Human Visual System The Human Visual System Retina Optic Nerve Optic Chiasm Lateral Geniculate Nucleus (LGN) Visual Cortex The Human Eye The Human Retina Lens rods cones Cornea Fovea Optic
More informationEYE MOVEMENT STRATEGIES IN NAVIGATIONAL TASKS Austin Ducworth, Melissa Falzetta, Lindsay Hyma, Katie Kimble & James Michalak Group 1
EYE MOVEMENT STRATEGIES IN NAVIGATIONAL TASKS Austin Ducworth, Melissa Falzetta, Lindsay Hyma, Katie Kimble & James Michalak Group 1 Abstract Navigation is an essential part of many military and civilian
More information2/3/2016. How We Move... Ecological View. Ecological View. Ecological View. Ecological View. Ecological View. Sensory Processing.
How We Move Sensory Processing 2015 MFMER slide-4 2015 MFMER slide-7 Motor Processing 2015 MFMER slide-5 2015 MFMER slide-8 Central Processing Vestibular Somatosensation Visual Macular Peri-macular 2015
More informationThe Persistence of Vision in Spatio-Temporal Illusory Contours formed by Dynamically-Changing LED Arrays
The Persistence of Vision in Spatio-Temporal Illusory Contours formed by Dynamically-Changing LED Arrays Damian Gordon * and David Vernon Department of Computer Science Maynooth College Ireland ABSTRACT
More informationAP PSYCH Unit 4.2 Vision 1. How does the eye transform light energy into neural messages? 2. How does the brain process visual information? 3.
AP PSYCH Unit 4.2 Vision 1. How does the eye transform light energy into neural messages? 2. How does the brain process visual information? 3. What theories help us understand color vision? 4. Is your
More informationTHE RELATIVE IMPORTANCE OF PICTORIAL AND NONPICTORIAL DISTANCE CUES FOR DRIVER VISION. Michael J. Flannagan Michael Sivak Julie K.
THE RELATIVE IMPORTANCE OF PICTORIAL AND NONPICTORIAL DISTANCE CUES FOR DRIVER VISION Michael J. Flannagan Michael Sivak Julie K. Simpson The University of Michigan Transportation Research Institute Ann
More informationSlide 4 Now we have the same components that we find in our eye. The analogy is made clear in this slide. Slide 5 Important structures in the eye
Vision 1 Slide 2 The obvious analogy for the eye is a camera, and the simplest camera is a pinhole camera: a dark box with light-sensitive film on one side and a pinhole on the other. The image is made
More informationLecture 2 Digital Image Fundamentals. Lin ZHANG, PhD School of Software Engineering Tongji University Fall 2016
Lecture 2 Digital Image Fundamentals Lin ZHANG, PhD School of Software Engineering Tongji University Fall 2016 Contents Elements of visual perception Light and the electromagnetic spectrum Image sensing
More informationSpatial Vision: Primary Visual Cortex (Chapter 3, part 1)
Spatial Vision: Primary Visual Cortex (Chapter 3, part 1) Lecture 6 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Spring 2019 1 remaining Chapter 2 stuff 2 Mach Band
More informationReading. 1. Visual perception. Outline. Forming an image. Optional: Glassner, Principles of Digital Image Synthesis, sections
Reading Optional: Glassner, Principles of Digital mage Synthesis, sections 1.1-1.6. 1. Visual perception Brian Wandell. Foundations of Vision. Sinauer Associates, Sunderland, MA, 1995. Research papers:
More informationSensing self motion. Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems
Sensing self motion Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems Position sensing Velocity and acceleration sensing Force sensing Vision based
More informationDepth Perception in an Anthropomorphic Robot that Replicates Human Eye Movements
Depth Perception in an Anthropomorphic Robot that Replicates Human Eye Movements Fabrizio Santini Dept. of Cognitive and Neural Systems Boston University Boston, Massachusetts 02215 Email: santini@cns.bu.edu
More informationUnderstanding Optical Illusions. Mohit Gupta
Understanding Optical Illusions Mohit Gupta What are optical illusions? Perception: I see Light (Sensing) Truth: But this is an! Oracle Optical Illusion in Nature Image Courtesy: http://apollo.lsc.vsc.edu/classes/met130/notes/chapter19/graphics/infer_mirage_road.jpg
More informationEinführung in die Erweiterte Realität. 5. Head-Mounted Displays
Einführung in die Erweiterte Realität 5. Head-Mounted Displays Prof. Gudrun Klinker, Ph.D. Institut für Informatik,Technische Universität München klinker@in.tum.de Nov 30, 2004 Agenda 1. Technological
More informationSensory and Perception. Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague
Sensory and Perception Team 4: Amanda Tapp, Celeste Jackson, Gabe Oswalt, Galen Hendricks, Harry Polstein, Natalie Honan and Sylvie Novins-Montague Our Senses sensation: simple stimulation of a sense organ
More informationVirtual Reality I. Visual Imaging in the Electronic Age. Donald P. Greenberg November 9, 2017 Lecture #21
Virtual Reality I Visual Imaging in the Electronic Age Donald P. Greenberg November 9, 2017 Lecture #21 1968: Ivan Sutherland 1990s: HMDs, Henry Fuchs 2013: Google Glass History of Virtual Reality 2016:
More informationVisual Perception. Readings and References. Forming an image. Pinhole camera. Readings. Other References. CSE 457, Autumn 2004 Computer Graphics
Readings and References Visual Perception CSE 457, Autumn Computer Graphics Readings Sections 1.4-1.5, Interactive Computer Graphics, Angel Other References Foundations of Vision, Brian Wandell, pp. 45-50
More informationGAZE contingent display techniques attempt
EE367, WINTER 2017 1 Gaze Contingent Foveated Rendering Sanyam Mehra, Varsha Sankar {sanyam, svarsha}@stanford.edu Abstract The aim of this paper is to present experimental results for gaze contingent
More informationMULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT
MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003
More informationVision. Biological vision and image processing
Vision Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Methods for Image processing academic year 2017 2018 Biological vision and image processing The human visual perception
More informationPerception. Read: AIMA Chapter 24 & Chapter HW#8 due today. Vision
11-25-2013 Perception Vision Read: AIMA Chapter 24 & Chapter 25.3 HW#8 due today visual aural haptic & tactile vestibular (balance: equilibrium, acceleration, and orientation wrt gravity) olfactory taste
More informationUnderstanding avian collisions: a birds eye view
Understanding avian collisions: a birds eye view Graham Martin University of Birmingham UK Graham Martin Centre for Ornithology School of Biosciences Why are these a problem to birds? In the majority of
More informationVision. The eye. Image formation. Eye defects & corrective lenses. Visual acuity. Colour vision. Lecture 3.5
Lecture 3.5 Vision The eye Image formation Eye defects & corrective lenses Visual acuity Colour vision Vision http://www.wired.com/wiredscience/2009/04/schizoillusion/ Perception of light--- eye-brain
More information7Motion Perception. 7 Motion Perception. 7 Computation of Visual Motion. Chapter 7
7Motion Perception Chapter 7 7 Motion Perception Computation of Visual Motion Eye Movements Using Motion Information The Man Who Couldn t See Motion 7 Computation of Visual Motion How would you build a
More informationBuilding a lightweight eyetracking headgear
Building a lightweight eyetracking headgear Jason S.Babcock & Jeff B. Pelz Rochester Institute of Technology Abstract Eyetracking systems that use video-based cameras to monitor the eye and scene can be
More informationVisual Perception of Images
Visual Perception of Images A processed image is usually intended to be viewed by a human observer. An understanding of how humans perceive visual stimuli the human visual system (HVS) is crucial to the
More informationExperiment HM-2: Electroculogram Activity (EOG)
Experiment HM-2: Electroculogram Activity (EOG) Background The human eye has six muscles attached to its exterior surface. These muscles are grouped into three antagonistic pairs that control horizontal,
More informationInformation Guide. Synoptophore (Major Amblyoscope) Heading. Body copy. Body copy bold
Information Guide Heading Body copy Body copy bold Synoptophore (Major Amblyoscope) Synoptophore (sin-op-to-phore) Greek: syn = with, ops = eye, phoros = bearing Introduction This information has been
More informationPERCEPTUAL INSIGHTS INTO FOVEATED VIRTUAL REALITY. Anjul Patney Senior Research Scientist
PERCEPTUAL INSIGHTS INTO FOVEATED VIRTUAL REALITY Anjul Patney Senior Research Scientist INTRODUCTION Virtual reality is an exciting challenging workload for computer graphics Most VR pixels are peripheral
More informationHW- Finish your vision book!
March 1 Table of Contents: 77. March 1 & 2 78. Vision Book Agenda: 1. Daily Sheet 2. Vision Notes and Discussion 3. Work on vision book! EQ- How does vision work? Do Now 1.Find your Vision Sensation fill-in-theblanks
More informationP15051: Robotic Eye for Eye Tracker
P15051: Robotic Eye for Eye Tracker Andrew Drogalis Mechanical Engineer Tim O Hearn Mechanical Engineer Katie Hardy Daniel Webster Jorge Gonzalez Abstract: A robotic eye was constructed for the purpose
More informationFundamentals of Computer Vision
Fundamentals of Computer Vision COMP 558 Course notes for Prof. Siddiqi's class. taken by Ruslana Makovetsky (Winter 2012) What is computer vision?! Broadly speaking, it has to do with making a computer
More information