Binaural hearing. Prof. Dan Tollin on the Hearing Throne, Oldenburg Hearing Garden

Similar documents
Acoustics Research Institute

Binaural Hearing. Reading: Yost Ch. 12

A learning, biologically-inspired sound localization model

Computational Perception. Sound localization 2

I R UNDERGRADUATE REPORT. Stereausis: A Binaural Processing Model. by Samuel Jiawei Ng Advisor: P.S. Krishnaprasad UG

Auditory Localization

Sound source localization and its use in multimedia applications

3D sound image control by individualized parametric head-related transfer functions

Study on method of estimating direct arrival using monaural modulation sp. Author(s)Ando, Masaru; Morikawa, Daisuke; Uno

Binaural Sound Localization Systems Based on Neural Approaches. Nick Rossenbach June 17, 2016

Dynamic sound localization in cats

EE1.el3 (EEE1023): Electronics III. Acoustics lecture 20 Sound localisation. Dr Philip Jackson.

III. Publication III. c 2005 Toni Hirvonen.

Listening with Headphones

Proceedings of Meetings on Acoustics

The psychoacoustics of reverberation

Computational Perception /785

COMP 546. Lecture 23. Echolocation. Tues. April 10, 2018

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Loudness & Temporal resolution

PERSONALIZED HEAD RELATED TRANSFER FUNCTION MEASUREMENT AND VERIFICATION THROUGH SOUND LOCALIZATION RESOLUTION

Evaluation of a new stereophonic reproduction method with moving sweet spot using a binaural localization model

URBANA-CHAMPAIGN. CS 498PS Audio Computing Lab. 3D and Virtual Sound. Paris Smaragdis. paris.cs.illinois.

An Auditory Localization and Coordinate Transform Chip

NAME STUDENT # ELEC 484 Audio Signal Processing. Midterm Exam July Listening test

Ivan Tashev Microsoft Research

Spatial Audio & The Vestibular System!

A CLOSER LOOK AT THE REPRESENTATION OF INTERAURAL DIFFERENCES IN A BINAURAL MODEL

Proceedings of Meetings on Acoustics

Monaural and binaural processing of fluctuating sounds in the auditory system

Hearing and Deafness 2. Ear as a frequency analyzer. Chris Darwin

Introduction. 1.1 Surround sound

HRTF adaptation and pattern learning

THE MATLAB IMPLEMENTATION OF BINAURAL PROCESSING MODEL SIMULATING LATERAL POSITION OF TONES WITH INTERAURAL TIME DIFFERENCES

Virtual Acoustic Space as Assistive Technology

INVESTIGATING BINAURAL LOCALISATION ABILITIES FOR PROPOSING A STANDARDISED TESTING ENVIRONMENT FOR BINAURAL SYSTEMS

EXPLORATION OF A BIOLOGICALLY INSPIRED MODEL FOR SOUND SOURCE LOCALIZATION IN 3D SPACE

Intensity Discrimination and Binaural Interaction

NEAR-FIELD VIRTUAL AUDIO DISPLAYS

Receptive Fields and Binaural Interactions for Virtual-Space Stimuli in the Cat Inferior Colliculus

Perception of pitch. Definitions. Why is pitch important? BSc Audiology/MSc SHS Psychoacoustics wk 4: 7 Feb A. Faulkner.

Monaural and Binaural Speech Separation

Perception of pitch. Importance of pitch: 2. mother hemp horse. scold. Definitions. Why is pitch important? AUDL4007: 11 Feb A. Faulkner.

ORIENTATION IN SIMPLE VIRTUAL AUDITORY SPACE CREATED WITH MEASURED HRTF

A binaural auditory model and applications to spatial sound evaluation

Auditory Distance Perception. Yan-Chen Lu & Martin Cooke

A cat's cocktail party: Psychophysical, neurophysiological, and computational studies of spatial release from masking

Spatial Audio Reproduction: Towards Individualized Binaural Sound

Neural Processing of Amplitude-Modulated Sounds: Joris, Schreiner and Rees, Physiol. Rev. 2004

Upper hemisphere sound localization using head-related transfer functions in the median plane and interaural differences

Binaural Mechanisms that Emphasize Consistent Interaural Timing Information over Frequency

Convention Paper 9712 Presented at the 142 nd Convention 2017 May 20 23, Berlin, Germany

3D Sound Simulation over Headphones

I. INTRODUCTION. NL-5656 AA Eindhoven, The Netherlands. Electronic mail:

Sound localization Sound localization in audio-based games for visually impaired children

Jason Schickler Boston University Hearing Research Center, Department of Biomedical Engineering, Boston University, Boston, Massachusetts 02215

Perception of pitch. Definitions. Why is pitch important? BSc Audiology/MSc SHS Psychoacoustics wk 5: 12 Feb A. Faulkner.

3D audio overview : from 2.0 to N.M (?)

AN IMPLEMENTATION OF VIRTUAL ACOUSTIC SPACE FOR NEUROPHYSIOLOGICAL STUDIES OF DIRECTIONAL HEARING

A VLSI-Based Model of Azimuthal Echolocation in the Big Brown Bat

Audio Engineering Society. Convention Paper. Presented at the 131st Convention 2011 October New York, NY, USA

PERFORMANCE COMPARISON BETWEEN STEREAUSIS AND INCOHERENT WIDEBAND MUSIC FOR LOCALIZATION OF GROUND VEHICLES ABSTRACT

GAZE AS A MEASURE OF SOUND SOURCE LOCALIZATION

Enhancing 3D Audio Using Blind Bandwidth Extension

A triangulation method for determining the perceptual center of the head for auditory stimuli

Extracting the frequencies of the pinna spectral notches in measured head related impulse responses

Psychoacoustics of 3D Sound Recording: Research and Practice

Proceedings of Meetings on Acoustics

Sound Source Localization using HRTF database

Dynamic Sound Localization during Rapid Eye Head Gaze Shifts

A Silicon Model Of Auditory Localization

Envelopment and Small Room Acoustics

Lecture IV. Sensory processing during active versus passive movements

A Virtual Audio Environment for Testing Dummy- Head HRTFs modeling Real Life Situations

Audio Engineering Society. Convention Paper. Presented at the 129th Convention 2010 November 4 7 San Francisco, CA, USA. Why Ambisonics Does Work

Convention Paper 9870 Presented at the 143 rd Convention 2017 October 18 21, New York, NY, USA

WAVELET-BASED SPECTRAL SMOOTHING FOR HEAD-RELATED TRANSFER FUNCTION FILTER DESIGN

Accurate sound reproduction from two loudspeakers in a living room

The role of intrinsic masker fluctuations on the spectral spread of masking

3D Sound System with Horizontally Arranged Loudspeakers

SOUND 1 -- ACOUSTICS 1

Acoustics, signals & systems for audiology. Week 9. Basic Psychoacoustic Phenomena: Temporal resolution

Audio Engineering Society. Convention Paper. Presented at the 124th Convention 2008 May Amsterdam, The Netherlands

The analysis of multi-channel sound reproduction algorithms using HRTF data

Recording and analysis of head movements, interaural level and time differences in rooms and real-world listening scenarios

Exploiting envelope fluctuations to achieve robust extraction and intelligent integration of binaural cues

Vision V Perceiving Movement

Localization of the Speaker in a Real and Virtual Reverberant Room. Abstract

Binaural Hearing- Human Ability of Sound Source Localization

Vision V Perceiving Movement

Effects of Reverberation on Pitch, Onset/Offset, and Binaural Cues

c 2014 Michael Friedman

Principles of Musical Acoustics

Limulus eye: a filter cascade. Limulus 9/23/2011. Dynamic Response to Step Increase in Light Intensity

MANY emerging applications require the ability to render

Lecture 14. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Fall 2017

Interaction of Object Binding Cues in Binaural Masking Pattern Experiments

Effect of Harmonicity on the Detection of a Signal in a Complex Masker and on Spatial Release from Masking

Capturing 360 Audio Using an Equal Segment Microphone Array (ESMA)

A Model of Head-Related Transfer Functions based on a State-Space Analysis

Factors Affecting Auditory Localization and Situational Awareness in the Urban Battlefield

Transcription:

Binaural hearing Prof. Dan Tollin on the Hearing Throne, Oldenburg Hearing Garden

Outline of the lecture Cues for sound localization Duplex theory Spectral cues do demo Behavioral demonstrations of pinna cues SOC circuits for encoding ITD/ILDs How do we show that the role of the SOC is to encode binaural localization cues? Behavior Effects of lesions on behavior Or even better, effects of stimulation on behavior Anatomical evidence Response properties of neurons: how do they respond to manipulations of that parameter? ITDs: characteristic delay

Visual vs auditory localization Visual world is mapped onto the retina. Visual localization requires preserving anatomical retinotopy. Spatial information is not represented in the cochlea. Auditory system has to compute space

What are the acoustic cues for localization? Binaural cues for horizontal localization Interaural time differences (ITDs) Interaural level differences (ILDs) Spectral cues for vertical localization Counter-intuitively, the spectrum of the sound helps us to localize it in the vertical dimension

Duplex theory of sound localization Low frequencies Requires phase locking (< 3 khz) Very high resolution (jnd = 5-10 sec) High frequencies Short (reflects from head, ears)

Effect of wavelength and size of object constant, size varies Size constant, varies

Head-related transfer functions (HRTFs)

Spectral cues are important for vertical localization

Demo of pinna cues

Pinna cues can be distorted chronically in human subjects Hofman et al., 1998

Distorted HRTFs affect vertical sound localization Human subjects can adapt to distorted HRTFs Curiously, there is no aftereffect Hofman et al., 1998

Pinna movements aid bats in wire avoidance during flight Mogdans et al., 1988

How do we encode these pinna cues? The type IV cells in the DCN have properties that suggest sensitivity to the notches in pinna cues. Lesions of DCN also suggest a role of DCN in localization in elevation.

Reiss and Young, 2005 Type IV responses to notched noise

Young et al., 1992 Type IV units are sensitive to notch noise stimuli, like HRTFs

Type IV cells show strong inhibition with a notch at CF

Effects of DAS lesion on head orientation Control DAS lesion May, 2000

Virtual acoustic space In addition to providing information on source elevation, the HRTFs of the sound also externalize the sound when heard over headphones. Since the HRTF measurements are not from your own ears, these effects vary considerably from subject to subject.

Saccade task

Adapted from Geisler, 1998, courtesy W. Welker What do the ears do?

Pinna movements during localization

With the head restrained, cats undershoot acoustic targets Populin and Yin, 1998

Pinna movements to visual and acoustic targets Populin and Yin, 1998

Pinna movements are largely on the ipsilateral side Populin and Yin, 1998

Pinna movements have very short latencies

Auditory localization improves markedly with the head unrestrained

With the head free, cats localize sounds about as well as barn owls and people

What are the ears doing? Vestibulo-auricular reflex (VAR): The left pinna moves reflexly to compensate for a leftward head movement VAR

The vestibular-auricular reflex (VAR)

Frens and van Opstal, 1995 Localization in elevation requires wide band spectral sounds

Cat 28 A 40 Noise 500 Hz 1000 Hz 2500 Hz 6000 Hz 20 0 o o o o o -20 Elevation (deg) B -40 40 20 0-20 -40 Target Response Target Response -40-20 0 20 40 B Azimuth (deg) Gaze Shift Elevation (deg) 40 20 0-20 -40 = 4.42 Gain =.86 n = 549 = 7.73 Gain = 0.01 n = 257 = 7.94 Gain =.11 n = 340 = 7.74 Gain =.07 n = 315 = 7.13 Gain =.07 n = 318 40 Gaze Shift Azimuth (deg) 20 0-20 -40 = 4.14 Gain =.78 n = 549 = 19.43 Gain =.85 n = 257 = 18.29 Gain = 1.00 n = 340 = 12.00 Gain =.85 n = 315 = 15.66 Gain =.69 n = 318-40 -20 0 20 40 Motor Error (deg)

Binaural beats (or rotating tones) f f + f b

Characteristic delay Rose, Gross, Geisler and Hind, 1966 Jerzy Rose

Shig Kuwada, U Conn Kuwada and Yin, 1983

Yin and Kuwada, 1983

Other important or interesting binaural phenomena Binaural masking level differences Huggins pitch

Binaural masking level differences (BMLDs)