Acoustics, signals & systems for audiology. Week 9. Basic Psychoacoustic Phenomena: Temporal resolution

Similar documents
Temporal resolution AUDL Domain of temporal resolution. Fine structure and envelope. Modulating a sinusoid. Fine structure and envelope

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Loudness & Temporal resolution

Perception of pitch. Importance of pitch: 2. mother hemp horse. scold. Definitions. Why is pitch important? AUDL4007: 11 Feb A. Faulkner.

You know about adding up waves, e.g. from two loudspeakers. AUDL 4007 Auditory Perception. Week 2½. Mathematical prelude: Adding up levels

Perception of pitch. Definitions. Why is pitch important? BSc Audiology/MSc SHS Psychoacoustics wk 5: 12 Feb A. Faulkner.

AUDL GS08/GAV1 Auditory Perception. Envelope and temporal fine structure (TFS)

Perception of pitch. Definitions. Why is pitch important? BSc Audiology/MSc SHS Psychoacoustics wk 4: 7 Feb A. Faulkner.

Complex Sounds. Reading: Yost Ch. 4

Hearing and Deafness 2. Ear as a frequency analyzer. Chris Darwin

Acoustics, signals & systems for audiology. Week 4. Signals through Systems

Signals & Systems for Speech & Hearing. Week 6. Practical spectral analysis. Bandpass filters & filterbanks. Try this out on an old friend

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007

EC209 - Improving Signal-To-Noise Ratio (SNR) for Optimizing Repeatable Auditory Brainstem Responses

HCS 7367 Speech Perception

Effect of fast-acting compression on modulation detection interference for normal hearing and hearing impaired listeners

Estimating critical bandwidths of temporal sensitivity to low-frequency amplitude modulation

Monaural and binaural processing of fluctuating sounds in the auditory system

The role of intrinsic masker fluctuations on the spectral spread of masking

Auditory modelling for speech processing in the perceptual domain

ABSTRACT. Title of Document: SPECTROTEMPORAL MODULATION LISTENERS. Professor, Dr.Shihab Shamma, Department of. Electrical Engineering

A102 Signals and Systems for Hearing and Speech: Final exam answers

Introduction to cochlear implants Philipos C. Loizou Figure Captions

Modeling auditory processing of amplitude modulation II. Spectral and temporal integration Dau, T.; Kollmeier, B.; Kohlrausch, A.G.

Spectral and temporal processing in the human auditory system

Machine recognition of speech trained on data from New Jersey Labs

Neural Processing of Amplitude-Modulated Sounds: Joris, Schreiner and Rees, Physiol. Rev. 2004

The psychoacoustics of reverberation

Outline. Communications Engineering 1

COM325 Computer Speech and Hearing

Psycho-acoustics (Sound characteristics, Masking, and Loudness)

Computational Perception. Sound localization 2

Modeling auditory processing of amplitude modulation I. Detection and masking with narrow-band carriers Dau, T.; Kollmeier, B.; Kohlrausch, A.G.

Auditory filters at low frequencies: ERB and filter shape

2920 J. Acoust. Soc. Am. 102 (5), Pt. 1, November /97/102(5)/2920/5/$ Acoustical Society of America 2920

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

Loudspeaker Distortion Measurement and Perception Part 2: Irregular distortion caused by defects

Binaural Hearing. Reading: Yost Ch. 12

Since the advent of the sine wave oscillator

PART II Practical problems in the spectral analysis of speech signals

Signals, Sound, and Sensation

Measuring the critical band for speech a)

AUDL 4007 Auditory Perception. Week 1. The cochlea & auditory nerve: Obligatory stages of auditory processing

Preeti Rao 2 nd CompMusicWorkshop, Istanbul 2012

Modeling spectro - temporal modulation perception in normal - hearing listeners

Speech, Hearing and Language: work in progress. Volume 12

Preface A detailed knowledge of the processes involved in hearing is an essential prerequisite for numerous medical and technical applications, such a

Tone-in-noise detection: Observed discrepancies in spectral integration. Nicolas Le Goff a) Technische Universiteit Eindhoven, P.O.

Music 171: Amplitude Modulation

A CLOSER LOOK AT THE REPRESENTATION OF INTERAURAL DIFFERENCES IN A BINAURAL MODEL

Perception of low frequencies in small rooms

SGN Audio and Speech Processing

Amplitude Modulation Chapter 2. Modulation process

Temporal Modulation Transfer Functions for Tonal Stimuli: Gated versus Continuous Conditions

Imagine the cochlea unrolled

III. Publication III. c 2005 Toni Hirvonen.

Code No: R Set No. 1

CS311: Data Communication. Transmission of Analog Signal - I

Effect of filter spacing and correct tonotopic representation on melody recognition: Implications for cochlear implants

Acoustics, signals & systems for audiology. Week 3. Frequency characterisations of systems & signals

EE390 Final Exam Fall Term 2002 Friday, December 13, 2002

speech signal S(n). This involves a transformation of S(n) into another signal or a set of signals

Linguistic Phonetics. Spectral Analysis

What is Sound? Part II

Speech/Music Change Point Detection using Sonogram and AANN

RESEARCH ON METHODS FOR ANALYZING AND PROCESSING SIGNALS USED BY INTERCEPTION SYSTEMS WITH SPECIAL APPLICATIONS

Modulation analysis in ArtemiS SUITE 1

Study on method of estimating direct arrival using monaural modulation sp. Author(s)Ando, Masaru; Morikawa, Daisuke; Uno

FFT 1 /n octave analysis wavelet

SPEECH INTELLIGIBILITY DERIVED FROM EXCEEDINGLY SPARSE SPECTRAL INFORMATION

THE PERCEPTION OF ALL-PASS COMPONENTS IN TRANSFER FUNCTIONS

Citation for published version (APA): Lijzenga, J. (1997). Discrimination of simplified vowel spectra Groningen: s.n.

Terminology (1) Chapter 3. Terminology (3) Terminology (2) Transmitter Receiver Medium. Data Transmission. Direct link. Point-to-point.

INTRODUCTION. Address and author to whom correspondence should be addressed. Electronic mail:

Effect of bandwidth extension to telephone speech recognition in cochlear implant users

Accurate Delay Measurement of Coded Speech Signals with Subsample Resolution

(b) What are the differences between FM and PM? (c) What are the differences between NBFM and WBFM? [9+4+3]

AUDL Final exam page 1/7 Please answer all of the following questions.

SOUND QUALITY EVALUATION OF FAN NOISE BASED ON HEARING-RELATED PARAMETERS SUMMARY INTRODUCTION

A cat's cocktail party: Psychophysical, neurophysiological, and computational studies of spatial release from masking

Research Note MODULATION TRANSFER FUNCTIONS: A COMPARISON OF THE RESULTS OF THREE METHODS

EENG473 Mobile Communications Module 3 : Week # (12) Mobile Radio Propagation: Small-Scale Path Loss

Influence of fine structure and envelope variability on gap-duration discrimination thresholds Münkner, S.; Kohlrausch, A.G.; Püschel, D.

Chapter 3. Amplitude Modulation Fundamentals

Exercise 1: Amplitude Modulation

YEDITEPE UNIVERSITY ENGINEERING FACULTY COMMUNICATION SYSTEMS LABORATORY EE 354 COMMUNICATION SYSTEMS

Feasibility of Vocal Emotion Conversion on Modulation Spectrogram for Simulated Cochlear Implants

EE228 Applications of Course Concepts. DePiero

Synthesis Techniques. Juan P Bello

Engineering Discovery

COMP 546. Lecture 23. Echolocation. Tues. April 10, 2018

Modulation Methods Frequency Modulation

Sound/Audio. Slides courtesy of Tay Vaughan Making Multimedia Work

Signals, systems, acoustics and the ear. Week 3. Frequency characterisations of systems & signals

MUS421/EE367B Applications Lecture 9C: Time Scale Modification (TSM) and Frequency Scaling/Shifting

Pattern Recognition. Part 6: Bandwidth Extension. Gerhard Schmidt

ET Envelope Path from digits to PA

Results of Egan and Hake using a single sinusoidal masker [reprinted with permission from J. Acoust. Soc. Am. 22, 622 (1950)].

Massachusetts Institute of Technology Dept. of Electrical Engineering and Computer Science Fall Semester, Introduction to EECS 2

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 AUDITORY EVOKED MAGNETIC FIELDS AND LOUDNESS IN RELATION TO BANDPASS NOISES

Interaction of Object Binding Cues in Binaural Masking Pattern Experiments

Transcription:

Acoustics, signals & systems for audiology Week 9 Basic Psychoacoustic Phenomena: Temporal resolution

Modulating a sinusoid carrier at 1 khz (fine structure) x modulator at 100 Hz (envelope) = amplitudemodulated wave

Domain of temporal resolution Fine structure and envelope fine structure relatively fast reflects spectral components of sounds in the sound waveform, and periodicity (in some definitions) envelope is the slower stuff think of all waves as being made by multiplying an envelope against a carrier

Fine structure and envelope Envelope reflects changing amplitude of signal e.g., over multiple cycles for periodic sounds

Caveat about temporal resolution Typically defined as reflecting perception of variations over time in envelope (and there are different ways to define envelope) rather than fine-structure But could concern temporal variations, for example, in frequency of a sinusoid

Temporal Resolution for envelope most often tested in two ways Both involve modulation of the amplitude of waveforms Gap detection Amplitude modulation but this almost always results in spectral changes. In other words, you usually cannot change the temporal (envelope) properties of a signal without also changing its spectrum leading to a difficulty of interpretation unless special measures are taken

The need to eliminate spectral cues Modulating signals in envelope usually results in spectral changes (broadening, known as splatter) e.g., effect of 10 ms gap in spectrum of 1 khz sinusoid Need to avoid listeners hearing spectral changes SineGaps.sfs

Effects of AM on spectrum 100 Hz AM of 1 khz sinusoid Spectral sidebands at 900 and 1100 Hz 100 Hz AM white noise Spectrum remains flat

Three possibilities Modulate wideband noise stimuli Minimise audibility of spectral changes by keeping any sidebands in the same auditory filter as the original signal allows use of low AM rates with sine carriers and/or adding masking noise to make spectral changes inaudible Modulate wideband noise stimuli and filter into bands afterwards but can change extent/form of modulation

Gap thresholds Pick the sound with the gap vary the gap duration to find threshold Thresholds for wide-band noise are around 3 ms

Effects of noise spectrum on gap detection Wider noise bandwidth gives smaller gap thresholds Frequency location of noise (UCF parameter) has little effect May be because wide bandwidth allows listeners access to information from large numbers of filter channels

AM detection - TMTF TMTF temporal modulation transfer function Analogous to an ordinary transfer function or frequency response dealing with frequencies of modulation rather than frequencies of a sinusoidal waveform directly Analytic approach to temporal resolution Considers temporal modulation across different single frequencies of sinusoidal AM cf gap detection where in effect the modulator is a pulse comprising wide range of modulation frequencies As for gap thresholds, wide-band noise is an ideal signal because of the lack of spectral changes. Fixed modulation rate vary depth of modulation to determine minimum detectable depth

10 Hz modulation rate

TMTF data Thresholds expressed in db as 20 log(m) where m is modulation index m = 1 gives 0 db (modulation depth = carrier amplitude) m = 0.05 gives -26 db The function looks very much like a low-pass filter (here inverted) Upper limit of amplitude modulation detection between 500 and 1000 Hz

Fundamentals of Hearing: An Introduction W.A. Yost Amplitude Modulation Detection Four sets of amplitude modulated noises each of 500-msec duration with modulation rates of 4, 16, 64, and 256 Hz For each set: ten comparisons of an unmodulated noise followed by the amplitude modulated noise Modulated The depth of modulation starts at 50% or 20log(m) = -6 db and decreases in 5% steps ending at 5%. Count how many of the ten pairs have a noticeable modulation compared to the 1 st unmodulated noise 256 Hz Unmodulated 4 Hz 16 Hz 64 Hz 256 Hz

Translating to the clinic: Auditory Neuropathy Spectrum Disorder (ANSD)

Temporal resolution in ANSD ANSD: normal OAEs but lack of CAP and ABR responses. Sometimes near normal audiometric thresholds but often severe problems with speech perception, out of line with hearing loss in PTA Locus of impairment unclear not like SNHL probably not involving OHCs Likely involves disruption of phaselocking in auditory nerve

Rance, McKay and Grayden, 2004 (Ear & Hearing) Compared children with normal hearing, SNHL, and ANSD Measured Frequency selectivity (simple notched noise method) Sinusoid frequency discrimination TMTFs CNC word phoneme recognition

Impaired modulation detection in AN group

Temporal resolution and temporal frequency coding seems impaired in ANSD And both correlate highly with speech scores While auditory filtering seems nearnormal in many of the ANSD subjects

A model of temporal resolution the temporal window LTI system characterised by a frequency response or?

A model of the auditory periphery temporal window 25 20 15 10 5 0-5 100 1000 10000 25 20 15 10 5 0-5 100 1000 10000 time 22

Sound with Gap Temporal Window The temporal window as a kind of smearing Temporal Excitation Pattern Output of Window / Excitation Level Center Time Time slide courtesy of Chris Plack, 2013

gap detection seen through the temporal window model

Effects of temporal window on signals Decision device looks at evidence of level changes at output a model of within-channel temporal resolution

Key Points Measures of temporal resolution typically relate to signal envelopes Measures must control spectral artefacts Gap detection and TMTF main measures Both indicate limits in region of 1 to 3 ms in normal hearing Temporal window model can account reasonably well for within-channel temporal resolution