Perception and evaluation of sound fields

Similar documents
Predicting localization accuracy for stereophonic downmixes in Wave Field Synthesis

Externalization in binaural synthesis: effects of recording environment and measurement procedure

GAZE AS A MEASURE OF SOUND SOURCE LOCALIZATION

Simulation of wave field synthesis

HRTF adaptation and pattern learning

Convention Paper Presented at the 129th Convention 2010 November 4 7 San Francisco, CA

Influence of the ventriloquism effect on minimum audible angles assessed with wave field synthesis and intensity panning

SIMULATION OF SMALL HEAD-MOVEMENTS ON A VIRTUAL AUDIO DISPLAY USING HEADPHONE PLAYBACK AND HRTF SYNTHESIS. György Wersényi

Proceedings of Meetings on Acoustics

Enhancing 3D Audio Using Blind Bandwidth Extension

University of Huddersfield Repository

COLOURATION IN 2.5D LOCAL WAVE FIELD SYNTHESIS USING SPATIAL BANDWIDTH-LIMITATION

Evaluation of a new stereophonic reproduction method with moving sweet spot using a binaural localization model

Spatial Audio with the SoundScape Renderer

VIRTUAL ACOUSTICS: OPPORTUNITIES AND LIMITS OF SPATIAL SOUND REPRODUCTION

Analysis of Frontal Localization in Double Layered Loudspeaker Array System

sources Satongar, D, Pike, C, Lam, YW and Tew, AI /jaes sources Satongar, D, Pike, C, Lam, YW and Tew, AI Article

Convention Paper Presented at the 124th Convention 2008 May Amsterdam, The Netherlands

STÉPHANIE BERTET 13, JÉRÔME DANIEL 1, ETIENNE PARIZET 2, LAËTITIA GROS 1 AND OLIVIER WARUSFEL 3.

QoE model software, first version

Novel approaches towards more realistic listening environments for experiments in complex acoustic scenes

A triangulation method for determining the perceptual center of the head for auditory stimuli

Audio Engineering Society. Convention Paper. Presented at the 129th Convention 2010 November 4 7 San Francisco, CA, USA. Why Ambisonics Does Work

Binaural auralization based on spherical-harmonics beamforming

From Binaural Technology to Virtual Reality

Perception of Focused Sources in Wave Field Synthesis

O P S I. ( Optimised Phantom Source Imaging of the high frequency content of virtual sources in Wave Field Synthesis )

The relation between perceived apparent source width and interaural cross-correlation in sound reproduction spaces with low reverberation

THE DEVELOPMENT OF A DESIGN TOOL FOR 5-SPEAKER SURROUND SOUND DECODERS

SOPA version 2. Revised July SOPA project. September 21, Introduction 2. 2 Basic concept 3. 3 Capturing spatial audio 4

A Virtual Audio Environment for Testing Dummy- Head HRTFs modeling Real Life Situations

A virtual headphone based on wave field synthesis

Spatial Audio Reproduction: Towards Individualized Binaural Sound

Convention Paper Presented at the 126th Convention 2009 May 7 10 Munich, Germany

Binaural Hearing. Reading: Yost Ch. 12

Proceedings of Meetings on Acoustics

Auditory Localization

Array processing for echo cancellation in the measurement of Head-Related Transfer Functions

Acoustics Research Institute

The analysis of multi-channel sound reproduction algorithms using HRTF data

3D AUDIO AR/VR CAPTURE AND REPRODUCTION SETUP FOR AURALIZATION OF SOUNDSCAPES

Sound source localization and its use in multimedia applications

THE TEMPORAL and spectral structure of a sound signal

Sound localization with multi-loudspeakers by usage of a coincident microphone array

Institute for Media Technology Electronic Media Technology (EMT)

HRIR Customization in the Median Plane via Principal Components Analysis

Lateralisation of multiple sound sources by the auditory system

Interpolation of Head-Related Transfer Functions

University of Huddersfield Repository

Vertical Localization Performance in a Practical 3-D WFS Formulation

The Association of Loudspeaker Manufacturers & Acoustics International presents

Virtual Acoustic Space as Assistive Technology

Listening with Headphones

BINAURAL RECORDING SYSTEM AND SOUND MAP OF MALAGA

Institute for Media Technology Electronic Media Technology (ELMT)

III. Publication III. c 2005 Toni Hirvonen.

Convention Paper 9712 Presented at the 142 nd Convention 2017 May 20 23, Berlin, Germany

Psychoacoustic Cues in Room Size Perception

Localization Experiments Using Different 2D Ambisonics Decoders (Lokalisationsversuche mit verschiedenen 2D Ambisonics Dekodern)

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 VIRTUAL AUDIO REPRODUCED IN A HEADREST

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

INVESTIGATING BINAURAL LOCALISATION ABILITIES FOR PROPOSING A STANDARDISED TESTING ENVIRONMENT FOR BINAURAL SYSTEMS

396 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 2, FEBRUARY 2011

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

ON THE APPLICABILITY OF DISTRIBUTED MODE LOUDSPEAKER PANELS FOR WAVE FIELD SYNTHESIS BASED SOUND REPRODUCTION

Perceptual Aspects of Dynamic Binaural Synthesis based on Measured Omnidirectional Room Impulse Responses

24. TONMEISTERTAGUNG VDT INTERNATIONAL CONVENTION, November Alexander Lindau*, Stefan Weinzierl*

PERSONAL 3D AUDIO SYSTEM WITH LOUDSPEAKERS

On the Validity of Virtual Reality-based Auditory Experiments: A Case Study about Ratings of the Overall Listening Experience

Influence of artificial mouth s directivity in determining Speech Transmission Index

Sound Field Synthesis for Audio Presentation

Introduction. 1.1 Surround sound

Outline. Context. Aim of our projects. Framework

SpringerBriefs in Computer Science

Vertical Sound Source Localization Influenced by Visual Stimuli

Convention Paper 9870 Presented at the 143 rd Convention 2017 October 18 21, New York, NY, USA

THE INTERACTION BETWEEN HEAD-TRACKER LATENCY, SOURCE DURATION, AND RESPONSE TIME IN THE LOCALIZATION OF VIRTUAL SOUND SOURCES

Perceptual Band Allocation (PBA) for the Rendering of Vertical Image Spread with a Vertical 2D Loudspeaker Array

EXPLORATION OF A BIOLOGICALLY INSPIRED MODEL FOR SOUND SOURCE LOCALIZATION IN 3D SPACE

Wave field synthesis: The future of spatial audio

Upper hemisphere sound localization using head-related transfer functions in the median plane and interaural differences

Personalized 3D sound rendering for content creation, delivery, and presentation

WAVELET-BASED SPECTRAL SMOOTHING FOR HEAD-RELATED TRANSFER FUNCTION FILTER DESIGN

The psychoacoustics of reverberation

ORIENTATION IN SIMPLE VIRTUAL AUDITORY SPACE CREATED WITH MEASURED HRTF

The Mona Lisa Effect: Perception of Gaze Direction in Real and Pictured Faces

Proceedings of Meetings on Acoustics

Wellenfeldsynthese: Grundlagen und Perspektiven

sink moving direction velocity radiation pattern Retrieval All Sources Ambient Sources Relevant Sources Silent Sources Sorting and Selecting

AURALIAS: An audio-immersive system for auralizing room acoustics projects

Convention Paper Presented at the 130th Convention 2011 May London, UK

THE PERCEPTION OF ALL-PASS COMPONENTS IN TRANSFER FUNCTIONS

Soundfield Navigation using an Array of Higher-Order Ambisonics Microphones

A binaural auditory model and applications to spatial sound evaluation

Localization of 3D Ambisonic Recordings and Ambisonic Virtual Sources

Robotic Spatial Sound Localization and Its 3-D Sound Human Interface

SOUND COLOUR PROPERTIES OF WFS AND STEREO

Ambisonics Directional Room Impulse Response as a New SOFA Convention

RWTHedition. RWTH Aachen

Perceptual evaluation of individual headphone compensation in binaural synthesis based on non-individual recordings

Transcription:

Perception and evaluation of sound fields Hagen Wierstorf 1, Sascha Spors 2, Alexander Raake 1 1 Assessment of IP-based Applications, Technische Universität Berlin 2 Institute of Communications Engineering, Universität Rostock 12. September 2012

Introduction How to assess and model the perception of a sound field? Why to assess and model the perception of a sound field? This will be discussed with the example of localization 1 / 13

Sound Field Synthesis physically motivated synthesis 1 virtual source 0 loudspeaker spacing: 0.19 m y/ m 1 2 2 1 0 1 2 x/ m 2 / 13

Sound Field Synthesis psychoacoustically motivated synthesis 1 virtual source 0 loudspeaker spacing: 0.41 m y/ m 1 2 2 1 0 1 2 x/ m 2 / 13

Localization within a sound field listener experiments 1 0 y/ m 1 loudspeaker spacing: 0.41 m 2 2 1 0 1 2 x/ m 3 / 13

Localization within a sound field definition localization error := deviation of the direction of the auditory event from the direction of the sound event 4 / 13

Localization within a sound field binaural modelling 1 0 20 40 0 y/ m 1 2 2 1 0 1 2 x/ m 4 / 13

Binaural synthesis virtual sources connection between sound field synthesis and psychoacoustics (Völk, 2008) dynamic binaural synthesis via head tracker transparent with individual HRTFs (Langendijk, 2000) Völk et al. (2008), Simulation of wave field synthesis, Acoustics Langendijk und Bronkhorst (2000), Fidelity of three-dimensional-sound reproduction using a virtual auditory display, JASA 5 / 13

Binaural synthesis virtual sources connection between sound field synthesis and psychoacoustics (Völk, 2008) dynamic binaural synthesis via head tracker transparent with individual HRTFs (Langendijk, 2000) Völk et al. (2008), Simulation of wave field synthesis, Acoustics Langendijk und Bronkhorst (2000), Fidelity of three-dimensional-sound reproduction using a virtual auditory display, JASA 5 / 13

Binaural synthesis virtual sources connection between sound field synthesis and psychoacoustics (Völk, 2008) dynamic binaural synthesis via head tracker transparent with individual HRTFs (Langendijk, 2000) Völk et al. (2008), Simulation of wave field synthesis, Acoustics Langendijk und Bronkhorst (2000), Fidelity of three-dimensional-sound reproduction using a virtual auditory display, JASA 5 / 13

Binaural synthesis virtual sources connection between sound field synthesis and psychoacoustics (Völk, 2008) dynamic binaural synthesis via head tracker transparent with individual HRTFs (Langendijk, 2000) Völk et al. (2008), Simulation of wave field synthesis, Acoustics Langendijk und Bronkhorst (2000), Fidelity of three-dimensional-sound reproduction using a virtual auditory display, JASA 5 / 13

Binaural synthesis and localization real vs. virtual sources localization error is between 1-5 for the horizontal plane for real and virtual sources (Makous 1990, Hess 2004, Bronkhorst 1995,...) it varies with different experimental methods (Majdak 2008) it is the same with individual HRTFs as for real sources, but slightly larger for non-individual HRTFs (Seeber 2003) Makous and Middlebrooks (1990), Two-dimensional sound localization by human listeners, JASA Hess (2004), Influence of head-tracking on spatial perception, 117 th AES Bronkhorst (1995), Localization of real and virtual sound sources, JASA Majdak et al. (2008), The Accuracy of Localizing Virtual Sound Sources: Effects of Pointing Method and Visual Environment, 124 th AES Seeber (2004), Untersuchung der auditiven Lokalisation mit einer Lichtzeigermethode, Technische Universität München 6 / 13

Localization of real and virtual sources apparatus 7 / 13

Localization of real and virtual sources apparatus 7 / 13

Localization of real and virtual sources method head-pointing method with laser pointer mounted on the head (Makous 1990) listener has to face the source, smallest human lateralisation error (Mills 1958) laser pointer gives visual feedback and enhances the cooperation with the motor system (Lewald 2000) white noise pulses 700 ms long, 300 ms pause 11 subjects, 11 loudspeakers 5 repetitons for each condition and loudspeaker position 3 conditions: real loudspeaker, anechoic HRTF, room HRTF Makous and Middlebrooks (1990), Two-dimensional sound localization by human listeners, JASA Mills (1958), On the minimum audible angle, JASA Lewald et al. (2000), Sound localization with eccentric head position, Behav Brain Res 8 / 13

Localization of real and virtual sources room HRTFs 9 / 13

Results mean signed error + 95% confidence interval φauditory event φsound event 6 0 6 6 0 6 6 0 6 loudspeaker room HRTF anechoic HRTF 45 30 15 0 15 30 45 φ sound event 10 / 13

Results summary Loudspeaker room HRTF anechoic HRTF unsigned error / 2.4 ±0.59 1.5 ±0.26 2.0 ±0.56 standard deviation / 2.2 ±0.15 2.4 ±0.28 3.8 ±0.30 time / s 3.5 ±0.65 3.7 ±0.55 5.5 ±1.72 11 / 13

Results summary Loudspeaker room HRTF anechoic HRTF unsigned error / 2.4 ±0.59 1.5 ±0.26 2.0 ±0.56 standard deviation / 2.2 ±0.15 2.4 ±0.28 3.8 ±0.30 time / s 3.5 ±0.65 3.7 ±0.55 5.5 ±1.72 11 / 13

Conclusion Why to assess and model the perception of a sound field? Sound field synthesis methods are more psychoacoustically motivated than considered. Localization and coloration still not fully understand. How to assess and model the perception of a sound field? With binaural synthesis. full control of stimuli reaching the listener or a auditory model every position and loudspeaker array possible not fully transparent, but localization with anechoic HRTFs feasible 12 / 13

Questions? http://audio.qu.tu-berlin.de/ 13 / 13