Ambisonics Directional Room Impulse Response as a New SOFA Convention

Similar documents
Measuring impulse responses containing complete spatial information ABSTRACT

ROOM IMPULSE RESPONSES AS TEMPORAL AND SPATIAL FILTERS ABSTRACT INTRODUCTION

Proceedings of Meetings on Acoustics

Audio Engineering Society. Convention Paper. Presented at the 131st Convention 2011 October New York, NY, USA

New acoustical techniques for measuring spatial properties in concert halls

ROOM AND CONCERT HALL ACOUSTICS MEASUREMENTS USING ARRAYS OF CAMERAS AND MICROPHONES

Advanced techniques for the determination of sound spatialization in Italian Opera Theatres

PSYCHOACOUSTIC EVALUATION OF DIFFERENT METHODS FOR CREATING INDIVIDUALIZED, HEADPHONE-PRESENTED VAS FROM B-FORMAT RIRS

A Toolkit for Customizing the ambix Ambisonics-to- Binaural Renderer

NEW MEASUREMENT TECHNIQUE FOR 3D SOUND CHARACTERIZATION IN THEATRES

Visualization of Compact Microphone Array Room Impulse Responses

AURALIAS: An audio-immersive system for auralizing room acoustics projects

29th TONMEISTERTAGUNG VDT INTERNATIONAL CONVENTION, November 2016

Spatialisation accuracy of a Virtual Performance System

Listening with Headphones

Live multi-track audio recording

REAL TIME WALKTHROUGH AURALIZATION - THE FIRST YEAR

Array processing for echo cancellation in the measurement of Head-Related Transfer Functions

VAMBU SOUND: A MIXED TECHNIQUE 4-D REPRODUCTION SYSTEM WITH A HEIGHTENED FRONTAL LOCALISATION AREA

Outline. Context. Aim of our projects. Framework

RIR Estimation for Synthetic Data Acquisition

3D impulse response measurements of spaces using an inexpensive microphone array

MEASURING DIRECTIVITIES OF NATURAL SOUND SOURCES WITH A SPHERICAL MICROPHONE ARRAY

DISTANCE CODING AND PERFORMANCE OF THE MARK 5 AND ST350 SOUNDFIELD MICROPHONES AND THEIR SUITABILITY FOR AMBISONIC REPRODUCTION

The analysis of multi-channel sound reproduction algorithms using HRTF data

Sound source localization and its use in multimedia applications

From Binaural Technology to Virtual Reality

Modeling Diffraction of an Edge Between Surfaces with Different Materials

Room impulse response measurement with a spherical microphone array, application to room and building acoustics

Electric Audio Unit Un

Convention Paper Presented at the 130th Convention 2011 May London, UK

capsule quality matter? A comparison study between spherical microphone arrays using different

Validation of lateral fraction results in room acoustic measurements

This is a repository copy of Impulse response estimation for the auralisation of vehicle engine sounds using dual channel FFT analysis.

Measurements and reproduction of spatial sound characteristics of auditoria

Audio Engineering Society. Convention Paper. Presented at the 115th Convention 2003 October New York, New York

Linux Audio Conference 2009

Convention Paper 9870 Presented at the 143 rd Convention 2017 October 18 21, New York, NY, USA

Multiple Sound Sources Localization Using Energetic Analysis Method

Acoustics II: Kurt Heutschi recording technique. stereo recording. microphone positioning. surround sound recordings.

Convention Paper Presented at the 137th Convention 2014 October 9 12 Los Angeles, USA

SOPA version 2. Revised July SOPA project. September 21, Introduction 2. 2 Basic concept 3. 3 Capturing spatial audio 4

Virtual Sound Source Positioning and Mixing in 5.1 Implementation on the Real-Time System Genesis

Wave Field Analysis Using Virtual Circular Microphone Arrays

ROOM IMPULSE RESPONSES AS TEMPORAL AND SPATIAL FILTERS

Master MVA Analyse des signaux Audiofréquences Audio Signal Analysis, Indexing and Transformation

SUBJECTIVE STUDY ON LISTENER ENVELOPMENT USING HYBRID ROOM ACOUSTICS SIMULATION AND HIGHER ORDER AMBISONICS REPRODUCTION

A spatial squeezing approach to ambisonic audio compression

Abstract. 1. Introduction and Motivation. 3. Methods. 2. Related Work Omni Directional Stereo Imaging

24. TONMEISTERTAGUNG VDT INTERNATIONAL CONVENTION, November Alexander Lindau*, Stefan Weinzierl*

DECORRELATION TECHNIQUES FOR THE RENDERING OF APPARENT SOUND SOURCE WIDTH IN 3D AUDIO DISPLAYS. Guillaume Potard, Ian Burnett

IMPULSE RESPONSE MEASUREMENT WITH SINE SWEEPS AND AMPLITUDE MODULATION SCHEMES. Q. Meng, D. Sen, S. Wang and L. Hayes

Robotic Spatial Sound Localization and Its 3-D Sound Human Interface

EFFECT OF ARTIFICIAL MOUTH SIZE ON SPEECH TRANSMISSION INDEX. Ken Stewart and Densil Cabrera

Audio Engineering Society. Convention Paper. Presented at the 129th Convention 2010 November 4 7 San Francisco, CA, USA. Why Ambisonics Does Work

Envelopment and Small Room Acoustics

University of Huddersfield Repository

Realtime auralization employing time-invariant invariant convolver

Sound Source Localization using HRTF database

3D REPRODUCTION OF ROOM AURALIZATIONS BY COMBINING INTENSITY PANNING, CROSSTALK CANCELLATION AND AMBISONICS

INVESTIGATING BINAURAL LOCALISATION ABILITIES FOR PROPOSING A STANDARDISED TESTING ENVIRONMENT FOR BINAURAL SYSTEMS

Tonehole Radiation Directivity: A Comparison Of Theory To Measurements

PERCEIVED ROOM SIZE AND SOURCE DISTANCE IN FIVE SIMULATED CONCERT AUDITORIA

On the Acoustics of the Underground Galleries of Ancient Chavín de Huántar, Peru

The effects of the excitation source directivity on some room acoustic descriptors obtained from impulse response measurements

D7.1 BINCI visual identity set

Perception and evaluation of sound fields

Sound source localization accuracy of ambisonic microphone in anechoic conditions

The psychoacoustics of reverberation

BINAURAL RECORDING SYSTEM AND SOUND MAP OF MALAGA

Localization of 3D Ambisonic Recordings and Ambisonic Virtual Sources

Blind source separation and directional audio synthesis for binaural auralization of multiple sound sources using microphone array recordings

Convention Paper Presented at the 138th Convention 2015 May 7 10 Warsaw, Poland

Enhancing 3D Audio Using Blind Bandwidth Extension

Proceedings of Meetings on Acoustics

Psychoacoustics of 3D Sound Recording: Research and Practice

Multi-Loudspeaker Reproduction: Surround Sound

AN AUDITORILY MOTIVATED ANALYSIS METHOD FOR ROOM IMPULSE RESPONSES

396 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 2, FEBRUARY 2011

STÉPHANIE BERTET 13, JÉRÔME DANIEL 1, ETIENNE PARIZET 2, LAËTITIA GROS 1 AND OLIVIER WARUSFEL 3.

Interactive 3D Audio Rendering in Flexible Playback Configurations

3D Binaural Sound Reproduction using a Virtual Ambisonic Approach

WHAT ELSE SAYS ACOUSTICAL CHARACTERIZATION SYSTEM LIKE RON JEREMY?

Experimental Evaluation Of The Performances Of A New Pressure-Velocity 3D Probe Based On The Ambisonics Theory

Deep learning architectures for music audio classification: a personal (re)view

SPATIAL SOUND REPRODUCTION WITH WAVE FIELD SYNTHESIS

PRODUCT DATA. DIRAC Room Acoustics Software Type Photo courtesy of Muziekcentrum Frits Philips, Eindhoven, The Netherlands

VIRTUAL ACOUSTICS: OPPORTUNITIES AND LIMITS OF SPATIAL SOUND REPRODUCTION

VST3 - Reaper manual, Mac and Windows

Personalized 3D sound rendering for content creation, delivery, and presentation

Microphone Array Design and Beamforming

Soundfield Navigation using an Array of Higher-Order Ambisonics Microphones

ICSA 2017: Much to hear / Art and science / Attendance up

Determination of directional echograms and application in room acoustics

Composite square and monomial power sweeps for SNR customization in acoustic measurements

Automatic Text-Independent. Speaker. Recognition Approaches Using Binaural Inputs

APPLICATION NOTE MAKING GOOD MEASUREMENTS LEARNING TO RECOGNIZE AND AVOID DISTORTION SOUNDSCAPES. by Langston Holland -

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007

6-channel recording/reproduction system for 3-dimensional auralization of sound fields

HRTF adaptation and pattern learning

Transcription:

Ambisonics Directional Room Impulse Response as a New Convention Andrés Pérez López 1 2 Julien De Muynke 1 1 Multimedia Technologies Unit Eurecat - Centre Tecnologic de Catalunya Barcelona 2 Music Technology Group Universitat Pompeu Fabra Barcelona 144th AES Convention 25th May 2018

Outline Introduction Presentation Ambisonics DRIRs Ambisonics DRIRs

Outline Introduction Presentation Ambisonics DRIRs Ambisonics DRIRs

Presentation About us https://binci.eu/ info@binci.eu

Presentation About us Main objectives of BINCI project: Developing production tools to encourage the creation of binaural contents Creating three binaural productions showcased and tested in three cultural and touristic sites Integrating software and hardware solutions for a complete immersive audio experience

BINCI St Andrews Castle

BINCI Die Alte Pinakothek

BINCI Fundació Miro

Outline Introduction Presentation Ambisonics DRIRs Ambisonics DRIRs

Ambisonics DRIRs Impulse Responses HOW? Logarithmic sweep sine technique for recording the RIR 1 All microphone s capsules recording at the same time, for each source position A to B format conversion either on live inputs or in post-processing Impulse is obtained after deconvolution on each Ambisonics channel Each source position is measured using a combination of laser meters that give the azimuth, elevation and distance 1 Simultaneous Measurement of Impulse Response and Distortion with a Swept-Sine Technique, A. Farina, Proc. AES 108th conv, Paris, France

Ambisonics DRIRs Impulse Responses WHAT FOR? Auralization 2 Room acoustics analysis 3 and modelling 4 Recording room acoustics for posterity 5 2 Object-based reverberation encoding from first-order Ambisonic RIRs, P. Coleman, A.Franck, D.Menzies, P.Jackson, Proceedings of the 142nd AES Convention, Berlin, Germany 3 Measurement of 3D Room Impulse Responses with a Spherical Microphone Array, J.J. Embrechts, Euronoise 2015 4 Diffuse Field Modeling Using Physically-Inspired Decorrelation Filters : Improvements to the Filter Design Method, D. Romblom, JAES, Vol. 65, No. 11, November 2017 5 Recording Concert Hall Acoustics for Posterity, M. Gerzon, JAES Volume 23 Issue 7 pp. 569, 571; September 1975

Ambisonics DRIRs Eurecat: 3D Tent

Outline Introduction Presentation Ambisonics DRIRs Ambisonics DRIRs

The problem Different conventions for different HRTF datasets...

The problem (again) Kemar (diffuse)

The problem (again) SADIE (Subject 001)

Conventions Majdak, Piotr, et al. Spatially oriented format for acoustics: A data exchange format representing head-related transfer functions. Audio Engineering Society Convention 134. Audio Engineering Society, 2013. AES69-2015 Standard

Conventions

The problem (again) Different conventions for different AmbisonicsDRIR datasets...

The problem (again) Main Church (S3A)

The problem (again) Guildhall Court Chamber (OpenAIR)

The problem (again) QMUL Octogon (Isophonics)

Candidates? Requirements: 1. Multiple speakers 2. Multiple microphone positions 3. Audio in Ambisonics domain 4. Ambisonics-related information

Candidates? Convention candidates: SingleRoomDRIR

Candidates? Convention candidates: SingleRoomDRIR MultiSpeakerBRIR

Candidates? Convention candidates: SingleRoomDRIR MultiSpeakerBRIR GeneralFIRE

Proposal AmbisonicsDRIR convention (v0.1)

Proposal Based on GeneralFIRE, with following additions: Global attributes: AmbisonicsOrder, AmbisonicsMicrophoneModel, AmbisonicsConversionMethod Variables: ListenerUp, ListenerView, EmitterUp, EmitterView Data attributes: ChannelOrdering, Normalization

Proposal Data type: FIRE M: Number of measurements (Listener positions) R: Number of Receivers (Ambisonics channels) E: Number of Emitters (speakers) N: Number of audio samples

Examples Main Church (S3A)

Examples

Examples M: 1 R: 4 E: 10 N: 65536 ListenerView: [0, 1, 0] (type: cartesian, unit: meter)

Examples Guildhall (OpenAIR)

Examples

Examples M: 4 R: 4 E: 3 N: 480000

Examples QMUL Octogon (Isophonics)

Examples

Examples M: 169 R: 4 E: 1 N: n

Links Matlab/Octave API: https://github.com/jdemuynke/api MO C++ API: https://github.com/andresperezlopez/api Cpp

Thanks. Questions?