Yoshiyuki Ito, 1 Koji Iwano 2 and Sadaoki Furui 1

Size: px
Start display at page:

Download "Yoshiyuki Ito, 1 Koji Iwano 2 and Sadaoki Furui 1"

Transcription

1 HMM F F F F F F A study on prosody control for spontaneous speech synthesis Yoshiyuki Ito, Koji Iwano and Sadaoki Furui This paper investigates several topics related to high-quality prosody estimation in HMM-based spontaneous speech synthesis. In our prosody control method, phoneme duration and fundamental frequency (F )aremodeledby Quantification Theory (Type ). We first analyzed the effects of the number and kinds of prosody control factors on spontaneity of synthesized speech. The analysis result showed that pause length between prosodic phrases was one of the important duration control factors while it was not particularly useful for duration control of reading-type speech synthesis. Next, we investigated reasons why the current prosody control method cannot sufficiently model the F features of spontaneous speech. Through the analysis, it was confirmed that the distribution of estimated phrase-averaged F values was reduced from original/correct distribution, and the reduction caused the low spontaneity of synthesized speech. It was also confirmed that spontaneity could be significantly improved if the correct phrase-averaged F values were assigned to the phrases whose original F values were located in a high-frequency region.. ) HMM ) ) CSJ F ) HMM F ) F F HMM TTS F F Department of Computer Science, Tokyo Institute of Technology Faculty of Environmental and Information Studies, Tokyo City University c 9 Information Processing Society of Japan

2 Phoneme HMM Cepstral feature model Quant. theory (Type ) Phoneme duration model Phoneme duration Cepstram parameter generation Mel-cepstram sequence MLSA filter Synthesized speech Japanese text Text analysis Language Information (Phoneme sequence, accent, etc) Fundamental frequency information model Voice source generation Voice source waveform F contour HMM TTS. HMM Quant. theory (Type ) Pulses : voiced sound Noises : unvoiced sound. HMM TTS HMM TTS ) F HMM F F HMM ) F MLSA ) TTS CSJ. vowel /a/,/i/,/u/,/e/,/o/. syllabic nasal /N/. choked sound /Q/. long vowel /-/. voiced stop /b/,/d/,/g/. unvoiced stop /p/,/t/,/k/. voiced fricative /z/,/j/. affricate /ch/,/ts/ 9. unvoiced fricative /f/,/h/,/s/,/sh/. nasal consonant /m/,/n/. liquid /r/. semi vowel /w/,/y/. palatalized consonant /by/,/dy/,/gy/,/py/, /ky/,/hy/,/ry/,/my/,/ny/... triphone HMM HMM left-to-right HMM khz Δ ms ms STRAIGHT ).. 9) I 9).. F I F F F F c 9 Information Processing Society of Japan

3 W 9 / P W / 9 // / / P W /9 W / / W / (9) / W / / W / O W 9 O ( 9 :O ) /9 O / ( 9 : O ) / O / ( 9) F W / P W / 9 / / P W / W / 9/ W /9 / W / / W / ) ( : n ) / / 9/ / M W n STRAIGHT F F ) M M W W P M W n I n =,,,,. 9),) CSJ.. (). (). () 9 9 F 9 9.,,, c 9 Information Processing Society of Japan

4 F F,,,, F F RMS ms F semitone = log (F [Hz]/). %,, 9) ) F,,, RMS[ms] RMS error of phoneme duration [ms] preference score [%] 9 9 Number of factors RMS[semitone]. RMS error of mora pitch [semitone] preference score [%] Number of factors F F 9) ) F F F c 9 Information Processing Society of Japan

5 . F F F F F F,, F F. F F F CSJ, F F ) F semitone Hz F F [semitone] 9 F F F F F F F c 9 Information Processing Society of Japan

6 F [semitone] 9 F F estimated correct F F F semitone F ( semitone ). F F F F F () F μ σ () F μ+σ μ σ F F F F F F. F 9 F F c 9 Information Processing Society of Japan

7 9 F F open * closed % % % % % % % % % % % * * F F F.. CSJ F % % F F open closed HMM.. F F F * % open closed open F F F open closed % % % % % % % % % % % ** *** F F.. F F F F F **,*** % % open closed F open closed F c 9 Information Processing Society of Japan

8 . F F ) F F F. F F F F F ) ) F ) STRAIGHT ) S. Werner, M. Eichner, M. Wolff, and R. Hoffmann, Toward spontaneous speech synthesis Utilizing language model information in TTS, IEEE Transactions on speech and audio proseccing, vol., no., pp.,. ) HMM vol.j9-d-ii, no., pp. 9, 99. ) HMM vol., no.9, pp.,. ) HMM vol., no., pp.,. ) K. Iwano, M. Yamada, T. Togawa, and S. Furui, Prosody control for HMM-based Japanese TTS, In S. Narayanan and A. Alwan (Eds.), Text to Speech Synthesis New Paradigms and Advances, Prentice Hall PTR, New Jersey, Ch., pp.,. ) HMM --, pp.9, 999. ) MLSA vol.j-a, no., pp. 9, 9. ) H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigne, Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F extraction: Possible role of a reptitive structure in sounds, Speech Communication, vol., pp., ) HMM vol., no.9, pp.,. ) F vol., no., pp.,. ) FLUET D-, p., 99. ) vol.9 no. pp c 9 Information Processing Society of Japan

Speech Synthesis using Mel-Cepstral Coefficient Feature

Speech Synthesis using Mel-Cepstral Coefficient Feature Speech Synthesis using Mel-Cepstral Coefficient Feature By Lu Wang Senior Thesis in Electrical Engineering University of Illinois at Urbana-Champaign Advisor: Professor Mark Hasegawa-Johnson May 2018 Abstract

More information

Converting Speaking Voice into Singing Voice

Converting Speaking Voice into Singing Voice Converting Speaking Voice into Singing Voice 1 st place of the Synthesis of Singing Challenge 2007: Vocal Conversion from Speaking to Singing Voice using STRAIGHT by Takeshi Saitou et al. 1 STRAIGHT Speech

More information

Recent Development of the HMM-based Singing Voice Synthesis System Sinsy

Recent Development of the HMM-based Singing Voice Synthesis System Sinsy ISCA Archive http://www.isca-speech.org/archive 7 th ISCAWorkshopon Speech Synthesis(SSW-7) Kyoto, Japan September 22-24, 200 Recent Development of the HMM-based Singing Voice Synthesis System Sinsy Keiichiro

More information

Speech Synthesis; Pitch Detection and Vocoders

Speech Synthesis; Pitch Detection and Vocoders Speech Synthesis; Pitch Detection and Vocoders Tai-Shih Chi ( 冀泰石 ) Department of Communication Engineering National Chiao Tung University May. 29, 2008 Speech Synthesis Basic components of the text-to-speech

More information

Lab 8. ANALYSIS OF COMPLEX SOUNDS AND SPEECH ANALYSIS Amplitude, loudness, and decibels

Lab 8. ANALYSIS OF COMPLEX SOUNDS AND SPEECH ANALYSIS Amplitude, loudness, and decibels Lab 8. ANALYSIS OF COMPLEX SOUNDS AND SPEECH ANALYSIS Amplitude, loudness, and decibels A complex sound with particular frequency can be analyzed and quantified by its Fourier spectrum: the relative amplitudes

More information

NOTES FOR THE SYLLABLE-SIGNAL SYNTHESIS METHOD: TIPW

NOTES FOR THE SYLLABLE-SIGNAL SYNTHESIS METHOD: TIPW NOTES FOR THE SYLLABLE-SIGNAL SYNTHESIS METHOD: TIPW Hung-Yan GU Department of EE, National Taiwan University of Science and Technology 43 Keelung Road, Section 4, Taipei 106 E-mail: root@guhy.ee.ntust.edu.tw

More information

IMPROVING QUALITY OF SPEECH SYNTHESIS IN INDIAN LANGUAGES. P. K. Lehana and P. C. Pandey

IMPROVING QUALITY OF SPEECH SYNTHESIS IN INDIAN LANGUAGES. P. K. Lehana and P. C. Pandey Workshop on Spoken Language Processing - 2003, TIFR, Mumbai, India, January 9-11, 2003 149 IMPROVING QUALITY OF SPEECH SYNTHESIS IN INDIAN LANGUAGES P. K. Lehana and P. C. Pandey Department of Electrical

More information

SYNTHETIC SPEECH DETECTION USING TEMPORAL MODULATION FEATURE

SYNTHETIC SPEECH DETECTION USING TEMPORAL MODULATION FEATURE SYNTHETIC SPEECH DETECTION USING TEMPORAL MODULATION FEATURE Zhizheng Wu 1,2, Xiong Xiao 2, Eng Siong Chng 1,2, Haizhou Li 1,2,3 1 School of Computer Engineering, Nanyang Technological University (NTU),

More information

SGN Audio and Speech Processing

SGN Audio and Speech Processing Introduction 1 Course goals Introduction 2 SGN 14006 Audio and Speech Processing Lectures, Fall 2014 Anssi Klapuri Tampere University of Technology! Learn basics of audio signal processing Basic operations

More information

COMP 546, Winter 2017 lecture 20 - sound 2

COMP 546, Winter 2017 lecture 20 - sound 2 Today we will examine two types of sounds that are of great interest: music and speech. We will see how a frequency domain analysis is fundamental to both. Musical sounds Let s begin by briefly considering

More information

EE 225D LECTURE ON SPEECH SYNTHESIS. University of California Berkeley

EE 225D LECTURE ON SPEECH SYNTHESIS. University of California Berkeley University of California Berkeley College of Engineering Department of Electrical Engineering and Computer Sciences Professors : N.Morgan / B.Gold EE225D Speech Synthesis Spring,1999 Lecture 23 N.MORGAN

More information

2nd MAVEBA, September 13-15, 2001, Firenze, Italy

2nd MAVEBA, September 13-15, 2001, Firenze, Italy ISCA Archive http://www.isca-speech.org/archive Models and Analysis of Vocal Emissions for Biomedical Applications (MAVEBA) 2 nd International Workshop Florence, Italy September 13-15, 21 2nd MAVEBA, September

More information

Aspiration Noise during Phonation: Synthesis, Analysis, and Pitch-Scale Modification. Daryush Mehta

Aspiration Noise during Phonation: Synthesis, Analysis, and Pitch-Scale Modification. Daryush Mehta Aspiration Noise during Phonation: Synthesis, Analysis, and Pitch-Scale Modification Daryush Mehta SHBT 03 Research Advisor: Thomas F. Quatieri Speech and Hearing Biosciences and Technology 1 Summary Studied

More information

Preeti Rao 2 nd CompMusicWorkshop, Istanbul 2012

Preeti Rao 2 nd CompMusicWorkshop, Istanbul 2012 Preeti Rao 2 nd CompMusicWorkshop, Istanbul 2012 o Music signal characteristics o Perceptual attributes and acoustic properties o Signal representations for pitch detection o STFT o Sinusoidal model o

More information

Speech Processing. Undergraduate course code: LASC10061 Postgraduate course code: LASC11065

Speech Processing. Undergraduate course code: LASC10061 Postgraduate course code: LASC11065 Speech Processing Undergraduate course code: LASC10061 Postgraduate course code: LASC11065 All course materials and handouts are the same for both versions. Differences: credits (20 for UG, 10 for PG);

More information

L19: Prosodic modification of speech

L19: Prosodic modification of speech L19: Prosodic modification of speech Time-domain pitch synchronous overlap add (TD-PSOLA) Linear-prediction PSOLA Frequency-domain PSOLA Sinusoidal models Harmonic + noise models STRAIGHT This lecture

More information

Performance Analysis of MFCC and LPCC Techniques in Automatic Speech Recognition

Performance Analysis of MFCC and LPCC Techniques in Automatic Speech Recognition www.ijecs.in International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume - 3 Issue - 8 August, 2014 Page No. 7727-7732 Performance Analysis of MFCC and LPCC Techniques in Automatic

More information

Improving Sound Quality by Bandwidth Extension

Improving Sound Quality by Bandwidth Extension International Journal of Scientific & Engineering Research, Volume 3, Issue 9, September-212 Improving Sound Quality by Bandwidth Extension M. Pradeepa, M.Tech, Assistant Professor Abstract - In recent

More information

Dimension Reduction of the Modulation Spectrogram for Speaker Verification

Dimension Reduction of the Modulation Spectrogram for Speaker Verification Dimension Reduction of the Modulation Spectrogram for Speaker Verification Tomi Kinnunen Speech and Image Processing Unit Department of Computer Science University of Joensuu, Finland Kong Aik Lee and

More information

Getting started with STRAIGHT in command mode

Getting started with STRAIGHT in command mode Getting started with STRAIGHT in command mode Hideki Kawahara Faculty of Systems Engineering, Wakayama University, Japan May 5, 27 Contents 1 Introduction 2 1.1 Highly reliable new F extractor and notes

More information

Application of velvet noise and its variants for synthetic speech and singing (Revised and extended version with appendices)

Application of velvet noise and its variants for synthetic speech and singing (Revised and extended version with appendices) Application of velvet noise and its variants for synthetic speech and singing (Revised and extended version with appendices) (Compiled: 1:3 A.M., February, 18) Hideki Kawahara 1,a) Abstract: The Velvet

More information

Digitized signals. Notes on the perils of low sample resolution and inappropriate sampling rates.

Digitized signals. Notes on the perils of low sample resolution and inappropriate sampling rates. Digitized signals Notes on the perils of low sample resolution and inappropriate sampling rates. 1 Analog to Digital Conversion Sampling an analog waveform Sample = measurement of waveform amplitude at

More information

Waveform generation based on signal reshaping. statistical parametric speech synthesis

Waveform generation based on signal reshaping. statistical parametric speech synthesis INTERSPEECH 2016 September 8 12, 2016, San Francisco, USA Waveform generation based on signal reshaping for statistical parametric speech synthesis Felipe Espic, Cassia Valentini-Botinhao, Zhizheng Wu,

More information

International Journal of Modern Trends in Engineering and Research e-issn No.: , Date: 2-4 July, 2015

International Journal of Modern Trends in Engineering and Research   e-issn No.: , Date: 2-4 July, 2015 International Journal of Modern Trends in Engineering and Research www.ijmter.com e-issn No.:2349-9745, Date: 2-4 July, 2015 Analysis of Speech Signal Using Graphic User Interface Solly Joy 1, Savitha

More information

INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET)

INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) Proceedings of the 2 nd International Conference on Current Trends in Engineering and Management ICCTEM -214 ISSN

More information

WaveNet Vocoder and its Applications in Voice Conversion

WaveNet Vocoder and its Applications in Voice Conversion The 2018 Conference on Computational Linguistics and Speech Processing ROCLING 2018, pp. 96-110 The Association for Computational Linguistics and Chinese Language Processing WaveNet WaveNet Vocoder and

More information

SGN Audio and Speech Processing

SGN Audio and Speech Processing SGN 14006 Audio and Speech Processing Introduction 1 Course goals Introduction 2! Learn basics of audio signal processing Basic operations and their underlying ideas and principles Give basic skills although

More information

Mel Spectrum Analysis of Speech Recognition using Single Microphone

Mel Spectrum Analysis of Speech Recognition using Single Microphone International Journal of Engineering Research in Electronics and Communication Mel Spectrum Analysis of Speech Recognition using Single Microphone [1] Lakshmi S.A, [2] Cholavendan M [1] PG Scholar, Sree

More information

Digital Speech Processing and Coding

Digital Speech Processing and Coding ENEE408G Spring 2006 Lecture-2 Digital Speech Processing and Coding Spring 06 Instructor: Shihab Shamma Electrical & Computer Engineering University of Maryland, College Park http://www.ece.umd.edu/class/enee408g/

More information

EE482: Digital Signal Processing Applications

EE482: Digital Signal Processing Applications Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu EE482: Digital Signal Processing Applications Spring 2014 TTh 14:30-15:45 CBC C222 Lecture 12 Speech Signal Processing 14/03/25 http://www.ee.unlv.edu/~b1morris/ee482/

More information

Signal Processing for Speech Applications - Part 2-1. Signal Processing For Speech Applications - Part 2

Signal Processing for Speech Applications - Part 2-1. Signal Processing For Speech Applications - Part 2 Signal Processing for Speech Applications - Part 2-1 Signal Processing For Speech Applications - Part 2 May 14, 2013 Signal Processing for Speech Applications - Part 2-2 References Huang et al., Chapter

More information

SPEECH TO SINGING SYNTHESIS SYSTEM. Mingqing Yun, Yoon mo Yang, Yufei Zhang. Department of Electrical and Computer Engineering University of Rochester

SPEECH TO SINGING SYNTHESIS SYSTEM. Mingqing Yun, Yoon mo Yang, Yufei Zhang. Department of Electrical and Computer Engineering University of Rochester SPEECH TO SINGING SYNTHESIS SYSTEM Mingqing Yun, Yoon mo Yang, Yufei Zhang Department of Electrical and Computer Engineering University of Rochester ABSTRACT This paper describes a speech-to-singing synthesis

More information

An Approach to Very Low Bit Rate Speech Coding

An Approach to Very Low Bit Rate Speech Coding Computing For Nation Development, February 26 27, 2009 Bharati Vidyapeeth s Institute of Computer Applications and Management, New Delhi An Approach to Very Low Bit Rate Speech Coding Hari Kumar Singh

More information

Determination of instants of significant excitation in speech using Hilbert envelope and group delay function

Determination of instants of significant excitation in speech using Hilbert envelope and group delay function Determination of instants of significant excitation in speech using Hilbert envelope and group delay function by K. Sreenivasa Rao, S. R. M. Prasanna, B.Yegnanarayana in IEEE Signal Processing Letters,

More information

Fundamental frequency estimation of speech signals using MUSIC algorithm

Fundamental frequency estimation of speech signals using MUSIC algorithm Acoust. Sci. & Tech. 22, 4 (2) TECHNICAL REPORT Fundamental frequency estimation of speech signals using MUSIC algorithm Takahiro Murakami and Yoshihisa Ishida School of Science and Technology, Meiji University,,

More information

Synchronous Overlap and Add of Spectra for Enhancement of Excitation in Artificial Bandwidth Extension of Speech

Synchronous Overlap and Add of Spectra for Enhancement of Excitation in Artificial Bandwidth Extension of Speech INTERSPEECH 5 Synchronous Overlap and Add of Spectra for Enhancement of Excitation in Artificial Bandwidth Extension of Speech M. A. Tuğtekin Turan and Engin Erzin Multimedia, Vision and Graphics Laboratory,

More information

Voice Conversion of Non-aligned Data using Unit Selection

Voice Conversion of Non-aligned Data using Unit Selection June 19 21, 2006 Barcelona, Spain TC-STAR Workshop on Speech-to-Speech Translation Voice Conversion of Non-aligned Data using Unit Selection Helenca Duxans, Daniel Erro, Javier Pérez, Ferran Diego, Antonio

More information

SPEECH AND SPECTRAL ANALYSIS

SPEECH AND SPECTRAL ANALYSIS SPEECH AND SPECTRAL ANALYSIS 1 Sound waves: production in general: acoustic interference vibration (carried by some propagation medium) variations in air pressure speech: actions of the articulatory organs

More information

A Pulse Model in Log-domain for a Uniform Synthesizer

A Pulse Model in Log-domain for a Uniform Synthesizer G. Degottex, P. Lanchantin, M. Gales A Pulse Model in Log-domain for a Uniform Synthesizer Gilles Degottex 1, Pierre Lanchantin 1, Mark Gales 1 1 Cambridge University Engineering Department, Cambridge,

More information

CS 188: Artificial Intelligence Spring Speech in an Hour

CS 188: Artificial Intelligence Spring Speech in an Hour CS 188: Artificial Intelligence Spring 2006 Lecture 19: Speech Recognition 3/23/2006 Dan Klein UC Berkeley Many slides from Dan Jurafsky Speech in an Hour Speech input is an acoustic wave form s p ee ch

More information

The Partly Preserved Natural Phases in the Concatenative Speech Synthesis Based on the Harmonic/Noise Approach

The Partly Preserved Natural Phases in the Concatenative Speech Synthesis Based on the Harmonic/Noise Approach The Partly Preserved Natural Phases in the Concatenative Speech Synthesis Based on the Harmonic/Noise Approach ZBYNĚ K TYCHTL Department of Cybernetics University of West Bohemia Univerzitní 8, 306 14

More information

A Comparative Performance of Various Speech Analysis-Synthesis Techniques

A Comparative Performance of Various Speech Analysis-Synthesis Techniques International Journal of Signal Processing Systems Vol. 2, No. 1 June 2014 A Comparative Performance of Various Speech Analysis-Synthesis Techniques Ankita N. Chadha, Jagannath H. Nirmal, and Pramod Kachare

More information

Emotional Voice Conversion Using Neural Networks with Different Temporal Scales of F0 based on Wavelet Transform

Emotional Voice Conversion Using Neural Networks with Different Temporal Scales of F0 based on Wavelet Transform 9th ISCA Speech Synthesis Workshop 13-15 Sep 216, Sunnyvale, USA Emotional Voice Conversion Using Neural Networks with Different Temporal Scales of F based on Wavelet Transform Zhaojie Luo 1, Jinhui Chen

More information

Sound Recognition. ~ CSE 352 Team 3 ~ Jason Park Evan Glover. Kevin Lui Aman Rawat. Prof. Anita Wasilewska

Sound Recognition. ~ CSE 352 Team 3 ~ Jason Park Evan Glover. Kevin Lui Aman Rawat. Prof. Anita Wasilewska Sound Recognition ~ CSE 352 Team 3 ~ Jason Park Evan Glover Kevin Lui Aman Rawat Prof. Anita Wasilewska What is Sound? Sound is a vibration that propagates as a typically audible mechanical wave of pressure

More information

Relative phase information for detecting human speech and spoofed speech

Relative phase information for detecting human speech and spoofed speech Relative phase information for detecting human speech and spoofed speech Longbiao Wang 1, Yohei Yoshida 1, Yuta Kawakami 1 and Seiichi Nakagawa 2 1 Nagaoka University of Technology, Japan 2 Toyohashi University

More information

USING A WHITE NOISE SOURCE TO CHARACTERIZE A GLOTTAL SOURCE WAVEFORM FOR IMPLEMENTATION IN A SPEECH SYNTHESIS SYSTEM

USING A WHITE NOISE SOURCE TO CHARACTERIZE A GLOTTAL SOURCE WAVEFORM FOR IMPLEMENTATION IN A SPEECH SYNTHESIS SYSTEM USING A WHITE NOISE SOURCE TO CHARACTERIZE A GLOTTAL SOURCE WAVEFORM FOR IMPLEMENTATION IN A SPEECH SYNTHESIS SYSTEM by Brandon R. Graham A report submitted in partial fulfillment of the requirements for

More information

Enhanced Waveform Interpolative Coding at 4 kbps

Enhanced Waveform Interpolative Coding at 4 kbps Enhanced Waveform Interpolative Coding at 4 kbps Oded Gottesman, and Allen Gersho Signal Compression Lab. University of California, Santa Barbara E-mail: [oded, gersho]@scl.ece.ucsb.edu Signal Compression

More information

Lecture 6: Speech modeling and synthesis

Lecture 6: Speech modeling and synthesis EE E682: Speech & Audio Processing & Recognition Lecture 6: Speech modeling and synthesis 1 2 3 4 5 Modeling speech signals Spectral and cepstral models Linear Predictive models (LPC) Other signal models

More information

Epoch Extraction From Emotional Speech

Epoch Extraction From Emotional Speech Epoch Extraction From al Speech D Govind and S R M Prasanna Department of Electronics and Electrical Engineering Indian Institute of Technology Guwahati Email:{dgovind,prasanna}@iitg.ernet.in Abstract

More information

A Method for Voiced/Unvoiced Classification of Noisy Speech by Analyzing Time-Domain Features of Spectrogram Image

A Method for Voiced/Unvoiced Classification of Noisy Speech by Analyzing Time-Domain Features of Spectrogram Image Science Journal of Circuits, Systems and Signal Processing 2017; 6(2): 11-17 http://www.sciencepublishinggroup.com/j/cssp doi: 10.11648/j.cssp.20170602.12 ISSN: 2326-9065 (Print); ISSN: 2326-9073 (Online)

More information

Lecture 5: Speech modeling. The speech signal

Lecture 5: Speech modeling. The speech signal EE E68: Speech & Audio Processing & Recognition Lecture 5: Speech modeling 1 3 4 5 Modeling speech signals Spectral and cepstral models Linear Predictive models (LPC) Other signal models Speech synthesis

More information

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 8, NOVEMBER

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 8, NOVEMBER IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 19, NO. 8, NOVEMBER 2011 2439 Transcribing Mandarin Broadcast Speech Using Multi-Layer Perceptron Acoustic Features Fabio Valente, Member,

More information

Applying the Harmonic Plus Noise Model in Concatenative Speech Synthesis

Applying the Harmonic Plus Noise Model in Concatenative Speech Synthesis IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, VOL. 9, NO. 1, JANUARY 2001 21 Applying the Harmonic Plus Noise Model in Concatenative Speech Synthesis Yannis Stylianou, Member, IEEE Abstract This paper

More information

Determination of Variation Ranges of the Psola Transformation Parameters by Using Their Influence on the Acoustic Parameters of Speech

Determination of Variation Ranges of the Psola Transformation Parameters by Using Their Influence on the Acoustic Parameters of Speech Determination of Variation Ranges of the Psola Transformation Parameters by Using Their Influence on the Acoustic Parameters of Speech L. Demri1, L. Falek2, H. Teffahi3, and A.Djeradi4 Speech Communication

More information

A simple RNN-plus-highway network for statistical

A simple RNN-plus-highway network for statistical ISSN 1346-5597 NII Technical Report A simple RNN-plus-highway network for statistical parametric speech synthesis Xin Wang, Shinji Takaki, Junichi Yamagishi NII-2017-003E Apr. 2017 A simple RNN-plus-highway

More information

STRAIGHT, exploitation of the other aspect of VOCODER: Perceptually isomorphic decomposition of speech sounds

STRAIGHT, exploitation of the other aspect of VOCODER: Perceptually isomorphic decomposition of speech sounds INVITED REVIEW STRAIGHT, exploitation of the other aspect of VOCODER: Perceptually isomorphic decomposition of speech sounds Hideki Kawahara Faculty of Systems Engineering, Wakayama University, 930 Sakaedani,

More information

HIGH-RESOLUTION SINUSOIDAL MODELING OF UNVOICED SPEECH. George P. Kafentzis and Yannis Stylianou

HIGH-RESOLUTION SINUSOIDAL MODELING OF UNVOICED SPEECH. George P. Kafentzis and Yannis Stylianou HIGH-RESOLUTION SINUSOIDAL MODELING OF UNVOICED SPEECH George P. Kafentzis and Yannis Stylianou Multimedia Informatics Lab Department of Computer Science University of Crete, Greece ABSTRACT In this paper,

More information

Spectral estimation using higher-lag autocorrelation coefficients with applications to speech recognition

Spectral estimation using higher-lag autocorrelation coefficients with applications to speech recognition Spectral estimation using higher-lag autocorrelation coefficients with applications to speech recognition Author Shannon, Ben, Paliwal, Kuldip Published 25 Conference Title The 8th International Symposium

More information

Project 0: Part 2 A second hands-on lab on Speech Processing Frequency-domain processing

Project 0: Part 2 A second hands-on lab on Speech Processing Frequency-domain processing Project : Part 2 A second hands-on lab on Speech Processing Frequency-domain processing February 24, 217 During this lab, you will have a first contact on frequency domain analysis of speech signals. You

More information

The NII speech synthesis entry for Blizzard Challenge 2016

The NII speech synthesis entry for Blizzard Challenge 2016 The NII speech synthesis entry for Blizzard Challenge 2016 Lauri Juvela 1, Xin Wang 2,3, Shinji Takaki 2, SangJin Kim 4, Manu Airaksinen 1, Junichi Yamagishi 2,3,5 1 Aalto University, Department of Signal

More information

Linguistic Phonetics. Spectral Analysis

Linguistic Phonetics. Spectral Analysis 24.963 Linguistic Phonetics Spectral Analysis 4 4 Frequency (Hz) 1 Reading for next week: Liljencrants & Lindblom 1972. Assignment: Lip-rounding assignment, due 1/15. 2 Spectral analysis techniques There

More information

Acoustic Phonetics. Chapter 8

Acoustic Phonetics. Chapter 8 Acoustic Phonetics Chapter 8 1 1. Sound waves Vocal folds/cords: Frequency: 300 Hz 0 0 0.01 0.02 0.03 2 1.1 Sound waves: The parts of waves We will be considering the parts of a wave with the wave represented

More information

A Very Low Bit Rate Speech Coder Based on a Recognition/Synthesis Paradigm

A Very Low Bit Rate Speech Coder Based on a Recognition/Synthesis Paradigm 482 IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, VOL. 9, NO. 5, JULY 2001 A Very Low Bit Rate Speech Coder Based on a Recognition/Synthesis Paradigm Ki-Seung Lee, Member, IEEE, and Richard V. Cox,

More information

Auto Regressive Moving Average Model Base Speech Synthesis for Phoneme Transitions

Auto Regressive Moving Average Model Base Speech Synthesis for Phoneme Transitions IOSR Journal of Computer Engineering (IOSR-JCE) e-iss: 2278-0661,p-ISS: 2278-8727, Volume 19, Issue 1, Ver. IV (Jan.-Feb. 2017), PP 103-109 www.iosrjournals.org Auto Regressive Moving Average Model Base

More information

A NEW FEATURE VECTOR FOR HMM-BASED PACKET LOSS CONCEALMENT

A NEW FEATURE VECTOR FOR HMM-BASED PACKET LOSS CONCEALMENT A NEW FEATURE VECTOR FOR HMM-BASED PACKET LOSS CONCEALMENT L. Koenig (,2,3), R. André-Obrecht (), C. Mailhes (2) and S. Fabre (3) () University of Toulouse, IRIT/UPS, 8 Route de Narbonne, F-362 TOULOUSE

More information

/$ IEEE

/$ IEEE 614 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 4, MAY 2009 Event-Based Instantaneous Fundamental Frequency Estimation From Speech Signals B. Yegnanarayana, Senior Member,

More information

Investigating Very Deep Highway Networks for Parametric Speech Synthesis

Investigating Very Deep Highway Networks for Parametric Speech Synthesis 9th ISCA Speech Synthesis Workshop September, Sunnyvale, CA, USA Investigating Very Deep Networks for Parametric Speech Synthesis Xin Wang,, Shinji Takaki, Junichi Yamagishi,, National Institute of Informatics,

More information

NOTICE WARNING CONCERNING COPYRIGHT RESTRICTIONS: The copyright law of the United States (title 17, U.S. Code) governs the making of photocopies or

NOTICE WARNING CONCERNING COPYRIGHT RESTRICTIONS: The copyright law of the United States (title 17, U.S. Code) governs the making of photocopies or NOTICE WARNING CONCERNING COPYRIGHT RESTRICTIONS: The copyright law of the United States (title 17, U.S. Code) governs the making of photocopies or other reproductions of copyrighted material. Any copying

More information

Speech/Non-speech detection Rule-based method using log energy and zero crossing rate

Speech/Non-speech detection Rule-based method using log energy and zero crossing rate Digital Speech Processing- Lecture 14A Algorithms for Speech Processing Speech Processing Algorithms Speech/Non-speech detection Rule-based method using log energy and zero crossing rate Single speech

More information

Real time noise-speech discrimination in time domain for speech recognition application

Real time noise-speech discrimination in time domain for speech recognition application University of Malaya From the SelectedWorks of Mokhtar Norrima January 4, 2011 Real time noise-speech discrimination in time domain for speech recognition application Norrima Mokhtar, University of Malaya

More information

EE 225D LECTURE ON SYNTHETIC AUDIO. University of California Berkeley

EE 225D LECTURE ON SYNTHETIC AUDIO. University of California Berkeley University of California Berkeley College of Engineering Department of Electrical Engineering and Computer Sciences Professors : N.Morgan / B.Gold EE225D Synthetic Audio Spring,1999 Lecture 2 N.MORGAN

More information

Reading: Johnson Ch , Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday.

Reading: Johnson Ch , Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday. L105/205 Phonetics Scarborough Handout 7 10/18/05 Reading: Johnson Ch.2.3.3-2.3.6, Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday Spectral Analysis 1. There are

More information

Announcements. Today. Speech and Language. State Path Trellis. HMMs: MLE Queries. Introduction to Artificial Intelligence. V22.

Announcements. Today. Speech and Language. State Path Trellis. HMMs: MLE Queries. Introduction to Artificial Intelligence. V22. Introduction to Artificial Intelligence Announcements V22.0472-001 Fall 2009 Lecture 19: Speech Recognition & Viterbi Decoding Rob Fergus Dept of Computer Science, Courant Institute, NYU Slides from John

More information

EE 225D LECTURE ON MEDIUM AND HIGH RATE CODING. University of California Berkeley

EE 225D LECTURE ON MEDIUM AND HIGH RATE CODING. University of California Berkeley University of California Berkeley College of Engineering Department of Electrical Engineering and Computer Sciences Professors : N.Morgan / B.Gold EE225D Spring,1999 Medium & High Rate Coding Lecture 26

More information

LAB 2 SPECTRUM ANALYSIS OF PERIODIC SIGNALS

LAB 2 SPECTRUM ANALYSIS OF PERIODIC SIGNALS Eastern Mediterranean University Faculty of Engineering Department of Electrical and Electronic Engineering EENG 360 Communication System I Laboratory LAB 2 SPECTRUM ANALYSIS OF PERIODIC SIGNALS General

More information

Artificial Bandwidth Extension Using Deep Neural Networks for Spectral Envelope Estimation

Artificial Bandwidth Extension Using Deep Neural Networks for Spectral Envelope Estimation Platzhalter für Bild, Bild auf Titelfolie hinter das Logo einsetzen Artificial Bandwidth Extension Using Deep Neural Networks for Spectral Envelope Estimation Johannes Abel and Tim Fingscheidt Institute

More information

Epoch Extraction From Speech Signals K. Sri Rama Murty and B. Yegnanarayana, Senior Member, IEEE

Epoch Extraction From Speech Signals K. Sri Rama Murty and B. Yegnanarayana, Senior Member, IEEE 1602 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 16, NO. 8, NOVEMBER 2008 Epoch Extraction From Speech Signals K. Sri Rama Murty and B. Yegnanarayana, Senior Member, IEEE Abstract

More information

A DEVICE FOR AUTOMATIC SPEECH RECOGNITION*

A DEVICE FOR AUTOMATIC SPEECH RECOGNITION* EVICE FOR UTOTIC SPEECH RECOGNITION* ats Blomberg and Kjell Elenius INTROUCTION In the following a device for automatic recognition of isolated words will be described. It was developed at The department

More information

Telecommunication Electronics

Telecommunication Electronics Politecnico di Torino ICT School Telecommunication Electronics C5 - Special A/D converters» Logarithmic conversion» Approximation, A and µ laws» Differential converters» Oversampling, noise shaping Logarithmic

More information

About waves. Sounds of English. Different types of waves. Ever done the wave?? Why do we care? Tuning forks and pendulums

About waves. Sounds of English. Different types of waves. Ever done the wave?? Why do we care? Tuning forks and pendulums bout waves Sounds of English Topic 7 The acoustics of speech: Sound Waves Lots of examples in the world around us! an take all sorts of different forms Definition: disturbance that travels through a medium

More information

Speech Signal Analysis

Speech Signal Analysis Speech Signal Analysis Hiroshi Shimodaira and Steve Renals Automatic Speech Recognition ASR Lectures 2&3 14,18 January 216 ASR Lectures 2&3 Speech Signal Analysis 1 Overview Speech Signal Analysis for

More information

Learning to Unlearn and Relearn Speech Signal Processing using Neural Networks: current and future perspectives

Learning to Unlearn and Relearn Speech Signal Processing using Neural Networks: current and future perspectives Learning to Unlearn and Relearn Speech Signal Processing using Neural Networks: current and future perspectives Mathew Magimai Doss Collaborators: Vinayak Abrol, Selen Hande Kabil, Hannah Muckenhirn, Dimitri

More information

Light Supervised Data Selection, Voice Quality Normalized Training and Log Domain Pulse Synthesis

Light Supervised Data Selection, Voice Quality Normalized Training and Log Domain Pulse Synthesis Light Supervised Data Selection, Voice Quality Normalized Training and Log Domain Pulse Synthesis Gilles Degottex, Pierre Lanchantin, Mark Gales University of Cambridge, United Kingdom gad27@cam.ac.uk,

More information

Chapter 1: Introduction to audio signal processing

Chapter 1: Introduction to audio signal processing Chapter 1: Introduction to audio signal processing KH WONG, Rm 907, SHB, CSE Dept. CUHK, Email: khwong@cse.cuhk.edu.hk http://www.cse.cuhk.edu.hk/~khwong/cmsc5707 Audio signal proce ssing Ch1, v.3c 1 Reference

More information

speech signal S(n). This involves a transformation of S(n) into another signal or a set of signals

speech signal S(n). This involves a transformation of S(n) into another signal or a set of signals 16 3. SPEECH ANALYSIS 3.1 INTRODUCTION TO SPEECH ANALYSIS Many speech processing [22] applications exploits speech production and perception to accomplish speech analysis. By speech analysis we extract

More information

Vancura Innovations, LLC. Imagination is more important than knowledge until you have to build what you ve imagined. Channel Talker 4DAP

Vancura Innovations, LLC. Imagination is more important than knowledge until you have to build what you ve imagined. Channel Talker 4DAP Vancura Innovations, LLC Imagination is more important than knowledge until you have to build what you ve imagined. Channel Talker 4DAP Test Tone Generator With Two Digital Stereo Channels, Four Analog

More information

SOURCE-filter modeling of speech is based on exciting. Glottal Spectral Separation for Speech Synthesis

SOURCE-filter modeling of speech is based on exciting. Glottal Spectral Separation for Speech Synthesis IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING 1 Glottal Spectral Separation for Speech Synthesis João P. Cabral, Korin Richmond, Member, IEEE, Junichi Yamagishi, Member, IEEE, and Steve Renals,

More information

Power Normalized Cepstral Coefficient for Speaker Diarization and Acoustic Echo Cancellation

Power Normalized Cepstral Coefficient for Speaker Diarization and Acoustic Echo Cancellation Power Normalized Cepstral Coefficient for Speaker Diarization and Acoustic Echo Cancellation Sherbin Kanattil Kassim P.G Scholar, Department of ECE, Engineering College, Edathala, Ernakulam, India sherbin_kassim@yahoo.co.in

More information

Single Channel Speaker Segregation using Sinusoidal Residual Modeling

Single Channel Speaker Segregation using Sinusoidal Residual Modeling NCC 2009, January 16-18, IIT Guwahati 294 Single Channel Speaker Segregation using Sinusoidal Residual Modeling Rajesh M Hegde and A. Srinivas Dept. of Electrical Engineering Indian Institute of Technology

More information

GROUP 741, Improvement of noise robustness of a small vocabulary speech recognition system

GROUP 741, Improvement of noise robustness of a small vocabulary speech recognition system GROUP 741, 28 1 Improvement of noise robustness of a small vocabulary speech recognition system Andreas Corneliussen, Brian Melgaard Christensen, Helge Glinvad Grøn, Palle Tofteng Andreasen, Troels Torkil

More information

Non-stationary Analysis/Synthesis using Spectrum Peak Shape Distortion, Phase and Reassignment

Non-stationary Analysis/Synthesis using Spectrum Peak Shape Distortion, Phase and Reassignment Non-stationary Analysis/Synthesis using Spectrum Peak Shape Distortion, Phase Reassignment Geoffroy Peeters, Xavier Rodet Ircam - Centre Georges-Pompidou, Analysis/Synthesis Team, 1, pl. Igor Stravinsky,

More information

Automatic Evaluation of Hindustani Learner s SARGAM Practice

Automatic Evaluation of Hindustani Learner s SARGAM Practice Automatic Evaluation of Hindustani Learner s SARGAM Practice Gurunath Reddy M and K. Sreenivasa Rao Indian Institute of Technology, Kharagpur, India {mgurunathreddy, ksrao}@sit.iitkgp.ernet.in Abstract

More information

Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis

Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis IEEE TRANSACTIONS ON AUDIO, SPEECH AND LANGUAGE PROCESSING 1 Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis Carlos Busso, Student Member, IEEE, Zhigang Deng, Student Member, IEEE,

More information

Communications Theory and Engineering

Communications Theory and Engineering Communications Theory and Engineering Master's Degree in Electronic Engineering Sapienza University of Rome A.A. 2018-2019 Speech and telephone speech Based on a voice production model Parametric representation

More information

Overview of Code Excited Linear Predictive Coder

Overview of Code Excited Linear Predictive Coder Overview of Code Excited Linear Predictive Coder Minal Mulye 1, Sonal Jagtap 2 1 PG Student, 2 Assistant Professor, Department of E&TC, Smt. Kashibai Navale College of Engg, Pune, India Abstract Advances

More information

System Fusion for High-Performance Voice Conversion

System Fusion for High-Performance Voice Conversion System Fusion for High-Performance Voice Conversion Xiaohai Tian 1,2, Zhizheng Wu 3, Siu Wa Lee 4, Nguyen Quy Hy 1,2, Minghui Dong 4, and Eng Siong Chng 1,2 1 School of Computer Engineering, Nanyang Technological

More information

Pulse Code Modulation

Pulse Code Modulation Pulse Code Modulation Modulation is the process of varying one or more parameters of a carrier signal in accordance with the instantaneous values of the message signal. The message signal is the signal

More information

Hungarian Speech Synthesis Using a Phase Exact HNM Approach

Hungarian Speech Synthesis Using a Phase Exact HNM Approach Hungarian Speech Synthesis Using a Phase Exact HNM Approach Kornél Kovács 1, András Kocsor 2, and László Tóth 3 Research Group on Artificial Intelligence of the Hungarian Academy of Sciences and University

More information

Formant Estimation and Tracking using Deep Learning

Formant Estimation and Tracking using Deep Learning Formant Estimation and Tracking using Deep Learning Yehoshua Dissen and Joseph Keshet Department of Computer Science Bar-Ilan University, Ramat-Gan, Israel disseny1@cs.biu.ac.il, joseph.keshet@biu.ac.il

More information

A Multipitch Tracking Algorithm for Noisy Speech

A Multipitch Tracking Algorithm for Noisy Speech IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, VOL. 11, NO. 3, MAY 2003 229 A Multipitch Tracking Algorithm for Noisy Speech Mingyang Wu, Student Member, IEEE, DeLiang Wang, Senior Member, IEEE, and

More information