ECE 556 BASICS OF DIGITAL SPEECH PROCESSING. Assıst.Prof.Dr. Selma ÖZAYDIN Spring Term-2017 Lecture 2

Size: px

Start display at page:

Download "ECE 556 BASICS OF DIGITAL SPEECH PROCESSING. Assıst.Prof.Dr. Selma ÖZAYDIN Spring Term-2017 Lecture 2"

Mary Parks
5 years ago
Views:

1 ECE 556 BASICS OF DIGITAL SPEECH PROCESSING Assıst.Prof.Dr. Selma ÖZAYDIN Spring Term-2017 Lecture 2

2 Analog Sound to Digital Sound

3 Characteristics of Sound Amplitude Wavelength (w) Frequency ( ) Timbre Hearing: [20Hz 20KHz] Speech: [200Hz 8KHz]

4 Digital Representation of Audio Must convert wave form to digital sample quantize compress

5 Signal Sampling Measure amplitude at regular intervals Sampling is converting a continuous time signal into a discrete time signal Categories: Impulse (ideal) sampling Natural Sampling Sample and Hold operation

6 Impulse Sampling

7 Impulse Sampling Impulse train spaced at T s multiplies the signal x(t) in time domain, creating discrete time, continuous amplitude signal x s (t) Impulse train spaced at f s convolutes the signal X(f) in frequency domain, creating Repeating spectrum X s (f) spaced at f s

8 The Aliasing Effect f s > 2f m f s < 2f m Aliasing happens

9 Aliasing Under sampling will result in aliasing that will create spectral overlap

10 Ideal Sampling and Aliasing Sampled signal is discrete in time domain with spacing T s Spectrum will repeat for every f s Hz Aliasing (spectral overlapping) if f s is too small (f s < 2f m ) Nyquist sampling rate f s = 2f m Generally oversampling is done f s > 2f m

11 Natural Sampling

12 Natural Sampling Sampling pulse train has a finite width τ Sampled spectrum will repeat itself with a Sinc envelope More realistic modeling Distortion after recovery depends on τ/t s

13 Different Sampling Models

14 Nyquist Theorem For lossless digitization, the sampling rate should be at least twice the maximum frequency response. In mathematical terms: f s > 2*f m where f s is sampling frequency and f m is the maximum frequency in the signal

15 Nyquist Limit max data rate = 2 H log 2 V bits/second, where H = bandwidth (in Hz) V = discrete levels (bits per signal change) Shows the maximum number of bits that can be sent per second on a noiseless channel with a bandwidth of H, if V bits are sent per signal Example: what is the maximum data rate for a 3kHz channel that transmits data using 2 levels (binary)? Solution: H = 3kHz; V = 2; max. data rate = 2x3,000xln2=6,000bits/second

16 Limited Sampling But what if one cannot sample fast enough? Reduce signal frequency to half of maximum sampling frequency low-pass filter removes higher-frequencies e.g., if max sampling frequency is 22kHz, must low-pass filter a signal down to 11kHz

17 Sampling Ranges Auditory range 20Hz to khz must sample up to to 44.1kHz common examples are khz, khz, khz, khz, and 44.1 KHz Speech frequency [200 Hz, 8 khz] sample up to 16 khz but typically 4 khz to 11 khz is used

22 Sampling Quantization Mapping Quantization Quantization is done to make the signal amplitude discrete Analog Signal Discrete Time Cont. Ampl. Signal Discrete Time & Discrete Ampl Signal Binary Sequence

24 Sampling and 4-bit quantization

25 Quantization Typically use 8 bits = 256 levels 16 bits = 65,536 levels How should the levels be distributed? Linearly? (PCM) Perceptually? (u-law) Differential? (DPCM) Adaptively? (ADPCM)

27 Linear Quantization L levels (L-1)q = 2V p = V pp For large L Lq V pp

28 Linear Quantization Summary Mean Squared Error (MSE) = q 2 /12 Mean signal power = E[m 2 (t)] Mean SNR = 12 E[m 2 (t)]/q 2 For binary PCM, L = 2 n n bits/sample Let signal bandwidth = B Hz If Nyquist sampling 2B samples/sec If 20% oversampling 1.2(2B) samples/sec Bit rate = 2nB bits/sec Required channel bandwidth = nb Hz

48 Pulse Code Modulation Pulse modulation Use discrete time samples of analog signals Transmission is composed of analog information sent at different times Variation of pulse amplitude or pulse timing allowed to vary continuously over all values PCM Analog signal is quantized into a number of discrete levels CS Spring 2012

49 PCM Mapping

50 PCM Quantization and Digitization Quantization Digitization

51 Quantization Index Linear Quantization (PCM) Divide amplitude spectrum into N units (for log 2 N bit quantization) Sound Intensity

52 Non-uniform Quantization

53 Non-Uniform Quantization In speech signals, very low speech volumes predominates Only 15% of the time, the voltage exceeds the RMS value These low level signals are under represented with uniform quantization Same noise power (q 2 /12) but low signal power The answer is non uniform quantization

54 Non-uniform Quantization Compress the signal first Then perform linear quantization Result in nonlinear quantization

55 Uniform Non-Uniform

56 Quantization Index Perceptual Quantization (u-law) Want intensity values logarithmically mapped over N quantization units Sound Intensity

57 µ-law and A-law Widely used compression algorithms

58 Differential Pulse Code Modulation (DPCM) What if we look at sample differences, not the samples themselves? d t = x t -x t-1 Differences tend to be smaller Use 4 bits instead of 12, maybe?

59 Differential Pulse Code Modulation (DPCM) Changes between adjacent samples small Send value, then relative changes value uses full bits, changes use fewer bits E.g., 220, 218, 221, 219, 220, 221, 222, 218,.. (all values between 218 and 222) Difference sequence sent: 220, +2, -3, 2, -1, -1, -1, Result: originally for encoding sequence numbers need 8 bits; Difference coding: need only 3 bits

60 Adaptive Differential Pulse Code Modulation (ADPCM) Adaptive similar to DPCM, but adjusts the width of the quantization steps Encode difference in 4 bits, but vary the mapping of bits to difference dynamically If rapid change, use large differences If slow change, use small differences

61 Signal-to-Noise Ratio (metric to quantify quality of digital audio)

62 Signal To Noise Ratio Measures strength of signal to noise SNR (in DB)= Signal energy 10log10( Noiseenergy Given sound form with amplitude in [-A, A] ) Signal energy = 2 A 2 A CS Spring A

63 Quantization Error Difference between actual and sampled value amplitude between [-A, A] quantization levels = N 2A N e.g., if A = 1, N = 8, = 1/ CS Spring

64 Compute Signal to Noise Ratio Signal energy = ; Noise energy = ; A A N Noise energy = 2 A 3 N 2 Signal to noise = 2 3N 10log 2 Every bit increases SNR by ~ 6 decibels

65 Example Consider a full load sinusoidal modulating signal of amplitude A, which utilizes all the representation levels provided The average signal power is P= A 2 /2 The total range of quantizer is 2A because modulating signal swings between A and A. Therefore, if it is N=16 (4-bit quantizer), Δ = 2A/2 4 = A/8 The quantization noise is Δ 2 /12 = A 2 /768 The S/N ratio is (A 2 /2)/(A 2 /768) = 384; SNR (in db) 25.8 db

66 Data Rates Data rate = sample rate * quantization * channel Compare rates for CD vs. mono audio 8000 samples/second * 8 bits/sample * 1 channel = 8 kbytes / second 44,100 samples/second * 16 bits/sample * 2 channel = 176 kbytes / second ~= 10MB / minute

67 Comparison and Sampling/Coding Techniques CS Spring 2012

68 Summary

Digital Audio. Lecture-6

Digital Audio. Lecture-6 Digital Audio Lecture-6 Topics today Digitization of sound PCM Lossless predictive coding 2 Sound Sound is a pressure wave, taking continuous values Increase / decrease in pressure can be measured in amplitude,