LAB 2 Machine Perception of Music Computer Science 395, Winter Quarter 2005
|
|
- Silas Newton
- 5 years ago
- Views:
Transcription
1 1.0 Lab overview and objectives This lab will introduce you to displaying and analyzing sounds with spectrograms, with an emphasis on getting a feel for the relationship between harmonicity, pitch, and frequency. Lab due time/date: 2PM, January 24, 2005 What to hand in: A text file containing short answers (at least a sentence, no more than a paragraph, except where noted) to each question in each section of this lab. Format of required submission: an attachment to the course address (cs395-23@cs.northwestern.edu). DON T ZIP YOUR ATTACHMENT! For some reason, the mail server is giving us problems with zipped attachments. 2.0 The spectrogram The MATLAB Signal Processing Toolbox provides a function, specgram, that returns the time-dependent Fourier transform for a sequence, or displays this information as a spectrogram. For your convenience, I have appended the MATLAB help page for specgram to the end of this document. You will need to consult this page. The time-dependent Fourier transform is the discrete-time Fourier transform for a sequence, computed using a sliding window. This form of the Fourier transform, also known as the short-time Fourier transform (STFT), has numerous applications in speech, sonar, and radar processing. You will explore some of these applications in this lab. The specgram function calculates the spectrogram for a given signal as follows (yes, this is drawn from the help page): 1. It splits the signal into overlapping sections and applies the window specified by the window parameter to each section. 2. It computes the discrete-time Fourier transform of each section with a length nfft FFT to produce an estimate of the short-term frequency content of the signal; these transforms make up the columns of B (see the MATLAB help page for specgram). The quantity (length(window) - numoverlap) specifies by how many samples specgram shifts the window. 3. For real input, specgram truncates the spectrogram to the first nfft/2 + 1 points for nfft even and (nfft + 1)/2 for nfft odd. All audio signals are real (as opposed to real + imaginary). As a first step to using specgram, copy the following into a simple MATLAB file It doesn t have to be a function, just save this as a.m file, put it on the MATLAB path, and then run the file by typing its name (without the.m extension).
2 % first, make the pitch using the function you made in lab 1 duration = 0.5; %the duration, in seconds, of the sound Fs = 8000; % the sample frequency, in Hz of the sound soundfreq = 440; % the frequency, in Hz of the pitch y = makepitch(duration,fs, 440); % now create a spectrogram and display it numberoffrequencybins = 500; windowfunction = hanning(numberoffrequencybins); specgram(y, numberoffrequencybins, samplefreq, windowfunction); When you run the file, you will see an image like the one below. In this image, the frequency of the signal is indicated by the strong red line Frequency Time MATLAB has a number of built in audio signals that you can play with. Load the laughter signal by typing the following: load laughter Try playing it and displaying it with the spectrogram. Once you have done that, try loading the chirp signal in the same way, and seeing what its spectrogram looks like. The spectrogram shows the estimate of the relative amplitudes of a set of sinusoids used to approximate the wave form analyzed. In order to see the information about the set of sinusoids used to approximate the wave, add the following to your.m file. (Note: the indicates a line continuation)
3 % now get the values corresponding to the image [B,frequencies,times] = specgram(y, numberoffrequencybins, Fs, windowfunction); amps = 20*log10(abs(B)); Once you run the file, you will have three new MATLAB variables in your environment. The variable amps contains a two dimensional array of values, each of which contains a real and imaginary part. For our purposes, we will ignore the imaginary portion of each value. The value B(i,j) contains phase and amplitude information for the ith window and the jth sinusoid in that window. Typically, we are interested only in the amplitude of the real portion of the values in B. This information is contained in amps. The variable frequencies contains the frequencies of the sinusoids used to analyze the sound, and frequencies(j) contains the frequency of the jth sinusoid. Similarly, times contains center times for the analysis windows. Thus, times(i) gives the time of the ith window. QUESTION 2.1 If you look at the contents of frequencies, you will notice that 440Hz is NOT among the frequencies used to analyze the sound you created. The spacing between the analysis frequencies determines the frequency resolution of the spectrogram. What is the frequency resolution of the spectrogram? The bins are spaced 16 Hz apart. QUESTION 2.2 Modify the number of frequency bins by modifying the MATLAB script you were given. Include the modified script as your answer to this question. They need to change numberoffrequencybins to some other value. An example would be. numberoffrequencybins = 1000; QUESTION 2.3 What number of bins seems sufficient to determine the frequency of the singal within 2 Hz? Change numberoffrequencybins to be 4000 bins because this makes the spacing between bin centers = 2 Hz. Another acceptable answer is 2000 bins because that gives you + or 2 Hz. 3.0 Window functions The code for spectrogram generation uses a window function. You can plot the window function by typing the following: plot(windowfunction) QUESTION 3.1 What shape is this window function? Any answer that sounded like bell curve or Gaussian is good. QUESTION 3.2 There are a number of other window functions that could be used. The most obvious is the boxcar window. In your MATLAB script, replace hanning with boxcar. Now run the script again. What happens to the spectrogram?
4 4000 boxcar Frequency Time Above is the spectrogram when you replace hanning with rectwin or boxcar in the script from section 2. You should indicate they notice energy happening at other places where they know the frequency of the signal has no energy. Notice the strong energy on alternating windows happening in frequencies where we know there shouldn t be any energy. QUESTION 3.3 Does the spectrogram using the boxcar window look more or less accurate than the one with the hanning window? The right answer is less QUESTION 3.4 What does the boxcar window function look like? A rectangle. A flat line. Something like that is the right answer. QUESTION 3.5 Now replace boxcar with triang and re-run your script. What happens to the spectrogram? What does the triang window function look like? It looks like a triangle and the spectrum gets more accurate. In other words, the strong vertical bands you see happening in the boxcar spectrogram get much weaker.but I won t be a big stickler for more accurate. Here is what the triang window makes the spectrogram looks like.
5 4000 triang Frequency Time QUESTION 3.6 Which window function seemed to produce the best result? Which produced the worst? Best = Hanning Worst = boxcar (rectangle) 4.0 Pitch and the missing fundamental frequency Create a signal of frequency 262 Hz using the makepitch function. Now listen to it, using soundsc. You should hear Middle C on the piano. Display it with the spectrogram function, to double check that you have created a signal of the frequency you expect. Now create two new signals at the frequencies 262*3 = 786 Hz and 262*5 = 1310These are multiples of 262, but not related by a power of two to the frequency 262.Thus, they are harmonics of Middle C, but are NOT frequencies associated with the pitch class of C Play each of these harmonics individually, using soundsc. Now, create a composite signal by adding the two harmonics together and play the resulting signal. Compare its pitch to the pitch for a sine wave of 262 Hz. Compare the pitch of the composite signal to the pitch of the of the signals used to create it. QUESTION 4.1 Do you hear a single pitch? Actually, either Yes or No is an OK answer here. It depends on the person. QUESTION 4.2 Do you hear a pitch that is not contained in either of the harmonics you just added together? Either answer is also OK as people vary on this point. QUESTION 4.3 If you do hear an additional pitch; is this pitch higher or lower than the 786 Hz tone?
6 The right answer is lower If you claimed not to hear an additional pitch, then you should say this question does not apply or something like that. If you want to argue higher then they need to talk to me, as MANY perceptual tests are on my side for this. QUESTION 4.3 Look at the composite sound with a spectrogram. How many frequencies with strong components are displayed in the spectrogram? The answer is 2. QUESTION 4.4 If you add additional harmonics, what happens to the pitch? (Don t guess, TRY it) Those who didn t hear an additional pitch may now hear the additional pitch. Others are probably going to talk about timbre. Anything that sounds like they are trying is fine. 5.0 Non harmonic tones Harmonic sounds are generally considered to be sounds whose primary frequency components are all integer multiples of a fundamental frequency within the range of human hearing (20 to 20,000 Hz). Create several sinusoids, using makepitch, at the following frequencies: 262, 500, 607, 714. Add these together and listen to the result. QUESTION 5.1 Does the resulting sound seem to have a single pitch? The answer is NO Now create a random signal (also known as white noise ) by using the rand function. y = rand(8000,1); QUESTION 5.2 Play the rand signal. What sounds does it remind you of? Any answer like white noise or rain or the ocean is good. These are all random sounds. QUESTION 5.3 Does the rand signal sound like it has a pitch? The answer is NO QUESTION 5.4 Now display the rand signal with a spectrogram. What does the spectrogram look like? Describe what you see. It has energy all across the spectrum with no clear band. QUESTION 5.5 Now display the laughter signal from section 2. What does the spectrogram look like? There is vertical striping. There is more energy below 2000 Hz. There are some (not very clear) horizontal bands that move up and down a bit. QUESTION 5.6 Does the laughter signal sound like it has a pitch? The answer is NO
7 6.0 Finding the pitch LAB 2 This section requires several.wav files, downloaded from the web. Go to the course home page and click on the link labeled Lab 2 audio files to reach these files. These will be made available on Tuesday, January 18, QUESTION 6.1 Sounds that have a pitch are harmonic sounds. Harmonic sounds consist primarily of energy concentrated at frequencies that are simple integer multiples of a fundamental frequency, f, in the range of human hearing. Write out a series of instructions to explain to another person how to determine whether a sound is harmonic or not. Assume they know what a spectrogram is. This explanation should be fairly detailed, taking about ½ a page. Here is an example answer. 1) Look at the spectrogram by running specgram on the sound. 2) Look to see if there are regularly spaced (spacing in the vertical dimension) horizontal lines of strong energy (coded as red in the default spectrogram). 3) In a section of the sound where there are obvious horizontal bands, take find the frequency of each of these horizontal bands and record the value in Hertz. 3B) OPTIONALLY: calculate the distances between all the frequencies. found in step 3. 4) If all the values from step 3 (or step 3B) are multiples of some value in the range of human hearing (20-20,000 Hertz), the sound is probably harmonic. CAVEATS: You might need to round the values before applying step 4, perhaps to the nearest 5 or 10 Hz. If you have multiple harmonic sounds happening at the same time, step 4 won t work very well. QUESTION 6.2 For each of the Lab 2 audio files, say whether or not it is a harmonic sound. Explain how you can determine whether each sound is harmonic, using the approach described in QUESTION 6.1. Anything that sounds fairly reasonable along the lines of what I laid out in class is fine. The answers I was looking for were Clarinet: Harmonic, it shows obvious strong, evenly-spaced bands Saxophone: Harmonic, it also shows strong, evenly-spaced bands. Piano: Depends on your method of describing harmonic from question 6.1 I think the sound IS harmonic, but won t fault you if you said otherwise.
8 Snare Drum: This would generally be though of as non-harmonic, although I ll accept either answer if it is well backed-up. Drum: This could go either way, as well. For me, I ll call it barely harmonic. QUESTION 6.3 One method of estimating the fundamental frequency of a sound is to look at the rate of repetition of the waveform. Another is to look at the spacing (in the frequency domain) between harmonics to infer the frequency of the fundamental. Assuming a sound is harmonic, write out a series of instructions to explain to another person how to determine the fundamental frequency of the sound, based on one of these two methods (or a third basic approach, if you come up with one). This should be as detailed as the answer to QUESTION 6.1. METHOD 1: Perform the steps 1-3 in question 6.1 and then find the LARGEST common divisor of the values from step 3 (or 3B). This should be the fundamental frequency. Often, this value is the lowest strong frequency found in the spectrogram.but NOT ALWAYS. The missing fundamental you experimented with in Section 4 shows you why this is. METHOD 2: 1) Look at a time-amplitude display of the acoustic signal. 2) Zoom in until you can see the shape of the waveform. 3) Find the period of the signal by looking to see where one complete repetition of the waveform happens. 4) Measure the period of the waveform 5) The frequency is 1 divided by the period. QUESTION 6.4 What are the strengths and weaknesses of the method you describe in the answer to QUESTION 6.3? In other words: What kind of sound that has a pitch would cause your system to fail? Give an example. For something that counts the spaces between harmonics, it will fail when you get a sine wave because there is only the one harmonic (the fundamental). For METHOD 2, if the missing fundamental isn t there, you can t find it by looking at the period of the waveform. Both methods may also suffer depending on the resolution (in time or frequency) of your measurement. When two harmonic sounds are happening at the same time, both methods may fail.
9 QUESTION 6.4B Find and report the fundamental frequency (or frequencies) for each harmonic sound in the Lab 2 audio files using the method you describe in the answer to QUESTION 6.3. Alto Sax: 506Hz =B4 Hz or 530 Hz = C5 Clarinet: 196Hz= G3, 262Hz = C4, 330Hz = E4 Drum: maybe 165Hz = E3, but really there is no pitch Piano: Too many pitches to say. Anything is fine Snare: Not harmonic. QUESTION 6.5 Given your estimate from QUESTION 6.4, what is the distance from A=440, in semitones, of each harmonic sound? If a sound has multiple fundamental frequencies, calculate the distance for each fundamental frequency. Alto Sax: B4 is 2 steps up. C4 is 3 steps up Clarinet: G3 is 14 steps down. C4 is 9 steps down, E4 is 5 steps down Drum: not harmonic Piano: not applicable (even though it is harmonic) Snare: not harmonic. Now that you know how many semitones each sound is from A=440, you can determine the pitch class. The wheel on the following page will help you determine this. It shows the numerical name assigned to each pitch class by music theorists. It also shows the common letter names given to each pitch class. Simply start at your reference pitch class and count around the wheel the appropriate number of semitones. Each step around the wheel is a semitone. If your pitch is higher than the reference pitch, count clockwise around the wheel. If the pitch is lower than the reference, go counter-clockwise around the wheel. QUESTION 6.6 For each pitch calculated in QUESTION 6.5, give the pitch class (use the letter name). Alto Sax: 506Hz =B4 Hz or 530 Hz = C5 Clarinet: 196Hz= G3, 262Hz = C4, 330Hz = E4 Drum: maybe 165Hz = E3, but really there is no pitch Piano: Too many pitches to say. Anything is fine Snare: Not harmonic.
10 PITCH & PITCH CLASS Every G has the same pitch class &? c w c w A Ab/G# G 7 Higher = clockwise 11 B Bb/A# 0 C Gb/F# 6 1 Db/C# D Eb/D# F 5 E 2 4 3
University of Pennsylvania Department of Electrical and Systems Engineering Digital Audio Basics
University of Pennsylvania Department of Electrical and Systems Engineering Digital Audio Basics ESE250 Spring 2013 Lab 4: Time and Frequency Representation Friday, February 1, 2013 For Lab Session: Thursday,
More informationSignal Processing First Lab 20: Extracting Frequencies of Musical Tones
Signal Processing First Lab 20: Extracting Frequencies of Musical Tones Pre-Lab and Warm-Up: You should read at least the Pre-Lab and Warm-up sections of this lab assignment and go over all exercises in
More informationDSP First. Laboratory Exercise #11. Extracting Frequencies of Musical Tones
DSP First Laboratory Exercise #11 Extracting Frequencies of Musical Tones This lab is built around a single project that involves the implementation of a system for automatically writing a musical score
More informationLab S-8: Spectrograms: Harmonic Lines & Chirp Aliasing
DSP First, 2e Signal Processing First Lab S-8: Spectrograms: Harmonic Lines & Chirp Aliasing Pre-Lab: Read the Pre-Lab and do all the exercises in the Pre-Lab section prior to attending lab. Verification:
More informationME scope Application Note 01 The FFT, Leakage, and Windowing
INTRODUCTION ME scope Application Note 01 The FFT, Leakage, and Windowing NOTE: The steps in this Application Note can be duplicated using any Package that includes the VES-3600 Advanced Signal Processing
More informationDiscrete Fourier Transform (DFT)
Amplitude Amplitude Discrete Fourier Transform (DFT) DFT transforms the time domain signal samples to the frequency domain components. DFT Signal Spectrum Time Frequency DFT is often used to do frequency
More informationDSP First Lab 03: AM and FM Sinusoidal Signals. We have spent a lot of time learning about the properties of sinusoidal waveforms of the form: k=1
DSP First Lab 03: AM and FM Sinusoidal Signals Pre-Lab and Warm-Up: You should read at least the Pre-Lab and Warm-up sections of this lab assignment and go over all exercises in the Pre-Lab section before
More informationMUSC 316 Sound & Digital Audio Basics Worksheet
MUSC 316 Sound & Digital Audio Basics Worksheet updated September 2, 2011 Name: An Aggie does not lie, cheat, or steal, or tolerate those who do. By submitting responses for this test you verify, on your
More informationPHYSICS 107 LAB #9: AMPLIFIERS
Section: Monday / Tuesday (circle one) Name: Partners: PHYSICS 107 LAB #9: AMPLIFIERS Equipment: headphones, 4 BNC cables with clips at one end, 3 BNC T connectors, banana BNC (Male- Male), banana-bnc
More informationLab P-4: AM and FM Sinusoidal Signals. We have spent a lot of time learning about the properties of sinusoidal waveforms of the form: ) X
DSP First, 2e Signal Processing First Lab P-4: AM and FM Sinusoidal Signals Pre-Lab and Warm-Up: You should read at least the Pre-Lab and Warm-up sections of this lab assignment and go over all exercises
More informationTHE CITADEL THE MILITARY COLLEGE OF SOUTH CAROLINA. Department of Electrical and Computer Engineering. ELEC 423 Digital Signal Processing
THE CITADEL THE MILITARY COLLEGE OF SOUTH CAROLINA Department of Electrical and Computer Engineering ELEC 423 Digital Signal Processing Project 2 Due date: November 12 th, 2013 I) Introduction In ELEC
More informationECEn 487 Digital Signal Processing Laboratory. Lab 3 FFT-based Spectrum Analyzer
ECEn 487 Digital Signal Processing Laboratory Lab 3 FFT-based Spectrum Analyzer Due Dates This is a three week lab. All TA check off must be completed by Friday, March 14, at 3 PM or the lab will be marked
More informationLab 4 Fourier Series and the Gibbs Phenomenon
Lab 4 Fourier Series and the Gibbs Phenomenon EE 235: Continuous-Time Linear Systems Department of Electrical Engineering University of Washington This work 1 was written by Amittai Axelrod, Jayson Bowen,
More informationSpectrum Analysis: The FFT Display
Spectrum Analysis: The FFT Display Equipment: Capstone, voltage sensor 1 Introduction It is often useful to represent a function by a series expansion, such as a Taylor series. There are other series representations
More informationAdvanced Audiovisual Processing Expected Background
Advanced Audiovisual Processing Expected Background As an advanced module, we will not cover introductory topics in lecture. You are expected to already be proficient with all of the following topics,
More informationEE 422G - Signals and Systems Laboratory
EE 422G - Signals and Systems Laboratory Lab 3 FIR Filters Written by Kevin D. Donohue Department of Electrical and Computer Engineering University of Kentucky Lexington, KY 40506 September 19, 2015 Objectives:
More informationGEORGIA INSTITUTE OF TECHNOLOGY. SCHOOL of ELECTRICAL and COMPUTER ENGINEERING
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL and COMPUTER ENGINEERING ECE 2026 Summer 2018 Lab #3: Synthesizing of Sinusoidal Signals: Music and DTMF Synthesis Date: 7 June. 2018 Pre-Lab: You should
More informationBiomedical Signals. Signals and Images in Medicine Dr Nabeel Anwar
Biomedical Signals Signals and Images in Medicine Dr Nabeel Anwar Noise Removal: Time Domain Techniques 1. Synchronized Averaging (covered in lecture 1) 2. Moving Average Filters (today s topic) 3. Derivative
More informationWhat is Sound? Part II
What is Sound? Part II Timbre & Noise 1 Prayouandi (2010) - OneOhtrix Point Never PSYCHOACOUSTICS ACOUSTICS LOUDNESS AMPLITUDE PITCH FREQUENCY QUALITY TIMBRE 2 Timbre / Quality everything that is not frequency
More informationLab 3 FFT based Spectrum Analyzer
ECEn 487 Digital Signal Processing Laboratory Lab 3 FFT based Spectrum Analyzer Due Dates This is a three week lab. All TA check off must be completed prior to the beginning of class on the lab book submission
More informationFFT analysis in practice
FFT analysis in practice Perception & Multimedia Computing Lecture 13 Rebecca Fiebrink Lecturer, Department of Computing Goldsmiths, University of London 1 Last Week Review of complex numbers: rectangular
More informationFourier Series and Gibbs Phenomenon
Fourier Series and Gibbs Phenomenon University Of Washington, Department of Electrical Engineering This work is produced by The Connexions Project and licensed under the Creative Commons Attribution License
More informationLab 1B LabVIEW Filter Signal
Lab 1B LabVIEW Filter Signal Due Thursday, September 12, 2013 Submit Responses to Questions (Hardcopy) Equipment: LabVIEW Setup: Open LabVIEW Skills learned: Create a low- pass filter using LabVIEW and
More information8A. ANALYSIS OF COMPLEX SOUNDS. Amplitude, loudness, and decibels
8A. ANALYSIS OF COMPLEX SOUNDS Amplitude, loudness, and decibels Last week we found that we could synthesize complex sounds with a particular frequency, f, by adding together sine waves from the harmonic
More informationLab week 4: Harmonic Synthesis
AUDL 1001: Signals and Systems for Hearing and Speech Lab week 4: Harmonic Synthesis Introduction Any waveform in the real world can be constructed by adding together sine waves of the appropriate amplitudes,
More informationTopic 6. The Digital Fourier Transform. (Based, in part, on The Scientist and Engineer's Guide to Digital Signal Processing by Steven Smith)
Topic 6 The Digital Fourier Transform (Based, in part, on The Scientist and Engineer's Guide to Digital Signal Processing by Steven Smith) 10 20 30 40 50 60 70 80 90 100 0-1 -0.8-0.6-0.4-0.2 0 0.2 0.4
More informationChapter 2. Meeting 2, Measures and Visualizations of Sounds and Signals
Chapter 2. Meeting 2, Measures and Visualizations of Sounds and Signals 2.1. Announcements Be sure to completely read the syllabus Recording opportunities for small ensembles Due Wednesday, 15 February:
More informationComplex Sounds. Reading: Yost Ch. 4
Complex Sounds Reading: Yost Ch. 4 Natural Sounds Most sounds in our everyday lives are not simple sinusoidal sounds, but are complex sounds, consisting of a sum of many sinusoids. The amplitude and frequency
More informationEE 464 Short-Time Fourier Transform Fall and Spectrogram. Many signals of importance have spectral content that
EE 464 Short-Time Fourier Transform Fall 2018 Read Text, Chapter 4.9. and Spectrogram Many signals of importance have spectral content that changes with time. Let xx(nn), nn = 0, 1,, NN 1 1 be a discrete-time
More informationSeeing Music, Hearing Waves
Seeing Music, Hearing Waves NAME In this activity, you will calculate the frequencies of two octaves of a chromatic musical scale in standard pitch. Then, you will experiment with different combinations
More informationLab S-7: Spectrograms of AM and FM Signals. 2. Study the frequency resolution of the spectrogram for two closely spaced sinusoids.
DSP First, 2e Signal Processing First Lab S-7: Spectrograms of AM and FM Signals Pre-Lab: Read the Pre-Lab and do all the exercises in the Pre-Lab section prior to attending lab. Verification: The Exercise
More informationFrom Fourier Series to Analysis of Non-stationary Signals - VII
From Fourier Series to Analysis of Non-stationary Signals - VII prof. Miroslav Vlcek November 23, 2010 Contents Short Time Fourier Transform 1 Short Time Fourier Transform 2 Contents Short Time Fourier
More informationG(f ) = g(t) dt. e i2πft. = cos(2πf t) + i sin(2πf t)
Fourier Transforms Fourier s idea that periodic functions can be represented by an infinite series of sines and cosines with discrete frequencies which are integer multiples of a fundamental frequency
More informationPART I: The questions in Part I refer to the aliasing portion of the procedure as outlined in the lab manual.
Lab. #1 Signal Processing & Spectral Analysis Name: Date: Section / Group: NOTE: To help you correctly answer many of the following questions, it may be useful to actually run the cases outlined in the
More informationSIGNALS AND SYSTEMS LABORATORY 3: Construction of Signals in MATLAB
SIGNALS AND SYSTEMS LABORATORY 3: Construction of Signals in MATLAB INTRODUCTION Signals are functions of time, denoted x(t). For simulation, with computers and digital signal processing hardware, one
More informationStructure of Speech. Physical acoustics Time-domain representation Frequency domain representation Sound shaping
Structure of Speech Physical acoustics Time-domain representation Frequency domain representation Sound shaping Speech acoustics Source-Filter Theory Speech Source characteristics Speech Filter characteristics
More informationSignal Analysis. Young Won Lim 2/9/18
Signal Analysis Copyright (c) 2016 2018 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later
More informationCreating Digital Music
Chapter 2 Creating Digital Music Chapter 2 exposes students to some of the most important engineering ideas associated with the creation of digital music. Students learn how basic ideas drawn from the
More informationTopic. Spectrogram Chromagram Cesptrogram. Bryan Pardo, 2008, Northwestern University EECS 352: Machine Perception of Music and Audio
Topic Spectrogram Chromagram Cesptrogram Short time Fourier Transform Break signal into windows Calculate DFT of each window The Spectrogram spectrogram(y,1024,512,1024,fs,'yaxis'); A series of short term
More informationCOMP 546, Winter 2017 lecture 20 - sound 2
Today we will examine two types of sounds that are of great interest: music and speech. We will see how a frequency domain analysis is fundamental to both. Musical sounds Let s begin by briefly considering
More informationArmstrong Atlantic State University Engineering Studies MATLAB Marina Sound Processing Primer
Armstrong Atlantic State University Engineering Studies MATLAB Marina Sound Processing Primer Prerequisites The Sound Processing Primer assumes knowledge of the MATLAB IDE, MATLAB help, arithmetic operations,
More informationAdditive Synthesis OBJECTIVES BACKGROUND
Additive Synthesis SIGNALS & SYSTEMS IN MUSIC CREATED BY P. MEASE, 2011 OBJECTIVES In this lab, you will construct your very first synthesizer using only pure sinusoids! This will give you firsthand experience
More informationFall Music 320A Homework #2 Sinusoids, Complex Sinusoids 145 points Theory and Lab Problems Due Thursday 10/11/2018 before class
Fall 2018 2019 Music 320A Homework #2 Sinusoids, Complex Sinusoids 145 points Theory and Lab Problems Due Thursday 10/11/2018 before class Theory Problems 1. 15 pts) [Sinusoids] Define xt) as xt) = 2sin
More informationCOM325 Computer Speech and Hearing
COM325 Computer Speech and Hearing Part III : Theories and Models of Pitch Perception Dr. Guy Brown Room 145 Regent Court Department of Computer Science University of Sheffield Email: g.brown@dcs.shef.ac.uk
More informationSound synthesis with Pure Data
Sound synthesis with Pure Data 1. Start Pure Data from the programs menu in classroom TC307. You should get the following window: The DSP check box switches sound output on and off. Getting sound out First,
More informationTopic 2. Signal Processing Review. (Some slides are adapted from Bryan Pardo s course slides on Machine Perception of Music)
Topic 2 Signal Processing Review (Some slides are adapted from Bryan Pardo s course slides on Machine Perception of Music) Recording Sound Mechanical Vibration Pressure Waves Motion->Voltage Transducer
More informationBoomTschak User s Guide
BoomTschak User s Guide Audio Damage, Inc. 1 November 2016 The information in this document is subject to change without notice and does not represent a commitment on the part of Audio Damage, Inc. No
More informationE40M Sound and Music. M. Horowitz, J. Plummer, R. Howe 1
E40M Sound and Music M. Horowitz, J. Plummer, R. Howe 1 LED Cube Project #3 In the next several lectures, we ll study Concepts Coding Light Sound Transforms/equalizers Devices LEDs Analog to digital converters
More informationSAMPLING THEORY. Representing continuous signals with discrete numbers
SAMPLING THEORY Representing continuous signals with discrete numbers Roger B. Dannenberg Professor of Computer Science, Art, and Music Carnegie Mellon University ICM Week 3 Copyright 2002-2013 by Roger
More informationCMPT 468: Frequency Modulation (FM) Synthesis
CMPT 468: Frequency Modulation (FM) Synthesis Tamara Smyth, tamaras@cs.sfu.ca School of Computing Science, Simon Fraser University October 6, 23 Linear Frequency Modulation (FM) Till now we ve seen signals
More informationSGN Audio and Speech Processing
Introduction 1 Course goals Introduction 2 SGN 14006 Audio and Speech Processing Lectures, Fall 2014 Anssi Klapuri Tampere University of Technology! Learn basics of audio signal processing Basic operations
More informationSaxophone Lab. Source 1
IB Physics HLII Derek Ewald B. 03Mar14 Saxophone Lab Research Question How do different positions of the mouthpiece (changing the length of the neck) of a saxophone affect the frequency of the sound wave
More informationElectrical & Computer Engineering Technology
Electrical & Computer Engineering Technology EET 419C Digital Signal Processing Laboratory Experiments by Masood Ejaz Experiment # 1 Quantization of Analog Signals and Calculation of Quantized noise Objective:
More informationIntroduction to Simulink
EE 460 Introduction to Communication Systems MATLAB Tutorial #3 Introduction to Simulink This tutorial provides an overview of Simulink. It also describes the use of the FFT Scope and the filter design
More informationLaboratory Assignment 4. Fourier Sound Synthesis
Laboratory Assignment 4 Fourier Sound Synthesis PURPOSE This lab investigates how to use a computer to evaluate the Fourier series for periodic signals and to synthesize audio signals from Fourier series
More informationCS 591 S1 Midterm Exam
Name: CS 591 S1 Midterm Exam Spring 2017 You must complete 3 of problems 1 4, and then problem 5 is mandatory. Each problem is worth 25 points. Please leave blank, or draw an X through, or write Do Not
More informationGeorge Mason University Signals and Systems I Spring 2016
George Mason University Signals and Systems I Spring 2016 Laboratory Project #4 Assigned: Week of March 14, 2016 Due Date: Laboratory Section, Week of April 4, 2016 Report Format and Guidelines for Laboratory
More informationE40M Sound and Music. M. Horowitz, J. Plummer, R. Howe 1
E40M Sound and Music M. Horowitz, J. Plummer, R. Howe 1 LED Cube Project #3 In the next several lectures, we ll study Concepts Coding Light Sound Transforms/equalizers Devices LEDs Analog to digital converters
More informationPerception of pitch. Definitions. Why is pitch important? BSc Audiology/MSc SHS Psychoacoustics wk 5: 12 Feb A. Faulkner.
Perception of pitch BSc Audiology/MSc SHS Psychoacoustics wk 5: 12 Feb 2009. A. Faulkner. See Moore, BCJ Introduction to the Psychology of Hearing, Chapter 5. Or Plack CJ The Sense of Hearing Lawrence
More informationReading: Johnson Ch , Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday.
L105/205 Phonetics Scarborough Handout 7 10/18/05 Reading: Johnson Ch.2.3.3-2.3.6, Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday Spectral Analysis 1. There are
More informationA Parametric Model for Spectral Sound Synthesis of Musical Sounds
A Parametric Model for Spectral Sound Synthesis of Musical Sounds Cornelia Kreutzer University of Limerick ECE Department Limerick, Ireland cornelia.kreutzer@ul.ie Jacqueline Walker University of Limerick
More informationMusical Acoustics, C. Bertulani. Musical Acoustics. Lecture 13 Timbre / Tone quality I
1 Musical Acoustics Lecture 13 Timbre / Tone quality I Waves: review 2 distance x (m) At a given time t: y = A sin(2πx/λ) A -A time t (s) At a given position x: y = A sin(2πt/t) Perfect Tuning Fork: Pure
More information14 fasttest. Multitone Audio Analyzer. Multitone and Synchronous FFT Concepts
Multitone Audio Analyzer The Multitone Audio Analyzer (FASTTEST.AZ2) is an FFT-based analysis program furnished with System Two for use with both analog and digital audio signals. Multitone and Synchronous
More informationSound is the human ear s perceived effect of pressure changes in the ambient air. Sound can be modeled as a function of time.
2. Physical sound 2.1 What is sound? Sound is the human ear s perceived effect of pressure changes in the ambient air. Sound can be modeled as a function of time. Figure 2.1: A 0.56-second audio clip of
More informationChapter 4: AC Circuits and Passive Filters
Chapter 4: AC Circuits and Passive Filters Learning Objectives: At the end of this topic you will be able to: use V-t, I-t and P-t graphs for resistive loads describe the relationship between rms and peak
More informationSampling and Reconstruction
Experiment 10 Sampling and Reconstruction In this experiment we shall learn how an analog signal can be sampled in the time domain and then how the same samples can be used to reconstruct the original
More informationThe quality of the transmission signal The characteristics of the transmission medium. Some type of transmission medium is required for transmission:
Data Transmission The successful transmission of data depends upon two factors: The quality of the transmission signal The characteristics of the transmission medium Some type of transmission medium is
More informationProject 0: Part 2 A second hands-on lab on Speech Processing Frequency-domain processing
Project : Part 2 A second hands-on lab on Speech Processing Frequency-domain processing February 24, 217 During this lab, you will have a first contact on frequency domain analysis of speech signals. You
More informationSignal Processing for Digitizers
Signal Processing for Digitizers Modular digitizers allow accurate, high resolution data acquisition that can be quickly transferred to a host computer. Signal processing functions, applied in the digitizer
More informationPrinceton ELE 201, Spring 2014 Laboratory No. 2 Shazam
Princeton ELE 201, Spring 2014 Laboratory No. 2 Shazam 1 Background In this lab we will begin to code a Shazam-like program to identify a short clip of music using a database of songs. The basic procedure
More informationSince it s a long and technical article (11k words) feel free to read each part at different times.
How does Shazam work Have you ever wondered how Shazam works? I asked myself this question a few years ago and I read a research article written by Avery Li-Chun Wang, the confounder of Shazam, to understand
More informationComparison of a Pleasant and Unpleasant Sound
Comparison of a Pleasant and Unpleasant Sound B. Nisha 1, Dr. S. Mercy Soruparani 2 1. Department of Mathematics, Stella Maris College, Chennai, India. 2. U.G Head and Associate Professor, Department of
More informationMusic 171: Amplitude Modulation
Music 7: Amplitude Modulation Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) February 7, 9 Adding Sinusoids Recall that adding sinusoids of the same frequency
More informationIntroduction to signals and systems
CHAPTER Introduction to signals and systems Welcome to Introduction to Signals and Systems. This text will focus on the properties of signals and systems, and the relationship between the inputs and outputs
More informationTWO-DIMENSIONAL FOURIER PROCESSING OF RASTERISED AUDIO
TWO-DIMENSIONAL FOURIER PROCESSING OF RASTERISED AUDIO Chris Pike, Department of Electronics Univ. of York, UK chris.pike@rd.bbc.co.uk Jeremy J. Wells, Audio Lab, Dept. of Electronics Univ. of York, UK
More informationLinear Frequency Modulation (FM) Chirp Signal. Chirp Signal cont. CMPT 468: Lecture 7 Frequency Modulation (FM) Synthesis
Linear Frequency Modulation (FM) CMPT 468: Lecture 7 Frequency Modulation (FM) Synthesis Tamara Smyth, tamaras@cs.sfu.ca School of Computing Science, Simon Fraser University January 26, 29 Till now we
More informationSpectrum. Additive Synthesis. Additive Synthesis Caveat. Music 270a: Modulation
Spectrum Music 7a: Modulation Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) October 3, 7 When sinusoids of different frequencies are added together, the
More informationDSP First Lab 06: Digital Images: A/D and D/A
DSP First Lab 06: Digital Images: A/D and D/A Pre-Lab and Warm-Up: You should read at least the Pre-Lab and Warm-up sections of this lab assignment and go over all exercises in the Pre-Lab section before
More informationLinguistic Phonetics. Spectral Analysis
24.963 Linguistic Phonetics Spectral Analysis 4 4 Frequency (Hz) 1 Reading for next week: Liljencrants & Lindblom 1972. Assignment: Lip-rounding assignment, due 1/15. 2 Spectral analysis techniques There
More informationMusic 270a: Modulation
Music 7a: Modulation Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) October 3, 7 Spectrum When sinusoids of different frequencies are added together, the
More informationMath and Music: Understanding Pitch
Math and Music: Understanding Pitch Gareth E. Roberts Department of Mathematics and Computer Science College of the Holy Cross Worcester, MA Topics in Mathematics: Math and Music MATH 110 Spring 2018 March
More informationLaboratory Experiment #1 Introduction to Spectral Analysis
J.B.Francis College of Engineering Mechanical Engineering Department 22-403 Laboratory Experiment #1 Introduction to Spectral Analysis Introduction The quantification of electrical energy can be accomplished
More informationLinguistics 401 LECTURE #2. BASIC ACOUSTIC CONCEPTS (A review)
Linguistics 401 LECTURE #2 BASIC ACOUSTIC CONCEPTS (A review) Unit of wave: CYCLE one complete wave (=one complete crest and trough) The number of cycles per second: FREQUENCY cycles per second (cps) =
More informationECE 201: Introduction to Signal Analysis
ECE 201: Introduction to Signal Analysis Prof. Paris Last updated: October 9, 2007 Part I Spectrum Representation of Signals Lecture: Sums of Sinusoids (of different frequency) Introduction Sum of Sinusoidal
More informationME scope Application Note 02 Waveform Integration & Differentiation
ME scope Application Note 02 Waveform Integration & Differentiation The steps in this Application Note can be duplicated using any ME scope Package that includes the VES-3600 Advanced Signal Processing
More informationPreeti Rao 2 nd CompMusicWorkshop, Istanbul 2012
Preeti Rao 2 nd CompMusicWorkshop, Istanbul 2012 o Music signal characteristics o Perceptual attributes and acoustic properties o Signal representations for pitch detection o STFT o Sinusoidal model o
More informationAcoustic Resonance Lab
Acoustic Resonance Lab 1 Introduction This activity introduces several concepts that are fundamental to understanding how sound is produced in musical instruments. We ll be measuring audio produced from
More informationSignals A Preliminary Discussion EE442 Analog & Digital Communication Systems Lecture 2
Signals A Preliminary Discussion EE442 Analog & Digital Communication Systems Lecture 2 The Fourier transform of single pulse is the sinc function. EE 442 Signal Preliminaries 1 Communication Systems and
More informationENSC327 Communication Systems Fall 2011 Assignment #1 Due Wednesday, Sept. 28, 4:00 pm
ENSC327 Communication Systems Fall 2011 Assignment #1 Due Wednesday, Sept. 28, 4:00 pm All problem numbers below refer to those in Haykin & Moher s book. 1. (FT) Problem 2.20. 2. (Convolution) Problem
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY /6.071 Introduction to Electronics, Signals and Measurement Spring 2006
MASSACHUSETTS INSTITUTE OF TECHNOLOGY.071/6.071 Introduction to Electronics, Signals and Measurement Spring 006 Lab. Introduction to signals. Goals for this Lab: Further explore the lab hardware. The oscilloscope
More informationJOURNAL OF OBJECT TECHNOLOGY
JOURNAL OF OBJECT TECHNOLOGY Online at http://www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2009 Vol. 9, No. 1, January-February 2010 The Discrete Fourier Transform, Part 5: Spectrogram
More informationEGR 111 Audio Processing
EGR 111 Audio Processing This lab shows how to load, play, create, and filter sounds and music with MATLAB. Resources (available on course website): speech1.wav, birds_jet_noise.wav New MATLAB commands:
More informationLAB 2 SPECTRUM ANALYSIS OF PERIODIC SIGNALS
Eastern Mediterranean University Faculty of Engineering Department of Electrical and Electronic Engineering EENG 360 Communication System I Laboratory LAB 2 SPECTRUM ANALYSIS OF PERIODIC SIGNALS General
More informationMusic: Sound that follows a regular pattern; a mixture of frequencies which have a clear mathematical relationship between them.
The Sound of Music Music: Sound that follows a regular pattern; a mixture of frequencies which have a clear mathematical relationship between them. How is music formed? By STANDING WAVES Formed due to
More informationPerception of pitch. Importance of pitch: 2. mother hemp horse. scold. Definitions. Why is pitch important? AUDL4007: 11 Feb A. Faulkner.
Perception of pitch AUDL4007: 11 Feb 2010. A. Faulkner. See Moore, BCJ Introduction to the Psychology of Hearing, Chapter 5. Or Plack CJ The Sense of Hearing Lawrence Erlbaum, 2005 Chapter 7 1 Definitions
More informationKeywords: spectral centroid, MPEG-7, sum of sine waves, band limited impulse train, STFT, peak detection.
Global Journal of Researches in Engineering: J General Engineering Volume 15 Issue 4 Version 1.0 Year 2015 Type: Double Blind Peer Reviewed International Research Journal Publisher: Global Journals Inc.
More informationLecture 7 Frequency Modulation
Lecture 7 Frequency Modulation Fundamentals of Digital Signal Processing Spring, 2012 Wei-Ta Chu 2012/3/15 1 Time-Frequency Spectrum We have seen that a wide range of interesting waveforms can be synthesized
More informationMeasuring the complexity of sound
PRAMANA c Indian Academy of Sciences Vol. 77, No. 5 journal of November 2011 physics pp. 811 816 Measuring the complexity of sound NANDINI CHATTERJEE SINGH National Brain Research Centre, NH-8, Nainwal
More informationAberehe Niguse Gebru ABSTRACT. Keywords Autocorrelation, MATLAB, Music education, Pitch Detection, Wavelet
Master of Industrial Sciences 2015-2016 Faculty of Engineering Technology, Campus Group T Leuven This paper is written by (a) student(s) in the framework of a Master s Thesis ABC Research Alert VIRTUAL
More informationPHYC 500: Introduction to LabView. Exercise 9 (v 1.1) Spectral content of waveforms. M.P. Hasselbeck, University of New Mexico
PHYC 500: Introduction to LabView M.P. Hasselbeck, University of New Mexico Exercise 9 (v 1.1) Spectral content of waveforms This exercise provides additional experience with the Waveform palette, along
More information