Wavelets and wavelet convolution and brain music. Dr. Frederike Petzschner Translational Neuromodeling Unit

Similar documents
21/01/2014. Fundamentals of the analysis of neuronal oscillations. Separating sources

ADDITIVE SYNTHESIS BASED ON THE CONTINUOUS WAVELET TRANSFORM: A SINUSOIDAL PLUS TRANSIENT MODEL

Modulation. Digital Data Transmission. COMP476 Networked Computer Systems. Analog and Digital Signals. Analog and Digital Examples.

The Fast Fourier Transform

E40M Sound and Music. M. Horowitz, J. Plummer, R. Howe 1

E40M Sound and Music. M. Horowitz, J. Plummer, R. Howe 1

Lecture 5: Sinusoidal Modeling

The exponentially weighted moving average applied to the control and monitoring of varying sample sizes

Orthonormal bases and tilings of the time-frequency plane for music processing Juan M. Vuletich *

Fourier Transform. Any signal can be expressed as a linear combination of a bunch of sine gratings of different frequency Amplitude Phase

Introduction to Wavelets Michael Phipps Vallary Bhopatkar

EEE508 GÜÇ SİSTEMLERİNDE SİNYAL İŞLEME

X Space X Time X Condition

8.3 Basic Parameters for Audio

Topic 6. The Digital Fourier Transform. (Based, in part, on The Scientist and Engineer's Guide to Digital Signal Processing by Steven Smith)

SAMPLING THEORY. Representing continuous signals with discrete numbers

Time-Frequency analysis of biophysical time series

Introduction to Wavelet Transform. Chapter 7 Instructor: Hossein Pourghassem

EE 791 EEG-5 Measures of EEG Dynamic Properties

Detection, localization, and classification of power quality disturbances using discrete wavelet transform technique

The Electroencephalogram. Basics in Recording EEG, Frequency Domain Analysis and its Applications

Chapter 5 Window Functions. periodic with a period of N (number of samples). This is observed in table (3.1).

CHAPTER 6 Frequency Response, Bode. Plots, and Resonance

Evoked Potentials (EPs)

The Discrete Fourier Transform. Claudia Feregrino-Uribe, Alicia Morales-Reyes Original material: Dr. René Cumplido

Transforms and Frequency Filtering

PART II Practical problems in the spectral analysis of speech signals

Frequency Domain Representation of Signals

Practical Application of Wavelet to Power Quality Analysis. Norman Tse

Filters. Materials from Prof. Klaus Mueller

Lecture 3 Complex Exponential Signals

Part 2: Fourier transforms. Key to understanding NMR, X-ray crystallography, and all forms of microscopy

Extraction of Musical Pitches from Recorded Music. Mark Palenik

Introduction. Chapter Time-Varying Signals

(Time )Frequency Analysis of EEG Waveforms

Introduction to Communications Part Two: Physical Layer Ch3: Data & Signals

Chapter 3 Data and Signals 3.1

DIGITAL SIGNAL PROCESSING CCC-INAOE AUTUMN 2015

!"!#"#$% Lecture 2: Media Creation. Some materials taken from Prof. Yao Wang s slides RECAP

Musical Acoustics, C. Bertulani. Musical Acoustics. Lecture 13 Timbre / Tone quality I

IDENTIFYING TREND MODES and CYCLE MODES

Application of The Wavelet Transform In The Processing of Musical Signals

PSYC696B: Analyzing Neural Time-series Data

Time-Frequency analysis of biophysical time series. Courtesy of Arnaud Delorme

Topic 2. Signal Processing Review. (Some slides are adapted from Bryan Pardo s course slides on Machine Perception of Music)

ECEn 487 Digital Signal Processing Laboratory. Lab 3 FFT-based Spectrum Analyzer

Complex Sounds. Reading: Yost Ch. 4

FFT Convolution. The Overlap-Add Method

INTRODUCTION TO COMPUTER MUSIC SAMPLING SYNTHESIS AND FILTERS. Professor of Computer Science, Art, and Music

INDEX TO SERIES OF TUTORIALS TO WAVELET TRANSFORM BY ROBI POLIKAR THE ENGINEER'S ULTIMATE GUIDE TO WAVELET ANALYSIS ROBI POLIKAR

Lecture Fundamentals of Data and signals

Phase Synchronization of Two Tremor-Related Neurons

Sound is the human ear s perceived effect of pressure changes in the ambient air. Sound can be modeled as a function of time.

Lab 3 FFT based Spectrum Analyzer

PART I: The questions in Part I refer to the aliasing portion of the procedure as outlined in the lab manual.

Determination of human EEG alpha entrainment ERD/ERS using the continuous complex wavelet transform

ECE 440L. Experiment 1: Signals and Noise (1 week)

CMPT 368: Lecture 4 Amplitude Modulation (AM) Synthesis

Time-Frequency analysis of biophysical time series. Arnaud Delorme CERCO, CNRS, France & SCCN, UCSD, La Jolla, USA

Fourier and Wavelets

Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi

TRANSFORMS / WAVELETS

This tutorial describes the principles of 24-bit recording systems and clarifies some common mis-conceptions regarding these systems.

SIMULATING RESTING CORTICAL BACKGROUND ACTIVITY WITH FILTERED NOISE. Journal of Integrative Neuroscience 7(3):

Reading: Johnson Ch , Ch.5.5 (today); Liljencrants & Lindblom; Stevens (Tues) reminder: no class on Thursday.

Sampling and Reconstruction of Analog Signals

WAVELET TRANSFORMS FOR SYSTEM IDENTIFICATION AND ASSOCIATED PROCESSING CONCERNS

Introduction p. 1 Review of Radar Principles p. 1 Tracking Radars and the Evolution of Monopulse p. 3 A "Baseline" Monopulse Radar p.

Structure of Speech. Physical acoustics Time-domain representation Frequency domain representation Sound shaping

Alternative View of Frequency Modulation

FFT 1 /n octave analysis wavelet

DISCRETE FOURIER TRANSFORM AND FILTER DESIGN

AUDL GS08/GAV1 Auditory Perception. Envelope and temporal fine structure (TFS)

Biosignal Analysis Biosignal Processing Methods. Medical Informatics WS 2007/2008

3.2 Measuring Frequency Response Of Low-Pass Filter :

College of information Technology Department of Information Networks Telecommunication & Networking I Chapter DATA AND SIGNALS 1 من 42

Nyquist's criterion. Spectrum of the original signal Xi(t) is defined by the Fourier transformation as follows :

CS 591 S1 Midterm Exam

ME scope Application Note 01 The FFT, Leakage, and Windowing

Biomedical Signals. Signals and Images in Medicine Dr Nabeel Anwar

Appendix B. Design Implementation Description For The Digital Frequency Demodulator

ELEC3242 Communications Engineering Laboratory Amplitude Modulation (AM)

The aim is to understand the power spectrum for non-white noise and non-coherent oscillations.

Applications of Music Processing

Acoustics, signals & systems for audiology. Week 4. Signals through Systems

How to Use the Method of Multivariate Statistical Analysis Into the Equipment State Monitoring. Chunhua Yang

Sinusoids and Phasors (Chapter 9 - Lecture #1) Dr. Shahrel A. Suandi Room 2.20, PPKEE

MULTIMEDIA SYSTEMS

Thinking in Frequency

06: Thinking in Frequencies. CS 5840: Computer Vision Instructor: Jonathan Ventura

Outline. EECS 3213 Fall Sebastian Magierowski York University. Review Passband Modulation. Constellations ASK, FSK, PSK.

Singing Voice Detection. Applications of Music Processing. Singing Voice Detection. Singing Voice Detection. Singing Voice Detection

Topic. Spectrogram Chromagram Cesptrogram. Bryan Pardo, 2008, Northwestern University EECS 352: Machine Perception of Music and Audio

Fourier Signal Analysis

Technical note. Impedance analysis techniques

Reference Manual SPECTRUM. Signal Processing for Experimental Chemistry Teaching and Research / University of Maryland

Fundamentals of Digital Audio *

Analysis of Neuroelectric Oscillations of the Scalp EEG Signals

Chapter 16. Waves and Sound

Filters. Motivating Example. Tracking a fly, oh my! Moving Weighted Average Filter. General Picture

Transcription:

Wavelets and wavelet convolution and brain music Dr. Frederike Petzschner Translational Neuromodeling Unit 06.03.2015

Recap Why are we doing this? We know that EEG data contain oscillations. Or goal is to disentangle these oscillations (alpha, gamma, theta waves)

What are oscillations?

Simply think of music Notes: Music: Superposition of notes/waves: Amplitude Phase Frequency

Decoding brain music We want to decode brain music. Knowing which frequency was present, when and how strong over time! So at EACH POINT IN TIME we want to know the frequency, phase and amplitude of the underlying signal.

What have we done so far? We model our signal as a linear combination of sine waves! Fourier Transform: frequency domain representation https://electronics.stackexchange.com/questions/32310/what-exactly-are-harmonics-and-how-do-they-appear

What s the problem with that? Frequency changes over time

What would we want?! Something that includes a temporal weighting

What would we want?! Something that includes a temporal weighting

What would we want?! Something that includes a temporal weighting Morlet wavelet

What is this talk about? Time-frequency representations retain advantages of both time and frequency domain While making only small sacrifices to precision: Frequency information at each point in time is a weighted sum of the frequency information of the instantaneous time AND the neighboring time.

How to make a Morlet wavelet Instead of using many sine waves with different frequencies, time-frequency decomposition uses many wavelets with different frequencies.

http://moargeek.com/2014/07/29/nerd-nerd-nerd-nerd-word/

Wavelet Convolution as a Bandpass Filter Remember a convolution is the time-varying mapping between a kernel (here the wavelet) and a signal (EEG).

Limitations of the approach so far It works like a bandpass filter nice, but time-frequency analysis means we want the power and phase which are not directly apparent convolution with a Morlet wavelet depends on the phase offset between wavelet and data http://www.sodahead.com/entertainment/anyone-have-any-suggestions-on-what-to-do-with-a-broken-guitar-other-then-the-two-obvious-suggestio/question-1119071/

Limitations of the approach so far Integrals are multiplication, taking changes into account and the dot product is multiplication, taking direction into account.

The solution Use complex Morlet wavelets

Reminder: What do we want? Extract estimates of time-varying frequency band-specific power and phase from EEG! What will we do to get there? Calculate complex Morlet Wavelets (3D: time, real and imaginary part)

Recap complex numbers http://betterexplained.com/articles/a-visual-intuitive-guide-to-imaginary-numbers/

Recap complex numbers i 2 = -1 http://betterexplained.com/articles/a-visual-intuitive-guide-to-imaginary-numbers/

Recap complex numbers http://betterexplained.com/articles/a-visual-intuitive-guide-to-imaginary-numbers/

Recap complex numbers 4-8i cartesian polar

Complex Morelet Remember a Morlet is created by multiplying a sine wave with a Gaussian A complex Morlet is created by multiplying a complex sine wave with a Gaussian Gauss Complex Sine

Why???

Wavelet= -0.0002-0.0001i -0.0002-0.0001i -0.0002-0.0001i -0.0003-0.0001i -0.0003-0.0001i -0.0003-0.0001i -0.0004-0.0001i -0.0004-0.0000i -0.0004-0.0000i -0.0005 + 0.0000i http://moargeek.com/2014/07/29/nerd-nerd-nerd-nerd-word/

Complex Wavelets

Walking in imaginary space

Remember our problem: Why do we need that?

Remember our problem: Why do we need that? Length provides information about similarity of the one cycle sine and Morlet wavelet Orientation provides information about the phase We get the bandpass filter BUT in addition we also get information about the phase AND the amplitude!!!!

Power = M 2 We get the bandpass filter BUT in addition we also get information about the phase AND the amplitude!!!!

That was one step of the convolution now we need to get from one point to a time series of power an phase values for ONE frequency band

Now look at that in 3D again

Concrete considerations: Question answer session Lowest frequency? Hypothesis driven: e.g. looking at alpha 5-6 Hz Highest frequency? Hypothesis and sampling rate driven: you can t use frequencies higher than the Nyquist frequency (sampling rate 500Hz, max 250 Hz better would be 125 Hz)!If no expectations: 4-60Hz How many frequencies? 20-30 for 4-60Hz Linear or logarithmic spacing of frequencies? both correct. As frequencies are often conceptualized on log space log spacing makes sense as you get equal distance data (especially if you are interested in lower-frequencies) How long should wavelets be? Long enough so that the lowest-frequency wavelet tapers to zero

Concrete considerations: Question answer session How many cycles should be used for the Gaussian Taper defines the width of the wavelet, non-trivial parameter, will influence the results! trade of between temporal and frequency precision. if you are looking for transient changes! smaller number of cycles if you are looking for frequency-band activity over an extended period of time (e.g. visual stimulation, working memory)! larger number of cycles

Fine Take home: We want to decode brain music Because the main frequency components of that music may change over time we want something that takes both the time and frequency domain into account What we can use is a Morlet Wavelet: combination of a Gaussian with a Sine Allows us to get a time-frequency representations of our data that retain advantages of both domains To get at the actual phase and power information we need to use a complex Morlet Wavelet Recommended Reading: chapter 12-13 Cohen 2014

Concrete considerations: Question answer session How strong is the frequency smoothing (incorporation of neighboring frequencies)? reported in terms of full-width at half-maximum (FWHM) = frequency at which power is at 50% on the left and right sides of the peak

Wavelet families http://cliparts.co/clipart-of-families Group of wavelets that share the same properties but have different frequencies. How to construct a wavelet family: 1. don t use frequencies lower than you epoch (1s data no less than 1 Hz -> better 4Hz or faster) 2. don t chose frequencies above Nyquist frequency (one-half of the sampling rate) 3. not much gain from 0.1 Hz increase! 15-30 frequencies between 3 Hz- 60 Hz should be enough