Brain Computer Interface Control of a Virtual Robotic System based on SSVEP and EEG Signal

Similar documents
Brain-computer Interface Based on Steady-state Visual Evoked Potentials

An Improved SSVEP Based BCI System Using Frequency Domain Feature Classification

Non-Invasive Brain-Actuated Control of a Mobile Robot

Presented by: V.Lakshana Regd. No.: Information Technology CET, Bhubaneswar

A Brain-Computer Interface Based on Steady State Visual Evoked Potentials for Controlling a Robot

Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers

780. Biomedical signal identification and analysis

Processing and Decoding Steady-State Visual Evoked Potentials for Brain-Computer Interfaces

Classifying the Brain's Motor Activity via Deep Learning

Multi-target SSVEP-based BCI using Multichannel SSVEP Detection

A Review of SSVEP Decompostion using EMD for Steering Control of a Car

Decoding Brainwave Data using Regression

Brain Computer Interfaces for Full Body Movement and Embodiment. Intelligent Robotics Seminar Kai Brusch

Available online at ScienceDirect. Procedia Technology 24 (2016 )

Detecting spread spectrum pseudo random noise tags in EEG/MEG using a structure-based decomposition

6.555 Lab1: The Electrocardiogram

The effect of the viewing distance of stimulus on SSVEP response for use in Brain Computer Interfaces

Towards an SSVEP Based BCI With High ITR

EE105 Fall 2015 Microelectronic Devices and Circuits Multi-Stage Amplifiers. Prof. Ming C. Wu 511 Sutardja Dai Hall (SDH)

BRAINWAVE RECOGNITION

Beyond Blind Averaging Analyzing Event-Related Brain Dynamics

Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands

Brain-Computer Interface for Control and Communication with Smart Mobile Applications

SSRG International Journal of Electronics and Communication Engineering - (2'ICEIS 2017) - Special Issue April 2017

Voice Assisting System Using Brain Control Interface

MOUSE CURSOR CONTROL SYTEM BASED ON SSVEP

Brain Computer Interfaces Lecture 2: Current State of the Art in BCIs

Wireless Neural Loggers

University of West Bohemia in Pilsen Department of Computer Science and Engineering Univerzitní Pilsen Czech Republic

Impact of Stimulus Configuration on Steady State Visual Evoked Potentials (SSVEP) Response

Brain computer interfaces (BCIs), which can provide a new

BRAIN MACHINE INTERFACE SYSTEM FOR PERSON WITH QUADRIPLEGIA DISEASE

On diversity within operators EEG responses to LED-produced alternate stimulus in

Capacitive MEMS accelerometer for condition monitoring

Designing a Brain-Computer Interface controlled video-game using consumer grade EEG hardware

Behavior-Based SSVEP Hierarchical Architecture for Telepresence Control of Humanoid Robot to Achieve Full-Body Movement

A MOBILE EEG SYSTEM FOR PRACTICAL APPLICATIONS. Sciences, Beijing , China

The all-in-one solution for wireless recording and stimulating in vivo

Determination of human EEG alpha entrainment ERD/ERS using the continuous complex wavelet transform

A Study on Ocular and Facial Muscle Artifacts in EEG Signals for BCI Applications

EasyChair Preprint. A Tactile P300 Brain-Computer Interface: Principle and Paradigm

A Study of Various Feature Extraction Methods on a Motor Imagery Based Brain Computer Interface System

A Practical VEP-Based Brain Computer Interface

Off-line EEG analysis of BCI experiments with MATLAB V1.07a. Copyright g.tec medical engineering GmbH

Non-Contact EEG Active Multielectrode Hardware Design

Real Robots Controlled by Brain Signals - A BMI Approach

ACS College of Engineering Department of Biomedical Engineering. BMDSP LAB (10BML77) Pre lab Questions ( ) Cycle-1

Computational Complexity of Multiuser. Receivers in DS-CDMA Systems. Syed Rizvi. Department of Electrical & Computer Engineering

Evaluation of the Refraction Technology RT130HR Remote Seismic System For IRIS/GSN

FEATURES EXTRACTION TECHNIQES OF EEG SIGNAL FOR BCI APPLICATIONS

Research Article A Prototype SSVEP Based Real Time BCI Gaming System

Recently, electroencephalogram (EEG)-based brain

The Electroencephalogram. Basics in Recording EEG, Frequency Domain Analysis and its Applications

EEG-Based Brain-Controlled Wheelchair with Four Different Stimuli Frequencies

enhancement based on Canonical Correlation Analysis to improve BCI performances. AFRICON 2013,

Changing the sampling rate

BRAIN COMPUTER INTERFACE (BCI) RESEARCH CENTER AT SRM UNIVERSITY

Chapter 2 Fundamentals: From Light to Command

Wavelet Based Classification of Finger Movements Using EEG Signals

Controlling a Robotic Arm by Brainwaves and Eye Movement

Integrating Human and Computer Vision with EEG Toward the Control of a Prosthetic Arm Eugene Lavely, Geoffrey Meltzner, Rick Thompson

Magnetoencephalography and Auditory Neural Representations

Creating Retinotopic Mapping Stimuli - 1

DESIGN AND IMPLEMENTATION OF WIRELESS MULTI-CHANNEL EEG RECORDING SYSTEM AND STUDY OF EEG CLUSTERING METHOD

[Marghade*, 4.(7): July, 2015] ISSN: (I2OR), Publication Impact Factor: 3.785

Sampled Sinusoidal Stimulation Profile and Multichannel Fuzzy Logic Classification for Monitor-based Phase-coded SSVEP Brain-Computer Interfacing

Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials

Outline. Noise and Distortion. Noise basics Component and system noise Distortion INF4420. Jørgen Andreas Michaelsen Spring / 45 2 / 45

Modeling, Architectures and Signal Processing for Brain Computer Interfaces

Analysis of brain waves according to their frequency

Bio-Signal Based Human-Computer Interface for Geometric. Modeling

Neuroprosthetics *= Hecke. CNS-Seminar 2004 Opener p.1

Virtual and Augmented Reality Brain Games

EC209 - Improving Signal-To-Noise Ratio (SNR) for Optimizing Repeatable Auditory Brainstem Responses

Three Phase Active Shunt Power Filter with Simple Control in PSIM Simulation

Controlling Robots with Non-Invasive Brain-Computer Interfaces

Training of EEG Signal Intensification for BCI System. Haesung Jeong*, Hyungi Jeong*, Kong Borasy*, Kyu-Sung Kim***, Sangmin Lee**, Jangwoo Kwon*

BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE

VOG-ENHANCED ICA FOR SSVEP RESPONSE DETECTION FROM CONSUMER-GRADE EEG. Mohammad Reza Haji Samadi, Neil Cooke

BCI-based Electric Cars Controlling System

ANIMA: Non-conventional Brain-Computer Interfaces in Robot Control through Electroencephalography and Electrooculography, ARP Module

Neurophysiology. The action potential. Why should we care? AP is the elemental until of nervous system communication

SIEMOS PQ The Multi-Functional Power Quality Analyzer for Low and Medium-Voltage Networks

Temporal based EEG Signals Classification for Talocrural and Knee Joint Movements using Emotive Head Set

Metrics for Assistive Robotics Brain-Computer Interface Evaluation

Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment

A Prototype Wire Position Monitoring System

Bi-directional brain computer interface with brain implantable Arm-based SoCs Joseph Fernando Principal architect

Booklet of teaching units

New ways in non-stationary, nonlinear EEG signal processing

FYS3240 PC-based instrumentation and microcontrollers. Signal sampling. Spring 2015 Lecture #5

40 Hz Event Related Auditory Potential

Physiological signal(bio-signals) Method, Application, Proposal

Second-Order Sigma-Delta Modulator in Standard CMOS Technology

REPORT ON THE RESEARCH WORK

LAB #7: Digital Signal Processing

Biometric: EEG brainwaves

Appliance of Genetic Algorithm for Empirical Diminution in Electrode numbers for VEP based Single Trial BCI.

Control Design Made Easy By Ryan Gordon

Electroencephalogram (EEG) Sensor for Teleoperation of Domotics Applications via Virtual Environments

Transcription:

Brain Computer Interface Control of a Virtual Robotic based on SSVEP and EEG Signal By: Fatemeh Akrami Supervisor: Dr. Hamid D. Taghirad October 2017

Contents 1/20

Brain Computer Interface (BCI) A direct connection pathway between the brain and external world. BCI acquires brain signal in response to a certain type of behavior and decode it into the device control commands. 2/20

Steady Brain State Computer Visual Interface Evoked Potential (BCI) Response to flickering stimulus. Generates in the visual cortex of the brain. It contains stimulus frequency and its harmonics. 3/20

Brain PSD Computer of SSVEP Interface Signal(BCI) Amplitude spectrum of the SSVEP BCI signal for P7, O1, O2, P8 electrodes in 17Hz stimulus frequency 6/20

Brain Why Computer SSVEP Interface signal? (BCI) SSVEP needs less training time Information transfer rate is high It has higher classification accuracy 4/20

Brain SSVEP Computer based Interface BCI system (BCI) Typical structure of the SSVEP based BCI system 5/20

Brain Computer Visual stimulus Interface (BCI) Visual Stimulus Design Mechanical design MCU and control color and frequency Connection between MCU and PC 7/20

Brain Computer Visual stimulus Interface (BCI) 7/20

Brain Computer Data acquisition Interface (BCI) 14 channels: AF3, F7, F3, FC5, T7, P7, O1, O2, P8, T8, FC6, F4, F8, AF4 References: In the CMS/DRL noise cancellation Sampling rate: 128 SPS Resolution: 14 bits 1 LSB = 0.51μV Bandwidth: 0.2 43Hz Wireless and rechargeable 8/20

Brain Computer Data acquisition Interface (BCI) Distance between the stimulus and subject is 80 [cm]. Visual stimulus frequencies are 11, 13, 15 and 17 [Hz]. The color of the stimulus is set to green. Electrodes placed on O1, O2, P7 and P8 locations. 9/20

Brain Computer Data Processing Interface (BCI) Likelihood Ratio Test (LRT) method M = mean value C = Covariance matrix The reference signal 10/20

Brain Computer Data Processing Interface (BCI) Likelihood ratio for static signal The measure of association L=1: data are perfectly correlated L=0: data are uncorrelated 11/20

Brain Virtual Computer robotic Interface arm (BCI) Virtual model of RV2AJ robot in Solidwork RV2AJ Robot dimensions [mm] 12/20

Brain Virtual Computer robotic Interface arm (BCI) The robot has two degree of freedom. Theta1 and Theta2 are inputs to determine the robot movement. RV2AJ Simulink model 13/20

Brain Computer Interface (BCI) Simulink block diagram of SSVEP based BCI and their connection 14/20

Brain Computer State of the Interface robot (BCI) State of the robot corresponding to stimulus frequency 15/20

Brain Computer Offline Interface (BCI) Data was recorded in ARAS lab Four subject participated in experiments Length of the data is 20 second in four different trails The experiment was performed in dim room 16/20

Brain Computer Offline Interface (BCI) Each time window for processing is four second Accuracy is the number of the correct segments to the total number of segments 16/20

Brain Computer Online Interface (BCI) Online result of LRT algorithm and Classification output in test1 17/20

Brain Computer Online Interface (BCI) Online result of LRT algorithm and Classification output in test2 18/20

Brain Computer Interface (BCI) An effective strategy is done for implementation of complete BCI system. LRT method is evaluated in offline analysis and implemented for online detection. It is improved that the online detection with high accuracy in short time windows are possible. It is improved that the input stimulus frequencies are perfectly distinguishable. The experiments show promising features of the developed system for further application. 19/20