Development of a Human Machine Interface for Control of Robotic Wheelchair and Smart Environment

Size: px
Start display at page:

Download "Development of a Human Machine Interface for Control of Robotic Wheelchair and Smart Environment"

Transcription

1 Preprints of the 11th IFAC Symposium on Robot Control, Salvador, BA, Brazil, August 26-28, 2015 ThMS2.1 Development of a Human Machine Interface for Control of Robotic Wheelchair and Smart Environment Richard J. M. G. Tello, Alexandre L. C. Bissoli, Flavio Ferrara, Sandra Müller, Andre Ferreira, Teodiano F. Bastos-Filho Post-Graduate Program in Electrical Engineering (PPGEE). Federal University of Espirito Santo (UFES). Av. Fernando Ferrari 514. Vitoria, Brazil. ( richard@ele.ufes.br; alexandre-bissoli@hotmail.com; andrefer@ele.ufes.br; teodiano.bastos@ufes.br) Politecnico di Milano: Piazza Leonardo da Vinci, 20133, Milano, Italy ( femferrara@gmail) Electrical Engineering Department, Federal Institute of Esprito Santo (IFES). Av. Vitoria, 1729, Vitoria, Brazil ( sandra.muller@ifes.edu.br) Abstract: In this work, we address the problem of integrating a robotic wheelchair into a smart environment. This approach allows people with disabilities to control home appliances of the environment using a Human Computer Interface (HCI) based on different biological signals. The home appliances includes TV, radio, lights/lamp and fan. Three control paradigms using surface Electromyography (semg), Electrooculography (EOG) and Electroencephalography (EEG) signals were used. These signals are captured through a biosignal acquisition system. Three subparadigms for semg/eog analyzes were defined: moving eyes horizontally (left/right), raising brow and prolonged clench. On the other hand, the navigation of the wheelchair is executed through an Steady-State Visually Evoked Potentials (SSVEP)-BCI. Each stage of our proposed system showed a good performance for most subjects. Therefore, volunteers were recruited to participate of the study and were distributed in two groups (subjects for home appliances and subjects for SSVEP-BCI). The average accuracy for prolonged clench approach was of 95%, the raising brow was 85% and moving eyes achieved 93%. Multivariate Synchronization Index (MSI) was used for feature extraction from EEG signals. The flickering frequencies were 8.0 Hz (top), 11.0 Hz (right), 13.0 Hz (bottom) and 15.0 Hz (left). Results from this approach showed that classification varies in the range of 45-77% among subjects using window length of 1 s. Keywords: SSVEP-BCI, Robotic Wheelchair, EEG, semg, EOG, Smart Environment. 1. INTRODUCTION A Human Machine Interface (HMI) is a platform that allows interaction between user and automatized system. On the other hand, a Brain-computer interface (BCI) is a technology that provides human with direct communication between the users brain signals and a computer, generating an alternative channel of communication that does not involve the traditional way as muscles and nerves (Wolpaw et al. (2000)). Among current BCIs, a noninvasive brain imaging method commonly employed in BCIs is EEG, which has the advantages of lower risk, inexpensive and easily measurable (Chen et al. (2014) and Kelly et al. (2005)). Further, EEG provides electrical signals of high The authors thank FAPES (a foundation of the Secretary of Science and Technology of the State of Espirito Santo, Brazil), CAPES (a foundation of the Brazilian Ministry of Education) and CNPQ (The Brazilian National Council for Scientific and Technological Development), for the support given to this work. temporal resolution generated by neuronal dynamics from the scalp. Therefore, a BCI records brain signals, and EEG signal features are then translated into artificial outputs or commands that act in a real world. BCI is a potential alternative and augmentative communication (AAC) and control solution for people with severe motor disabilities (Wolpaw et al. (2000), Kelly et al. (2005) and Gao et al. (2003)). One kind of BCI named SSVEP-BCI uses the excitation of the retina of eye by a stimulus at a certain frequency, making the brain generating an electrical activity of the same frequency with its multiples or harmonics. This stimulus produces a stable Visual Evoked Potential (VEP) of small amplitude termed as Steady-State Visually Evoked Potentials (SSVEPs) of the human visual system. To produce such potentials, the user gazes at one flickering stimulus oscillating at a certain frequency (He (2013)). In a typical SSVEP-BCI system, several stimuli flickering at different frequencies are presented to the user. The subject Copyright 2015 IFAC. 144

2 overtly directs attention to one of the stimuli by changing his/her gaze attention (Zhang et al. (2010)). This kind of SSVEP-BCI was evaluated in this study and is commonly called as dependent since muscle activities, such as gaze shifting, are necessary. One of the first studies related to control of smart home applications using biological signals, such as EEG, was reported in (Holzner et al. (2009)). In that work a BCI based on P300 approach is used for TV channels switching, for opening and closing doors and windows, navigation and conversation, but all in a controlled environment of a virtual reality (VR) system. Twelve subjects were evaluated and an average of 67.51% in the classification for all subjects and all decisions was achieved. Other study (Ou et al. (2012)) based on VR in order to create a controlled environment was performed. In that work, the term Brain computer interface-based Smart Environmental Control System (BSECS) was introduced and a BCI technique with Universal Plug and Play (UPnP) home networking for smart house applications environment was proposed. Also, an architecture where the air conditioner and lights/lamp can be successfully and automatically adjusted in realtime based on the change of cognitive state of users was designed. A hybrid BCI for improving the usability of a smart home control was reported in (Edlinger and Guger (2012)). In that study, P300 and SSVEP approaches were used. Results indicated that P300 is very suitable for applications with several controllable devices, where a discrete control command is desired. However, that study also reports that SSVEP is more suitable if a continuous control signal is needed and the number of commands is rather limited. A simple threshold criterion was used to determine if the user is looking at the flickering light. All the different commands were summarized in 7 control masks: a light mask, a music mask, a phone mask, a temperature mask, a TV mask, a move mask and a go to mask. That study was also tested in a VR. A similar approach using a hybrid BCI paradigm based on P300 and SSVEP is reported in (Wang et al. (2014)), where a Canonical Correlation Analysis (CCA) technique was applied for the SSVEP detection. Applications involving robotic wheelchairs and SSVEP signals were also reported in (Muller et al. (2011); Xu et al. (2012); Diez et al. (2013); Singla et al. (2014)). A recent study using SSVEP and P300 approaches for wheelchair control was reported in (Li et al. (2013)). On the other hand, a hybrid BCI based on SSVEP and visual motion stimulus was applied to a robotic wheelchair in (Punsawad and Wongsawat (2013)). Finally, studies that combine motor imagery (MI) and SSVEPs to control a real wheelchair were reported in (Bastos et al. (2011) and Cao et al. (2014)). In this work, we address the problem of integrating a wheelchair into a smart environment. Due to the variety of disabilities that benefit from assistive technologies, an optimal approach could allow the user to choose the preferred control paradigm according to the degree of his/her disability. The system allows the handling of various devices in a real environment, e.g. a room, by means of biological signals controlled from a robotic wheelchair. We present this system with three kind of assistive control paradigms using, respectively, muscle (semg), EOG and brain signals (EEG) as shown in Fig. 1. USER INTERFACE semg SIGNAL EOG SIGNAL EEG SIGNAL LEVELS OF CAPACITY Face muscles: clenching and raising brow Ocular globe: left and right SSVEP Fig. 1. Levels of capacity of our proposed system. 2. METHODS Different stages were addressed as follows: 2.1 Assistive System In the context of smart environments applied to assistive technologies, this paper proposes an input interface allowing people with disabilities to turn on and off appliances without help, from the wheelchair. Part of this work was to design and build a smart box that allows controlling up to four appliances in an environment, including TV set, radio, lamp/lights and fan. semg, EOG and EEG signals were recorded using a biological signal acquisition device. The user can issue commands from the wheelchair, and then the signal is transmitted through RF to the smart box, when the corresponding equipment is finally operated. We used RF communication to turn the appliances on and off remotely. The RF transmitter and receiver work in a frequency of 433MHz, controlled by an Arduino Mega microcontroller. The communication is unidirectional, that is, only the transmitter sends the data to the receiver. On the other hand, an SSVEP-BCI was used to control the navigation of the wheelchair. The wheelchair is equipped with a small 10.1 display that exhibits the Control Interface (CI). In addition, four small boxes containing four Light-Emitting Diodes (LEDs) of white color were placed in the four side of this display as visual stimuli for the generation of evoked potentials. The CI uses the display to visualize a menu, through which the user can navigate or operate the desired device. It is worth noting that this menu is dynamic, as device options can change according to the current room, or be customized by the user before running the system. Moreover, for some device we provide additional operations that can be performed using a sub-menu. For example, after turning on the TV, the display shows a sub-menu with options such as Channel Up, Channel Down, Volume Up, Volume Down. It is always possible to go back to the main menu and turn off the system. The CI was presented in (Ferrara et al. (2015)). It offers an interface of procedures that can be accessed through Remote Procedure Call (RPC), that is, one for turning the interface on, one for turning it off, and one for transmitting Copyright 2015 IFAC. 145

3 logical commands encoded as integers. In (Ferrara et al. (2015)), it has been demonstrated that choosing three kinds of paradigms is optimal to operate the menu. In this work, we used a novel method to assess the overall performance of the system, named Utility (Dal Seno et al. (2010)) while using the preferred control paradigm. 2.2 semg and EOG control For individuals with disabilities that do not affect voluntary control of facial muscles, we propose a system based on semg and EOG signals. With the aim of ensuring a high reliability, we defined the three paradigms aforementioned: moving eyes horizontally (left/right), raising brow and prolonged clench. For processing semg/eog signals, a comparison of the signal amplitude with a predefined threshold value was performed. Aspects involving the width and duration of the signal components in the decision of classification were observed. The signals corresponding to the left-right eye movements were dominant in the horizontal axes. For those signals, we found an amplitude and duration very prolonged, opposite signals and high amplitude. Thus, the user is able to control the options through moving eyes whereas the raising brow is used to confirm the highlighted option. Finally, prolonged clench option is used for activation and deactivation of the SSVEP-BCI. Fig. 2 shows a summary of the three paradigms allocated for the semg/eog approaches. Fig. 2. Biological signal transducer module for semg/eog signals. Each individual performed the tasks regarding the semg/ EOG in a different personal fashion. Thus, it is quite optimistic to expect that a new user is able to achieve an optimal performance since the first trial. However, our tests revealed than for most users, just a very brief adaptation period was required to figure out the best way to perform the gesture. This adaptation period consisted of 2 or 3 minutes while the user tries to execute a command and observe a visual feedback in a LCD screen. Although this step is not required, it is recommended considering that this procedure can accelerate the development of the user s control skills. Online experiments with eight healthy subjects were performed. Further, the subjects were seated on the wheelchair, in front of the display where the program was running, and asked to perform thirty repetitions per command, resulting in 90 total trials. In a control panel, the level of clenching and raising brow through continuous values between 0 and 1 is expressed, so it is sufficient to set predefined thresholds to detect the two movements. We opted to trigger an action when the correspondent value is greater than 0.8 and the other one is less than 0.2. These thresholds were obtained empirically; we found them to provide good results with most subjects. For detecting eye movements, our system provides a discrete number with values 0 and 1. We analyzed the classification accuracy of 720 total trials. Hence, the average accuracy and trial duration using Utility were computed. 2.3 Estimation of MSI for SSVEP-BCI This stage is in charge of controlling the navigation of the robotic wheelchair. Five subjects (three males and two females), with ages from 21 to 27 years old, were recruited to participate in this study (average age: 25.6; Standard Deviation (STD): 2.61). The research was carried out in compliance with Helsinki declaration, and the experiments were performed according to the rules of the ethics committee of UFES/Brazil, under registration number CEP- 048/08. For the development of the SSVEP-BCI, 12 channels of EEG with the reference at the left ear lobe were recorded at 600 samples/s, with 1 to 100 Hz pass-band. The ground electrode was placed on the forehead. The EEG electrode placements were based on the International System. The electrodes used were: P7, PO7, PO5, PO3, POz, PO4, PO6, PO8, P8, O1, O2 and Oz. The equipment used for EEG signal recording was BrainNet-36. The timing of the four LEDs flickers was precisely controlled by a microcontroller (PIC18F4550, Microchip Technology Inc., USA) with 50/50% on-off duties, and frequencies of 8.0 Hz (top), 11.0 Hz (right), 13.0 Hz (bottom) and 15.0 Hz (left). To send commands to the wheelchair, the user has to fix the attention to one of the flickering frequencies. The EEG data are segmented and windowed in window lengths (WL) of 1 s with an overlap of 50%. Then, a spatial filtering is applied using a Common Average Reference (CAR) filter and a band-pass filter between 3-60 Hz for the twelve channels. Several studies (Vialatte et al. (2010); Pastor et al. (2003)) confirm that visual evoked potentials are generated with greater intensity on the occipital area of the cortex. Thus, the twelve electrodes were used in the initial stage only for application of a CAR spatial filter. According to our observations, the application of this spatial filter to the twelve electrodes improves the classification performance when selecting O1, O2 and Oz electrodes. Based on that fact, we have evaluated the detection of SSVEPs using these three channels as input vector for the feature extractor after the filtering process. Multivariate Synchronization Index (MSI) was used for feature extraction. A brief description of this technique is explained below. MSI is a novel method to estimate the synchronization between the actual mixed signals and the reference signals as a potential index for recognizing the stimulus frequency. (Zhang et al. (2014)) has proposed the use of a S-estimator as index, which is based on the entropy of the normalized eigenvalues of the correlation matrix of multivariate signals. Autocorrelation matrices C 11 and C 22 for X and Y i, respectively, and crosscorrelation matrices C 12 and C 21 for X and Y i can be obtained as (Tello et al. (2014)), where i refers to the number of targets Copyright 2015 IFAC. 146

4 C 11 = (1/N).XX T (1) T C 22 = (1/N).Y i.y i (2) T C 12 = (1/N).XY i (3) C 21 = (1/N).Y i.x T (4) A correlation matrix C i can [ be constructed ] as C i C11 C = 12 C 21 C 22 (5) in the lateral canthus of the eye (F7 and F8 position according to standard) in order to monitoring the frontal lobe. In addition, Fig. 4 shows the general block diagram of the proposed system. The internal correlation structure of X and Y i contained in the matrices C 11 and C 22, respectively, is irrelevant for the detection of stimulus frequency (Carmeli et al. (2005)). It can be removed by constructing a linear transformation matrix U = [ C11 1/2 0 0 C 22 1/2 ] (6) So that C 1/2 11 C 1/2 11 =C 11, C 1/2 22 C 1/2 22 =C 22 and by applying the transformation C i = UCU which results in a transformed correlation matrix of size P P, where P = M + 2H (Carmeli et al. (2005)). The eigenvalues λ i 1, λ i 2,...,λ i P of C i, normalized as λ i m = λ i m/ P m=1 λi m for m = 1, 2,..., P, can be used to evaluate the synchronization index S i for matrix Y i as P m=1 S i = 1 + λ i m log( λ i m) (7) log(p ) see (Zhang et al. (2014)). Using S 1,S 2,...,S K computed for the stimulus frequencies f 1,f 2,...,f K, the MSI can be estimated as S = maximum S i (8) 1 i K In this case, the way to assess the performance of the SSVEP-BCI system was the Shannon s Information Transfer Rate (ITR), see details in (Vialatte et al. (2010)). 3. SYSTEM ARCHITECTURE semg, EOG and EEG signals are captured by the signal acquisition equipment, which has inputs for electromyographic and electroencephalographic signals. Through a computational sniffer the biological signals are read from the equipment, then these signals are transmitted and processed in an embedded computer by algorithms developed in Matlab. This embedded computer in the wheelchair has the following specifications: Mini ITX motherboard, 3.40 GHz Intel Core i5 processor, and 4GB RAM. The data are analyzed in the main routine and the prolonged clench signal works as a switch, which determines the operation of the navigation or the smart environment control. Raising brow or moving the eyes are used to control the devices inside the house. The navigation of the wheelchair is executed through the SSVEP-BCI approach, which is based on commands and these are used for directional control of the wheelchair. The LED on the above side (8 Hz) indicates forward, the LED on the right indicates the movement to the right turn (11 Hz), the LED on the left side (15 Hz) indicates the movement to the left turn and, finally, the LED on the bottom (13 Hz) indicates stopping. Fig. 3 shows all electrode placement locations and a user on the wheelchair. The semg/eog electrodes were placed Fig. 3. (a) Electrode placement location using system for our system; (b) an user using the wheelchair. 4. EXPERIMENTAL RESULTS Table 1 summarizes the classification outcome for muscle movement tasks. Each movement is treated independently because a subject may be able to execute some movement very better (or worse) than the others. It can be noticed that the average accuracy is remarkably higher than random guessing and often expresses a very good performance of the classifier (between 85% to 95%). Nevertheless, as often in assistive technologies, some users show troubles while realizing a certain movement that preclude them to give the correspondent command. For example, subject 1 was not able to succeed while raising brow. Since the computation of Utility depends on which menu option the user wants to operate, we consider the mean Utility as the arithmetic mean of the Utility in a menu with four options and express the result in bits per minute to facilitate the comparison with ITR. A critical advantage of control by means of muscle movement is the speed of recognition. It can be seen that an operation is triggered after a very small amount of time. Fig. 5 represents the results of online tests using facial expressions. Each point represents an expression made by a user. Points in the top-left corner indicate better performance. The size of the dots represents the value of Utility. This could lead to a fast and efficient control paradigm, especially after a period of training and selfimprovement. For evaluation of the EEG control, each volunteer (during 30 seconds) fixes his/her attention to each stimulus and the results are shown in Table 2. The results from the SSVEP- BCI were acceptable considering that subjects never used a BCI and neither had previous training. The highest value of accuracy was for the subject 3 with 77% and bits/min of ITR achieved from the average value of the accuracy. Copyright 2015 IFAC. 147

5 Navigation Control Pre-processing Feature Extraction Classification semg (Clenching) Main Routine PC Switch Control Brain Signals (EEG) Biosignal Acquisition Equipment EOG + semg (raising brow) Smart Environment UFES Robotic Wheelchair Brain Signals (EEG) Ocular globe (EOG) Switch Control 8 Hz Face muscles (semg) 15 Hz 13 Hz 11 Hz Visual stimuli through SSVEP Navigation Fig. 4. The system paradigm of our multimodal system. Fig. 5. Comparison between control of the system from different muscle movements and speed of recognition. Table 1. Accuracy results for EEG control using WL of 1 s. SSVEP Subjects Frequency s1 s2 s3 s4 s5 8 Hz Hz Hz Hz Mean Acc. [%] ITR [bits/min] CONCLUSION In this paper we presented a multimodal system capable to employ different biological signals in order to control several home appliances and the navigation of a robotic wheelchair. Three control paradigms using semg, EOG and EEG signals were introduced and each stage showed a good performance for most subjects. Our strategy provides the reliability in terms of classification result and safety of wheelchair control. To evaluate the semg/eog system, eight subjects participated of the experiments. The average accuracy for prolonged clench approach was of 95%, the raising brow was 85% and moving eyes achieved 93%. On the other hand, five subjects participated of the study for the SSVEP-BCI. The total values of classification vary in the range of 45-77% among subjects, considering a WL of 1s. Our results would even improve because it is widely known that increase in accuracy is related with increase of the time windows (Tello et al. (2014)), this fact suggests that while more information is processed, the feature extractor can detect visual evoked potentials with more precision. ACKNOWLEDGEMENTS The authors wish to thank all the volunteers for their participation in the experiments. REFERENCES Bastos, T., Muller, S., Benevides, A., and Sarcinelli-Filho, M. (2011). Robotic wheelchair commanded by SSVEP, motor imagery and word generation. In IEEE Engineering in Medicine and Biology Society, (EMBC). Cao, L., Li, J., Ji, H., and Jiang, C. (2014). A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control. Journal of Neuroscience Methods, 229, Carmeli, C., Knyazeva, M.G., Innocenti, G.M., and Feo, O.D. (2005). Assessment of EEG synchronization based on state-space analysis. NeuroImage, 25, Copyright 2015 IFAC. 148

6 Chen, C.H., Ho, M.S., Shyu, K.K., Hsu, K.C., Wang, K.W., and Lee, P.L. (2014). A noninvasive brain computer interface using visually-induced near-infrared spectroscopy responses. Neur. Letters, 580, Dal Seno, B., Matteucci, M., and Mainardi, L. (2010). The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain-Computer Interfaces. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 18(1), Diez, P.F., Muller, S.M.T., Mut, V.A., Laciar, E., Avila, E., Bastos-Filho, T.F., and Sarcinelli-Filho, M. (2013). Commanding a robotic wheelchair with a highfrequency steady-state visual evoked potential based brain-computer interface. Med Eng Phys. Edlinger, G. and Guger, C. (2012). A hybrid Brain- Computer Interface for improving the usability of a smart home control. In Complex Medical Engineering (CME), 2012 ICME, Ferrara, F., Bissoli, A., and Bastos-Filho, T. (2015). Designing an Assistive Control Interface based on Utility. Proceedings of the 1st International Workshop on Assistive Technology IWAT 2015, Vitoria, Brazil, Gao, X., Xu, D., Cheng, M., and Gao, S. (2003). A BCIbased environmental controller for the motion-disabled. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 11(2), He, B. (2013). Neural Engineering. Springer. 2nd ed. Holzner, C., Guger, C., Edlinger, G., Gronegress, C., and Slater, M. (2009). Virtual Smart Home Controlled by Thoughts. In Enabling Technologies: Infrastructures for Collaborative Enterprises, WETICE th IEEE International Workshops on, Kelly, S., Lalor, E., Reilly, R., and Foxe, J. (2005). Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 13(2), Li, Y., Pan, J., Wang, F., and Yu, Z. (2013). A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control. Biomedical Engineering, IEEE Transactions on, 60(11), Muller, S.M.T., de S, A.M.F.L.M., Bastos-Filho, T.F., and Sarcinelli-Filho, M. (2011). Spectral techniques for incremental SSVEP analysis applied to a BCI implementation. V CLAIB La Habana, Ou, C.Z., Lin, B.S., Chang, C.J., and Lin, C.T. (2012). Brain Computer Interface-based Smart Environmental Control System. In Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Pastor, M., Artieda, J., Arbizu, J., Valencia, M., and Masdeu, J. (2003). Human cerebral activation during steady-state visual evoked response. J. Neurosci. Punsawad, Y. and Wongsawat, Y. (2013). Hybrid SSVEPmotion visual stimulus based BCI system for intelligent wheelchair. In Engineering in Medicine and Biology Society (EMBC), Singla, R., Khosla, A., and Jha, R. (2014). Influence of stimuli colour in SSVEP-based BCI wheelchair control using support vector machines. Journal of Medical Engineering & Technology, 38, Tello, R., Muller, S., Bastos-Filho, T., and Ferreira, A. (2014). A comparison of techniques and technologies for SSVEP classification. In Biosignals and Biorobotics Conference (BRC), 5th ISSNIP-IEEE, 1 6. Vialatte, F.B., Mauriceb, M., Dauwelsc, J., and Cichocki, A. (2010). Steady state visually evoked potentials: Focus on essential paradigms and future perspectives. Progress in Neurobiology, 90, Wang, M., Daly, I., Allison, B.Z., Jin, J., Zhang, Y., Chen, L., and Wang, X. (2014). A new hybrid BCI paradigm based on P300 and SSVEP. Jour of Neur Methods. Wolpaw, J., Birbaumer, N., Heetderks, W., McFarland, D., Peckham, P., Schalk, G., Donchin, E., Quatrano, L., Robinson, C., and Vaughan, T. (2000). Brain-computer interface technology: a review of the first international meeting. Rehabilitation Engineering, IEEE Transactions on, 8(2), Xu, Z., Li, J., Gu, R., and Xia, B. (2012). Steady- State Visually Evoked Potential (SSVEP)-Based Brain- Computer Interface (BCI): A Low-Delayed Asynchronous Wheelchair Control System. Neural Information Processing. 19th ICONIP. Springer., Zhang, D., Maye, A., Gao, X., Hong, B., Engel, A.K., and Gao, S. (2010). An independent brain-computer interface using covert non-spatial visual selective attention. J. Neural Eng. Zhang, Y., Xu, P., Cheng, K., and Yao, D. (2014). Multivariate synchronization index for frequency recognition of SSVEP-based brain computer interface. Journal of Neuroscience Methods, 221(0), Table 2. Summary results for semg/eog control. Prolonged clench Subject Acc. [%] Time [s] Utility [bits/min] Average Raising brow Subject Acc. [%] Time [s] Utility [bits/min] Average Moving eyes Subject Acc. [%] Time [s] Utility [bits/min] Average Copyright 2015 IFAC. 149

An Improved SSVEP Based BCI System Using Frequency Domain Feature Classification

An Improved SSVEP Based BCI System Using Frequency Domain Feature Classification American Journal of Biomedical Engineering 213, 3(1): 1-8 DOI: 1.5923/j.ajbe.21331.1 An Improved SSVEP Based BCI System Using Frequency Domain Feature Classification Seyed Navid Resalat, Seyed Kamaledin

More information

Impact of Stimulus Configuration on Steady State Visual Evoked Potentials (SSVEP) Response

Impact of Stimulus Configuration on Steady State Visual Evoked Potentials (SSVEP) Response Impact of Stimulus Configuration on Steady State Visual Evoked Potentials (SSVEP) Response Chi-Hsu Wu Bioengineering Unit University of Strathclyde Glasgow, United Kingdom e-mail: chihsu.wu@strath.ac.uk

More information

Towards an SSVEP Based BCI With High ITR

Towards an SSVEP Based BCI With High ITR Towards an SSVEP Based BCI With High ITR Ivan Volosyak, Diana Valbuena, Thorsten Lüth, and Axel Gräser 1 Abstract A brain-computer interface (BCI) provides the possibility to translate brain neural activity

More information

A Brain-Computer Interface Based on Steady State Visual Evoked Potentials for Controlling a Robot

A Brain-Computer Interface Based on Steady State Visual Evoked Potentials for Controlling a Robot A Brain-Computer Interface Based on Steady State Visual Evoked Potentials for Controlling a Robot Robert Prueckl 1, Christoph Guger 1 1 g.tec, Guger Technologies OEG, Sierningstr. 14, 4521 Schiedlberg,

More information

The effect of the viewing distance of stimulus on SSVEP response for use in Brain Computer Interfaces

The effect of the viewing distance of stimulus on SSVEP response for use in Brain Computer Interfaces The effect of the viewing distance of stimulus on SSVEP response for use in Brain Computer Interfaces Chi-Hsu Wu, Heba Lakany Department of Biomedical Engineering University of Strathclyde Glasgow, UK

More information

A Review of SSVEP Decompostion using EMD for Steering Control of a Car

A Review of SSVEP Decompostion using EMD for Steering Control of a Car A Review of SSVEP Decompostion using EMD for Steering Control of a Car Mahida Ankur H 1, S. B. Somani 2 1,2. MIT College of Engineering, Kothrud, Pune, India Abstract- Recently the EEG based systems have

More information

A Practical VEP-Based Brain Computer Interface

A Practical VEP-Based Brain Computer Interface 234 IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, VOL. 14, NO. 2, JUNE 2006 A Practical VEP-Based Brain Computer Interface Yijun Wang, Ruiping Wang, Xiaorong Gao, Bo Hong, and Shangkai

More information

Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers

Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers Motor Imagery based Brain Computer Interface (BCI) using Artificial Neural Network Classifiers Maitreyee Wairagkar Brain Embodiment Lab, School of Systems Engineering, University of Reading, Reading, U.K.

More information

Non Invasive Brain Computer Interface for Movement Control

Non Invasive Brain Computer Interface for Movement Control Non Invasive Brain Computer Interface for Movement Control V.Venkatasubramanian 1, R. Karthik Balaji 2 Abstract: - There are alternate methods that ease the movement of wheelchairs such as voice control,

More information

780. Biomedical signal identification and analysis

780. Biomedical signal identification and analysis 780. Biomedical signal identification and analysis Agata Nawrocka 1, Andrzej Kot 2, Marcin Nawrocki 3 1, 2 Department of Process Control, AGH University of Science and Technology, Poland 3 Department of

More information

A Study on Gaze Estimation System using Cross-Channels Electrooculogram Signals

A Study on Gaze Estimation System using Cross-Channels Electrooculogram Signals , March 12-14, 2014, Hong Kong A Study on Gaze Estimation System using Cross-Channels Electrooculogram Signals Mingmin Yan, Hiroki Tamura, and Koichi Tanno Abstract The aim of this study is to present

More information

Multi-target SSVEP-based BCI using Multichannel SSVEP Detection

Multi-target SSVEP-based BCI using Multichannel SSVEP Detection Multi-target SSVEP-based BCI using Multichannel SSVEP Detection Indar Sugiarto Department of Electrical Engineering, Petra Christian University Jl. Siwalankerto -3, Surabaya, Indonesia indi@petra.ac.id

More information

Classifying the Brain's Motor Activity via Deep Learning

Classifying the Brain's Motor Activity via Deep Learning Final Report Classifying the Brain's Motor Activity via Deep Learning Tania Morimoto & Sean Sketch Motivation Over 50 million Americans suffer from mobility or dexterity impairments. Over the past few

More information

Playing with your mind

Playing with your mind Journal of Physics: Conference Series OPEN ACCESS Playing with your mind To cite this article: Mauro Rodríguez et al 2013 J. Phys.: Conf. Ser. 477 012038 View the article online for updates and enhancements.

More information

On diversity within operators EEG responses to LED-produced alternate stimulus in

On diversity within operators EEG responses to LED-produced alternate stimulus in On diversity within operators EEG responses to LED-produced alternate stimulus in SSVEP BCI Marcin Byczuk, Paweł Poryzała, Andrzej Materka Lodz University of Technology, Institute of Electronics, 211/215

More information

Patter Recognition Applied to Mouse Pointer Controlled by Ocular Movements

Patter Recognition Applied to Mouse Pointer Controlled by Ocular Movements Patter Recognition Applied to Mouse Pointer Controlled by Ocular Movements JOB RAMÓN DE LA O CHÁVEZ, CARLOS AVILÉS CRUZ Signal Processing and Pattern Recognition Universidad Autónoma Metropolitana Unidad

More information

Controlling a Robotic Arm by Brainwaves and Eye Movement

Controlling a Robotic Arm by Brainwaves and Eye Movement Controlling a Robotic Arm by Brainwaves and Eye Movement Cristian-Cezar Postelnicu 1, Doru Talaba 2, and Madalina-Ioana Toma 1 1,2 Transilvania University of Brasov, Romania, Faculty of Mechanical Engineering,

More information

Non-Invasive Brain-Actuated Control of a Mobile Robot

Non-Invasive Brain-Actuated Control of a Mobile Robot Non-Invasive Brain-Actuated Control of a Mobile Robot Jose del R. Millan, Frederic Renkens, Josep Mourino, Wulfram Gerstner 5/3/06 Josh Storz CSE 599E BCI Introduction (paper perspective) BCIs BCI = Brain

More information

Off-line EEG analysis of BCI experiments with MATLAB V1.07a. Copyright g.tec medical engineering GmbH

Off-line EEG analysis of BCI experiments with MATLAB V1.07a. Copyright g.tec medical engineering GmbH g.tec medical engineering GmbH Sierningstrasse 14, A-4521 Schiedlberg Austria - Europe Tel.: (43)-7251-22240-0 Fax: (43)-7251-22240-39 office@gtec.at, http://www.gtec.at Off-line EEG analysis of BCI experiments

More information

An EOG based Human Computer Interface System for Online Control. Carlos A. Vinhais, Fábio A. Santos, Joaquim F. Oliveira

An EOG based Human Computer Interface System for Online Control. Carlos A. Vinhais, Fábio A. Santos, Joaquim F. Oliveira An EOG based Human Computer Interface System for Online Control Carlos A. Vinhais, Fábio A. Santos, Joaquim F. Oliveira Departamento de Física, ISEP Instituto Superior de Engenharia do Porto Rua Dr. António

More information

EasyChair Preprint. A Tactile P300 Brain-Computer Interface: Principle and Paradigm

EasyChair Preprint. A Tactile P300 Brain-Computer Interface: Principle and Paradigm EasyChair Preprint 117 A Tactile P300 Brain-Computer Interface: Principle and Paradigm Aness Belhaouari, Abdelkader Nasreddine Belkacem and Nasreddine Berrached EasyChair preprints are intended for rapid

More information

Training of EEG Signal Intensification for BCI System. Haesung Jeong*, Hyungi Jeong*, Kong Borasy*, Kyu-Sung Kim***, Sangmin Lee**, Jangwoo Kwon*

Training of EEG Signal Intensification for BCI System. Haesung Jeong*, Hyungi Jeong*, Kong Borasy*, Kyu-Sung Kim***, Sangmin Lee**, Jangwoo Kwon* Training of EEG Signal Intensification for BCI System Haesung Jeong*, Hyungi Jeong*, Kong Borasy*, Kyu-Sung Kim***, Sangmin Lee**, Jangwoo Kwon* Department of Computer Engineering, Inha University, Korea*

More information

An Ssvep-Based Bci System and its Applications

An Ssvep-Based Bci System and its Applications An Ssvep-Based Bci System and its Applications Jzau-Sheng Lin Dept. of Computer Science and Information Eng., National Chin-Yi University of Technology No.57, Sec. 2, Zhongshan Rd., Taiping Dist., Taichung

More information

doi: /APSIPA

doi: /APSIPA doi: 10.1109/APSIPA.2014.7041770 P300 Responses Classification Improvement in Tactile BCI with Touch sense Glove Hiroki Yajima, Shoji Makino, and Tomasz M. Rutkowski,,5 Department of Computer Science and

More information

Brain Computer Interface Control of a Virtual Robotic System based on SSVEP and EEG Signal

Brain Computer Interface Control of a Virtual Robotic System based on SSVEP and EEG Signal Brain Computer Interface Control of a Virtual Robotic based on SSVEP and EEG Signal By: Fatemeh Akrami Supervisor: Dr. Hamid D. Taghirad October 2017 Contents 1/20 Brain Computer Interface (BCI) A direct

More information

MOUSE CURSOR CONTROL SYTEM BASED ON SSVEP

MOUSE CURSOR CONTROL SYTEM BASED ON SSVEP DOI: http://dx.doi.org/10.26483/ijarcs.v8i7.4147 Volume 8, No. 7, July August 2017 International Journal of Advanced Research in Computer Science RESEARCH PAPER Available Online at www.ijarcs.info ISSN

More information

1. INTRODUCTION: 2. EOG: system, handicapped people, wheelchair.

1. INTRODUCTION: 2. EOG: system, handicapped people, wheelchair. ABSTRACT This paper presents a new method to control and guide mobile robots. In this case, to send different commands we have used electrooculography (EOG) techniques, so that, control is made by means

More information

The Virtual Reality Brain-Computer Interface System for Ubiquitous Home Control

The Virtual Reality Brain-Computer Interface System for Ubiquitous Home Control The Virtual Reality Brain-Computer Interface System for Ubiquitous Home Control Hyun-sang Cho, Jayoung Goo, Dongjun Suh, Kyoung Shin Park, and Minsoo Hahn Digital Media Laboratory, Information and Communications

More information

Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands

Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands Filipp Gundelakh 1, Lev Stankevich 1, * and Konstantin Sonkin 2 1 Peter the Great

More information

Presented by: V.Lakshana Regd. No.: Information Technology CET, Bhubaneswar

Presented by: V.Lakshana Regd. No.: Information Technology CET, Bhubaneswar BRAIN COMPUTER INTERFACE Presented by: V.Lakshana Regd. No.: 0601106040 Information Technology CET, Bhubaneswar Brain Computer Interface from fiction to reality... In the futuristic vision of the Wachowski

More information

BCI for Comparing Eyes Activities Measured from Temporal and Occipital Lobes

BCI for Comparing Eyes Activities Measured from Temporal and Occipital Lobes BCI for Comparing Eyes Activities Measured from Temporal and Occipital Lobes Sachin Kumar Agrawal, Annushree Bablani and Prakriti Trivedi Abstract Brain computer interface (BCI) is a system which communicates

More information

A MOBILE EEG SYSTEM FOR PRACTICAL APPLICATIONS. Sciences, Beijing , China

A MOBILE EEG SYSTEM FOR PRACTICAL APPLICATIONS. Sciences, Beijing , China A MOBILE EEG SYSTEM FOR PRACTICAL APPLICATIONS Xiaoshan Huang 1,2 *, Erwei Yin 3 *, Yijun Wang 4, Rami Saab 1, Xiaorong Gao 1 1 Department of Biomedical Engineering, Tsinghua University, Beijing 100084,

More information

BCI-based Electric Cars Controlling System

BCI-based Electric Cars Controlling System nications for smart grid. Renewable and Sustainable Energy Reviews, 41, p.p.248-260. 7. Ian J. Dilworth (2007) Bluetooth. The Cable and Telecommunications Professionals' Reference (Third Edition) PSTN,

More information

Physiological signal(bio-signals) Method, Application, Proposal

Physiological signal(bio-signals) Method, Application, Proposal Physiological signal(bio-signals) Method, Application, Proposal Bio-Signals 1. Electrical signals ECG,EMG,EEG etc 2. Non-electrical signals Breathing, ph, movement etc General Procedure of bio-signal recognition

More information

Behavior-Based SSVEP Hierarchical Architecture for Telepresence Control of Humanoid Robot to Achieve Full-Body Movement

Behavior-Based SSVEP Hierarchical Architecture for Telepresence Control of Humanoid Robot to Achieve Full-Body Movement IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, VOL. 9, NO. 2, JUNE 2017 197 Behavior-Based SSVEP Hierarchical Architecture for Telepresence Control of Humanoid Robot to Achieve Full-Body Movement

More information

Spatial Auditory BCI Paradigm based on Real and Virtual Sound Image Generation

Spatial Auditory BCI Paradigm based on Real and Virtual Sound Image Generation Spatial Auditory BCI Paradigm based on Real and Virtual Sound Image Generation Nozomu Nishikawa, Shoji Makino, Tomasz M. Rutkowski,, TARA Center, University of Tsukuba, Tsukuba, Japan E-mail: tomek@tara.tsukuba.ac.jp

More information

Review: Recent Development of Signal Processing Algorithms for SSVEP-based Brain Computer Interfaces

Review: Recent Development of Signal Processing Algorithms for SSVEP-based Brain Computer Interfaces Journal of Medical and Biological Engineering, 34(4): 299-309 299 Review: Recent Development of Signal Processing Algorithms for SSVEP-based Brain Computer Interfaces Quan Liu 1 Kun Chen 1,2,* Qingsong

More information

BRAINWAVE CONTROLLED WHEEL CHAIR USING EYE BLINKS

BRAINWAVE CONTROLLED WHEEL CHAIR USING EYE BLINKS BRAINWAVE CONTROLLED WHEEL CHAIR USING EYE BLINKS Harshavardhana N R 1, Anil G 2, Girish R 3, DharshanT 4, Manjula R Bharamagoudra 5 1,2,3,4,5 School of Electronicsand Communication, REVA University,Bangalore-560064

More information

Electroencephalogram (EEG) Sensor for Teleoperation of Domotics Applications via Virtual Environments

Electroencephalogram (EEG) Sensor for Teleoperation of Domotics Applications via Virtual Environments Electroencephalogram (EEG) Sensor for Teleoperation of Domotics Applications via Virtual Environments Oscar F. Avilés S Titular Professor, Department of Mechatronics Engineering, Militar Nueva Granada

More information

Brain-computer Interface Based on Steady-state Visual Evoked Potentials

Brain-computer Interface Based on Steady-state Visual Evoked Potentials Brain-computer Interface Based on Steady-state Visual Evoked Potentials K. Friganović*, M. Medved* and M. Cifrek* * University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, Croatia

More information

ROBOT APPLICATION OF A BRAIN COMPUTER INTERFACE TO STAUBLI TX40 ROBOTS - EARLY STAGES NICHOLAS WAYTOWICH

ROBOT APPLICATION OF A BRAIN COMPUTER INTERFACE TO STAUBLI TX40 ROBOTS - EARLY STAGES NICHOLAS WAYTOWICH World Automation Congress 2010 TSl Press. ROBOT APPLICATION OF A BRAIN COMPUTER INTERFACE TO STAUBLI TX40 ROBOTS - EARLY STAGES NICHOLAS WAYTOWICH Undergraduate Research Assistant, Mechanical Engineering

More information

A Study on Ocular and Facial Muscle Artifacts in EEG Signals for BCI Applications

A Study on Ocular and Facial Muscle Artifacts in EEG Signals for BCI Applications A Study on Ocular and Facial Muscle Artifacts in EEG Signals for BCI Applications Carmina E. Reyes, Janine Lizbeth C. Rugayan, Carl Jason G. Rullan, Carlos M. Oppus ECCE Department Ateneo de Manila University

More information

EEG Signal Analysis Methods Based on Steady State Visual Evoked Potential Stimuli for the Development of Brain Computer Interfaces: A Review

EEG Signal Analysis Methods Based on Steady State Visual Evoked Potential Stimuli for the Development of Brain Computer Interfaces: A Review Review Article EEG Signal Analysis Methods Based on Steady State Visual Evoked Potential Stimuli for the Development of Brain Computer Interfaces: A Review S. M. Fernandez-Fraga 1, M.A. Aceves-Fernandez*

More information

Tactile Brain computer Interface Using Classification of P300 Responses Evoked by Full Body Spatial Vibrotactile Stimuli

Tactile Brain computer Interface Using Classification of P300 Responses Evoked by Full Body Spatial Vibrotactile Stimuli Tactile Brain computer Interface Using Classification of P300 Responses Evoked by Full Body Spatial Vibrotactile Stimuli Takumi Kodama, Shoji Makino and Tomasz M. Rutkowski 5 Life Science Center of TARA,

More information

The Making of a Kinect-based Control Car and Its Application in Engineering Education

The Making of a Kinect-based Control Car and Its Application in Engineering Education The Making of a Kinect-based Control Car and Its Application in Engineering Education Ke-Yu Lee Department of Computer Science and Information Engineering, Cheng-Shiu University, Taiwan Chun-Chung Lee

More information

Appliance of Genetic Algorithm for Empirical Diminution in Electrode numbers for VEP based Single Trial BCI.

Appliance of Genetic Algorithm for Empirical Diminution in Electrode numbers for VEP based Single Trial BCI. Appliance of Genetic Algorithm for Empirical Diminution in Electrode numbers for VEP based Single Trial BCI. S. ANDREWS 1, LOO CHU KIONG 1 and NIKOS MASTORAKIS 2 1 Faculty of Information Science and Technology,

More information

ISSN: [Folane* et al., 6(3): March, 2017] Impact Factor: 4.116

ISSN: [Folane* et al., 6(3): March, 2017] Impact Factor: 4.116 IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY BRAIN COMPUTER INTERFACE BASED WHEELCHAIR: A ROBOTIC ARCHITECTURE Nikhil R Folane *, Laxmikant K Shevada, Abhijeet A Chavan, Kiran

More information

Leonard J. Trejo, Roman Rosipal, and Bryan Matthews

Leonard J. Trejo, Roman Rosipal, and Bryan Matthews IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, VOL. 14, NO. 2, JUNE 2006 225 Brain Computer Interfaces for 1-D and 2-D Cursor Control: Designs Using Volitional Control of the EEG Spectrum

More information

Classification of Four Class Motor Imagery and Hand Movements for Brain Computer Interface

Classification of Four Class Motor Imagery and Hand Movements for Brain Computer Interface Classification of Four Class Motor Imagery and Hand Movements for Brain Computer Interface 1 N.Gowri Priya, 2 S.Anu Priya, 3 V.Dhivya, 4 M.D.Ranjitha, 5 P.Sudev 1 Assistant Professor, 2,3,4,5 Students

More information

Research Article Noninvasive Electroencephalogram Based Control of a Robotic Arm for Writing Task Using Hybrid BCI System

Research Article Noninvasive Electroencephalogram Based Control of a Robotic Arm for Writing Task Using Hybrid BCI System Hindawi BioMed Research International Volume 2017, Article ID 8316485, 8 pages https://doi.org/10.1155/2017/8316485 Research Article Noninvasive Electroencephalogram Based Control of a Robotic Arm for

More information

Metrics for Assistive Robotics Brain-Computer Interface Evaluation

Metrics for Assistive Robotics Brain-Computer Interface Evaluation Metrics for Assistive Robotics Brain-Computer Interface Evaluation Martin F. Stoelen, Javier Jiménez, Alberto Jardón, Juan G. Víctores José Manuel Sánchez Pena, Carlos Balaguer Universidad Carlos III de

More information

BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE

BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE 1. ABSTRACT This paper considers the development of a brain driven car, which would be of great help to the physically disabled people. Since

More information

arxiv: v2 [q-bio.nc] 30 Sep 2016

arxiv: v2 [q-bio.nc] 30 Sep 2016 Article Visual Motion Onset Brain computer Interface arxiv:17.95v [q-bio.nc] 3 Sep 1 1 3 5 7 8 9 1 11 1 13 1 15 1 17 18 19 1 3 5 7 8 9 3 31 Jair Pereira Junior 1,,, Caio Teixeira 1,3, and Tomasz M. Rutkowski

More information

Design of Signal Conditioning Circuit for Photoelectric Sensor. , Zhennan Zhang

Design of Signal Conditioning Circuit for Photoelectric Sensor. , Zhennan Zhang 7th International Conference on Education, Management, Computer and Medicine (EMCM 2016) Design of Signal Conditioning Circuit for Photoelectric Sensor 1, a* Nan Xie 2, b, Zhennan Zhang 2, c and Weimin

More information

BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE

BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE BRAIN CONTROLLED CAR FOR DISABLED USING ARTIFICIAL INTELLIGENCE Presented by V.DIVYA SRI M.V.LAKSHMI III CSE III CSE EMAIL: vds555@gmail.com EMAIL: morampudi.lakshmi@gmail.com Phone No. 9949422146 Of SHRI

More information

enhancement based on Canonical Correlation Analysis to improve BCI performances. AFRICON 2013,

enhancement based on Canonical Correlation Analysis to improve BCI performances. AFRICON 2013, SSVEP enhancement based on Canonical Correlation Analysis to improve BCI performances Emmanuel Kalunga, Karim Djouani, Yskandar Hamam, Sylvain Chevallier, Eric Monacelli To cite this version: Emmanuel

More information

Master Thesis Proposal: Chess Brain-Computer Interface Design and Optimization for Low-Bandwidth and Errors

Master Thesis Proposal: Chess Brain-Computer Interface Design and Optimization for Low-Bandwidth and Errors Master Thesis Proposal: Chess Brain-Computer Interface Design and Optimization for Low-Bandwidth and Errors Samuel A. Inverso Computer Science Department College of Computing and Information Sciences Rochester

More information

ANIMA: Non-conventional Brain-Computer Interfaces in Robot Control through Electroencephalography and Electrooculography, ARP Module

ANIMA: Non-conventional Brain-Computer Interfaces in Robot Control through Electroencephalography and Electrooculography, ARP Module ANIMA: Non-conventional Brain-Computer Interfaces in Robot Control through Electroencephalography and Electrooculography, ARP Module Luis F. Reina, Gerardo Martínez, Mario Valdeavellano, Marie Destarac,

More information

A Novel EEG Feature Extraction Method Using Hjorth Parameter

A Novel EEG Feature Extraction Method Using Hjorth Parameter A Novel EEG Feature Extraction Method Using Hjorth Parameter Seung-Hyeon Oh, Yu-Ri Lee, and Hyoung-Nam Kim Pusan National University/Department of Electrical & Computer Engineering, Busan, Republic of

More information

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3102 3107 INTE 2014 Fabrication of the kinect remote-controlled cars and planning of the motion

More information

A Study of Various Feature Extraction Methods on a Motor Imagery Based Brain Computer Interface System

A Study of Various Feature Extraction Methods on a Motor Imagery Based Brain Computer Interface System Basic and Clinical January 2016. Volume 7. Number 1 A Study of Various Feature Extraction Methods on a Motor Imagery Based Brain Computer Interface System Seyed Navid Resalat 1, Valiallah Saba 2* 1. Control

More information

Research on Hand Gesture Recognition Using Convolutional Neural Network

Research on Hand Gesture Recognition Using Convolutional Neural Network Research on Hand Gesture Recognition Using Convolutional Neural Network Tian Zhaoyang a, Cheng Lee Lung b a Department of Electronic Engineering, City University of Hong Kong, Hong Kong, China E-mail address:

More information

Computer Access Devices for Severly Motor-disability Using Bio-potentials

Computer Access Devices for Severly Motor-disability Using Bio-potentials Proceedings of the 5th WSEAS Int. Conf. on COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS, Venice, Italy, November 20-22, 2006 164 Computer Access Devices for Severly Motor-disability

More information

BRAINWAVE RECOGNITION

BRAINWAVE RECOGNITION College of Engineering, Design and Physical Sciences Electronic & Computer Engineering BEng/BSc Project Report BRAINWAVE RECOGNITION Page 1 of 59 Method EEG MEG PET FMRI Time resolution The spatial resolution

More information

International Journal of Computer Sciences and Engineering. Research Paper Volume-5, Issue-12 E-ISSN:

International Journal of Computer Sciences and Engineering. Research Paper Volume-5, Issue-12 E-ISSN: International Journal of Computer Sciences and Engineering Open Access Research Paper Volume-5, Issue-12 E-ISSN: 2347-2693 Performance Analysis of Real-Time Eye Blink Detector for Varying Lighting Conditions

More information

A Two-class Self-Paced BCI to Control a Robot in Four Directions

A Two-class Self-Paced BCI to Control a Robot in Four Directions 2011 IEEE International Conference on Rehabilitation Robotics Rehab Week Zurich, ETH Zurich Science City, Switzerland, June 29 - July 1, 2011 A Two-class Self-Paced BCI to Control a Robot in Four Directions

More information

Brain Computer Interfaces for Full Body Movement and Embodiment. Intelligent Robotics Seminar Kai Brusch

Brain Computer Interfaces for Full Body Movement and Embodiment. Intelligent Robotics Seminar Kai Brusch Brain Computer Interfaces for Full Body Movement and Embodiment Intelligent Robotics Seminar 21.11.2016 Kai Brusch 1 Brain Computer Interfaces for Full Body Movement and Embodiment Intelligent Robotics

More information

Voice Assisting System Using Brain Control Interface

Voice Assisting System Using Brain Control Interface I J C T A, 9(5), 2016, pp. 257-263 International Science Press Voice Assisting System Using Brain Control Interface Adeline Rite Alex 1 and S. Suresh Kumar 2 ABSTRACT This paper discusses the properties

More information

Classification for Motion Game Based on EEG Sensing

Classification for Motion Game Based on EEG Sensing Classification for Motion Game Based on EEG Sensing Ran WEI 1,3,4, Xing-Hua ZHANG 1,4, Xin DANG 2,3,4,a and Guo-Hui LI 3 1 School of Electronics and Information Engineering, Tianjin Polytechnic University,

More information

Wheeled Mobile Robot Kuzma I

Wheeled Mobile Robot Kuzma I Contemporary Engineering Sciences, Vol. 7, 2014, no. 18, 895-899 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ces.2014.47102 Wheeled Mobile Robot Kuzma I Andrey Sheka 1, 2 1) Department of Intelligent

More information

Brain-Computer Interface for Control and Communication with Smart Mobile Applications

Brain-Computer Interface for Control and Communication with Smart Mobile Applications University of Telecommunications and Post Sofia, Bulgaria Brain-Computer Interface for Control and Communication with Smart Mobile Applications Prof. Svetla Radeva, DSc, PhD HUMAN - COMPUTER INTERACTION

More information

Multi-modality EMG and Visual Based Hands-Free Control of an Intelligent Wheelchair

Multi-modality EMG and Visual Based Hands-Free Control of an Intelligent Wheelchair Multi-modality EMG and Visual Based Hands-Free Control of an Intelligent Wheelchair Lai Wei and Huosheng Hu School of Computer Science & Electronic Engineering, University of Essex Wivenhoe Park, Colchester

More information

Brain-machine interfaces through control of electroencephalographic signals and vibrotactile feedback

Brain-machine interfaces through control of electroencephalographic signals and vibrotactile feedback Brain-machine interfaces through control of electroencephalographic signals and vibrotactile feedback Fabio Aloise 1, Nicholas Caporusso 1,2, Donatella Mattia 1, Fabio Babiloni 1,3, Laura Kauhanen 4, José

More information

Key-Words: - Neural Networks, Cerebellum, Cerebellar Model Articulation Controller (CMAC), Auto-pilot

Key-Words: - Neural Networks, Cerebellum, Cerebellar Model Articulation Controller (CMAC), Auto-pilot erebellum Based ar Auto-Pilot System B. HSIEH,.QUEK and A.WAHAB Intelligent Systems Laboratory, School of omputer Engineering Nanyang Technological University, Blk N4 #2A-32 Nanyang Avenue, Singapore 639798

More information

EMD Approach to Multichannel EEG Data - The Amplitude and Phase Synchrony Analysis Technique

EMD Approach to Multichannel EEG Data - The Amplitude and Phase Synchrony Analysis Technique EMD Approach to Multichannel EEG Data - The Amplitude and Phase Synchrony Analysis Technique Tomasz M. Rutkowski 1, Danilo P. Mandic 2, Andrzej Cichocki 1, and Andrzej W. Przybyszewski 3,4 1 Laboratory

More information

Biomedical Signal Processing and Applications

Biomedical Signal Processing and Applications Proceedings of the 2010 International Conference on Industrial Engineering and Operations Management Dhaka, Bangladesh, January 9 10, 2010 Biomedical Signal Processing and Applications Muhammad Ibn Ibrahimy

More information

Analysis of brain waves according to their frequency

Analysis of brain waves according to their frequency Analysis of brain waves according to their frequency Z. Koudelková, M. Strmiska, R. Jašek Abstract The primary purpose of this article is to show and analyse the brain waves, which are activated during

More information

Implementation of Mind Control Robot

Implementation of Mind Control Robot Implementation of Mind Control Robot Adeel Butt and Milutin Stanaćević Department of Electrical and Computer Engineering Stony Brook University Stony Brook, New York, USA adeel.butt@stonybrook.edu, milutin.stanacevic@stonybrook.edu

More information

SSRG International Journal of Electronics and Communication Engineering - (2'ICEIS 2017) - Special Issue April 2017

SSRG International Journal of Electronics and Communication Engineering - (2'ICEIS 2017) - Special Issue April 2017 Eeg Based Brain Computer Interface For Communications And Control J.Abinaya,#1 R.JerlinEmiliya #2, #1,PG students [Communication system], Dept.of ECE, As-salam engineering and technology, Aduthurai, Tamilnadu,

More information

Asynchronous BCI Control of a Robot Simulator with Supervised Online Training

Asynchronous BCI Control of a Robot Simulator with Supervised Online Training Asynchronous BCI Control of a Robot Simulator with Supervised Online Training Chun Sing Louis Tsui and John Q. Gan BCI Group, Department of Computer Science, University of Essex, Colchester, CO4 3SQ, United

More information

OVER the past couple of decades, there have been numerous. Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI

OVER the past couple of decades, there have been numerous. Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI IEEE TRANSACTIONS ON ROBOTICS 1 Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI Yongwook Chae, Jaeseung Jeong, Member, IEEE, and Sungho Jo, Member, IEEE Abstract

More information

EEG-Based Brain-Controlled Wheelchair with Four Different Stimuli Frequencies

EEG-Based Brain-Controlled Wheelchair with Four Different Stimuli Frequencies Vol.8/No.1 (2016) INTERNETWORKING INDONESIA JOURNAL 65 EEG-Based Brain-Controlled Wheelchair with Four Different Stimuli Frequencies Arjon Turnip, Member, IEEE, Demi Soetraprawata, Mardi Turnip, Endra

More information

Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment

Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment EURASIP Journal on Applied Signal Processing 2005:19, 3156 3164 c 2005 Hindawi Publishing Corporation Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment E. C.

More information

Detecting spread spectrum pseudo random noise tags in EEG/MEG using a structure-based decomposition

Detecting spread spectrum pseudo random noise tags in EEG/MEG using a structure-based decomposition Detecting spread spectrum pseudo random noise tags in EEG/MEG using a structure-based decomposition P Desain 1, J Farquhar 1,2, J Blankespoor 1, S Gielen 2 1 Music Mind Machine Nijmegen Inst for Cognition

More information

Journal of NeuroEngineering and Rehabilitation

Journal of NeuroEngineering and Rehabilitation Journal of NeuroEngineering and Rehabilitation BioMed Central Research Human-machine interfaces based on EMG and EEG applied to robotic systems Andre Ferreira 1, Wanderley C Celeste 1, Fernando A Cheein

More information

Research Article Towards Development of a 3-State Self-Paced Brain-Computer Interface

Research Article Towards Development of a 3-State Self-Paced Brain-Computer Interface Computational Intelligence and Neuroscience Volume 2007, Article ID 84386, 8 pages doi:10.1155/2007/84386 Research Article Towards Development of a 3-State Self-Paced Brain-Computer Interface Ali Bashashati,

More information

BEYOND VISUAL P300 BASED BRAIN-COMPUTER INTERFACING PARADIGMS

BEYOND VISUAL P300 BASED BRAIN-COMPUTER INTERFACING PARADIGMS Innovations in Information and Communication Science and Technology Third Postgraduate Consortium International Workshop E. Cooper, G.A. Kobzev, A.F. Uvarov, and V.V. Kryssanov Eds. IICST 2013: pp. 277-283.

More information

Brain-Computer Interfaces, Virtual Reality, and Videogames

Brain-Computer Interfaces, Virtual Reality, and Videogames C O V E R F E A T U R E Brain-Computer Interfaces, Virtual Reality, and Videogames Anatole Lécuyer and Fabien Lotte, INRIA Richard B. Reilly, Trinity College Robert Leeb, Graz University of Technology

More information

Towards Multimodal, Multi-party, and Social Brain-Computer Interfacing

Towards Multimodal, Multi-party, and Social Brain-Computer Interfacing Towards Multimodal, Multi-party, and Social Brain-Computer Interfacing Anton Nijholt University of Twente, Human Media Interaction P.O. Box 217, 7500 AE Enschede, The Netherlands anijholt@cs.utwente.nl

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

BRAIN-COMPUTER INTERFACE FOR MOBILE DEVICES

BRAIN-COMPUTER INTERFACE FOR MOBILE DEVICES JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 24/2015, ISSN 1642-6037 brain computer interface, mobile devices, software tool, motor disability Krzysztof DOBOSZ 1, Piotr WITTCHEN 1 BRAIN-COMPUTER

More information

Bioengineering Department, Politecnico di Milano University, Milan, Italy 2

Bioengineering Department, Politecnico di Milano University, Milan, Italy 2 Computational Intelligence and Neuroscience Volume 009, Article ID 864564, 11 pages doi:10.1155/009/864564 Research Article A Robust and Self-Paced BCI System Based on a Four Class SSVEP Paradigm: Algorithms

More information

A CYBER PHYSICAL SYSTEMS APPROACH FOR ROBOTIC SYSTEMS DESIGN

A CYBER PHYSICAL SYSTEMS APPROACH FOR ROBOTIC SYSTEMS DESIGN Proceedings of the Annual Symposium of the Institute of Solid Mechanics and Session of the Commission of Acoustics, SISOM 2015 Bucharest 21-22 May A CYBER PHYSICAL SYSTEMS APPROACH FOR ROBOTIC SYSTEMS

More information

AN FPGA-BASED BCI SYSTEM WITH SSVEP AND PHASED CODING TECHNIQUES

AN FPGA-BASED BCI SYSTEM WITH SSVEP AND PHASED CODING TECHNIQUES 53 Journal of Technology, Vol. 33, o. 1, pp. 53-62 (2018) A FPGA-BASED BCI SYSTEM WITH SSVEP AD PHASED CODIG TECHIQUES Jzau-Sheng Lin* Wun-Ciang Wu Department of computer science and information engineering

More information

Research Article A Prototype SSVEP Based Real Time BCI Gaming System

Research Article A Prototype SSVEP Based Real Time BCI Gaming System Computational Intelligence and Neuroscience Volume 2016, Article ID 3861425, 15 pages http://dx.doi.org/10.1155/2016/3861425 Research Article A Prototype SSVEP Based Real Time BCI Gaming System Ignas Martišius

More information

Processing and Decoding Steady-State Visual Evoked Potentials for Brain-Computer Interfaces

Processing and Decoding Steady-State Visual Evoked Potentials for Brain-Computer Interfaces 1 Processing and Decoding Steady-State Visual Evoked Potentials for Brain-Computer Interfaces Nikolay Chumerin, Nikolay V. Manyakov, Marijn van Vliet, Arne Robben, Adrien Combaz, Marc M. Van Hulle {Nikolay.Chumerin,

More information

Hands-free Operation of a Small Mobile Robot*

Hands-free Operation of a Small Mobile Robot* c,, Hands-free Operation of a Small Mobile Robot* Wendy A Amai, Jill C Fahrenholtz, and Chris L Leger Sandia National Laboratories PO 5800, MS 1125 Albuquerque, NM 87185 (2 23Q 3 pm ~~~ +2!J< o~~ a t Abstract

More information

Impact of an Energy Normalization Transform on the Performance of the LF-ASD Brain Computer Interface

Impact of an Energy Normalization Transform on the Performance of the LF-ASD Brain Computer Interface Impact of an Energy Normalization Transform on the Performance of the LF-ASD Brain Computer Interface Zhou Yu 1 Steven G. Mason 2 Gary E. Birch 1,2 1 Dept. of Electrical and Computer Engineering University

More information

The Study of Methodologies for Identifying the Drowsiness in Smart Traffic System: A Survey Mariya 1 Mrs. Sumana K R 2

The Study of Methodologies for Identifying the Drowsiness in Smart Traffic System: A Survey Mariya 1 Mrs. Sumana K R 2 IJSRD - International Journal for Scientific Research & Development Vol. 3, Issue 02, 2015 ISSN (online): 2321-0613 The Study of Methodologies for Identifying the Drowsiness in Smart Traffic System: A

More information

DESIGN AND IMPLEMENTATION OF EMG TRIGGERED - STIMULATOR TO ACTIVATE THE MUSCLE ACTIVITY OF PARALYZED PATIENTS

DESIGN AND IMPLEMENTATION OF EMG TRIGGERED - STIMULATOR TO ACTIVATE THE MUSCLE ACTIVITY OF PARALYZED PATIENTS DESIGN AND IMPLEMENTATION OF EMG TRIGGERED - STIMULATOR TO ACTIVATE THE MUSCLE ACTIVITY OF PARALYZED PATIENTS 1 Ms. Snehal D. Salunkhe, 2 Mrs Shailaja S Patil Department of Electronics & Communication

More information