Brainwave based Accident Avoidance System for Drowsy Drivers

Transcription

1 Indian Journal of Science and Technology, Vol 9(3), DOI: /ijst/2016/v9i3/86381, January 2016 ISSN (Print) : ISSN (Online) : Brainwave based Accident Avoidance System for Drowsy Drivers P. Visu 1*, K. A. Varunkumar 1, R. Srinivasan 1 and R. Vinoth Kumar 2 1 Department of CSE, Vel Tech University, Avadi, Chennai , Tamil Nadu, India; pandu.visu@gmail.com, varun.kumar300@gmail.com, srinivasanrajkumar28@gmail.com 2 Department of IT, Vel Tech University, Avadi, Chennai , Tamil Nadu, India; vinothkumar.r@veltechuniv.edu.in Abstract Background/Objectives: Brainwave based accident avoidance system for drowsy drivers. Methods/Statistical Analysis: Accident avoidance system is an effective way to prevent accident caused due to drowsy driving. Every year, approximately 100,000 crashes are caused by drowsy driving. These kind of crashes are most common in highways during long journeys, youth, adults with children and shift workers. Till now, there is no test to determine sleepiness. Findings: The proposed idea brain wave accident avoidance system is to avoid this kind of accident using Electroencephalography (EEG) of human brain and Cruise control in automobiles. Whenever the driver tends to drowse, obviously his brain signals will change which will trigger a set of routine on cruise control to control the automobile to avoid accidents effectively. Application/ Improvements: Brain computer interface. Keywords: Automobile, Brain Wave, Cruise Control, Electrical Signals, Electroencephalography 1. Introduction Brain contains billions of network of neurons which communicate through electrical charge. Neurons are electrically charged by membrane proteins which transport ions across the membrane. Ions of similar charge repels each other causing a wave of electrical charge called volume conduction 1. When an electrode is brought near the scalp, they perform push or pull of electrons on the metal of electrode 2. This push and pull of electrons between electrons gives potential difference 3. The Electric potential created by single neuron is too small to record but when billions of neurons comes together it forms a wave of detectable electrical potential 4,5. The oscillation recorded by Scalp EEG gives different kind of frequency. Each frequency represent different activity caused due to network of neurons called EEG rhythmic activity frequency band. These bands are delta, theta, alpha, beta and gamma as shown in Figure 1. Among these bands, theta and alpha are the signals which represents drowsiness to relaxed sleep. Figure 1. Comparison of EEG bands. * Author for correspondence

2 Brainwave based Accident Avoidance System for Drowsy Drivers During driving the car, the driver will emit EEG signal from the brain which can be captured with the enclosed EEG headset 6,7. A Bluetooth module will transmit the signal from the headset to an interface which recognizes the kind of EEG signal from EEG bands 8. If the frequency of the EEG signal lies between theta and alpha then the control of the car will be passed immediately to Programmable cruise control 9. Cruise control is an automatic system to controls the speed of an automobile 10,11. The system is based on servomechanism that controls the throttle of the car to maintain speed as set by the driver 12,13. Basically cruise control takes on the throttle of the car by using electronic systems built into the vehicle 14. The driver bring the speed of the car up to a level manually when cruise control takes on and maintain the speed without stepping on accelerator paddles 15. This system is used effectively by driver on long drives on straight roads comfortably 16. In upcoming vehicles, the cruise control is integrated with vehicles engine management system which has the ability to reduce speed automatically according to environment 17. Figure 2. Block diagram of routine. Cruise control is over taken by new technology, Adaptive cruise control, also called active cruise control, autonomous cruise control, intelligent cruise control, or radar cruise control 18. The car is equipped with small radar or laser unit which calculates the distance and maintain a safe distance from the car in front 19. Along with all that features of cruise control, I propose to add another feature which enables Stop and Go function when theta or alpha EEG signals is received by interface 20. This technique will help drowsy driver to avoid accident 21,22. Whenever EEG signal is interpret as theta or alpha a set of routine operation will take place as shown in Figure 2 23,24. Firstly, the cruise control will slowly decelerate the vehicle and finally stops it, along with warning the cars at the back with help of back lights, finally alarms the driver to take control of the car Design and Implementation 2.1 EEG Headset Electroencephalography (EEG) is a method to record electrical activity of the brain. Whenever electron is placed on the scalp, it can record brain s spontaneous electrical activity over a period of time. The electrical activity of brain recorded by use of multiple electrode placed on scalp possess different patterns. Pattern can be characterized by different amplitudes and frequency as shown in Figure 1. These patterns represents thoughts and emotional state of the driver 26. Every pattern is different because every thought or emotion is unique. Based on frequency the electrical potentials can be distinguished as EEG rhythmic activity frequency band as shown in Table 1. For the implementation, the main EEG signals we need are theta and alpha. To capture this EEG signal we need an EEG headset, fortunately this technology is in existence. Neuro SkyInc, is a private company which is the manufacture of brain-computer interface technologies which are consumer based. The company created the neurosky headset as shown on Figure 3 which enable low cost EEG signal capture for research, entertainment(mindflex), education etc 27,28. The headset was design in such a way that it do not need conductive gel between scalp and electrode and even it can reduce the electrical noise from other electrical devices for more efficient capture of EEG signals 29. Table 1. EEG rhythmic activity frequency band No Band Frequency Activity 1 Delta <4 Slow wave found during some task performance with attention continuously. 2 Theta 4-7 Refers to drowsiness or in situation where one continuously try to suppress a response. 3 Alpha 8-15 When one is at a state of relaxing or during closing the eyes. 4 Beta During intense, stress, obsession, focus, alert or anxious 5 Gamma >32 Seen during combine use of different senses such as sound and sight 2 Vol 9 (3) January Indian Journal of Science and Technology

3 P. Visu, K. A. Varunkumar, R. Srinivasan and R. Vinoth Kumar Figure 4. Raspberry pi. Figure 3. NeuroSky headset. Neurosky headset architecture consist of AAA battery power source along with a power switch, flexible ear arm, sensor tip, ground connection clip and most importantly an inbuilt Bluetooth module which can transmit those signal to an interface. The headset have an visual indicator, i.e. a LED indicator, where red light means power is provided to headset while blue light means it is connected to the interface. This headset do not cause any harm to the brain because it uses non-invasive sensors. 3. Interface An interface is any interpreter which can receive the transmitted data from headset and identify the theta and alpha EEG signals. A laptop could be fine for this cause but in a real time simulation we need a miniaturized interface. For this reason, raspberry pi is the perfect for our cause shown in Figure 4. Raspberry pi is a low cost credit card-sized single board computer initially invented for teaching computer science to children. Raspberry pi have different versions and models but for this interface, Raspberry pi 2 Model B is perfect for use because it can run MATLAB which can identify the EEG signal and can trigger the set of routine over cruise control for avoiding accident. Raspberry pi 2 consist of Broadcom BCM2836 ARMv7 Quad Core Processor chip running at 900 MHz along with 1 GB RAM, 4 USB ports 40 pin extended GPIO pins and 10/100 Ethernet Port. Similar to any computer it also need an operating system for interaction with the user. We can use to Linux based Raspian operating system or most recommended is Windows 10 IoT. Raspberry pi 2 is the only model which is compatible with newly launched Windows 10 IoT. To identify aeeg signal the interface, MATLAB can be used for recognizing those important signal. With the help of MATLAB support package for raspberry pi hardware, we can use the peripheral devices and designed sensors through raspberry pi. When the driver starts drowsing or goes to nap during driving, the headset sends the theta or alpha signal data through Bluetooth connection and interface receives the data from a ZigBEE or Bluetooth module. The data is processed by interface using MATLAB and identify the EEG signal. If the signal frequency is found to be between theta s and alpha s frequency then the interface gains control over the higher and lower level function of the vehicle using cruise control. The interface perform set of routine to avoid accident as shown on Flow Chart Programmable Cruise Control Cruise control is a system that automatically controls the speed of vehicle. Cruise control is based on servomechanism which control the throttle of the vehicle 30. Adaptive cruise control is a upgrade in the cruise control system where the vehicle can automatically maintain the speed and distance from vehicle ahead by the use of radar or sensor built at vehicles head. The interface Vol 9 (3) January Indian Journal of Science and Technology 3

4 Brainwave based Accident Avoidance System for Drowsy Drivers will be able operate the cruise control using the active go and stop function, so that whenever the driver drowses the vehicle could be kept in control without causing any accident. Cruise control s main function is to maintain the speed of the vehicle when the driver crosses that speed provided by the driver 31. Programmable cruise control means that, the interface will be able slowly decelerate the vehicle when the driver starts becoming drowsy. In addition to the vehicle s speed control, the interface will be able to warn the cars at back using back lights and alert the driver to gain control of the car. 5. Design Flow module, then the signal will undergo signal processing. After identifying the signal as theta or alpha, the control of the vehicle will be passed on to cruise control by the interface. Cruise control will safely stop the car and will turn off the engine to avoid accidents. The control will be passed on to the interface which will warn the cars at back using back lights and will alert the driver about the situation. The driver can gain control of the car by restarting the engine. 6. Conclusion Accident avoidance system for drowsy drivers which predicts the signals and system is engaging with processing of signals to alert the drivers drowsy situation.the first stage of the implementation is that to built this system to observe the headset and it signals and try to control motor using Arduino. The biggest challenge about the system is that to determine the signal from the headset. Proper identification is needed for theta and alpha signal so that wrong signal do not trigger the routine even when driver is not drowsing. Every person is different and every person have different thoughts and emotions so they might have slightly different brainwaves signals. So before adapting this system, the interface should be configure according to the brain activity of the driver. 7. References Figure 5. Flow Chart 1. Design flow of system. The flow diagram of brainwave based accident avoidance system is step by step diagrammatic representation of the operations that will happen from brainwave signals to speed control of vehicle. Initialize the headset and the interface, to start sensing the brainwaves and transmit to the interface. When the headset detect the brainwaves, it will transfer them to the interface through a Bluetooth. The signal will be received by an RX: Bluetooth 1. Electroencephalography Aug. Available from: en.wikipedia.org/wiki/electroencephalography#comparison_table 2. Niedermeyer E, da Silva FL. Electroencephalography: Basic Principles, Clinical Applications and Related Fields. USA: Lippincot Williams and Wilkins; Abou-Khalil B, Musilus KE. Atlas of EEG and Seizure Semiology. USA: Elsevier; Cruisecontrol May. Available from: 5. Teetor RR. Speed control device for resisting operation of the accelerator. US-Patent A Engine control unit Available from: 7. Austen I. What s Next: A chip-based challenge to a car s spinning camshaft. New York Times Jan 16. Available from: what-s-next-a-chip-based-challenge-to-a-car-s-spinningcamshaft.html 8. Kassakian JG, Wolf H-C, Miller JM, Hurton CJ. Automotive electrical systems circa 2005 IEEE Spectrum. IEEE Spectrum. 1996; 33(8):22. 4 Vol 9 (3) January Indian Journal of Science and Technology

5 P. Visu, K. A. Varunkumar, R. Srinivasan and R. Vinoth Kumar 9. NeuroSky May. Available from: org/wiki/neurosky 10. Dean T. NeuroSky raises $11.8M for brainwave-controlled games (exclusive). VentureBeat.com. Available from: venturebeat.com/2010/06/22/neurosky-raises-11-8m-forbrainwave-controlled-games/ 11. Brain Control Technology - A New Olympic Sport? EON. com. Enhanced Online News. Available from: BCM2835 Media Processor; Broadcom. Broadcom.com Sept Shan L. Mind reading is on the market. LATimes.com (Los Angeles Times) Available from: Scott A. The Daily Start-Up: NeuroSky Uses TheForce. Venture Capital Dispatch (The Wall Street Journal) Available from: the-daily-start-up-neurosky-uses-the-force 15. Evan E. NeuroSkyThinkGearMind-controlled Toys with Sega Available from: gamrfeed.com 16. Sierra M. NeuroSky to Present Project Millennia. Tech Pin Available from: Techpin.com 17. Facts and Stats May. Available from: Statistics Related to Drowsy Driver Crashes Available from: Autonomous cruise control Available from: en.wikipedia.org/wiki/autonomous_cruise_control_system 20. Alexander B. Abstandsregeltempomatenim Test: Mittelklasse-Autos. Available from: Auto-motor-und-sport.de 21. The new Audi A8 The sportiest sedan in the luxury class. Available from: the_new_audi_a8.html 22. Vehicle technologies to improve performance and safety Jun. Available from: pdf 23. Active Cruise Control Apr. Available from: guide/articles/active_cruise_control.html 24. Active Cruise Control with Stop&Go function Sep 16. Available from: technology/technology_guide/articles/active_cruise_control_stop_go.html 25. Adaptive cruise control Available from: Microsoft brings Windows 10 to Makers May 16. Available from: Raspberry Pi Apr. Available from: Shin DJ, Chung HY. Analysis of productivity for manufacturing processe improvement of an automobile bearing flange by simulation experiments. Indian Journal of Science and Technology Oct; 8(26): Raspberry Pi Jan 18. Available from: Punitha A, Kalaiselvi GM. Driver eye state detection using minimum intensity projection - An application to driver fatigue alertness. Indian Journal of Science and Technology Aug; 8(17): Roy R, Venkatasubramanian K. EKG/ECG based driver alert system for long haul drive. Indian Journal of Science and Technology Aug; 8(19):1 6. Vol 9 (3) January Indian Journal of Science and Technology 5