Brain Research Center. Hsinchu,, Taiwan

Transcription

1 國立交通大學 National Chiao Tung University 國立交通大學腦科學研究中心 Brain Research Center, NCTU Brain Research Center National Chiao-Tung University Hsinchu,, Taiwan Director: Dr. Chin-Teng Lin

2 Missions of NCTU BRC To Integrate MEMS technology, biotechnology, information technology, and cognitive science into basic and applied Neural Engineering research. Basic Studies Investigate underlying neurobiological mechanisms associated with cognitivestate changes (e.g., drowsiness, attention, etc.) and accompanying optimal and suboptimal motor responses in attentiondemanding cognitive tasks involving kinesthetic, visual, auditory stimulus interpretation and decision-making.

3 Missions of NCTU BRC Applied studies To extend the information management capacity of the human-machine operating integral for safety and efficiency by enhancing human cognitive ability in diverse and stressful task environments (e.g., Vehicle Driving). To develop adaptive assistant devices or neuroprosthetic devices to provide unobstructed living environments for aging or disableds individuals.

4 Approaches Integrating NBIC (Nano-, Bio-, Info., Cognition) Technologies and using 3D Virtual-Reality (VR) Surrounded Environment Six Degrees-of-freedom Dynamic Platform Portable Real-time Biomedical Signal Acquisition and Analysis System To pursue combined cognitive neuroscience/engineering research 1. MEMS Bio-Sensors Augmented Human Performance Electroacupunture Stimulation 4. Biofeedback Physiological Signals 2. Wireless Transceiver Bluetooth RF-232 Physical States Mental States Data Acquisition 3. Performance Monitoring

5 Organization Director: Prof. Chin-Teng Lin International Cooperators: MPIHD: Shu-Chen Li UCSD: Tzyy-Ping Jung, Jeng- Ren Duann, & Ruey-Song Huang Core Members: J. C. Chiou, K. Y. Yang, S.F. Liang, I.F. Chung, W.C. Lin Research Teams BCI Lab Chief Executive Biosensor & Portable Embedded Devices Driving related Cognitive Engineering 6-DOM Dynamic Simulator Bio-feedback Testbed Research Fellows Research Assistants Brain Computer Interface Aging related Cognitive Engineering

6 Director: Dr. C. T. Lin Chin-Teng (CT) Lin received Ph.D. degrees in electrical engineering from Purdue University, U.S.A., in He is currently the Chair Professor of Electrical and Computer Engineering, Dean of Computer Science College, and Director of Brain Research Center at NCTU. Dr. Lin is an IEEE Fellow for his contributions to biologically inspired information systems. He serves on Board of Governors at IEEE Circuits and Systems (CAS) Society in , and at IEEE Systems, Man, Cybernetics (SMC) Society in He is the Distinguished Lecturer of IEEE CAS Society from 2003 to Dr. Lin currently serves as the Deputy Editor-in- Chief of IEEE Trans. on Circuits and Systems, Part II, AEs of IEEE CAS Part I & Part II, IEEE SMC, IEEE Fuzzy Systems. Dr. Lin is a member of Tau Beta Pi, Eta Kappa Nu, and Phi Kappa Phi honorary societies.

7 International Institutes and Hospital Collaboration Defense Advanced Research Projects Agency (DARPA) Research Project (USA): Development of Dry MEMS Bio-Sensors Cooperation with Swartz Center, INC, UCSD for more than 5 years 50 Billion / 5 Years Grant Project in Taiwan Nanoelectronics Infotornic Systems Research Center Bio-inspired Intelligent System Project National Science Council Grant Project: Bio-Cultural Co-construction of Adaptive Assistive Technologies and Environments for Successful Aging (Only 5 Projects are supported each year) Cooperation with MPI-HD, Berlin more than 2 years Long-term cooperation with Nation Yang-Ming University National Science Council Grant Project: The Develop of Portable EEG Monitoring and Brain-Computer-Interface System (Only 20 are supported/220 applications) Long-term cooperation with Taipei Veterans General Hospital Long-term cooperation with Nation Yang-Ming University

8 International Collaborations Swartz Center for Computational Neuroscience Institute for Neural Computation University of California, San Diego Professor T. P. Jung ( 鍾子平博士 ) Doctor J. R. Duann ( 段正仁博士 ) Dr. Jung and Dr. Duann has been visited NCTU BRC for 3 months in Professor Lin Visited UCSD Dr. Jung Visited NCTU BRC on July, Dr. Duann Visited NCTU BRC on Aug. & Sep., 2006

9 International Collaborations Comparisons with Benchmark Institutes Neural Comp. Institute UCSD Max Planck Institute Berlin Beckman Institute UIUC Characteristic BRC Advantage Famous for Static Bio. Cog. Neuroscience World leading Wireless Dry Electrodes 3D VR Dynamic Driving Platform Aging and Cognitive Science Research World leading Wireless Dry Electrodes World Leading Information Technologies Start to study VR Static Driving Tasks Camera-based Analysis Behavior Data Plan to Add Dynamic Platform Development Create Dynamic Cog. Eng. New Research Field Develop Adaptive Assistive Tech. for Aging Research Results Over 2 Years

10 Ongoing Research Topics Real-Time Physiological Signal Acquisition and Analysis System Innovative Dry Electrodes Bio-Amplifier Wireless Transceiver Portable Embedded System Dynamic Stimulus Cognitive Engineering Driving related Research: Cognitive State Estimation System (Drowsiness) Single Trial ERP Biofeedback Motion Sickness Dual Task Driving Style Aging related Research: Spatial Navigation Sensory-motor Coordination Attention/Memory

11 Research Highlights - Outline Wireless MEMS-based Bio-sensors Portable Embedded Multi-tasks SoC System Cognitive Engineering Cognitive Neuroscience Adaptive Assistive Technologies --- Elder s PDA Smart Environments

12 Research Highlights MEMS Biosensors The pioneering innovation in dry probes by using MEMS Self-Stabilization and All-in-one (measuring physiological signals). The lowest-cost electrodes (NT$ > NT$10) Build-in EEG Amplifier (x10000) and filters (1-100 bandpass) Ultra-low-power wireless transmission Innovation of on-chip skin/hair compensation system Minimize Size: 2 x 2 mm 2, array Good thermal stability (186 in air)

13 Research Highlights MEMS Biosensors Fabrication of Dry Electrodes (a) (b) (c) (d) (e) (a) Pattern photoresist to provide etching masks. (b) Perform isotropic etching for probe tip. (c) Perform anisotropic etching for probe shaft. (d) Release the hard mask on the probe tip. (e) Coat the probes with Ti/Pt using DC-sputtering technique. Micrograph under Electrical Microscope 2 US Patents and 2 R.O.C. Patents Gotten: A Rapid Batch Fabrication Method in Manufacturing Physiological Signal Sensing Chip Self-stabilized microprobe array and method for manufacturing electrically isolated microprobes

14 Drowsiness Estimation Flowchart Physiological Signals Wireless MEMS Sensors Brain Dynamics and Neural Activity Augmented Human Performance Data Acquisition Brain Dynamics Cognitive-based Dynamic Information Display Physica l States Mental States Physical, Mental, Cognitive States Vigilance, Alertness, Drowsiness Concentration Attention Perception Workload Feature Extraction Translation Algorithm Device Command Neurocognitive Brain-Computer Interface

15 Detection of Traffic Light Awareness Artifact removal by using ICA algorithm. The driver s ERP signals corresponding to R, Y, G traffic-light stimuli after artifact removal.

16 Study of Driving Style Data Analysis Methods Driving Style Identification Gentle Driving (Under Driving) Aggressive Driving (Over Driving) Extract Event-Related Potentials (ERP) Independent Component Analysis (ICA) Power Spectral Analysis

17 Study of Motion Sickness Experiment Design and Setup 10-min 40-min 20-min The physiological signals recorded for objective motion sickness assessment includes: EEG Brain EKG Heart EGG Stomach

18 Research Highlights Smart Environment Vision-based Monitoring System People Location System Elder Movement Analysis (Household Objects) 無線電子聽診器 Gesture Recognition Omni-directional Camera Image Size: 320 x 240 Foreground Object Position: (131,166) Foreground Object Angle: 35 o Estimated Angle: o PTZ Camera Elder s PDA Foreground Object Portable Physiological System Omni-directional Camera

19