Detection of a Person Awakening or Falling Out of Bed Using a Range Sensor Geer Cheng, Sawako Kida, Hideo Furuhashi

Similar documents
Evolution of an Eldercare Technology System to Monitor Motion and Detect Falls.

Homeostasis Lighting Control System Using a Sensor Agent Robot

Designing the Smart Foot Mat and Its Applications: as a User Identification Sensor for Smart Home Scenarios

A Survey on Assistance System for Visually Impaired People for Indoor Navigation

Image Interpretation System for Informed Consent to Patients by Use of a Skeletal Tracking

A software video stabilization system for automotive oriented applications

Fabrication of the kinect remote-controlled cars and planning of the motion interaction courses

System of Recognizing Human Action by Mining in Time-Series Motion Logs and Applications

Robust Low-Resource Sound Localization in Correlated Noise

A Novel Knee Position Acquisition and Face Recognition System Using Kinect v2 at Entrance for Fatigue Detection and Automated Door Opening

Learning to traverse doors using visual information

LAMB-WAVE ACOUSTIC EMISSION FOR CONDITION MONITORING OF TANK BOTTOM PLATES

Autonomous Monitoring Framework with Fallen Person Pose Estimation and Vital Sign Detection

RESEARCH AND DEVELOPMENT OF DSP-BASED FACE RECOGNITION SYSTEM FOR ROBOTIC REHABILITATION NURSING BEDS

The User Activity Reasoning Model Based on Context-Awareness in a Virtual Living Space

Gesture Identification Using Sensors Future of Interaction with Smart Phones Mr. Pratik Parmar 1 1 Department of Computer engineering, CTIDS

Performance Improvement of Contactless Distance Sensors using Neural Network

LabVIEW based Intelligent Frontal & Non- Frontal Face Recognition System

Bluetooth Low Energy Sensing Technology for Proximity Construction Applications

Driver status monitoring based on Neuromorphic visual processing

Image Processing Based Vehicle Detection And Tracking System

Sensors. CS Embedded Systems p. 1/1

Multi-Resolution Estimation of Optical Flow on Vehicle Tracking under Unpredictable Environments

Intel Research: Global Innovation Barometer

Image Recognition for PCB Soldering Platform Controlled by Embedded Microchip Based on Hopfield Neural Network

Robust Wrist-Type Multiple Photo-Interrupter Pulse Sensor

Moving Domestic Robotics Control Method Based on Creating and Sharing Maps with Shortest Path Findings and Obstacle Avoidance

VLSI Implementation of Impulse Noise Suppression in Images

Deep Learning for Human Activity Recognition: A Resource Efficient Implementation on Low-Power Devices

Development of Hybrid Image Sensor for Pedestrian Detection

Interaction rule learning with a human partner based on an imitation faculty with a simple visuo-motor mapping

Pervasive and mobile computing based human activity recognition system

Touch & Gesture. HCID 520 User Interface Software & Technology

Multi-channel Active Control of Axial Cooling Fan Noise

Low-frequency signals detection and identification as a key point of software for surveillance and security applications

On Observer-based Passive Robust Impedance Control of a Robot Manipulator

A Fall Detection System based on SensorTag and Windows 10 IoT Core

Privacy-Protected Camera for the Sensing Web

Get your daily health check in the car

An Un-awarely Collected Real World Face Database: The ISL-Door Face Database

/08/$25.00 c 2008 IEEE

Estimation of Folding Operations Using Silhouette Model

Automatic Crack Detection on Pressed panels using camera image Processing

Evaluation of Connected Vehicle Technology for Concept Proposal Using V2X Testbed

Markerless 3D Gesture-based Interaction for Handheld Augmented Reality Interfaces

HUMAN society is experiencing tremendous demographic

TRIANGULATION-BASED light projection is a typical

Activity Analyzing with Multisensor Data Correlation

II. EXPERIMENTAL SETUP

Research and application on the smart home based on component technologies and Internet of Things

Remote control system of disaster response robot with passive sub-crawlers considering falling down avoidance

Room Impulse Response Modeling in the Sub-2kHz Band using 3-D Rectangular Digital Waveguide Mesh

1531. The application of vital signs detection system for detecting in a truck with noise cancellation method

The Making of a Kinect-based Control Car and Its Application in Engineering Education

A Smart Wheelchair Based on Gesture Control and Vital Signs Monitoring

Sound absorption of Helmholtz resonator included a winding built-in neck extension

Design and Testing of DWT based Image Fusion System using MATLAB Simulink

Evaluation of Illuminance Provided by the Intelligent Lighting System in Actual Office

Touch technologies for large-format applications

A Study on Gaze Estimation System using Cross-Channels Electrooculogram Signals

Development of intelligent systems

Distance Estimation and Localization of Sound Sources in Reverberant Conditions using Deep Neural Networks

Semantic Segmentation in Red Relief Image Map by UX-Net

Healthcare and Usability in Senior- Centred Design.

Artificial Beacons with RGB-D Environment Mapping for Indoor Mobile Robot Localization

Sensory Fusion for Image

Guided Filtering Using Reflected IR Image for Improving Quality of Depth Image

Accident prevention and detection using internet of Things (IOT)

Implementation and analysis of vibration measurements obtained from monitoring the Magdeburg water bridge

Students: Avihay Barazany Royi Levy Supervisor: Kuti Avargel In Association with: Zoran, Haifa

Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface

A Study on the control Method of 3-Dimensional Space Application using KINECT System Jong-wook Kang, Dong-jun Seo, and Dong-seok Jung,

KINECT CONTROLLED HUMANOID AND HELICOPTER

Research on an Economic Localization Approach

Interactive guidance system for railway passengers

SMART WORK SPACE USING PIR SENSORS

Number Plate Detection with a Multi-Convolutional Neural Network Approach with Optical Character Recognition for Mobile Devices

Face Detection System on Ada boost Algorithm Using Haar Classifiers

Recognition of very low-resolution characters from motion images captured by a portable digital camera

Reikan FoCal Aperture Sharpness Test Report

Compressive Through-focus Imaging

FRAUNHOFER INSTITUTE FOR INTEGRATED CIRCUITS IIS SHORE PIONEERING FACIAL ANALYSIS

Research Article Evaluation of a Home Biomonitoring Autonomous Mobile Robot

UWB 2D Communication Tiles

Sound Source Localization using HRTF database

Intelligent Traffic Sign Detector: Adaptive Learning Based on Online Gathering of Training Samples

Image Manipulation Interface using Depth-based Hand Gesture

* Intelli Robotic Wheel Chair for Specialty Operations & Physically Challenged

SEPARATION AND DEREVERBERATION PERFORMANCE OF FREQUENCY DOMAIN BLIND SOURCE SEPARATION. Ryo Mukai Shoko Araki Shoji Makino

An Enhanced Fall Detection System for Elderly Person Monitoring using Consumer Home Networks

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

Fall Detection and Classifications Based on Time-Scale Radar Signal Characteristics

Multi-spectral acoustical imaging

A Vehicle Speed Measurement System for Nighttime with Camera

Reikan FoCal Aperture Sharpness Test Report

Using sound levels for location tracking

Facial Caricaturing Robot COOPER in EXPO 2005

Receiver Design for Passive Millimeter Wave (PMMW) Imaging

Sound Processing Technologies for Realistic Sensations in Teleworking

Multi-sensory Tracking of Elders in Outdoor Environments on Ambient Assisted Living

Transcription:

Information Systems International Conference (ISICO), 2 4 December 2013 Detection of a Person Awakening or Falling Out of Bed Using a Range Sensor Geer Cheng, Sawako Kida, Hideo Furuhashi Geer Cheng, Sawako Kida, Hideo Furuhashi Department of Electrical and Electronics Engineering, Aichi Institute of Technology Keywords: Range Sensor Awakening Behavior Detection Fall Prevention ABSTRACT In this paper, we describe a monitoring system for bedridden persons that utilize a proximity range sensor with an infrared projector and is capable of detecting persons awakening and/or falling out of bed. The system, which utilizes an optimal linear discriminant function, has demonstrated a detection rate of 98% for the targeted behaviors. It is believed that this system will be useful for monitoring seriously ill and/or elderly persons in hospitals and private homes that must occasionally be left unsupervised by healthcare professionals or family members. The wandering of elderly persons suffering from dementia can also be detected and averted. Corresponding Author: Geer Cheng Department of Electrical and Electronics Engineering Aichi Institute of Technology, 1247 Yachigusa, Yakusa-cho, Toyota, Japan. Email: chenggeer2008@yahoo.co.jp Copyright 2013 Information Systems International Conference. All rights reserved. 1. INTRODUCTION Demand is increasing for methods of monitoring bedridden seriously ill and/or elderly persons in hospitals and private homes. In hospitals, if a person who is seriously ill awakens, it is important that the responsible healthcare professionals be made aware of that fact because such patients may fall out of bed and suffer serious injuries. Elderly persons being cared for by family members at home can be injured in the same way. Furthermore, the wandering of elderly persons suffering from dementia is a serious social problem. However, full 24-hour supervision by healthcare professionals in hospitals, or by family members at home, is difficult to provide. In this paper, we describe a monitoring system for bedridden persons that can detect awakening behaviors and can sense when persons are in danger of falling out of bed. Currently, numerous types of monitoring systems are available or have been proposed [1-8]. These include passive camera-based image processing systems, mat sensors, and ultrasonic sensors. However, the recognition rates for passive camerabased systems and ultrasonic based systems are unimpressive and mat sensors are subject to mechanical failure. Here, we propose a monitoring system using a range sensor with an infrared projector. 2. RESEARCH METHOD Figure 1 shows the experimental setup of our system. A range sensor with an infrared projector (Kinect, Microsoft Corp.) is positioned on the ceiling above the bed. The ceiling height is 240 cm above the floor level and the bed is 30 cm high. Test subjects, covered with a quilt, are positioned lying in the bed. To simulate the case of a bedridden patient, the volume, space, maximum bed height, and patient information are first recorded and stored in the system memory. Next, the following changes related to the subject s positions are recorded: (a) patient lying on his/her back, then changing to the following positions, (b) lying on side, (c) sitting up, and (d) falling out of the bed. The range data were measured twice for each of these four cases for each subject. The absolute and relative values were then calculated. Five male and one female subjects participated in these experiments. Obtained data was analyzed via an optimal linear discriminant function (OLDF). Figure 2 shows the measurement process used for data analysis.

504 Software Engineering and Design Track Figure 1. Effects of selecting position switching under dynamic conditions Acquire range data for the bed only Acquire range data for the subject on the bed Calculate the range based on the bed height Calculate changes to the volume, height, and space Calculate the relative value of the volume, height, and space Analyze data via OLDF Figure 2. Measurement process used for data analysis 3. RESULTS AND ANALYSIS Figure 3 shows the range image data for the bed itself. Figures 4 (a) and (b) show the camera image and range image for a bedridden subject lying on his back. As can be seen in the figures, range variations become notable.

Software Engineering and Design Track 505 Figure 3. Range image for the bed (a) Camera (b) Range image Figure 4. Camera image and range image for the bed By subtracting the range image without a subject (Fig. 3) from the image with a subject (Fig. 4 (a)), a range image such as shown in Fig. 5(a) is obtained. Figures 5 (b), (c), and (d) show the subtracted range images when the subject is in other positions. Specifically, (b) shows an image of the subject lying on his side, (c) shows an image of the subject sitting up, and (d) shows the subject falling out of the bed. When the subject is lying on his side, the height value becomes slightly higher. When the subject is sitting up, the height value becomes very high. When the subject falls out of bed, only the quilt is detected. As a result, the height value decreases slightly and the space variations become somewhat smaller. (a) Subject lying on back (b) Subject lying on side

506 Software Engineering and Design Track (c) Subject sitting up (d) Subject falling out of bed Figure 5. Subtracted range images Table 1 shows data for a subject obtained using the measurement process. Table 2 shows the relative changes to the data. The sitting condition can be detected using the value change to maximum height, which increases significantly. The falling out of bed condition can be detected using the volume value change, which decreases significantly. Table 1. Absolute change to measurement data obtained via the senso (Note: changes are calculated based on data for a subject lying on his/her back.) Lying on back (Position change) Lying on side Sitting up Falling out of bed Volume change (cm 3 ) 7,688 81,486 66,653-91,583 Space chance (cm 2 ) -229 1,955-2,499 2,459 Maximum height change (cm) 3.3 23.5 55.7-8 Table 2. Relative change to data obtained by via sensor measurement (Changes are calculated based on data for a subject lying on his/her back.) Lying on back Lying on side Sitting up Falling out of bed (Position change) Volume change (%) 104 135 131 52 Space change (%) 99 109 89 113 Maximum height change (%) 116 194 352 96 OLDFs were found for combinations of two absolute or relative data values, and the resulting efficiencies were evaluated by the Shapiro-Wilk test. Table 3 shows the Wilks Coefficients for the combinations of two of three absolute change data and three relative change data. As can be seen in the table, the smallest coefficients of 0.0090 were obtained for OLDFs with relative volume and absolute height changes. Absolute volume Table 3. Wilks Coefficients for each combination Relative Absolute Relative volume space space Absolute volume Relative volume 0.0620 Absolute space 0.1026 0.0888 Relative space 0.2175 0.0631 0.2123 Absolute height 0.0146 0.0090 0.0117 0.0092 Absolute height Relative height 0.0422 0.0184 0.0435 0.0266 0.0356 Relative height The discriminant functions become as follows: u 0.059306 x + 28.71124 x 21.413 (1) lb = ah rv

Software Engineering and Design Track 507 u, Here, u lb, ls u 0.10256 x + 34.86084 x 41.2457 (2) ls = ah rv up =.237491 xah + 34.95733 xrv u 0 119.817 (3) u 0.033068 x + 2.048445 x 1.892243 (4) fo = ah rv u up, and u fo are discriminant values for the conditions of lying on back, lying on side, x are the absolute change of the height and sitting up, and falling out of bed, respectively. x ah, while rv relative change of the volume, respectively. The original condition of the subject is modified to the condition in which largest value is obtained by these equations. Figure 6 shows the test results of the system for six subjects. M1 to M5 are the male test subjects, and W1 is the female test subject. Each subject was measured twice for each of the four conditions (eight measurements total). Equations 1 through 4 are used to determine the conditions of the subjects. The detection rate is 98%, the error rate is 0%, and the loss rate is 2%. With regards to the loss case, although the subject fell out of the bed, the quilt remained on the bed and the high maximum height and large volume of the range image remained stable. It does not concern the sex. Accordingly, the condition was indistinguishable from that of a subject lying on his/her back. 8 6 Number 4 2 失報 loss 誤報 error 正報 detect 0 M1 M2 M3 M4 M5 W6 Objects Figure 6. Test results for six subjects 4. CONCLUSION In this paper, a monitoring system using range sensor with an infrared projector capable of detecting the behaviors of a person awakening and/or falling out of bed was proposed. The obtained data was analyzed by OLDF. Experiments using the system recorded a detection rate is 98%, thus proving its high reliability and practicality. It is believed that the system will be useful for monitoring seriously ill patients or elderly people in hospitals and private homes that must occasionally be left unsupervised by healthcare professionals or family members. The wandering of elderly persons suffering from dementia can also be detected and averted. For further verification, investigation using more samples is required. REFERENCES [11] P. Rashidi, A. Mihailidis, "A Survey on Ambient-Assisted Living Tools for Older Adults", IEEE Journal of Biomedical and Health Informatics, Vol.17, no. 3, pp.579 590, 2013. [12] K. Ozcan, A. K. Mahabalagiri, M. Casares, S. Velipasalar, "Automatic Fall Detection and Activity Classification by a Wearable Embedded Smart Camera", IEEE Journal on Emerging and Selected Topics in Circuits and Systems, IEEE Journal on, Vol. 3, no. 2, pp. 125 136, 2013. [13] L. Yun, K. C. Ho, M. Popescu, "A Microphone Array System for Automatic Fall Detection", IEEE Transactions on Biomedical Engineering, Vol. 59, no. 5, pp. 1291 1301, May 2012.

508 Software Engineering and Design Track [14] C. Rougier, J. Meunier, A. St-Arnaud, J. Rousseau, "Robust Video Surveillance for Fall Detection Based on Human Shape Deformation", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, no. 5, pp.611 622, 2011. [15] Fu. Zhengming, T. Delbruck, P. Lichtsteiner, E. Culurciello, "An Address-Event Fall Detector for Assisted Living Applications", IEEE Transactions on Biomedical Circuits and Systems, pp. 88-96 Vol. 2, no. 2, 2008. [16] H. Satoh, F. Takeda, Y. Saeki, R. Ikeda, and Y. Shiraishi, Proposal of Awakening Behavior Detection System using Neural Network, Computational Intelligence, Proceedings, 523, 2006. [17] H. Satoh, T. Ohkura, F. Takeda, Proposal for the awakening behavior detection system using images and adaptation for fluctuation of brightness quantity in the captured image, 4th International Conference on Modeling, Simulation and Applied Optimization (ICMSAO), pp1-7, 2011. [18] M. Alwan,P. J. Rajendran, S. Kell, D. Mack, S. Dalal, M. Wolfe, R. Felder, A Smart and Passive Floor-Vibration Based Fall Detector for Elderly, Information and Communication Technologies, ICTTA '06. 2nd, Vol.1, pp.1003-1007, 2006. BIBLIOGRAPHY OF AUTHORS Geer Cheng received the M.S. degree from Aichi Institute of Technology. She is now a student of the doctoral course of the same institution. Her main field of work is 3D measurement and its applications. Contact at chenggeer2008@yahoo.co.jp Sawako Kida received the B.S. degree from Aichi Institute of technology. She is now working at Daiichi System Engineering. Her main field of research is applications of 3D measurement. Hideo Furuhashi received the Ph.D. degree from Nagoya University. He is now a Professor of Aichi Institute of Technology. His main research field is measurements using optics and acoustics. Contact at furuhasi@aitech.ac.jp