A Smart Multy-Sensory System for Environmental Monitoring. DIEEI Dipartimento di Ingegneria Elettrica, Elettronica e Informatica

Transcription

1 A Smart Multy-Sensory System for Environmental Monitoring DIEEI Dipartimento di Ingegneria Elettrica, Elettronica e Informatica

2 Contents Goals Solutions Methodologies Implementations Hardware 3-axis Accelerometer ADXL335 Pyrometer PIR-Sensor # Microphone FG P16 Micro-Controller and RX/TX Wireless Module Software Firmware LabVIEW User Interface

3 Goals Development of a smart multi-sensory system with functions of environmental monitoring. Development of innovative algorithms for processing the data acquired by the sensors.

4 Solutions Scheme of the system to be developed: «Server» «End Device» Core Users Audio + Sensors Application Server IP Network (es. UMTS) WAN / LAN Communication Gateway Wireless Wired RF Transceiver PowerLine Transceiver LAN Communication Micro-Controller Actuators Power Supply - small; - low power consumption; - minimizing the possibility of detection the communications.

5 Methodologies Quantities to be monitored Human presence/activity in the environment. Environmental noise and/or voice activity. Inertial solicitations. Acoustic signals Random noise «Typical» noise Conversation Human presence Static Dynamic Sylent Not sylent Inertial solicitations Random Weak Intense Intentional Weak Intense Direct Indirect

6 Implementation HW Architecture Firmware Classification SW data elab. Simulation and Test Sensors Micro-Controller Interfaces Acquisition Trasmission Energy saving Normal working Unintentional solicitations Manumission Data processing Algorithms User Interface Simulations Test real-world scenarios

7 Hardware Architecture of the multi-sensory system

8 Hardware 3-axis Accelerometer ADXL335 General Features Range measurement of the acceleration: ± 3 g. Static and dynamic measurement of the acceleration. Small, low profile package LFCSP (4 mm 4 mm 1.45 mm). Low power: 350 μa (typ.). Single-supply operation: 1.8 V to 3.6 V. Shock survival: g. Excellent temperature stability. Analogic output. Bandwidth: 0.5 Hz to 1600 Hz (x and y), 0.5 Hz to 550 Hz (z). a x = (V X V S / 2) / (V S / 10)

9 Hardware Pyrometer PIR-Sensor # General Features Digital Output ON/OFF. Single-supply operation: 3.3 V or 5 V. Low power: <100 μa. Warm-up time:10 s to 60 s.

10 Hardware Microphone FG P16 General Features Type: Condenser microphone «electret» Direction: Omni-directional Dimension: diameter 2.56 mm, height 2.56 mm. 1kHz: -53.0±3 db re1v/0.1pa. Single-supply operation: 1.3 V (nom.) 3.0 V (max). Maximum power consumption: 50 μa. Noise type A : 28.0 db 1 khz equivalent SPL. Output impedance (nominal): 4400 Ω.

11 Hardware Micro-Controller and RX/TX Wireless Module Texas Instruments ez430-rf2500 Micro-Controller: MSP430F2274 Computational power: 16 MIPS ADC SAR at 10 bit 200 ksps Low-Power modes: 700 na in standby. Single-supply operation: 1.8 V to 3.6 V. Power consumption, 2.2V 1 MHz: 270 μa (typ.) Power consumption in Off mode with RAM retention: 0.1 μa Transceiver Module RF CC2500 Frequency 2.4 GHz Programmable Data Rate: up to 500 kbps Programmable Transimssion Power: -30 dbm to 0 dbm

12 Hardware Electrical schematic

13 Hardware First prototype

14 Software The software can be divided into three distinct parts: remote microcontroller firmware; local microcontroller firmware; processing and visualization of acquired data via LabVIEW.

15 Software The integrated development environment that was chosen for programming and debugging is IAR, while the programming language is C. It was necessary to use the libraries provided by TI for the initialization of the microcontroller and the CC2500 wi-fi module. The main purpose of the microcontroller of the battery board (remote microcontroller) is to receive data from all connected sensors, convert them to digital (if needed) and initialize a wireless communication with the microprocessor of the USB board (local microcontroller) for data transfer. The role of USB board is to receive data packets from the battery board and forward them to the USB port via serial communications. There is no type of analysis data in the USB board, but the incoming data is directly routed via USB.

16 Remote Micro-Controller firmware 1/2 Main procedure void main(void){ Microcontroller ports and wi-fi inizialization. 10 bit ADC converter initialization. BSP_Init(); MRFI_Init(); MRFI_WakeUp(); MRFI_RxOn(); ADC10CTL0 = ADC10ON + ADC10IE + REFON; For cycle: sequence repeated for all the analog sensors. (MIC and ACC) ADC converter input pin selection (pin 3) ADC conversion start Sleep until ADC conversion ends Wifi transmission start ADC10CTL1 = INCH_3; ADC10CTL0 = ENC + ADC10SC; bis_sr_register(cpuoff + GIE); invia(adc10mem,4);

17 Remote Micro-Controller firmware 2/2 PIR digital input and wifi transmission start if(p2in & 0x10) invia(1,5); else invia(0,5); End main procedure } Other routines Function to trasmit data via wifi. Accepts two input parameters: the aquired value and the sensor type ADC interrupt service routine. Wake the cpu when the conversion ends. void invia(unsigned int value, unsigned int sensortype){ } interrupt void ADC10_ISR(void){ bic_sr_register_on_exit(cpuoff); }

18 Local Micro-Controller firmware 1/2 Main procedure Microcontroller ports and wi-fi inizialization. Serial communication inizialization. Sleep until a wifi packet is received. void main(void){ BSP_Init(); MRFI_Init(); MRFI_WakeUp(); MRFI_RxOn(); P3SEL = 0x30; UCA0CTL1 = UCSSEL_2; UCA0BR0 = 0x41; UCA0BR1 = 0x3; UCA0MCTL = UCBRS_2; UCA0CTL1 &= ~UCSWRST; IE2 = UCA0RXIE; bis_sr_register(gie+lpm4_bits); End main procedure }

19 Local Micro-Controller firmware 2/2 Function to write char to usb. void trasmetti(char string[]){... } Other routines Wifi packet receive interrupt service routine. void MRFI_RxCompleteISR(){ mrfipacket_t packet; MRFI_Receive(&packet); char output[] = generaoutput(packet); trasmetti(output); }

20 LabVIEW Through the serial communication with the USB board, LabVIEW receive the packets sent by the multi-sensory system. Combining the incoming signals from various inputs we can provide additional information about the current situation of the system. A system to distinguish different states where you will find the system from the data received from the sensors is created. Through a user-friendly interface the user have the tools to verify the individual signals, the individual sensors and have an overall view of the system.

21 System states 1/2 The various states that the software can distinguish could be simply classified as: weak stress (small entity stress) from strong stress; accidental stress or unintended or impulsive movements from voluntary stress; direct stress, in the presence of man, from indirect stress (without detecting any human presence); The next table can show all the states that can be individuated by the software.

22 System states 2/2 Sensors states Sollecitazione accelerometro PIR Microfono Debole Intensa System states ON/OFF Casuale Intenzionale Casuale Intenzionale ON/OFF Sollecitazione diretta ON/OFF Rumore Rumore X Rumore prolungato X Presenza umana in movimento X Presenza umana X Sollecitazione debole indiretta casuale X X Sollecitazione debole indiretta intenzionale X X Sollecitazione intensa indiretta casuale X X Sollecitazione intensaindiretta intenzionale X X Sollecitazione debole diretta casuale Sollecitazione debole diretta intenzionale Sollecitazione intensa diretta casuale Sollecitazione intensa diretta intenzionale X X X X X X X X X X X X X X X X

23 LabVIEW user interface Accelerometer, microphone and PIR state. actual state of the system Microphone signal graph Accelerometer axes signals graphs Run/test button Input port selection 3D rotation view

24 Simulations Was made a lot of simulation to test the sensors and the various system states. The example introduces how the software shows a weak (small entity stress), voluntary, direct (presence of man) stress;

25 Simulations - Example Actual system state: Intentional, weak and direct solicitation. Sollecitazione inerziale Debole Intensa ON/OFF Casuale Intenzionale Casuale Intenzionale ON/OFF PIR Sollecitazione diretta X X X X

26 Conclusions This project may find interesting future developments thanks to its modularity. To ensure best performance is needed the miniaturization of the system itself. We can also include other sensors to detect data on the environmental temperature or the presence of gas, depending on design requirements and demands of the customer. The software could be improved, for example in the case of special warning the system could be induced in sleep and reactivated after a certain time interval. This is to preserve the life of the device, protecting it from detectors.