Smart Objects for Human Computer Interaction, Experimental Study

Smart Objects for Human Computer Interaction, Experimental Study Doggen, J.*; Neefs, J.; Brands, E.; Peeters, T.; Bracke, J.; Smets, M.; Van der Schueren, F. *jeroen.doggen@artesis.be March 22, 2012

2/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board.

3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board. We use the smart dice to control computer applications.

3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board. We use the smart dice to control computer applications. This basic concept can be adapted to implement various sensor based applications.

Wireless Sensor Networks & Smart Objects A wireless sensor network is a set of small autonomous sensor nodes which cooperate to solve a common application using some kind of perception of physical parameters 1. Smart objects sense their environment and communicate to increase sensing efficiency and enable new ways of end-user interaction. 1 An FDL ed Textbook on Sensor Networks, Thomas Haenselmann. 4/29

5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes.

5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes. The platform has gained increased popularity over the last years.

5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes. The platform has gained increased popularity over the last years. The open-source community has 70000 registered users and an abundance of user submitted libraries.

6/29 Arduino based Smart Objects We built a WSN using the Arduino platform to develop a smart object. A smart dice to control computer applications. The dice can be replaced by any object, e.g. a kids toy

Arduino based Smart Objects 7/29

8/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

9/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

System Architecture 10/29

11/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

12/29 Hardware Specifications Seeeduino development board Digi XBee wireless interface Freescale Semiconductor MMA7361 analog accelerometer InvenSense ITG-3200 digital gyroscope Sharp GP2Y0A21YK infra-red distance sensor

13/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development.

14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development. Used Arduino libraries ITG-3200 Gyro library

14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development. Used Arduino libraries ITG-3200 Gyro library Developed Arduino libraries Sharp GP2Y0A21YK infra-red distance sensor MMA7361 accelerometer Signal filtering

15/29 Arduino Library Example 1. Include header files

15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables

15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables 3. setup configuration

15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables 3. setup configuration 4. loop start example program

Arduino libraries: usage statistics MMA7361 accelerometer library 2 2 http://code.google.com/p/mma7361-library 3 http://code.google.com/p/gp2y0a21yk-library/ 16/29

Arduino libraries: usage statistics MMA7361 accelerometer library 2 Sharp GP2Y0A21YK infrared distance sensor library 3 Total downloads: both ± 320 2 http://code.google.com/p/mma7361-library 3 http://code.google.com/p/gp2y0a21yk-library/ 16/29

17/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

18/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

4 http://code.google.com/p/arduino-signal-filtering-library 19/29 Signal Filtering Many analog sensors have signal differences between individual sensors. Calibration and signal filtering is needed to compensate for these undesirable effects. We implemented three simple software based filters: variable-length weighted moving average filter Bessel low-pass filter Chebychev low-pass filter The signal filtering library is available online 4.

20/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

21/29 Software Tools SerialMonitor: log and analyse sensor data SerialForwarder: forward serial data over a TCP/IP socket

22/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

23/29 Demo Applications Flight simulator: sensor acts as a joystick Pac-man clone: sensor generates arrow inputs

Demo Applications I 2-D platform game: I I Left/right: tilt detection Jump: upward movement 24/29

25/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

Future Work I Use mixed RF technologies I Support the more power efficient nrf24 wireless technology 26/29

Future Work I Use mixed RF technologies I I Support the more power efficient nrf24 wireless technology Minimise energy consumption 26/29

Future Work I Use mixed RF technologies I I I Support the more power efficient nrf24 wireless technology Minimise energy consumption Use the module for various student projects: I I I Development of embedded software Printed circuit board design Signal processing applications 26/29

Future Work I Use mixed RF technologies I I I Minimise energy consumption Use the module for various student projects: I I I I Support the more power efficient nrf24 wireless technology Development of embedded software Printed circuit board design Signal processing applications Projects I I Development of a city monitoring application Cooperation with product development department: prototyping 26/29

27/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors.

28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download.

28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download. The system and its derivatives are being used for student projects. We plan to cooperate with third parties by developing similar modules:

Questions & Answers 29/29