Smart Objects for Human Computer Interaction, Experimental Study

Transcription

1 Smart Objects for Human Computer Interaction, Experimental Study Doggen, J.*; Neefs, J.; Brands, E.; Peeters, T.; Bracke, J.; Smets, M.; Van der Schueren, F. March 22, 2012

2 2/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

3 3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board.

4 3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board. We use the smart dice to control computer applications.

5 3/29 Arduino based Smart Objects We developed a wireless sensor module based on the Arduino development board. We use the smart dice to control computer applications. This basic concept can be adapted to implement various sensor based applications.

6 Wireless Sensor Networks & Smart Objects A wireless sensor network is a set of small autonomous sensor nodes which cooperate to solve a common application using some kind of perception of physical parameters 1. 1 An FDL ed Textbook on Sensor Networks, Thomas Haenselmann. 4/29

7 Wireless Sensor Networks & Smart Objects A wireless sensor network is a set of small autonomous sensor nodes which cooperate to solve a common application using some kind of perception of physical parameters 1. Smart objects sense their environment and communicate to increase sensing efficiency and enable new ways of end-user interaction. 1 An FDL ed Textbook on Sensor Networks, Thomas Haenselmann. 4/29

8 5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes.

9 5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes. The platform has gained increased popularity over the last years.

10 5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes. The platform has gained increased popularity over the last years. The open-source community has registered users and an abundance of user submitted libraries.

11 5/29 Arduino Development Platform The Arduino development platform allow designers to develop electronic prototypes. The platform has gained increased popularity over the last years. The open-source community has registered users and an abundance of user submitted libraries. Ease of use is the main selling point.

12 6/29 Arduino based Smart Objects We built a WSN using the Arduino platform to develop a smart object. A smart dice to control computer applications. The dice can be replaced by any object, e.g. a kids toy

13 Arduino based Smart Objects 7/29

14 8/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

15 9/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

16 System Architecture 10/29

17 11/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

18 12/29 Hardware Specifications Seeeduino development board Digi XBee wireless interface Freescale Semiconductor MMA7361 analog accelerometer InvenSense ITG-3200 digital gyroscope Sharp GP2Y0A21YK infra-red distance sensor

19 13/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

20 14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development.

21 14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development. Used Arduino libraries ITG-3200 Gyro library

22 14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development. Used Arduino libraries ITG-3200 Gyro library Developed Arduino libraries Sharp GP2Y0A21YK infra-red distance sensor MMA7361 accelerometer Signal filtering

23 14/29 Arduino Libraries Arduino software libraries make it straightforward for anyone to start embedded development. Used Arduino libraries ITG-3200 Gyro library Developed Arduino libraries Sharp GP2Y0A21YK infra-red distance sensor MMA7361 accelerometer Signal filtering XNA library to connect the module to C# applications

24 15/29 Arduino Library Example 1. Include header files

25 15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables

26 15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables 3. setup configuration

27 15/29 Arduino Library Example 1. Include header files 2. Initialise objects and variables 3. setup configuration 4. loop start example program

28 Arduino libraries: usage statistics MMA7361 accelerometer library /29

29 Arduino libraries: usage statistics MMA7361 accelerometer library 2 Sharp GP2Y0A21YK infrared distance sensor library 3 Total downloads: both ± /29

30 17/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

31 18/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

32 4 19/29 Signal Filtering Many analog sensors have signal differences between individual sensors. Calibration and signal filtering is needed to compensate for these undesirable effects.

33 4 19/29 Signal Filtering Many analog sensors have signal differences between individual sensors. Calibration and signal filtering is needed to compensate for these undesirable effects. We implemented three simple software based filters: variable-length weighted moving average filter Bessel low-pass filter Chebychev low-pass filter The signal filtering library is available online 4.

34 20/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

35 21/29 Software Tools SerialMonitor: log and analyse sensor data SerialForwarder: forward serial data over a TCP/IP socket

36 22/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

37 23/29 Demo Applications Flight simulator: sensor acts as a joystick Pac-man clone: sensor generates arrow inputs

38 Demo Applications I 2-D platform game: I I Left/right: tilt detection Jump: upward movement 24/29

39 25/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

40 Future Work I Use mixed RF technologies I Support the more power efficient nrf24 wireless technology 26/29

41 Future Work I Use mixed RF technologies I I Support the more power efficient nrf24 wireless technology Minimise energy consumption 26/29

42 Future Work I Use mixed RF technologies I I I Support the more power efficient nrf24 wireless technology Minimise energy consumption Use the module for various student projects: I I I Development of embedded software Printed circuit board design Signal processing applications 26/29

43 Future Work I Use mixed RF technologies I I I Minimise energy consumption Use the module for various student projects: I I I I Support the more power efficient nrf24 wireless technology Development of embedded software Printed circuit board design Signal processing applications Projects I I Development of a city monitoring application Cooperation with product development department: prototyping 26/29

44 27/29 Outline Introduction and Problem Statement System Design System Architecture Hardware Specifications Software Libraries Applications Signal Filtering Software Tools Demo Applications Future Work Conclusion

45 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors.

46 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download.

47 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download. The system and its derivatives are being used for student projects.

48 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download. The system and its derivatives are being used for student projects. We plan to cooperate with third parties by developing similar modules:

49 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download. The system and its derivatives are being used for student projects. We plan to cooperate with third parties by developing similar modules: Evaluation of the feasibility of industrial applications.

50 28/29 Conclusion We developed an Arduino based smart cube, equipped with various sensors. The LGPL licensed Arduino software libraries for these sensors are freely available for download. The system and its derivatives are being used for student projects. We plan to cooperate with third parties by developing similar modules: Evaluation of the feasibility of industrial applications. Prototyping tool for product development purposes.

51 Questions & Answers 29/29