Interaction Technologies and Context-awareness

Transcription

1 Interaction Technologies and Context-awareness Kaj Grønbæk Research and Innovation Manager for Interactive Spaces The Alexandra Institute, Aarhus Professor, Department of Computer Science Aarhus University

2 Plan! About Alexandra and Interactive Spaces Lab! Interaction tech a selection in overview! Context-awareness a definition! Application examples produced by our lab! Camera-tracking, Multi-sensory interaction, Augmented Reality, Multitouch displays! User driven innovation! Conclusion

3 The Alexandra Institute! GTS (Godkendt Teknologisk Service)! Match making between research and industry! ~100 employees! Departments in Aarhus and Copenhagen! Activity areas! Pervasive Healthcare, Business and Processes, Pervasive Positioning, Interactive Spaces, Software Infrastructure, Security, New Ways of Working, Computer Graphics, SmartCity! R&D projects! Many technological networks

4 Interactive Spaces Lab!!!!! Started as Interdisciplinary research center (2003- current)! Computer Science, Architecture, Design, and Engineering ICT in the physcial environment! Infrastructure, interaction, physical design, building components, new user experiences Projects with industry involvement! research projects and consultancy projects! Activities for approx. 100 mio. dkr. until now Application domains! Home, schools, libraries, public spaces, museums, attractions and work places Partners/Customers:! B&O, LEGO, ARLA, Arkitema, Solutors, Systematic, Theater Katapult, municipalities, museums, libraries!

5 Interaction Technologies a selection in overview

6 1. Camera-based interaction! Camera-based vision! Cameras everywhere! Cheap Kinect 3D camera! Multitouch displays! Vision Through Display! Eye and facetracking! (theeyetribe.com from ITU) Reactable

7 2. Augmented Reality! Huge increase in AR applications due to smartphones! Vision based tags such as QR-Codes! Vision based - feature tracking! Qualcomm tool, Layar! GPS/Compass! Layar, Junaio! Google Goggles

8 ! Click 3. RFID to edit tags Master implicit title style interaction! RFID = Radio Frequency ID! Unclear of where the original invention took place! Related to spy equipment!! Today's reflected power RFID tags was presented by the Los Alamos Scientific Laboratory in 1973.! The first patent associated with RFID was granted to Charles Walton in 1983! Two main types! Passive, i.e. no internal power source! Active with an internal power source

9 4.1 Multi sensory interaction! Position sensing! GPS/Galileo! WiFi! Dead Reckoning! Movement sensors! Accellerometers! Gyro! Vital signs! Heartbeat! Temperature! EKG

10 Click 4.2 Multisensory to edit Master interaction title style! Multitouch surface - AudioPad - for music control! Based on MIT sensetable electronic tracking of pucks

11 5. Context-awareness!!! Machine learning techniques e.g. to Derive context from previous activity such as SMS dictionary Derive gesture categories from example gestures

12 Camera Tracking - Examples

13 Wisdom Well Interactive floor for learning - camera-based interaction

14 Ceiling projected Wisdom Well Click to edit Master title style Kinect camera tracking from ceiling Product sold via Solutors A/S

15 H2Interaction Camera tracking for simulating energy cycle

16 Kinect 3D tracking in PIXLPark Click to edit Master title style - Denmarks First Digital Playground

17 Sensor-based interaction

18 Click Context-Aware to edit Master Remote title style Control! Made in the ihome project with B&O! Accelerometer based gesture tracking! Control device in close proximity (BT/WiFi)! Move digital material as if it was physical! i.e. meta-data and link to material is moved Throw Grab

19 Sensor Tech for Football training game Click to edit Master title style (installed at Herning Fremad)! Alexandra and Munins Sport has developed the installation for Herning Fremad Football Lab! Open 24/7! 3 exercise games developed sofar! Results on Web and Facebook! Piezo sensors measure where the nets are hit

20 SwingScape interactive music Click to edit Master title style installation with sensor network Developed for the Roskilde Festival by Interactive Alexandra Institute

21 Wind sensor Vestas interactive wall at EXPO2012

22 Augmented Reality (AR) - Examples

23 Click Vision to edit and Master feature title tracking style AR! Register reference picture! Make a virtual tag based on local feature tracking! Align the generated graphics to virtual tag! Try it by downloading SMK Hammershøi fra Google play and Apple App Store! Made by Redia A/S

24 Augmented Reality for Pervasive Click to edit Master title style Museum Experiences

25 WorkSpace SitePack Construction site with overlays

26 Aligning digital building models with Click to edit Master title style physical site Initialization and continous overlay alignment

27 RFID-based applications - Examples

28 H2Interaction - The Village Simulation (RFID, LED, acryl, projection, sound)

29 Kategat Center Click to edit Master title style Learning about fish! RFID construction set! Playful learning about fish properties and characteristics! Co-con-struction of fish! Fish are released in large virtual sea to be explored

30 Hospital navigation Wayfinding with active RFID

31 Interaction based on position sensing - examples

32 Click PerPos to edit Indoor Master navigation title style! Utilize WiFi and RFID for accurate positioning e.g. in hospitals! People and resources tracked by RFID tags, WiFi tags or smartphone/tablet based devices.! Navigation provided on smartphones in the augmented environment.

33 PerPos Indoor navigation hospitals, malls and office buildings

34 PlanA Click to edit Master title style context-aware app for service planning 34

35 PlanA: overview and collaborative task management via SmartBoards

36 User driven innovation techniques

37 User driven innovation! Involve the relevant parties Users! Follow an iterative approach! Gradually reduce the design uncertainties Industry Innovation Research

38 Click Techniques to edit Master for User title involvement style! Etnographic based field studies! Observations, interviews and video analysis! Structured brainstorming! Future workshops, metaphorical design, organizational games! Scenarios! Descriptive, tableau, video, fiction, personas, extreme characters! Mock-ups! Physical and paper models! Video prototyping! Stop-motion, blue-screen! Prototyping! Exploratory, experimental, evolutionary, cooperative

39 Wrap UP

40 More techniques not covered! Voice control! Paper based interaction! Physical actuation, e.g. robotics! Shape changing!!

41 Click Summary to edit Master Interactive title style Spaces lab!! Has extensive experiences with a rich variety of interaction techniques! Provides technological services within Interaction! Consultancy, e.g. user driven design processes! Custom technical development! Product development and sale! Has close research collaboration with Computer Science, AU, i.e. co-authorship on many international publications