Interaction Technologies and Context-awareness Kaj Grønbæk Research and Innovation Manager for Interactive Spaces The Alexandra Institute, Aarhus Professor, Department of Computer Science Aarhus University
Plan! About Alexandra and Interactive Spaces Lab! Interaction tech a selection in overview! Context-awareness a definition! Application examples produced by our lab! Camera-tracking, Multi-sensory interaction, Augmented Reality, Multitouch displays! User driven innovation! Conclusion
The Alexandra Institute! GTS (Godkendt Teknologisk Service)! Match making between research and industry! ~100 employees! Departments in Aarhus and Copenhagen! Activity areas! Pervasive Healthcare, Business and Processes, Pervasive Positioning, Interactive Spaces, Software Infrastructure, Security, New Ways of Working, Computer Graphics, SmartCity! R&D projects! Many technological networks
Interactive Spaces Lab!!!!! Started as Interdisciplinary research center (2003- current)! Computer Science, Architecture, Design, and Engineering ICT in the physcial environment! Infrastructure, interaction, physical design, building components, new user experiences Projects with industry involvement! research projects and consultancy projects! Activities for approx. 100 mio. dkr. until now Application domains! Home, schools, libraries, public spaces, museums, attractions and work places Partners/Customers:! B&O, LEGO, ARLA, Arkitema, Solutors, Systematic, Theater Katapult, municipalities, museums, libraries!
Interaction Technologies a selection in overview
1. Camera-based interaction! Camera-based vision! Cameras everywhere! Cheap Kinect 3D camera! Multitouch displays! Vision Through Display! Eye and facetracking! (theeyetribe.com from ITU) Reactable http://en.wikipedia.org/wiki/file:reactable_multitouch.jpg
2. Augmented Reality! Huge increase in AR applications due to smartphones! Vision based tags such as QR-Codes! Vision based - feature tracking! Qualcomm tool, Layar! GPS/Compass! Layar, Junaio! Google Goggles
! Click 3. RFID to edit tags Master implicit title style interaction! RFID = Radio Frequency ID! Unclear of where the original invention took place! Related to spy equipment!! Today's reflected power RFID tags was presented by the Los Alamos Scientific Laboratory in 1973.! The first patent associated with RFID was granted to Charles Walton in 1983! Two main types! Passive, i.e. no internal power source! Active with an internal power source
4.1 Multi sensory interaction! Position sensing! GPS/Galileo! WiFi! Dead Reckoning! Movement sensors! Accellerometers! Gyro! Vital signs! Heartbeat! Temperature! EKG
Click 4.2 Multisensory to edit Master interaction title style! Multitouch surface - AudioPad - for music control! Based on MIT sensetable electronic tracking of pucks
5. Context-awareness!!! Machine learning techniques e.g. to Derive context from previous activity such as SMS dictionary Derive gesture categories from example gestures
Camera Tracking - Examples
Wisdom Well Interactive floor for learning - camera-based interaction
Ceiling projected Wisdom Well Click to edit Master title style Kinect camera tracking from ceiling Product sold via Solutors A/S
H2Interaction Camera tracking for simulating energy cycle
Kinect 3D tracking in PIXLPark Click to edit Master title style - Denmarks First Digital Playground http://vimeo.com/38725130
Sensor-based interaction
Click Context-Aware to edit Master Remote title style Control! Made in the ihome project with B&O! Accelerometer based gesture tracking! Control device in close proximity (BT/WiFi)! Move digital material as if it was physical! i.e. meta-data and link to material is moved Throw Grab
Sensor Tech for Football training game Click to edit Master title style (installed at Herning Fremad)! Alexandra and Munins Sport has developed the installation for Herning Fremad Football Lab! Open 24/7! 3 exercise games developed sofar! Results on Web and Facebook! Piezo sensors measure where the nets are hit
SwingScape interactive music Click to edit Master title style installation with sensor network Developed for the Roskilde Festival by Interactive Spaces @ Alexandra Institute http://vimeo.com/11259859
Wind sensor Vestas interactive wall at EXPO2012
Augmented Reality (AR) - Examples
Click Vision to edit and Master feature title tracking style AR! Register reference picture! Make a virtual tag based on local feature tracking! Align the generated graphics to virtual tag! Try it by downloading SMK Hammershøi fra Google play and Apple App Store! Made by Redia A/S
Augmented Reality for Pervasive Click to edit Master title style Museum Experiences
WorkSpace SitePack Construction site with overlays
Aligning digital building models with Click to edit Master title style physical site Initialization and continous overlay alignment
RFID-based applications - Examples
H2Interaction - The Village Simulation (RFID, LED, acryl, projection, sound)
Kategat Center Click to edit Master title style Learning about fish! RFID construction set! Playful learning about fish properties and characteristics! Co-con-struction of fish! Fish are released in large virtual sea to be explored
Hospital navigation Wayfinding with active RFID
Interaction based on position sensing - examples
Click PerPos to edit Indoor Master navigation title style! Utilize WiFi and RFID for accurate positioning e.g. in hospitals! People and resources tracked by RFID tags, WiFi tags or smartphone/tablet based devices.! Navigation provided on smartphones in the augmented environment.
PerPos Indoor navigation hospitals, malls and office buildings
PlanA Click to edit Master title style context-aware app for service planning 34
PlanA: overview and collaborative task management via SmartBoards
User driven innovation techniques
User driven innovation! Involve the relevant parties Users! Follow an iterative approach! Gradually reduce the design uncertainties Industry Innovation Research
Click Techniques to edit Master for User title involvement style! Etnographic based field studies! Observations, interviews and video analysis! Structured brainstorming! Future workshops, metaphorical design, organizational games! Scenarios! Descriptive, tableau, video, fiction, personas, extreme characters! Mock-ups! Physical and paper models! Video prototyping! Stop-motion, blue-screen! Prototyping! Exploratory, experimental, evolutionary, cooperative
Wrap UP
More techniques not covered! Voice control! Paper based interaction! Physical actuation, e.g. robotics! Shape changing!!
Click Summary to edit Master Interactive title style Spaces lab!! Has extensive experiences with a rich variety of interaction techniques! Provides technological services within Interaction! Consultancy, e.g. user driven design processes! Custom technical development! Product development and sale! Has close research collaboration with Computer Science, AU, i.e. co-authorship on many international publications