NOTE: SOME OF THE MATERIAL IN THIS PRESENTATION IS COPYRIGHTED BUT FREE FOR RESEARCH PURPOSES.

Size: px

Start display at page:

Download "NOTE: SOME OF THE MATERIAL IN THIS PRESENTATION IS COPYRIGHTED BUT FREE FOR RESEARCH PURPOSES."

Morgan Wright
5 years ago
Views:

1 NOTE: SOME OF THE MATERIAL IN THIS PRESENTATION IS COPYRIGHTED BUT FREE FOR RESEARCH PURPOSES. CHECK WITH BEFORE USING OUTSIDE THE SGN-5858 SEMINAR.

4 What is context? S O M E E X A M P L E S

6 CONTEXT IN DIALOGUE Could I have some Camels, please. Yes, up here in my room. 2 packs, please. What? Animals not allowed? Cigarettes! Cigarettes, you idiot!

Dictionary Computer access will be everywhere: in the walls, on

8 Ubiquitous Computing Ubiquitous, a. Existing or being everywhere; omnipresent The New Webster s Dictionary Computer access will be everywhere: in the walls, on wrists, and in scrap computers (like scrap paper) lying about to be grabbed as needed. This is called Ubiquitous Computing, or ubicomp. -- Mark Weiser, IEEE Computer, October 1993 June 25, 2008 UbiComm Slide

9 NOKIA Point & Find paf.nokia.com

12 How are contexts recognised? Higher level context Trip to work 0.93 Context recognition (time series sensor fusion) Indoors 1.0 Arrival 0.7 Context atoms in a time sequence vector Time WalkingFrequency Car WalkingFrequency Elevator 1.0 WalkingFrequency 0.8 Indoors 0.9 Context atoms Probabilities NOKIA Pertti Huuskonen

Multichannel sensor interpretation 9 channels: 3x acceleration, 2x light intensity, temperature, humidity, skin conductivity, audio Phase of the scenario Correct set of contexts 1.

13 Multichannel sensor interpretation 9 channels: 3x acceleration, 2x light intensity, temperature, humidity, skin conductivity, audio Phase of the scenario Correct set of contexts 1. Drive car (Car, Activity) Source: VTT Electronics/ Panu Korpipää 2. Run to the door (Other sound, Running, Outside, Activity) 3. Walk to the elevator (Other sound, Walking, Inside, Activity) 4. Wait for the elevator (Other sound, Inside) 5. Elevator (Elevator, Inside) 6. Walk to the door (Other sound, Walking, Inside, Activity) 7. Open the door, sit down (Other sound, Walking, Inside, Activity) 8. Make a phone call (Speech, Inside) 9. End call, put on music (Other sound, Walking, Inside, Activity) 10. Classical music (Classical music, Inside, Still) 11. Stop, change disc, play (Other sound, Walking, Inside, Activity) 12. Rock music (Rock music, Inside, Still) 13. Stop music, walk to tap (Other sound, Walking, Inside, Activity) 14. Take tap water (Tap water sound, Inside) 15. Walk to the table, sit (Other sound, Walking, Inside, Activity) 16. Eat (Other sound, Inside, Activity) 17. Conversation (Speech, Inside)

15 Semantic Data 15

16 Modeling people / the world / life... is hard.

18 Google needs some context awareness and / or common sense :-) Google ad upon searching Context Awareness

20 Why Middleware? Context 0.784V, ma, -0.84i+0.23j Application Context 0.784V, ma, Middleware Outdoors, In Hand, Application -0.84i+0.23j Running

21 Context Framework Series 60

22 Nokia N97 contains the context framework in its Symbian operating system.

$File: - E:\PICS\IMG_8699.JPG.. Make - Canon. Model - Canon EOS 300D DIGITAL. Orientation - Top left. XResolution - 180. YResolution - 180. ResolutionUnit - Inch. DateTime - 2006:11:05 18:45:52.$

24 File: - E:\PICS\IMG_8699.JPG.. Make - Canon. Model - Canon EOS 300D DIGITAL. Orientation - Top left. XResolution YResolution ResolutionUnit - Inch. DateTime :11:05 18:45:52. YCbCrPositioning - Centered. ExifOffset ExposureTime - 2 seconds. FNumber ISOSpeedRatings ExifVersion DateTimeOriginal :11:05 18:45:52. DateTimeDigitized :11:05 18:45:52. ComponentsConfiguration - YCbCr. CompressedBitsPerPixel - 3 (bits/pixel). ShutterSpeedValue - 2 seconds. ApertureValue - F ExposureBiasValue MaxApertureValue - F MeteringMode - Multi-segment. Flash - Not fired, compulsory flash mode. FocalLength - 22 mm. UserComment -. FlashPixVersion ColorSpace - srgb. ExifImageWidth ExifImageHeight I n t e r o p e ra b i l i t y O f f s e t Fo c a l P l a n e X R e s o l u t i o n FocalPlaneYResolution FocalPlaneResolutionUnit - Inch. SensingMethod - One-chip color area sensor. FileSource - DSC - Digital still camera. CustomRendered - Normal process. ExposureMode - Auto. WhiteBalance - Auto. SceneCaptureType - Landscape.. Maker Note (Vendor): -. Macro mode - Off. Self timer - Off. Quality - Fine. Flash mode - Auto + red-eye reduction. Sequence mode - Single or Timer. Focus mode - One-Shot. Image size - Large. Easy shooting mode - Landscape. Digital zoom - None. Contrast - High, +1. Saturation - High, +1. Sharpness - High, +1. ISO Value Metering mode - Evaluative. Focus type - Auto. AF point selected -. Exposure mode - Easy shooting. Focal length mm (1 mm). Flash activity - Not fired. Flash details -. Focus mode White Balance - Auto. Sequence number - 0. Flash bias EV. Subject Distance File number Image Type - IMG:EOS 300D DIGITAL JPEG. Firmware Version - Firmware Version Camera Serial Number Image Number Owner Name - MarjaN Nokia

25 Metadata GSM clock GPS+Place server Bluetooth WLAN Presence & Calendar uk.weather.com Message log NOKIA

Emerging content types UI skins, voice commands, profiles,

playlists, bookmarks, personal settings game content

remixes collections & combinations (benchmark: Apple ilife

history and relation What was the MP3 I was listening to

28 Emerging content types UI skins, voice commands, profiles, T9 dictionaries, images, video, audio, messages, contacts, playlists, bookmarks, personal settings game content macros & scripts social network data superdata landmarks remixes collections & combinations (benchmark: Apple ilife suite) items, movies, characters, saved games, Content history and relation What was the MP3 I was listening to when I took this photo? New types coming up all the time; slow adoption

30 Nokia

34 Forget-me-not by Xerox Research (around 1993) Intimate computing : carry a computer (ParcTab) at all times Collect contextual data into a biography Personal location (by tabs) Encounters with people (by tabs) Workstation activities: programs, files, Phone calls Context as retrieval key Access with icon-based hypertext system on the tabs

35 Context Movies Calendar! Presents collected context through fun and entertaining video diaries! Minimal labor yet graphically spectacular movies!! Save to gallery or send via MMS Set Time span, determine movie length and fetch background music from media gallery Then preview, and save to gallery. or send as MMS

36 2007 Nokia

38 Conversing Texting Snoring Listening Watching Sleeping Photo: Gardiner Pearson (

39 IEEE Wireless Communications, October 2002, pp

40 VTT TECHNICAL RESEARCH CENTRE OF FINLAND Case study: Sports data sensing Based on the Palantir dataset Several people are doing the same activity 9 Context classes All recognizers have slightly different recognition accuracy Improves recognition from 72% to 92% From: Jani Mäntyjärvi & Ville Könönen, VTT 40

42 C.S.P. (Context Service Provider) KNOWITALL.COM (Picture depicting the agents from the movie Matrix removed) W E K N O W Y O U R C O N T E X T.

43 > 38 C > Quite humid > Not moving > Touch detected > Inferred location: by the pool _

44 > 38 C > Quite humid > Not moving > Touch detected > Inferred location: by the pool _ Burp.

46 Why is context awareness needed?!" NOKIA Pertti Huuskonen

Archival challenges about reproductions of archival material

IIAS Autumn Archival School 2014 Archival challenges about reproductions of archival material dr. Miroslav NOVAK Introduction starting point Original documents Archival material Reproductions (copies,