Augmented and Virtual Reality 6.S063 Engineering Interaction Technologies Prof. Stefanie Mueller MIT CSAIL HCI Engineering Group
AR supplements the real world VR replaces the real world mixed reality real environment augmented reality (AR) augmented virtuality (AV) virtual reality (VR)
let s look at the very beginning
2012 - Occulus Rift not quite the first when was the first AR/VR headset developed? <30 second brainstorming>
1965: Ivan Sutherland - Sword of Damocles (first video headset)
binocular display (both eyes) displayed output 1965: Ivan Sutherland - Sword of Damocles (first video headset)
too heave to carry, thus suspended from ceiling included head & eye tracking designed for helicopter pilots to have light synchronized with head movement when flying in the dark 1965: Ivan Sutherland - Sword of Damocles (first video headset)
the ultimate display :: a room where the computer can control the existence of matter (Ivan Sutherland, 1965)
Ivan created the first head mounted display but the idea of augmenting human senses has already around a bit longer
stereoscopic display vibrating seat body tilting fragrance generating system wind generation 1965: Marc Heiling - Sensorama (even before Sutherland)
first data glove 1985: NASA virtual environment work station
1985: NASA virtual environment work station
1985: NASA virtual environment work station
1985: NASA virtual environment work station
any ideas which tech advances made AR/VR suddenly mass-available in the last 5-10 years? <30 second brainstorming>
small and light-weight displays became low-cost mobile computing: small & powerful computers for graphics
1996: Columbia - Mobile AR Touring Machine: first mobile system
commodity devices are finally sufficiently powerful, small, inexpensive 2000+: consumer AR / VR
what s next in terms of technology? how does the next AR/VR hardware look like? <30 second brainstorming>
AR contact lenses (many challenges, max. 8 pixel right now)
display technologies
projector retinal display headworn display hand-held display spatial see-through display projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial [Ramesh Raskar]
projector retinal display headworn display hand-held display spatial see-through display projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial retinal display
today multifocal lenses color blindness lenses sensor lenses for body information future AR with digital overlay future: VR [NaturalVue, ColorMax]
projector retinal display headworn display hand-held display spatial see-through display projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial head-worn displays
optical see-through: you see the real-world with your eyes in the same way as using regular glasses on top digital content is displayed Vuzix Star 1200XL
using a cellphone and materials from the workshop, how would you build an optical see-through display? draw it on paper. <2 minutes>
optical see-through: smart phone display real world semi-transparent mirror
optical see-through: display mirror
what are some of the benefits and drawbacks of optical see through? <30 second brainstorming>
benefits:: real world is full resolution and FOV if you run out of battery, you still see something no control over real world you cannot display sth behind a real world object virtual/real worlds focus at different distances
video see-through: real world is captured with cameras camera image is digitally enhanced you look at the camera image Vuzix Wrap 1200AR
benefits:: full control over image you can display something behind a real world object real world is low resolution and low field of view (FOV)
field of view (FOV): here HoloLens, FOV < 100 degree)
projector retinal display headworn display hand-held display spatial see-through display projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial hand-held displays
kind of video see-through device camera captures real world, then displays it on screen
markers help to align multiple devices
projector retinal display headworn display hand-held display spatial see-through display projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial spatial augmented reality (SAR)
spatial AR: project onto real-world objects no need to wear or hold something digital content directly in the real-world
spatial AR: camera: find out where the object is projector: enhance with digital content [SoftAR, Punpongsanon]
projector retinal display headworn display hand-held display spatial see-through display? projector Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial [Ramesh Raskar]
if spatial AR brings digital content closer to the real-world object, what would be the next logical step in terms of technology? <30 second brainstorming>
the future? everything becomes a display
and maybe even a physical display The ultimate display would, of course, be a room within which the computer can control the existence of matter. A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be fatal. I. Sutherland, The Ultimate Display, Proc. IFIP 65, 506 508, 1965
any many more interesting questions..
Liwei Chan: Frontface
Yoichi Ochiai: Augmented Mom
that s it for today
until wednesday laser cut business card (HW1) setup your micro-controller on your computer (HW2) connect your micro-controller to wifi (HW3) Jared s tuesday office hour: 4.15-6pm
end.