X11 in Virtual Environments ARL

Size: px

Start display at page:

Download "X11 in Virtual Environments ARL"

Stella Carter
5 years ago
Views:

COMS W4172 Case Study: 3D Windows/Desktops 2 Steven Feiner Department of Computer Science Columbia University New York, NY 10027 www.cs.columbia.

1 COMS W4172 Case Study: 3D Windows/Desktops 2 Steven Feiner Department of Computer Science Columbia University New York, NY February 8, X11 in Virtual Environments ARL P. Dykstra. X11 in Virtual Environments. Proc. IEEE 1993 Symp. on Research Frontiers in Virtual Reality, October 1993, Render X11 server into shared memory Texture-map 3D polygon with shared memory 2

Windows on the World Columbia View through see-through head-tracked display Feiner, S., MacIntyre, B., Haupt, M.

UIST '93, Atlanta, GA, November 3 5, 1993, 145 155 Render X11 server into 6K 2K shared memory, and copy relevant

coordinate system of 1. User s display, or 2.

World (including tracked objects) 3 Windows on the World Columbia Feiner, S., MacIntyre, B., Haupt, M.

2 Windows on the World Columbia View through see-through head-tracked display Feiner, S., MacIntyre, B., Haupt, M., and Solomon, E. Windows on the world: 2D windows for 3D augmented reality. Proc. UIST '93, Atlanta, GA, November 3 5, 1993, Render X11 server into 6K 2K shared memory, and copy relevant portions to tracked seethrough head-worn display Windows are Always perpendicular to user s line of sight Fixed to coordinate system of 1. User s display, or 2. User s body mapped to partial virtual sphere surrounding user, relative to waist-worn tracker, or 3. World (including tracked objects) 3 Windows on the World Columbia Feiner, S., MacIntyre, B., Haupt, M., and Solomon, E. Windows on the world: 2D windows for 3D augmented reality. Proc. UIST '93, Atlanta, GA, November 3 5, 1993, Hypermedia system allows links to be made between any combination of Virtual windows Physical objects Locations View through see-through head-tracked display 4

Workscape Maya Design [for DEC] Ballay, J. Designing Workscape: An interdisciplinary experience. Proc.

v=h9f17jrg-se 200 points of light demonstration, 1990: http://www.youtube.com/watch?v=h5-t_s50sr4 5 Web Forager PARC T. Moran, How do people organize their desks?

and York, W. The WebBook and the Web Forager: An Information Workspace for the World- Wide Web. Proc. CHI 96, 111 117 Hierarchical workspace 1.

3 Workscape Maya Design [for DEC] Ballay, J. Designing Workscape: An interdisciplinary experience. Proc. CHI 94, Research prototype Objects at different depths, use of perspective Piles Cast shadows Sticky notes points of light demonstration, 1990: 5 Web Forager PARC T. Moran, How do people organize their desks?: Implications for the design of office information systems, ACM TOIS, 1(1), :10 Card, S.K., Robertson, G. and York, W. The WebBook and the Web Forager: An Information Workspace for the World- Wide Web. Proc. CHI 96, Hierarchical workspace 1. Focus: Page/book/pile at full size for direct interaction 2. Immediate memory: Air and desk for objects in use, but not in focus Air: Objects placed at different distances Desk: Moves with user 3. Tertiary: Bookcase for storing objects not in use (angled to save screen space) 6

Web Forager PARC Touching the bookcase 3D manipulation/navigation are invoked indirectly based on semantics T.

: Implications for the design of office information systems, ACM TOIS, 1(1), 1983 Manipulation Objects in air

focused object fly to immediate memory Navigation Touching bookcase makes user fly to it; touching object in

and layout to save space Beam Window 3D Finder prototype, 1996 Hierarchy of angled 3D trays (alternative rep

4 Web Forager PARC Touching the bookcase 3D manipulation/navigation are invoked indirectly based on semantics T. Moran, How do people organize their desks?: Implications for the design of office information systems, ACM TOIS, 1(1), 1983 Manipulation Objects in air can be moved forward/backward, or moved to focus Touching object in bookcase makes it fly to focus, and focused object fly to immediate memory Navigation Touching bookcase makes user fly to it; touching object in bookcase causes user to fly back, and object to fly to focus 7 3Desque Apple G. Miller, S Grisedale, K. Anderson, J. Visualization and Computer Animation, 10(2), 1999, Hierarchy of trays Explores use of 3D projection and layout to save space Beam Window 3D Finder prototype, 1996 Hierarchy of angled 3D trays (alternative rep for folders) Trays contain nested subtrays and upright angled documents A tray can be opened as a window, showing a beam to its footprint Automated layout Scrollable windows have border areas in which objects scrolled out of visibility are represented as scaled rectangles Popup names for browsing 8

5 The Task Gallery Microsoft Developed as research testbed, G. Robertson et al., The Task Gallery: A 3D Window Manager, CHI The Task Gallery Microsoft Task contains windows Room contains tasks Task gallery contains rooms Arranged as a long hall 10

Remember nearfar order better than left-right order 11 The Task Gallery Microsoft Navigation Designed to avoid

6 The Task Gallery Microsoft Active task is on stage (far wall) User can Move tasks to desired locations on room surfaces Select a task to make it the active task Study shows users Prefer tasks on walls, not floor/ceiling Remember nearfar order better than left-right order 11 The Task Gallery Microsoft Navigation Designed to avoid confusion of unconstrained 3D travel User can move only forward or backward one room at a time always facing forward 12

The Task Gallery Microsoft Only user icon is

palette of apps and docs Add to existing task or

7 The Task Gallery Microsoft Only user icon is visible until mouse hovers over it Navigation On-screen controls Keyboard accelerators 13 The Task Gallery Microsoft Glancing to left reveals palette of apps and docs Add to existing task or create new task Designed to exploit spatial memory 14

into Selected set Loose stack Can be moved anywhere on stage,

8 The Task Gallery Microsoft Glancing to right reveals file browser 15 The Task Gallery Microsoft Task windows organized into Selected set Loose stack Can be moved anywhere on stage, scaling based on distance On stands Ordered stack Inactive windows On podium 16

loose stack or ordered stack 17 The Task Gallery

9 The Task Gallery Microsoft Selection Replace or add to selected set Automated layout Move selected window to loose stack or ordered stack 17 The Task Gallery Microsoft 1:35-3:36 18

v=jxv8vlpok_g 2:10 19 Project Looking Glass Sun Switching virtual desktops by

10 Project Looking Glass Sun Originally internal research testbed, 2003 Then java.net open source project for Linux/Solaris 2:10 19 Project Looking Glass Sun Switching virtual desktops by panning Avoids 3D navigation by supporting only rotation among a surrounding set of desktops 20

11 Project Looking Glass Sun Switching virtual desktops by panning Avoids 3D navigation by supporting only rotation among a surrounding set of desktops 21 Project Looking Glass Sun Switching virtual desktops by panning Avoids 3D navigation by supporting only rotation among a surrounding set of desktops 22

12 Project Looking Glass Sun Browsing a 3D jukebox 23 Project Looking Glass Sun Rotating a window 24

13 Project Looking Glass Sun Rotating a window 25 Project Looking Glass Sun Rotating a window 26

14 Project Looking Glass Sun Rotating a window to interact with info on back 27 Project Looking Glass Sun Adding a note on the back of a window 28

com Originally research project (2006), later product, then acquired by

15 Project Looking Glass Sun Viewing windows at an angle with labeled edges 29 BumpTop A. Agarawala and R. Balakrishnan Originally research project (2006), later product, then acquired by Google (2010), now open source Piles Selective use of physics Pen-based interaction 31

BumpTop A. Agarawala and R. Balakrishnan www.bumptop.com http://www.youtube.com/watch?

window appears in front When user raises hands from kbd, main window slides down to allow

16 BumpTop A. Agarawala and R. Balakrishnan Piles Selective use of physics Pen-based interaction 32 SpaceTop J. Lee, A. Olwal, H. Ishii, C. Boulanger, CHI 2013 Transparent LCD display Depth cameras track head and hands Main window appears in front When user raises hands from kbd, main window slides down to allow user to select another window from virtual cabinet behind it to take its place

Accounting for asymmetric interaction around the body Limited FOV (2:08 2:50)

17 Personal Cockpit B. Ens, R. Finnegan, P. Irangi, CHI 2014 Exploration of layout and interaction with arrays of window in AR Accounting for asymmetric interaction around the body Limited FOV (2:08 2:50)

Open Archive TOULOUSE Archive Ouverte (OATAO)

Open Archive TOULOUSE Archive Ouverte (OATAO) OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible. This is an author-deposited