ROOMWARE MOVING TOWARD UBIQUITOUS COMPUTERS

Size: px
Start display at page:

Download "ROOMWARE MOVING TOWARD UBIQUITOUS COMPUTERS"

Transcription

1 P. Tandler, N. A. Streitz, Th. Prante Roomware Moving Toward Ubiquitous Computers. In: IEEE Micro, Nov/Dec, pp ROOMWARE MOVING TOWARD UBIQUITOUS COMPUTERS COLLABORATIVE WORK APPROACHES, FACILITATED BY UBIQUITOUS COMPUTING, WILL SHAPE FUTURE WORKING ENVIRONMENTS. ROOMWARE COMPONENTS INTEGRATE EVERYDAY OFFICE FURNITURE WITH COMPUTER- BASED INFORMATION DEVICES. 36 Peter Tandler Norbert Streitz Thorsten Prante Fraunhofer Integrated Publication and Information Systems Institute In the past, a central mainframe computer provided terminals for many users. In the current age of the personal desktop computer, there are one or more computers for each person. It s only in rare cases that these computers work together to jointly provide functions. In the future, computational power will be ubiquitous. In such an environment, devices that support humans interacting with information at work and in everyday activities will complement the desktop computer. These devices will be closely interconnected and integrated with the environment and context in which people use them. They indeed will synchronously work together to support fluent collaboration. Collaboration between users and environments with multiple interconnected devices will determine, to a large degree, approaches to work and everyday activities. An example of this type of device is roomware, or computer-augmented objects resulting from the integration of room elements, such as walls, doors, and furniture, with computer-based information devices. The roomware components that we have developed at Fraunhofer IPSI support the vision of a future where our surroundings act as an information interface, and the computer as a device disappears from our perception. Three main observations influenced the creation of roomware components: 1 the growing importance of information technology, the need to integrate information technology with the environment in which it is used, and the recognition that new work practices will emerge to cope with the increasing rate of the innovation. Growing importance of information technology Only a few remaining domains of modern social and economic life are independent of information technology. Within the working context, it s almost a requirement to use digital information as a major part of everyday work. The desktop computer as a device is ubiquitously present in every office. This idea was further pursued by Mark Weiser, who coined the term ubiquitous computing. 2 We interpret this view as the design goal of a two-way augmentation and smooth transition between real and virtual worlds. Combining real and virtual worlds in a computer-augmented environment resulting in hybrid worlds lets us design enabling interfaces that combine everyday reality and virtuality. We seek to use the best aspects of both worlds. Our goal is to transform and transcend human-computer interaction resulting in rather direct human-information interaction /02/$ IEEE

2 and human-human cooperation, making computers disappear. In our approach, we distinguish between two types of disappearance ( Physical disappearance of computer devices comes about by making the computer-based parts small enough to fit in the hand, interweave with clothing, or attach to the body. Mental disappearance of computers occurs when they become invisible to the user s mental eyes. The important aspect here is that humans do not perceive the devices as computers anymore, but as embedded elements of augmented artifacts in the environment. In our actual designs, we combine these two types of disappearance. Integration with the environment When the computer disappears in the sense defined previously, developers will need to widen their concept of computers and information technology. Their focus must begin to include the environment and context in which the computer is used. Architecture, as one major part of the surrounding environment, has a high degree of influence in determining our living and working habits. (Here, we use architecture to refer to the architecture of buildings, not software.) In addition, interaction with physical objects both as sources of information (such as books, magazines, or drawings) and tools or furniture is natural and normal for the way people live and work. This is in sharp contrast to the way people work with digital information today, which reduces interaction with information to interaction with computers in a very limited way. The computer has no information available about where it is located. It has no clue about the physical distance to other devices connected over the network; it s only aware of directly connected devices, such as its monitor, keyboard, mouse, and, perhaps, a printer or scanner. A computer cannot figure out whether or not there is a large public display close by, which could show information used for a discussion among several people. It normally would not even sense that several people are trying to look at its small screen, because most current operating systems enable application use by a single user only. Besides the need for awareness of the physical context in which a device is used, it s also helpful to make other types of context available. 3-4 Examples include the number of people present, their roles (in terms of team members or visitors), and their current tasks. This type of context information is closely related to the third observation. New work practices Looking at work environments, work is increasingly characterized by a high degree of dynamics, flexibility, and mobility. Initial examples include such new work practices as on-demand and ad hoc formation of teams. Contents and participants as well as contexts, tasks, processes, and structures of collaboration will change frequently to cope with the increasing rate of innovation. There is empirical evidence that teams work more effectively if they develop balanced proportions of individual work, subgroup activities, and full-group work. 5 The same study found the range and combination of information devices available determined, to a significant extent, a team s flexibility in relation to working in different modes. This stresses how important it is to provide the methods and tools to support different work phases in teams. Besides the need for new software tools, this variety of work phases influences other parts of the work environment. In the past, the role of architecture and office buildings addressed, to a large extent, the needs of individual work. In the future, work environments will increasingly address the needs for collaboration and communication. This evolution raises the need for appropriate furnishings and equipment. Roomware components address these needs, providing physical artifacts that meet the requirements of flexible reconfigurability. Software developer challenges Obviously, roomware components differ from desktop PCs in several ways. Interaction in a multiuser, multidevice environment supported by roomware components requires new user interface concepts for efficient interaction. Roomware components developed as part of the i-land an interactive landscape for creativity and innovation project base interaction on a pen or finger, instead of a mouse and keyboard. 1 However, all these features pose a challenge for the software developer of roomware appli- NOVEMBER DECEMBER

3 ROOMWARE DynaWall CommChair InteracTable ConnecTables Figure 1. Second generation of roomware. cations. Whereas several well-established s, frameworks, and tools exist to aid application design for a traditional PC,6 roomware application developers cannot draw upon such tools. They are in the same situation as that of pioneering computer scientists when PC use first began to spread. Roomware components Our approach to roomware component design is to meet, in parallel, the requirements of flexible configuration and dynamic resource allocation in physical and information environments. The term roomware was originally coined by Streitz and his Ambiente team5 and is now a registered Fraunhofer trademark. However, it also applies to a general characterization of this approach and to products in this area. The general goal of developing roomware is to design integrated physical and virtual information spaces. In the context of supporting teamwork, roomware components should let users tailor and compose them to form cooperation landscapes, serving multiple purposes such as project team rooms, presentation suites, learning environments, information foyers, and so on. These goals have in common the requirement of developing software that enables new forms of multiuser, multiple-display, human-computer interaction and cooperation. 38 IEEE MICRO In 1997, we began work on a testbed for experimenting with roomware components. We call this environment i-land. In 1999, as part of the research and development consortium Future Office Dynamics ( h t t p : / / w w w. f u t u r e office.de), we developed together with industry partners the second generation of roomware. We redesigned existing components and developed an additional component called ConnecTable. Figure 1 shows this and other roomware devices: an interactive electronic wall (DynaWall), interactive electronic table (InteracTable), and mobile and networked chairs with an attached interactive display (CommChairs). We developed the Basic Environment for Active Collaboration with Hypermedia (Beach) software framework as infrastructure to support synchronous collaboration with roomware components.7 Beach offers a user interface that addresses the needs of devices that have no mouse or keyboard, and require new forms of human-computer and teamcomputer interaction. To allow synchronous collaboration, Beach builds on shared documents concurrently accessible via multiple interaction devices. Large group activities: DynaWall The DynaWall provides a large whiteboard-like display that serves the needs of teams working in project and meeting rooms. It is the electronic equivalent of large areas of assembled sheets of paper covering the walls for creating and organizing information. The current realization consists of three segments with back projections and large touch-sensitive display surfaces ( The total display size of meters can cover one side of a room (see Figure 1). Although driven by three computers, Beach provides one large, homogeneous workspace with no interaction boundaries between the segments. Two or more people can either work

4 individually in parallel or share the entire display space. To acknowledge the large visual surface, Beach supports spatial hypertext documents. workspaces can be positioned freely on the surface. As the touch-sensitive displays enable direct interaction with the documents using pen or finger, users draw strokes rather than clicking (that is, tapping) on the surface. Beach therefore allows drawing informal scribbles. It also allows pen gestures to invoke commands. Users can gesture to create, for example, new workspaces or hyperlinks, or remove objects. In addition to the general design of a penbased user interface, DynaWall s size creates challenges for human-computer interaction. For example, it would be cumbersome for a user to drag an object or a window over a distance of more than 4 meters by having to touch the DynaWall the entire time (similar to holding down the mouse button). We developed two mechanisms to address these types of problems. Similar to physically picking up an object and placing it somewhere else, our take-and-put feature lets users take information objects at one position, walk over to a different place, and put them somewhere else on the display. For bridging the distance between several closely cooperating people during group brainstorming, for example, the shuffle feature lets users throw an object from one side of the display to the other, where another team member can catch it (by touching it). Individual work in a group context: CommChair A CommChair, shown in Figure 2, is a mobile chair with a built-in computer. These chairs represent a new type of furniture, combining the mobility and comfort of armchairs with information technology. CommChairs let people communicate and share information with people in other CommChairs, standing in front of the DynaWall, or using other roomware components. They can make personal notes in a private space but also interact remotely on shared (public) workspaces, for example, making remote annotations at the DynaWall. Beach software provides the cooperative sharing functionality. To offer flexibility and mobility, each chair has a wireless network (we currently use an IEEE WaveLAN) and independent power supply. Figure 2. Tight collaboration using a CommChair in front of a DynaWall. The user in the chair can remotely annotate the wall by simply writing on the display attached to the chair. Small-group collaboration: InteracTable The InteracTable interactive table provides a space for creation, display, discussion, and annotation of information objects. It s suitable for use by groups of up to six people standing around it. It consists of a large plasma display panel with a touch-sensitive surface ( embedded in the top of a stand-up table. People can write and draw on it with a pen and interact via finger or pen gestures with information objects. Users with a need for extensive text input can use a wireless keyboard. The InteracTable is an example of how designers need to adapt the user interface to different form factors. Its horizontal setup display lets people stand around it, resulting in an interaction area with no predefined orientation. In contrast, vertical displays such as desktop computer monitors have a dedicated top and bottom, left and right. Thus, horizontal displays require new forms of human-computer interaction. To this end, Beach provides gestures for rotating individual information objects or groups of objects. This accommodates the need for easy viewing from all perspectives. Furthermore, a user can create a second NOVEMBER DECEMBER

5 ROOMWARE Figure 3. To support horizontal displays, Beach lets different users rotate documents to a preferred orientation. 40 (a) IEEE MICRO view of an object; this view stays synchronized with the original view. 7 A user can shuffle this view to a colleague standing on the other side of the table, so this team member will always have a personal view of the same object in the preferred orientation. Now, both users can view, edit, and annotate the same object in parallel, as Figure 3 shows. Transition from individual to group work: ConnecTable The ConnecTable component is part of the second generation of roomware. It eases the transition between individual work and smallgroup cooperation. Users can adapt the display height to accommodate different Coil Tag Sensor Figure 4. Sensor technology integrated into the Connec- Table (a). A coil and tag at the top of the display detect other tables (b). (b) working situations, such as standing up or sitting. They can tilt the display to different angles, providing an optimal view. In this stand-alone mode, it is similar to a Comm- Chair. To initiate tight collaboration, two users can move their ConnecTables together, and arrange them to form a large display area, as shown in Figure 1. This makes the ConnecTables suitable for small-group work, just like the InteracTable. To detect adjacent tables, integrated sensors measure the distance between the Connec- Tables and initiate the automatic coupling of the displays once they are close enough. The current implementation uses a radio-frequency-based sensor, shown in Figure 4a. A coil integrated with the tabletop can detect radio frequency identification tags, shown in Figure 4b, when the tag s distance falls within a certain threshold. Whereas this implementation is simple to realize and can reliably detect other tables, it s only possible to connect two ConnecTables. However, adding coils and tags on each side of the tabletop would make it possible to connect more tables. Beach software lets workgroups use the resulting large display area as a common workspace, 8 employing the same technology as that for coupling the DynaWall s segments. Several people can then concurrently work and seamlessly move information objects across the physical borders of the individual displays. Like the InteracTable, people can create second views, shuffle them from one ConnecTable to another, rotate them there, and work on them in parallel with correct perspectives. Software application Traditional application s don t provide enough guidance for developers to create software systems, such as Beach, for roomware environments. Software developers must consider further aspects not relevant for software running on a desktop PC with monitor, mouse, and keyboard as standardized interaction devices. Our proposed application, shown in Figure 5, accounts for the properties of roomware and ubiquitous computing environments. It s based on three design dimensions, describing orthogonal aspects of roomware applications. The first design dimension entails five s that separate

6 the basic concerns of roomware applications and make up the application s structure. This structure provides reusable components and hooks for adapting to or for different devices. The second dimension entails the degree of coupling and the aspects of sharing information between devices. The third dimension entails the four levels that organize the application. These levels define different levels of abstractions for software functionality. Separating basic concerns Clearly separating different responsibilities within the software helps provide the flexibility that different devices need. Therefore, we distinguish s for the data, application, user interface, environment, and interaction, as Figure 5 shows. The data specifies the type of data that users can create and interact with. To work with data, the application provides the necessary functionality. These two s are independent of the currently used or supported hardware device. Instead, the environment describes available devices and other relevant parts of the environment. The user interface defines the framework for how the software can present its functionality to the user, taking into account the environment s properties. These s are applicable to other applications besides those for ubiquitous computing and roomware, as well. Yet, because of the heterogeneous environment ubiquitous computing applications operate in, they have a strong need for a structure that is clear yet flexible enough to adapt components independently for different situations. Level of abstraction Task Application Data : Information objects. A common approach in application ing is to separate the application from the data, domain, or business object. 9 The data relates to the information dimension identified by Jacobson et al., 10 while the application represents the behavior dimension. This way, software developers can independently reuse both data and application s. They can specify and implement different applications for an existing data. This reuse can save time if the current application domain has complex data structures or algorithms. Conversely, developers can reuse application s for different types of data, if they carefully define the interface between the application and the data at an appropriate level of abstraction. Application : Application behavior. Application s describe all platform- and interface-independent application aspects, such as manipulation of data objects. As application s define the application s behavior, they specify control objects as defined by Jacobson et al. 10 For a text object, the data includes the string describing the text and text attributes such as font or size. The application adds the text s editing state, such as cursor position or selection. Applications can give awareness, for example, displaying the cursors of other users, if they have access to a shared editing state. 11 To use different application s for the same data, the data must remain unaware of any application, but only represent the document state. Researchers and software developers have found it helpful to choose a fine granularity for some application s. This way, devel- Data Generic User interface Environment Model Interaction Core Local class Shared class NOVEMBER DECEMBER 2002 Separation of concerns Degree of coupling and sharing Figure 5. Application organized into four levels of abstractions and five s that separate basic concerns. Crucial for synchronous collaboration is the sharing dimension, responsible for distributed access to shared objects. 41

7 ROOMWARE 42 IEEE MICRO opers can aggregate low-level application s with a well-defined functionality (for example, to edit simple text) into more complex s at a higher level of abstraction (for example, an editor that can manage complete workspaces). Usually, a whole hierarchy of application s composed of generic, reusable, and custom parts constitutes an application. 11 This way, the application often forms a hierarchy that is isomorphic with respect to the containment hierarchy of its associated data. 9 Using small application s fostered a new conception of what developers regarded as an application. We view the application as a description of additional semantics for a data, instead of the conventional view of data as a supplement that applications will edit. This change in viewpoint, therefore, leads to an information-centric perspective of application s. In the context of roomware environments, it s essential that developers do not include user interface and environment aspects in the application. Enforcing a strict separation between application and devicedependent aspects makes it possible to reuse application s with different user interfaces and within a different environment. Environment : Context awareness. One major property of ubiquitous computing environments is the heterogeneity of the available devices. To provide a coherent user experience, the system must have a deeper understanding of the physical space. 12 This raises the need for an adequate of the application s physical environment. Therefore, the environment is the representation of relevant parts of the real world. This includes a description of the devices themselves, their configuration, and their capabilities. This is the direct hardware environment, which the user interface can employ in adapting to different devices. In addition, the environment can include other aspects if these aspects influence the software s behavior. Depending on detected changes in the physical environment, the software can trigger further actions to reflect the current situation. An example of this is the way ConnecTables establish a common workspace when placed next to each other. Besides the physical environment, other contextual information, such as the current task, project, or coworker presence, could influence the software s behavior insofar as this information is available to the application. We refer to this type of contextual information as the logical context of the application. 3 Currently, it s difficult for software applications to grasp the physical environment and logical context. Further work must establish how to capture sufficient information about the current environment and to define appropriate s (for example, as in Sousa and Garlan 4 ). User interface : Interface objects. Because traditional operating and window management systems are suited for a traditional desktop PC, their user interfaces have drawbacks when used with devices without a mouse and keyboard, or those having different forms and sizes. For instance, if a menu bar were always at the top of the screen in a wall-sized display such as DynaWall, shown in Figure 1, users would find it difficult to reach. Alternatively, a toolbar takes up a lot of precious screen space on a small device, such as a personal digital assistant. Accordingly, the user interface could define alternative user interface concepts suitable for different interaction devices, for example, rotation of user interface elements on horizontal displays. To choose an appropriate user interface, the user interface can draw on information provided by the environment. An explicit of an appropriate user interface addresses all issues related to the hardware and the physical environment, making applications and documents device and environment independent. Still, the user interface must not enforce a dedicated presentation or interaction style; this is the responsibility of the interaction. Rather, the user interface concentrates on the elements offered for interaction. These elements can be a device-independent representation of user interface widgets or interactors. Figure 6 illustrates the dependencies between data, application, environment, and user interface s. Interaction : Presentation and interaction. To support different styles of interaction, it s

8 Environment User interface Application Data Interaction Presentation and interaction style Context awareness, devices, and tasks User interface objects Application behavior Information objects Figure 6. Dependencies between data, application, environment, user interface, and interaction s. The user interface can draw on information available in the environment to define an application s interface. crucial to separate interaction issues from all other aspects of an application. The interaction is the only place that specifies presentation aspects or interaction style. This way, a software system can adapt its presentation for different contexts, for example, by using a pop-up menu instead of a list box. It s also possible to choose a different representation when no display is available, voicebased interaction might still be possible. Hence, the interaction defines a way to interact with all other basic s, as shown in Figure 6. An appropriate interaction style depends on the available interaction devices and the associated user interface. Software can choose a suitable interaction, depending on the environment and user interface s. When designing an interaction, the software developer has to choose an architectural style that is appropriate for the supported interaction style. For visual interaction, researchers have successfully used an adapted version of the -view-controller style; this style separates input and output explicitly. 13 Views render a visual representation of their. Watching for changes, the view updates the representation whenever the is modified. Controller objects receive input events and modify their associated accordingly. This way, the needs no information about how it is visualized, or how users can trigger functionality. Coupling and sharing Aiming at synchronous collaboration, traditional computer-supported cooperative work (CSCW) or groupware systems 14 have two crucial aspects: access to shared data and the ability to couple the applications of collaborating users. Obviously, this coupling must apply to both data and application s for software running in a distributed environment. 11 In the context of ubiquitous-computing environments, we must extend this view. In addition to data and application, different devices and applications must exchange information about the physical environment, such as the presence of nearby users or other available interaction devices. The user interface can be distributed among several machines or among complementing devices. Beach software explores these additional issues. Sharing the data : Collaborative data access. To access and work with common documents, researchers widely agree that a shared for documents reduces the complexity in dealing with distributed applications. 13 In the example of a team member sitting in a CommChair and working with another member at the DynaWall, both users have access to the same information objects and can modify them simultaneously. Sharing the application : Workspace awareness. As an easy way of sharing information about the editing state of other users, researchers have proposed sharing the application as well as the data. 11 Sharing the editing state allows accessing NOVEMBER DECEMBER

9 ROOMWARE 44 IEEE MICRO Figure 7. When placed next to each other, two ConnecTables allow seamless movement of user interface elements from one device to another. This is realized by using a shared user interface. information about who is working on which document, providing awareness information to collaborating team members. For example, activity indicators 15 can provide visual feedback for actions performed at a DynaWall by a user sitting in a CommChair. By changing the state of the application, the software can control possible work modes such as the degree of coupling. When two users in Beach share the same workspace browser, they couple their navigation; when one user switches to another workspace, all users sharing the same application will follow. 7 Sharing the environment : Environmental awareness. When several people and devices physically share a common environment, it s obvious that the applications used in such situations should also have a shared of how their environment looks. In ubiquitous-computing environments, many devices have sensors that grasp some aspects of the physical environment. By combining all available information and making it accessible to other applications, each application draws on context information that it can use to adapt its behavior. Thus, a shared environment can serve as the basis for environment or context awareness. When someone places roomware components, such as two ConnecTables, next to each other, the ConnecTables update their shared environment using the information detected by sensors. As soon as Beach observes this change, it triggers functionality to connect the two displays to form a homogeneous interaction area. 8 Currently, the involved sensors are attached to computers built into the ConnecTables; future work could replace or augment this setup. A sophisticated object tracking system, for example, as described in Brummit et al., 12 involves computers integrated into the environment. Here, a shared environment enables arbitrary computers to update the information. Sharing the user interface : Distributed user interface. We want a visual interaction area to cross the borders between adjacent displays (as in our realization of the DynaWall, or with ConnecTables) but connected to different machines. To do so, the user interface elements must move freely between the different displays, as Figure 7 shows. In this case, different machines must share user interface elements. Furthermore, if one user interacts with different devices at the same time, it s useful to coordinate the devices user interfaces. This is only possible if all involved devices can access information about the current user interface elements. For instance, a user sitting in a CommChair in front of a large DynaWall can view all information at the chair and on the wall at the same time. Consequently, the user would benefit if he could modify the information visible on the wall and remotely control the entire user interface. Depending on how much state collaborating users share, applications can control the degree of coupling. Sharing all involved user interfaces and application states produces a tightly coupled collaboration mode; sharing only the same data creates a loosely coupled environment. 11 Linking the interaction and shared s. Implementing data, tool, user interface, and environment s as shared objects gives several users or devices simultaneous access to these objects. However, objects for the interaction must exist locally on each machine. This is necessary because the interaction s objects must communicate with the locally available interaction devices. Moreover, a local interaction lets each

10 client adapt the interaction style according to its local context, especially to its physical environment and interaction capabilities. Tandler et al. give an extensive example of how local interaction objects can adapt to their local context. 8 Although the interaction is local to every machine, for synchronous collaboration, the generated presentation must be consistent with the underlying s. Therefore, Beach uses a dependency mechanism, similar to the one provided by Amulet ( 2.cs.cmu.edu/~amulet), to link the output of the interaction to the shared s it presents. Beach ensures that refresh and recomputation begin as soon as an observed changes. Sharing environment, user interface, and application s lets all clients access the information encapsulated in the s. This can provide awareness information to the user as part of the interaction. Typical for CSCW applications is the provision of workspace or activity awareness. 15 This can easily be realized by sharing the application, including all editing state. 11 A shared user interface can be used to implement tightly coupled user interfaces. However, an always tightly coupled user interface can be inconvenient to use. Therefore, shared user interface information can instead supply additional awareness hints to remote users. Beyond the provision of awareness in traditional CSCW systems, sharing the environment enables a new type of awareness environmental awareness for ubiquitous computing environments. Conceptual levels of abstraction The third dimension of the application is the abstraction level. Separating software into levels of abstraction is a common software engineering technique; it reduces the complexity of each level 16 and ensures interoperability. 17 For example, a core functionality of the interaction, such as handling physical interaction devices, belongs to a very low level. Based on this functionality, higher levels define abstractions, such as widgets or logicaldevice handlers. High-level interaction components use these abstractions to define the user s access and interaction possibilities for some other at the same level of abstraction. The application presented here proposes four levels of abstraction. Core level: Platform-dependent infrastructure. The core level provides functionality that makes higher-level development convenient by abstracting from the underlying hardware platform. Roomware applications require additional functionality that is unavailable from off-theshelf libraries or toolkits. This functionality includes support for multiuser event handling or low-level device and sensor management. For Beach, this includes implementation of the shared-object space and the dependency mechanism. Model level: Basic separation of concerns. The level provides basic abstractions that can serve as the basis for the definition of higher-level abstractions. Here, for example, Beach implements the -view-controller style for the interaction. Generic level: Reusable functionality. One important goal of every software system is to provide generic components suited for many different situations and tasks. Therefore, software developers should group s and concepts that apply to a whole application domain at a generic level. This way, the software developer must think about generic concepts, which will lead to the implementation of reusable elements. At the generic level, Beach defines generic document elements, such as workspaces, text, scribbles, or hyperlinks. Task level: Tailored support. When a conceptual application defines only generic elements, this restricts the application s usability to some degree. Some tasks require specialized support. Therefore, our conceptual has a task level that groups all highlevel abstractions unique to small application areas. For example, we have implemented support for creative sessions on top of Beach. 18 Our initial experiences are quite promising. In addition to our Ambiente Lab in Darmstadt, we had two external installations of i-land: at the Deutsche Arbeitsschutzausstellung (DASA), or German Occu- NOVEMBER DECEMBER

11 ROOMWARE 46 IEEE MICRO pational Safety and Health Exhibition, in Dortmund, which is ongoing, and at Wilkhahn in Bad Münder, which lasted for five months. Both installations were part of registered projects of the world exhibition EXPO In 2000, second-generation roomware components won the International Design Award of the state Baden Württemberg in Germany. Given the structure suggested by the application, we have restructured Beach to consist of layered frameworks. With these frameworks, we are currently developing further applications tailored for roomware components ( We consider architectural space as a guiding metaphor for designing environments that support cooperation between humans and their interaction with information. This is an important perspective for us. Innovative forms of interaction, such as throwing information objects on large interactive walls, provide intuitive forms of cooperation and communication. Nevertheless, it remains to be seen how far the use of these concepts and metaphors will actually carry. We are continuing this research in the Ambient-Agoras project, which is part of the European-Union-funded Disappearing Computer initiative. MICRO Acknowledgments We thank Jörg Geißler, Torsten Holmer, and Christian Müller-Tomfelde as well as many of our students for their valuable contributions to various parts of the i-land project and the Ambiente division. Likewise, we thank the IEEE Computer Society s reviewers for their extensive and helpful comments. Furthermore, we appreciate the cooperation with Heinrich Iglseder, Burkhard Remmers, Frank Sonder, and Jürgen Thode from the German office furniture manufacturer Wilkhahn; and Michael Englisch from their design company, WIEGE. They worked with us in the context of the Future Office Dynamics consortium ( which sponsored part of this work. References 1. N.A. Streitz et al., i-land: An Interactive Landscape for Creativity and Innovation, Proc. Conf. Human Factors in Computing Systems (CHI), ACM Press, New York, 1999, pp ; publications. 2. M. Weiser, The Computer for the 21st Century, Scientific American, Sept. 1991, pp ; weiser/sciamdraft3.html. 3. A. Schmidt, M. Beigl, and H. Gellersen, There is More to Context than Location, Computers & Graphics, vol. 23, no. 6, Dec. 1999, pp ; 4. J.P. Sousa and D. Garlan, Aura: An Architectural Framework for User Mobility in Ubiquitous Computing Environments, Proc. 3rd Working IEEE/IFIP Conf. Software Architecture, Kluwer Academic, Boston, 2002, pp ; ~aura/. 5. N.A. Streitz, P. Rexroth, and T. Holmer, Does roomware Matter? Investigating the Role of Personal and Public Information Devices and their Combination in Meeting Room Collaboration, Proc. European Conf. Computer-Supported Cooperative Work (E- CSCW), Kluwer Academic, Amsterdam, 1997, pp ; publications. 6. B.A. Myers, User Interface Software Tools, ACM Trans. Computer-Human Interaction, vol. 2, no. 1, Mar. 1995, pp ; P. Tandler, Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices, Proc. Ubiquitous Computing (UbiComp), LNCS vol. 2201, Springer, New York, 2001, pp P. Tandler et al., ConnecTables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces, Proc. 14th Ann. ACM Symp. User Interface and Software Technology (UIST), vol. 3, no. 2, CHI Letters, ACM Press, New York, 2001, pp ; 9. VisualWorks User s Guide, rev. 2.0 (software release 2.5), ParcPlace-Digitalk, Palo Alto, Calif., I. Jacobson et al., Object-Oriented Software Engineering: A Use Case Driven Approach, Addison-Wesley Professional, Boston, C. Schuckmann, J. Schümmer, and P. Seitz, Modeling Collaboration using Shared

12 Objects, Proc. Int l ACM Siggroup Conf. Supporting Group Work, ACM Press, New York, 1999, pp ; opencoast.org. 12. B. Brummit et al., Easyliving: Technologies for Intelligent Environments, Proc. 2nd Int l Symp. Handheld and Ubiquitous Computing (HUC), LNCS vol. 1927, Springer-Verlag, Heidelberg, Germany, 2000, pp W.G. Phillips, Architectures for Synchronous Groupware, tech. report , Dept. Computing and Information Science, Queen s University, Kingston, Ontario, Canada, 1999; C.A. Ellis, S.J. Gibbs, and G.L. Rein, Groupware Some Issues and Experiences, Comm. ACM, vol. 34, no. 1, Jan. 1999, pp C. Gutwin and S. Greenberg, Design for Individuals, Design for Groups: Tradeoffs between Power and Workspace Awareness, Proc. ACM Conf. Computer Supported Cooperative Work, ACM Press, New York, 1998, pp ; L. Nigay and J. Coutaz, Building User Interfaces: Organizing Software Agents, Esprit 91 Conf. Proc., ACM Press, New York, 1991, pp ; /. 17. J.I. Hong and J.A. Landay, An Infrastructure Approach to Context-Aware Computing, Human-Computer Interaction, vol. 16, no. 2-4, Dec. 2001, pp T. Prante, C. Magerkurth, and N.A. Streitz, Developing CSCW Tools for Idea Finding: Empirical Results and Implications for Design, Proc. ACM 2002 Conf. Computer Supported Cooperative Work (CSCW), ACM Press, New York, 2002; ambiente/publications. Peter Tandler is a scientific staff member of the Ambiente division of the Fraunhofer Integrated Publication and Information Systems Institute (IPSI). He leads software development within the Beach and i-land projects. His research interests include synchronous groupware, integration of virtual and physical environments, new forms of human-computer and team-computer interaction for roomware, software architecture, programming languages, object-oriented frameworks, and object-oriented design and programming. Tandler is working on a PhD in the context of application s and software infrastructure for roomware environments at Fraunhofer IPSI. He has a Dipl.-Inform. in computer science from the Darmstadt University of Technology, Germany. Norbert Streitz is the head of the research division at Ambiente Workspaces of the Future, which he founded to initiate work on roomware and cooperative buildings at Fraunhofer IPSI. He also teaches in the computer science department of the Technical University Darmstadt. He is the chair of the steering group of the European research initiative The Disappearing Computer (DC) and manager of the DC project Ambient Agoras. His research interests include human-computer interaction, hypermedia, computer-supported cooperative work, ubiquitous computing, user-centered design of smart artifacts, and the relationship between real and virtual worlds. Streitz has an MSc and PhD in physics and a second PhD in psychology. He is a member of the German Society of Computer Science (GI) and the German Society of Psychology (DGP). Thorsten Prante is a scientific staff member of the Ambiente division at Fraunhofer IPSI. He also coordinates activities of the Future Office Dynamics consortium, and he teaches at the Darmstadt University of Technology in the departments of computer science and architecture. His research interests include humancomputer interaction and computer-supported cooperative work, focusing on user interfaces for cooperative software in ubiquitous computing. Prante has a Dipl.-Inform. in computer science with minors in architecture and software ergonomics. Direct questions and comments about this article to Peter Tandler, Fraunhofer IPSI, Ambiente division, Dolivostr. 15, 64293, Darmstadt, Germany; Peter.Tandler@ipsi.fraunhofer.de. For further information on this or any other computing topic, visit our Digital Library at NOVEMBER DECEMBER

Interaction Design for the Disappearing Computer

Interaction Design for the Disappearing Computer Interaction Design for the Disappearing Computer Norbert Streitz AMBIENTE Workspaces of the Future Fraunhofer IPSI 64293 Darmstadt Germany VWUHLW]#LSVLIUDXQKRIHUGH KWWSZZZLSVLIUDXQKRIHUGHDPELHQWH Abstract.

More information

The Disappearing Computer

The Disappearing Computer IPSI - Integrated Publication and Information Systems Institute Norbert Streitz AMBIENTE Research Division http:// http://www.future-office.de http://www.roomware.de http://www.ambient-agoras.org http://www.disappearing-computer.net

More information

AUDIO-ENHANCED COLLABORATION AT AN INTERACTIVE ELECTRONIC WHITEBOARD. Christian Müller Tomfelde and Sascha Steiner

AUDIO-ENHANCED COLLABORATION AT AN INTERACTIVE ELECTRONIC WHITEBOARD. Christian Müller Tomfelde and Sascha Steiner AUDIO-ENHANCED COLLABORATION AT AN INTERACTIVE ELECTRONIC WHITEBOARD Christian Müller Tomfelde and Sascha Steiner GMD - German National Research Center for Information Technology IPSI- Integrated Publication

More information

Roomware: Towards the next generation of human-computer interaction based on an integrated design of real and virtual worlds

Roomware: Towards the next generation of human-computer interaction based on an integrated design of real and virtual worlds Roomware: Towards the next generation of human-computer interaction based on an integrated design of real and virtual worlds Norbert A. Streitz, Peter Tandler, Christian Müller-Tomfelde, Shin ichi Konomi

More information

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT

INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT INTERACTION AND SOCIAL ISSUES IN A HUMAN-CENTERED REACTIVE ENVIRONMENT TAYSHENG JENG, CHIA-HSUN LEE, CHI CHEN, YU-PIN MA Department of Architecture, National Cheng Kung University No. 1, University Road,

More information

Roomware: Toward the Next Generation of Human- Computer Interaction Based on an Integrated Design of Real and Virtual Worlds

Roomware: Toward the Next Generation of Human- Computer Interaction Based on an Integrated Design of Real and Virtual Worlds pp. 11- rah.ps //1 : PM Page Roomware: Toward the Next Generation of Human- Computer Interaction Based on an Integrated Design of Real and Virtual Worlds Norbert A. Streitz Peter Tandler Christian Müller-Tomfelde

More information

Norbert A. Streitz. Smart Future Initiative

Norbert A. Streitz. Smart Future Initiative 3. 6. May 2011, Budapest The Disappearing Computer, Ambient Intelligence, and Smart (Urban) Living Norbert A. Streitz Smart Future Initiative http://www.smart-future.net norbert.streitz@smart-future.net

More information

i-land: An interactive Landscape for Creativity and Innovation

i-land: An interactive Landscape for Creativity and Innovation Papers CHI 99 15-20 MAY 1999 i-land: An interactive Landscape for Creativity and Innovation Norbert A. Streitz, Jiirg GeiBler, Torsten Holmer, Shin ichi Konomi, Christian Miiller-Tomfelde, Wolfgang Reischl,

More information

R (2) Controlling System Application with hands by identifying movements through Camera

R (2) Controlling System Application with hands by identifying movements through Camera R (2) N (5) Oral (3) Total (10) Dated Sign Assignment Group: C Problem Definition: Controlling System Application with hands by identifying movements through Camera Prerequisite: 1. Web Cam Connectivity

More information

! Computation embedded in the physical spaces around us. ! Ambient intelligence. ! Input in the real world. ! Output in the real world also

! Computation embedded in the physical spaces around us. ! Ambient intelligence. ! Input in the real world. ! Output in the real world also Ubicomp? Ubicomp and Physical Interaction! Computation embedded in the physical spaces around us! Ambient intelligence! Take advantage of naturally-occurring actions and activities to support people! Input

More information

Ubiquitous. Waves of computing

Ubiquitous. Waves of computing Ubiquitous Webster: -- existing or being everywhere at the same time : constantly encountered Waves of computing First wave - mainframe many people using one computer Second wave - PC one person using

More information

COMET: Collaboration in Applications for Mobile Environments by Twisting

COMET: Collaboration in Applications for Mobile Environments by Twisting COMET: Collaboration in Applications for Mobile Environments by Twisting Nitesh Goyal RWTH Aachen University Aachen 52056, Germany Nitesh.goyal@rwth-aachen.de Abstract In this paper, we describe a novel

More information

Vocational Training with Combined Real/Virtual Environments

Vocational Training with Combined Real/Virtual Environments DSSHDUHGLQ+-%XOOLQJHU -=LHJOHU(GV3URFHHGLQJVRIWKHWK,QWHUQDWLRQDO&RQIHUHQFHRQ+XPDQ&RPSXWHU,Q WHUDFWLRQ+&,0 QFKHQ0DKZDK/DZUHQFH(UOEDXP9RO6 Vocational Training with Combined Real/Virtual Environments Eva

More information

The Disappearing Computer. Information Document, IST Call for proposals, February 2000.

The Disappearing Computer. Information Document, IST Call for proposals, February 2000. The Disappearing Computer Information Document, IST Call for proposals, February 2000. Mission Statement To see how information technology can be diffused into everyday objects and settings, and to see

More information

HUMAN COMPUTER INTERFACE

HUMAN COMPUTER INTERFACE HUMAN COMPUTER INTERFACE TARUNIM SHARMA Department of Computer Science Maharaja Surajmal Institute C-4, Janakpuri, New Delhi, India ABSTRACT-- The intention of this paper is to provide an overview on the

More information

HELPING THE DESIGN OF MIXED SYSTEMS

HELPING THE DESIGN OF MIXED SYSTEMS HELPING THE DESIGN OF MIXED SYSTEMS Céline Coutrix Grenoble Informatics Laboratory (LIG) University of Grenoble 1, France Abstract Several interaction paradigms are considered in pervasive computing environments.

More information

Collaboration on Interactive Ceilings

Collaboration on Interactive Ceilings Collaboration on Interactive Ceilings Alexander Bazo, Raphael Wimmer, Markus Heckner, Christian Wolff Media Informatics Group, University of Regensburg Abstract In this paper we discuss how interactive

More information

Effective Iconography....convey ideas without words; attract attention...

Effective Iconography....convey ideas without words; attract attention... Effective Iconography...convey ideas without words; attract attention... Visual Thinking and Icons An icon is an image, picture, or symbol representing a concept Icon-specific guidelines Represent the

More information

User Experience of Physical-Digital Object Systems: Implications for Representation and Infrastructure

User Experience of Physical-Digital Object Systems: Implications for Representation and Infrastructure User Experience of Physical-Digital Object Systems: Implications for Representation and Infrastructure Les Nelson, Elizabeth F. Churchill PARC 3333 Coyote Hill Rd. Palo Alto, CA 94304 USA {Les.Nelson,Elizabeth.Churchill}@parc.com

More information

Direct Manipulation. and Instrumental Interaction. CS Direct Manipulation

Direct Manipulation. and Instrumental Interaction. CS Direct Manipulation Direct Manipulation and Instrumental Interaction 1 Review: Interaction vs. Interface What s the difference between user interaction and user interface? Interface refers to what the system presents to the

More information

Beyond Actuated Tangibles: Introducing Robots to Interactive Tabletops

Beyond Actuated Tangibles: Introducing Robots to Interactive Tabletops Beyond Actuated Tangibles: Introducing Robots to Interactive Tabletops Sowmya Somanath Department of Computer Science, University of Calgary, Canada. ssomanat@ucalgary.ca Ehud Sharlin Department of Computer

More information

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS

ENHANCED HUMAN-AGENT INTERACTION: AUGMENTING INTERACTION MODELS WITH EMBODIED AGENTS BY SERAFIN BENTO. MASTER OF SCIENCE in INFORMATION SYSTEMS BY SERAFIN BENTO MASTER OF SCIENCE in INFORMATION SYSTEMS Edmonton, Alberta September, 2015 ABSTRACT The popularity of software agents demands for more comprehensive HAI design processes. The outcome of

More information

REPRESENTATION, RE-REPRESENTATION AND EMERGENCE IN COLLABORATIVE COMPUTER-AIDED DESIGN

REPRESENTATION, RE-REPRESENTATION AND EMERGENCE IN COLLABORATIVE COMPUTER-AIDED DESIGN REPRESENTATION, RE-REPRESENTATION AND EMERGENCE IN COLLABORATIVE COMPUTER-AIDED DESIGN HAN J. JUN AND JOHN S. GERO Key Centre of Design Computing Department of Architectural and Design Science University

More information

Human-Computer Interaction

Human-Computer Interaction Human-Computer Interaction Prof. Antonella De Angeli, PhD Antonella.deangeli@disi.unitn.it Ground rules To keep disturbance to your fellow students to a minimum Switch off your mobile phone during the

More information

Activity-Centric Configuration Work in Nomadic Computing

Activity-Centric Configuration Work in Nomadic Computing Activity-Centric Configuration Work in Nomadic Computing Steven Houben The Pervasive Interaction Technology Lab IT University of Copenhagen shou@itu.dk Jakob E. Bardram The Pervasive Interaction Technology

More information

Advanced User Interfaces: Topics in Human-Computer Interaction

Advanced User Interfaces: Topics in Human-Computer Interaction Computer Science 425 Advanced User Interfaces: Topics in Human-Computer Interaction Week 04: Disappearing Computers 90s-00s of Human-Computer Interaction Research Prof. Roel Vertegaal, PhD Week 8: Plan

More information

Methodology for Agent-Oriented Software

Methodology for Agent-Oriented Software ب.ظ 03:55 1 of 7 2006/10/27 Next: About this document... Methodology for Agent-Oriented Software Design Principal Investigator dr. Frank S. de Boer (frankb@cs.uu.nl) Summary The main research goal of this

More information

Outline. Paradigms for interaction. Introduction. Chapter 5 : Paradigms. Introduction Paradigms for interaction (15)

Outline. Paradigms for interaction. Introduction. Chapter 5 : Paradigms. Introduction Paradigms for interaction (15) Outline 01076568 Human Computer Interaction Chapter 5 : Paradigms Introduction Paradigms for interaction (15) ดร.ชมพ น ท จ นจาคาม [kjchompo@gmail.com] สาขาว ชาว ศวกรรมคอมพ วเตอร คณะว ศวกรรมศาสตร สถาบ นเทคโนโลย

More information

A Brief Survey of HCI Technology. Lecture #3

A Brief Survey of HCI Technology. Lecture #3 A Brief Survey of HCI Technology Lecture #3 Agenda Evolution of HCI Technology Computer side Human side Scope of HCI 2 HCI: Historical Perspective Primitive age Charles Babbage s computer Punch card Command

More information

ActivityDesk: Multi-Device Configuration Work using an Interactive Desk

ActivityDesk: Multi-Device Configuration Work using an Interactive Desk ActivityDesk: Multi-Device Configuration Work using an Interactive Desk Steven Houben The Pervasive Interaction Technology Laboratory IT University of Copenhagen shou@itu.dk Jakob E. Bardram The Pervasive

More information

Physical Interaction and Multi-Aspect Representation for Information Intensive Environments

Physical Interaction and Multi-Aspect Representation for Information Intensive Environments Proceedings of the 2000 IEEE International Workshop on Robot and Human Interactive Communication Osaka. Japan - September 27-29 2000 Physical Interaction and Multi-Aspect Representation for Information

More information

Occlusion-Aware Menu Design for Digital Tabletops

Occlusion-Aware Menu Design for Digital Tabletops Occlusion-Aware Menu Design for Digital Tabletops Peter Brandl peter.brandl@fh-hagenberg.at Jakob Leitner jakob.leitner@fh-hagenberg.at Thomas Seifried thomas.seifried@fh-hagenberg.at Michael Haller michael.haller@fh-hagenberg.at

More information

Dual-Reality Objects

Dual-Reality Objects Dual-Reality Objects Randall B. Smith Sun Microsystems Laboratories We have of course created a new universe. Our agglomeration of networked computers enables us to move, copy, modify, and store away documents,

More information

User Interface Software Projects

User Interface Software Projects User Interface Software Projects Assoc. Professor Donald J. Patterson INF 134 Winter 2012 The author of this work license copyright to it according to the Creative Commons Attribution-Noncommercial-Share

More information

The Amalgamation Product Design Aspects for the Development of Immersive Virtual Environments

The Amalgamation Product Design Aspects for the Development of Immersive Virtual Environments The Amalgamation Product Design Aspects for the Development of Immersive Virtual Environments Mario Doulis, Andreas Simon University of Applied Sciences Aargau, Schweiz Abstract: Interacting in an immersive

More information

Tangible User Interfaces

Tangible User Interfaces Tangible User Interfaces Seminar Vernetzte Systeme Prof. Friedemann Mattern Von: Patrick Frigg Betreuer: Michael Rohs Outline Introduction ToolStone Motivation Design Interaction Techniques Taxonomy for

More information

SUPPORTING LOCALIZED ACTIVITIES IN UBIQUITOUS COMPUTING ENVIRONMENTS. Helder Pinto

SUPPORTING LOCALIZED ACTIVITIES IN UBIQUITOUS COMPUTING ENVIRONMENTS. Helder Pinto SUPPORTING LOCALIZED ACTIVITIES IN UBIQUITOUS COMPUTING ENVIRONMENTS Helder Pinto Abstract The design of pervasive and ubiquitous computing systems must be centered on users activity in order to bring

More information

Multi-User Multi-Touch Games on DiamondTouch with the DTFlash Toolkit

Multi-User Multi-Touch Games on DiamondTouch with the DTFlash Toolkit MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Multi-User Multi-Touch Games on DiamondTouch with the DTFlash Toolkit Alan Esenther and Kent Wittenburg TR2005-105 September 2005 Abstract

More information

INTELLIGENT GUIDANCE IN A VIRTUAL UNIVERSITY

INTELLIGENT GUIDANCE IN A VIRTUAL UNIVERSITY INTELLIGENT GUIDANCE IN A VIRTUAL UNIVERSITY T. Panayiotopoulos,, N. Zacharis, S. Vosinakis Department of Computer Science, University of Piraeus, 80 Karaoli & Dimitriou str. 18534 Piraeus, Greece themisp@unipi.gr,

More information

Designing Semantic Virtual Reality Applications

Designing Semantic Virtual Reality Applications Designing Semantic Virtual Reality Applications F. Kleinermann, O. De Troyer, H. Mansouri, R. Romero, B. Pellens, W. Bille WISE Research group, Vrije Universiteit Brussel, Pleinlaan 2, 1050 Brussels, Belgium

More information

DESIGNING UBICOMP MUTUAL INFLUENCES OF UBIQUITOUS COMPUTING AND DESIGN.

DESIGNING UBICOMP MUTUAL INFLUENCES OF UBIQUITOUS COMPUTING AND DESIGN. DESIGNING UBICOMP MUTUAL INFLUENCES OF UBIQUITOUS COMPUTING AND DESIGN. _A SHORT OUTLINE ON A PHD-PROJECT. JOCHEN DENZINGER // MARS EXPLORATORY MEDIA LAB FRAUNHOFER IMK SOMMER SCHOOL IN UBIQUITOUS COMPUTING,

More information

Organic UIs in Cross-Reality Spaces

Organic UIs in Cross-Reality Spaces Organic UIs in Cross-Reality Spaces Derek Reilly Jonathan Massey OCAD University GVU Center, Georgia Tech 205 Richmond St. Toronto, ON M5V 1V6 Canada dreilly@faculty.ocad.ca ragingpotato@gatech.edu Anthony

More information

how many digital displays have rconneyou seen today?

how many digital displays have rconneyou seen today? Displays Everywhere (only) a First Step Towards Interacting with Information in the real World Talk@NEC, Heidelberg, July 23, 2009 Prof. Dr. Albrecht Schmidt Pervasive Computing University Duisburg-Essen

More information

ISCW 2001 Tutorial. An Introduction to Augmented Reality

ISCW 2001 Tutorial. An Introduction to Augmented Reality ISCW 2001 Tutorial An Introduction to Augmented Reality Mark Billinghurst Human Interface Technology Laboratory University of Washington, Seattle grof@hitl.washington.edu Dieter Schmalstieg Technical University

More information

Interactive Room Support for Complex and Distributed Design Projects

Interactive Room Support for Complex and Distributed Design Projects Interactive Room Support for Complex and Distributed Design Projects Kaj Grønbæk 1, Kristian Gundersen 2, Preben Mogensen 1, Peter Ørbæk 1 1 Department of Computer Science,University of Aarhus, Denmark

More information

Enhancing Tabletop Games with Relative Positioning Technology

Enhancing Tabletop Games with Relative Positioning Technology Enhancing Tabletop Games with Relative Positioning Technology Albert Krohn, Tobias Zimmer, and Michael Beigl Telecooperation Office (TecO) University of Karlsruhe Vincenz-Priessnitz-Strasse 1 76131 Karlsruhe,

More information

Computer-Augmented Environments: Back to the Real World

Computer-Augmented Environments: Back to the Real World Computer-Augmented Environments: Back to the Real World Hans-W. Gellersen Lancaster University Department of Computing Ubiquitous Computing Research HWG 1 What I thought this talk would be about Back to

More information

Ubiquitous Home Simulation Using Augmented Reality

Ubiquitous Home Simulation Using Augmented Reality Proceedings of the 2007 WSEAS International Conference on Computer Engineering and Applications, Gold Coast, Australia, January 17-19, 2007 112 Ubiquitous Home Simulation Using Augmented Reality JAE YEOL

More information

Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs

Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática Interaction in Virtual and Augmented Reality 3DUIs Realidade Virtual e Aumentada 2017/2018 Beatriz Sousa Santos Interaction

More information

Issue Article Vol.30 No.2, April 1998 Article Issue

Issue Article Vol.30 No.2, April 1998 Article Issue Issue Article Vol.30 No.2, April 1998 Article Issue Tailorable Groupware Issues, Methods, and Architectures Report of a Workshop held at GROUP'97, Phoenix, AZ, 16th November 1997 Anders Mørch, Oliver Stiemerlieng,

More information

New interface approaches for telemedicine

New interface approaches for telemedicine New interface approaches for telemedicine Associate Professor Mark Billinghurst PhD, Holger Regenbrecht Dipl.-Inf. Dr-Ing., Michael Haller PhD, Joerg Hauber MSc Correspondence to: mark.billinghurst@hitlabnz.org

More information

Context Sensitive Interactive Systems Design: A Framework for Representation of contexts

Context Sensitive Interactive Systems Design: A Framework for Representation of contexts Context Sensitive Interactive Systems Design: A Framework for Representation of contexts Keiichi Sato Illinois Institute of Technology 350 N. LaSalle Street Chicago, Illinois 60610 USA sato@id.iit.edu

More information

Human Computer Interaction Lecture 04 [ Paradigms ]

Human Computer Interaction Lecture 04 [ Paradigms ] Human Computer Interaction Lecture 04 [ Paradigms ] Imran Ihsan Assistant Professor www.imranihsan.com imranihsan.com HCIS1404 - Paradigms 1 why study paradigms Concerns how can an interactive system be

More information

DiamondTouch SDK:Support for Multi-User, Multi-Touch Applications

DiamondTouch SDK:Support for Multi-User, Multi-Touch Applications MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com DiamondTouch SDK:Support for Multi-User, Multi-Touch Applications Alan Esenther, Cliff Forlines, Kathy Ryall, Sam Shipman TR2002-48 November

More information

EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment

EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment Hideki Koike 1, Shin ichiro Nagashima 1, Yasuto Nakanishi 2, and Yoichi Sato 3 1 Graduate School of Information Systems,

More information

Information Layout and Interaction on Virtual and Real Rotary Tables

Information Layout and Interaction on Virtual and Real Rotary Tables Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer System Information Layout and Interaction on Virtual and Real Rotary Tables Hideki Koike, Shintaro Kajiwara, Kentaro Fukuchi

More information

Simulation of Tangible User Interfaces with the ROS Middleware

Simulation of Tangible User Interfaces with the ROS Middleware Simulation of Tangible User Interfaces with the ROS Middleware Stefan Diewald 1 stefan.diewald@tum.de Andreas Möller 1 andreas.moeller@tum.de Luis Roalter 1 roalter@tum.de Matthias Kranz 2 matthias.kranz@uni-passau.de

More information

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...

preface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real... v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)

More information

SKETCHING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATION TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 7 CLASS 13

SKETCHING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATION TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 7 CLASS 13 SKETCHING CPSC 544 FUNDAMENTALS IN DESIGNING INTERACTIVE COMPUTATION TECHNOLOGY FOR PEOPLE (HUMAN COMPUTER INTERACTION) WEEK 7 CLASS 13 Joanna McGrenere and Leila Aflatoony Includes slides from Karon MacLean

More information

Issues on using Visual Media with Modern Interaction Devices

Issues on using Visual Media with Modern Interaction Devices Issues on using Visual Media with Modern Interaction Devices Christodoulakis Stavros, Margazas Thodoris, Moumoutzis Nektarios email: {stavros,tm,nektar}@ced.tuc.gr Laboratory of Distributed Multimedia

More information

Pervasive Services Engineering for SOAs

Pervasive Services Engineering for SOAs Pervasive Services Engineering for SOAs Dhaminda Abeywickrama (supervised by Sita Ramakrishnan) Clayton School of Information Technology, Monash University, Australia dhaminda.abeywickrama@infotech.monash.edu.au

More information

COLLABORATION USING HETEROGENEOUS DEVICES FROM 3D WORKSTATIONS TO PDA S

COLLABORATION USING HETEROGENEOUS DEVICES FROM 3D WORKSTATIONS TO PDA S Proceedings of the 4th IASTED International Conference Internet and Multimedia Systems and Applications (IMSA 2000) November 20-23, 2000 - Las Vegas, NV, pp.309-313 COLLABORATION USING HETEROGENEOUS DEVICES

More information

Open Archive TOULOUSE Archive Ouverte (OATAO)

Open Archive TOULOUSE Archive Ouverte (OATAO) Open Archive TOULOUSE Archive Ouverte (OATAO) OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible. This is an author-deposited

More information

Collaborative Virtual Environments Based on Real Work Spaces

Collaborative Virtual Environments Based on Real Work Spaces Collaborative Virtual Environments Based on Real Work Spaces Luis A. Guerrero, César A. Collazos 1, José A. Pino, Sergio F. Ochoa, Felipe Aguilera Department of Computer Science, Universidad de Chile Blanco

More information

A Quick Spin on Autodesk Revit Building

A Quick Spin on Autodesk Revit Building 11/28/2005-3:00 pm - 4:30 pm Room:Americas Seminar [Lab] (Dolphin) Walt Disney World Swan and Dolphin Resort Orlando, Florida A Quick Spin on Autodesk Revit Building Amy Fietkau - Autodesk and John Jansen;

More information

Accessible Power Tool Flexible Application Scalable Solution

Accessible Power Tool Flexible Application Scalable Solution Accessible Power Tool Flexible Application Scalable Solution Franka Emika GmbH Our vision of a robot for everyone sensitive, interconnected, adaptive and cost-efficient. Even today, robotics remains a

More information

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT

MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT MULTI-LAYERED HYBRID ARCHITECTURE TO SOLVE COMPLEX TASKS OF AN AUTONOMOUS MOBILE ROBOT F. TIECHE, C. FACCHINETTI and H. HUGLI Institute of Microtechnology, University of Neuchâtel, Rue de Tivoli 28, CH-2003

More information

SPACES FOR CREATING CONTEXT & AWARENESS - DESIGNING A COLLABORATIVE VIRTUAL WORK SPACE FOR (LANDSCAPE) ARCHITECTS

SPACES FOR CREATING CONTEXT & AWARENESS - DESIGNING A COLLABORATIVE VIRTUAL WORK SPACE FOR (LANDSCAPE) ARCHITECTS SPACES FOR CREATING CONTEXT & AWARENESS - DESIGNING A COLLABORATIVE VIRTUAL WORK SPACE FOR (LANDSCAPE) ARCHITECTS Ina Wagner, Monika Buscher*, Preben Mogensen, Dan Shapiro* University of Technology, Vienna,

More information

Advancements in Gesture Recognition Technology

Advancements in Gesture Recognition Technology IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 4, Issue 4, Ver. I (Jul-Aug. 2014), PP 01-07 e-issn: 2319 4200, p-issn No. : 2319 4197 Advancements in Gesture Recognition Technology 1 Poluka

More information

Situated Interaction:

Situated Interaction: Situated Interaction: Creating a partnership between people and intelligent systems Wendy E. Mackay in situ Computers are changing Cost Mainframes Mini-computers Personal computers Laptops Smart phones

More information

Argumentative Interactions in Online Asynchronous Communication

Argumentative Interactions in Online Asynchronous Communication Argumentative Interactions in Online Asynchronous Communication Evelina De Nardis, University of Roma Tre, Doctoral School in Pedagogy and Social Service, Department of Educational Science evedenardis@yahoo.it

More information

VEWL: A Framework for Building a Windowing Interface in a Virtual Environment Daniel Larimer and Doug A. Bowman Dept. of Computer Science, Virginia Tech, 660 McBryde, Blacksburg, VA dlarimer@vt.edu, bowman@vt.edu

More information

From Room Instrumentation to Device Instrumentation: Assessing an Inertial Measurement Unit for Spatial Awareness

From Room Instrumentation to Device Instrumentation: Assessing an Inertial Measurement Unit for Spatial Awareness From Room Instrumentation to Device Instrumentation: Assessing an Inertial Measurement Unit for Spatial Awareness Alaa Azazi, Teddy Seyed, Frank Maurer University of Calgary, Department of Computer Science

More information

A Survey on Smart City using IoT (Internet of Things)

A Survey on Smart City using IoT (Internet of Things) A Survey on Smart City using IoT (Internet of Things) Akshay Kadam 1, Vineet Ovhal 2, Anita Paradhi 3, Kunal Dhage 4 U.G. Student, Department of Computer Engineering, SKNCOE, Pune, Maharashtra, India 1234

More information

Interface Design V: Beyond the Desktop

Interface Design V: Beyond the Desktop Interface Design V: Beyond the Desktop Rob Procter Further Reading Dix et al., chapter 4, p. 153-161 and chapter 15. Norman, The Invisible Computer, MIT Press, 1998, chapters 4 and 15. 11/25/01 CS4: HCI

More information

Abstract. Keywords: Multi Touch, Collaboration, Gestures, Accelerometer, Virtual Prototyping. 1. Introduction

Abstract. Keywords: Multi Touch, Collaboration, Gestures, Accelerometer, Virtual Prototyping. 1. Introduction Creating a Collaborative Multi Touch Computer Aided Design Program Cole Anagnost, Thomas Niedzielski, Desirée Velázquez, Prasad Ramanahally, Stephen Gilbert Iowa State University { someguy tomn deveri

More information

Diploma Thesis Final Report: A Wall-sized Focus and Context Display. Sebastian Boring Ludwig-Maximilians-Universität München

Diploma Thesis Final Report: A Wall-sized Focus and Context Display. Sebastian Boring Ludwig-Maximilians-Universität München Diploma Thesis Final Report: A Wall-sized Focus and Context Display Sebastian Boring Ludwig-Maximilians-Universität München Agenda Introduction Problem Statement Related Work Design Decisions Finger Recognition

More information

Towards affordance based human-system interaction based on cyber-physical systems

Towards affordance based human-system interaction based on cyber-physical systems Towards affordance based human-system interaction based on cyber-physical systems Zoltán Rusák 1, Imre Horváth 1, Yuemin Hou 2, Ji Lihong 2 1 Faculty of Industrial Design Engineering, Delft University

More information

Interactive Exploration of City Maps with Auditory Torches

Interactive Exploration of City Maps with Auditory Torches Interactive Exploration of City Maps with Auditory Torches Wilko Heuten OFFIS Escherweg 2 Oldenburg, Germany Wilko.Heuten@offis.de Niels Henze OFFIS Escherweg 2 Oldenburg, Germany Niels.Henze@offis.de

More information

openaal 1 - the open source middleware for ambient-assisted living (AAL)

openaal 1 - the open source middleware for ambient-assisted living (AAL) AALIANCE conference - Malaga, Spain - 11 and 12 March 2010 1 openaal 1 - the open source middleware for ambient-assisted living (AAL) Peter Wolf 1, *, Andreas Schmidt 1, *, Javier Parada Otte 1, Michael

More information

3D Interaction Techniques Based on Semantics in Virtual Environments

3D Interaction Techniques Based on Semantics in Virtual Environments ISSN 1000-9825, CODEN RUXUEW E-mail jos@iscasaccn Journal of Software, Vol17, No7, July 2006, pp1535 1543 http//wwwjosorgcn DOI 101360/jos171535 Tel/Fax +86-10-62562563 2006 by of Journal of Software All

More information

Context-Aware Interaction in a Mobile Environment

Context-Aware Interaction in a Mobile Environment Context-Aware Interaction in a Mobile Environment Daniela Fogli 1, Fabio Pittarello 2, Augusto Celentano 2, and Piero Mussio 1 1 Università degli Studi di Brescia, Dipartimento di Elettronica per l'automazione

More information

Using Hands and Feet to Navigate and Manipulate Spatial Data

Using Hands and Feet to Navigate and Manipulate Spatial Data Using Hands and Feet to Navigate and Manipulate Spatial Data Johannes Schöning Institute for Geoinformatics University of Münster Weseler Str. 253 48151 Münster, Germany j.schoening@uni-muenster.de Florian

More information

Chapter 2 Understanding and Conceptualizing Interaction. Anna Loparev Intro HCI University of Rochester 01/29/2013. Problem space

Chapter 2 Understanding and Conceptualizing Interaction. Anna Loparev Intro HCI University of Rochester 01/29/2013. Problem space Chapter 2 Understanding and Conceptualizing Interaction Anna Loparev Intro HCI University of Rochester 01/29/2013 1 Problem space Concepts and facts relevant to the problem Users Current UX Technology

More information

Interaction Design -ID. Unit 6

Interaction Design -ID. Unit 6 Interaction Design -ID Unit 6 Learning outcomes Understand what ID is Understand and apply PACT analysis Understand the basic step of the user-centred design 2012-2013 Human-Computer Interaction 2 What

More information

MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device

MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device MOBAJES: Multi-user Gesture Interaction System with Wearable Mobile Device Enkhbat Davaasuren and Jiro Tanaka 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577 Japan {enkhee,jiro}@iplab.cs.tsukuba.ac.jp Abstract.

More information

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS

AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS AN AUTONOMOUS SIMULATION BASED SYSTEM FOR ROBOTIC SERVICES IN PARTIALLY KNOWN ENVIRONMENTS Eva Cipi, PhD in Computer Engineering University of Vlora, Albania Abstract This paper is focused on presenting

More information

The Mixed Reality Book: A New Multimedia Reading Experience

The Mixed Reality Book: A New Multimedia Reading Experience The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut

More information

End User Tools for Ambient Intelligence Environments: An Overview.

End User Tools for Ambient Intelligence Environments: An Overview. See discussions, stats, and author profiles for this publication at: http://www.researchgate.net/publication/221100226 End User Tools for Ambient Intelligence Environments: An Overview. CONFERENCE PAPER

More information

Interactive Coffee Tables: Interfacing TV within an Intuitive, Fun and Shared Experience

Interactive Coffee Tables: Interfacing TV within an Intuitive, Fun and Shared Experience Interactive Coffee Tables: Interfacing TV within an Intuitive, Fun and Shared Experience Radu-Daniel Vatavu and Stefan-Gheorghe Pentiuc University Stefan cel Mare of Suceava, Department of Computer Science,

More information

Foreword The Internet of Things Threats and Opportunities of Improved Visibility

Foreword The Internet of Things Threats and Opportunities of Improved Visibility Foreword The Internet of Things Threats and Opportunities of Improved Visibility The Internet has changed our business and private lives in the past years and continues to do so. The Web 2.0, social networks

More information

Ambient i,ledia for Peripherat Information Disptau

Ambient i,ledia for Peripherat Information Disptau Ambient i,ledia for Peripherat Information Disptau Hans-W. Gellersen, Albrecht Schmidt and Michael Beigl Telecooperation Office, University of KarIsruhe, Karlsruhe, Germany Abstract: In our everyday lives,

More information

Interactive Building

Interactive Building Advances in Internet of Things, 2012, 2, 86-90 http://dx.doi.org/10.4236/ait.2012.24011 Published Online October 2012 (http://www.scirp.org/journal/ait) Interactive Building Henriette Bier Faculty of Architecture,

More information

Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances

Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances Florent Berthaut and Martin Hachet Figure 1: A musician plays the Drile instrument while being immersed in front of

More information

DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS. Lucia Terrenghi*

DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS. Lucia Terrenghi* DESIGN FOR INTERACTION IN INSTRUMENTED ENVIRONMENTS Lucia Terrenghi* Abstract Embedding technologies into everyday life generates new contexts of mixed-reality. My research focuses on interaction techniques

More information

Daniel Fallman, Ph.D. Research Director, Umeå Institute of Design Associate Professor, Dept. of Informatics, Umeå University, Sweden

Daniel Fallman, Ph.D. Research Director, Umeå Institute of Design Associate Professor, Dept. of Informatics, Umeå University, Sweden Ubiquitous Computing Daniel Fallman, Ph.D. Research Director, Umeå Institute of Design Associate Professor, Dept. of Informatics, Umeå University, Sweden Stanford University 2008 CS376 In Ubiquitous Computing,

More information

RingEdit: A Control Point Based Editing Approach in Sketch Recognition Systems

RingEdit: A Control Point Based Editing Approach in Sketch Recognition Systems RingEdit: A Control Point Based Editing Approach in Sketch Recognition Systems Yuxiang Zhu, Joshua Johnston, and Tracy Hammond Department of Computer Science and Engineering Texas A&M University College

More information

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction.

Abstract. Keywords: virtual worlds; robots; robotics; standards; communication and interaction. On the Creation of Standards for Interaction Between Robots and Virtual Worlds By Alex Juarez, Christoph Bartneck and Lou Feijs Eindhoven University of Technology Abstract Research on virtual worlds and

More information

UNIT-III LIFE-CYCLE PHASES

UNIT-III LIFE-CYCLE PHASES INTRODUCTION: UNIT-III LIFE-CYCLE PHASES - If there is a well defined separation between research and development activities and production activities then the software is said to be in successful development

More information

Digital Paper Bookmarks: Collaborative Structuring, Indexing and Tagging of Paper Documents

Digital Paper Bookmarks: Collaborative Structuring, Indexing and Tagging of Paper Documents Digital Paper Bookmarks: Collaborative Structuring, Indexing and Tagging of Paper Documents Jürgen Steimle Technische Universität Darmstadt Hochschulstr. 10 64289 Darmstadt, Germany steimle@tk.informatik.tudarmstadt.de

More information