Multidimensional Information Visualization Using Augmented Reality
|
|
- Milton Morris
- 6 years ago
- Views:
Transcription
1 Multidimensional Information Visualization Using Augmented Reality Bianchi Serique Meiguins 1, Aruanda Simões Gonçalves 2, César Siqueira de Oliveira 1, Ricardo Melo Casseb do Carmo 1, Sérgio Clayton V. Pinheiro 2, Leonardo Hernandez 1 1 Departamento de Informática Universidade Federal do Pará (UFPA) Belém PA Brasil 2 Área de Ciências e Tecnologia - Centro de Universitário do Pará (CESUPA) Belém PA Brasil bianchi.serique@terra.com.br, aruanda@redeinformatica.com.br, {cesarso, rcasseb}@ufpa.br, serclay1@hotmail.com, leofozzy@hotmail.com Abstract. This paper presents a prototype for information visualization in an Augmented Reality environment. The prototype allows users to perform common tasks in desktop information visualization tools, such as data dynamic filters, attribute selection, semantic zoom and details on demand. Such tasks are seldom available in AR environments. We used a customized version of ARToolKit, a software tool that allows the insertion of virtual objects in real environments through cards with marks. The interactive controls as well as the data visualization are projected to the user and manipulated through these cards. Resumo. Este artigo apresenta um protótipo para visualização de informações em ambiente de Realidade Aumentada. O protótipo permite aos usuários realizarem tarefas comuns em ferramentas de visualização de informação desktop, tais como filtros dinâmicos de dados, seleção de atributos, zoom semântico e detalhes sob demanda, que em ambientes de RA quase nunca são vistos. Para a concepção do protótipo foi utilizada uma versão modificada do ARToolKit, software que permite incluir objetos virtuais em ambientes reais através de cartões com marcações. Os menus de comandos e controles interativos virtuais são projetados e manipulados através destes cartões, bem como a visualização dos dados para o usuário. 1. Introduction The ability to evaluate a decision-making process and perform rapid and accurate strategic changes is each day more important, specially on the fields of industry, economics and finances. In order to support theses processes, Data Mining, Information Visualization and Intelligent Systems projects are getting more and more attention from the research community. Specifically in the area of Information Visualization, new tools and techniques are constantly being developed to cope with the growing demand. An Information Visualization tool has the purpose of creating an interactive visual representation that transforms abstract data in a way that may be promptly understood by the user and may be used for tasks such as identification, multivariate correlation, search, exploration and communication.
2 Many current computational systems have tried to get more adaptable to human perceptions through more interactive user interfaces. This is also an important issue when it comes to Information Visualization tools. In this context, Augmented Reality (AR) studies new interaction and visualization mechanisms and allows a more natural user-to-system and user-to-user communication. AR creates enriched real environments by merging to this predominantly real world objects as geometric models, images, sounds and text and improving user perception. AR is a multidisciplinary field and may be adopted by Information Visualization tools. The goal of this paper is to present a Visualization Information in Augmented Reality prototype where the user may visualize and manipulate information in a real time three-dimension environment without the use of devices such as a keyboard or mouse and interact simultaneously with other users in order to make a decision related to the analyzed data. The contribution of this prototype are the new interaction mechanisms, the use of interactive menus and the implementation of filter techniques that modify the environment in real time without modifying all virtual objects. This allows the prototype to be more efficient for the support of a decision-making process. The prototype uses of ARToolKit, a free open-source library for the development of augmented reality applications, with the addition of new functionalities. OpenGL was used for the creation of virtual three-dimensional objects. This paper is organized as follows. Section 2 briefly presents Information Visualization concepts, characteristics and main techniques. Section 3 defines Augmented Reality and details of ARToolKit, the tool used for the construction of the prototype. Section 4 presents detailed development issues of the prototype. Finally, section 5 presents final remarks and future work proposals. 1.1 Related Works Bueno (2005) extended the Meta3D tool creating a AR module for Information Visualization. The user interaction in this tool depends on the configuration interface in a 2D environment and the data are grouped in clusters each cluster associated to a marker. The information filter quality depends on the number of markers. The tool used Chernoff Faces and Extended Parallel Coordinates techniques. Buk (2005) presented AR as an alternative for information visualization, where graphics are presented over real-world objects. However, filters are also associated to makers making the configuration options less flexible. The setting mechanisms are also 2D. Slay (1994) uses AR to visualize the Graph-based data representation technique. The setting options interface and the view generation is 2D. The intention of building a virtual marker from VRML objects is remarked. The tool does not present filter techniques on the AR interface. ARToolKit was used in all the above projects. An aspect in common is the absence of efficient filter techniques within the augmented interface.
3 2. Information Visualization In the different areas of human activities, the arduous task of extracting knowledge from data sources is primordial to improve the decision-making process. Professionals who are responsible for making decisions need efficient tools to help them perform their tasks in a very fast, simple and precise way. The Information Visualization area fulfills these requirements, since Information Visualization is, by definition, the process of turning abstract data into a visual shape easily understood by the user, making it possible for him/her to generate new knowledge about the relations between the data [Spencer 2001]. The visual form in which information is available to the user has influence on the knowledge extraction task of an information system and depends on the data. Data can be classified in 7 (seven) types and to each one of them a different visualization is described [Sheneiderman 1996]. The data types are: 1-D: Type of data represented by texts. 2-D: This type of data is used to represent geographic maps, engineering plants, etc. 3-D: This type of data has the characteristics of bi-dimensional data plus the information of volume. Multidimensional: Multidimensional data describes an item with more than three attributes. Dynamic consulting techniques [Card 1999] and dispersion diagrams are used to improve visualization of this type of data. Temporal: Type of data where the attribute is incorporated to previously described types. Hierarchic: Type of data which has a hierarchic structure where each item has a parent node. Network Data: nodes connected by links previously defined. Theses links can be organized in trees or hierarchically and the best manipulation way is to allow changes in node focus. According to Carr (1999), an information visualization tool should allow users to perform the following tasks: General View: the user needs an overall view of all analyzed data, based on the selected parameters for the visualization Zoom: the zoom technique is important because it allows focusing on the analyzed data. Semantic zoom also allows the user to visualize more details to the visualization. Filter: users frequently need to reduce the size of data sets by reducing the number of attributes. One of the most efficient ways is the use of Dynamic Queries, which is basically a technique that allows the user to select data without the use of any kind of command lines. Details on demand: when users are exploring a data set, they ll need to see details about one item in particular.
4 Relationship: If the user discovers an item of interest, he/she might need to know about other items with similar attributes, so the tool could point out these similar items. Historic: the user needs support to undo an action, show the steps until that point, etc. 3. Augmented Reality Augmented Reality s main characteristic is the creation of enriched real environments, adding to this predominantly real environment items such as geometric models, images, sound and texts and potentializing the utilization of the user s senses for a better perception of the environment. This way, Systems in AR generate to the user a combined vision of virtual objects generated by computer with real objects visualized by the user, enlarging the scene with additional information [Vallino 1998]. Augmented Reality is a particularization of a broader area known as Mixed Reality, which incorporates virtual elements to the real environment (Augmented Reality) or takes real elements to the virtual environment (Augmented Virtuality), completing the environments [Milgram and Kishino 1994]. One of the great advantages of using AR is the possibility for users to interact with the virtual and real worlds integrated. According to the type of display that is used for visualization and projection of virtual objects in the real environment, Augmented Reality can be classified in four main groups [Milgram and Kishino 1994]: Optical See-Trough AR: Combines virtual objects directly in the real scenario through Virtual Reality semi-transparent glasses. Video See-Trough AR: Opaque Virtual Reality helmets are used, with the help of a video camera that captures the real images and incorporates them with to the virtual environment. Monitor Based AR: Presents a mix of videos captured from real environments and virtual scenarios in monitors of computational devices. Projector Based AR: Projects the virtual environment in surfaces of real objects ARToolKit Developed by HIT Lab and distributed as an open code written in C Language. ARToolKit is a tool that allows that programmers develop applications in AR [Kato et al. 2003]. This library uses computational vision techniques to precisely calculate the position and orientation of a camera related to a marker in real time. The programmer can use this information to draw 3D objects exactly lined with the real ones. Figure 1 illustrates a basic cycle of ARToolKit execution. At first, an image of the real world is captured by any video input device (a webcam, for example) and then transformed into a binary image. The binary image is searched for squared regions. The next step is to calculate the position and orientation of the camera in relation to the squared regions that represents possible cards containing specific symbols called markers. The markers should contain different symbols previously registered through a
5 training of the internal neural net of ARToolKit for effective recognition. Once the marker is recognized, the next step is performed, when the tool calculates the exact point the virtual object must be in the real world builds an image and returns a visual combination of the real world and the virtual object to the user. Figure 1 ARToolKit Execution Steps The construction of objects to be combined to real world can be done through applications in OpenGL and VRML. There is also a version of ARToolKit written in Java (JARToolKit) [Geiger 2005] where JAVA3D can be used [Wash and Gehringer 2002]. 4. The Prototype In this section, the prototype that uses augmented reality to implement information visualization techniques is presented. The user interaction occurs in a very direct way, manipulating filters and 3D objects with his/her own hands instead of using conventional devices such as mouse and keyboard. It is also possible to manipulate virtual objects to select other virtual objects. The prototype produced modifications in ARToolKit and in OpenGL. Figure 2 Overview of the Prototype Architecture Figure 2 presents a general view of the changes or new implementations that were made in ARToolKit to develop the prototype presented in this paper. Some modules stand out: Interaction detection module, where the prototype identifies the action the user wants to perform; 3D objects settings module, which receives information about an action of the user and modifies the 3D objects that will be
6 presented to the user; and the database reader module, which is responsible for loading the data to the memory so that the prototype can manipulate the data. The main phases that must be accomplished in order to develop a good visualization project are the following: 4.1. Database Define with the user the data items that are relevant to the visualization project; Previous processing of the selected database; Identify the data types available in the base and their dimensionality; Identify a group of IV techniques that properly represent the data; Identify the best way to represent the data; Identify the best way to manipulate the represented data. An important pre-requisite in the implementation of the visualization technique is the initial treatment applied to the database. During this phase, the use of attribute selection techniques is recommended to reduce the volume of the existing data, using only the attributes that contribute to a good data analysis. This preparatory phase demands a high level of knowledge of the information that is being worked with to prevent important attributes that are initially considered irrelevant from being eliminated. The prototype used a public domain database containing information on Brazilian automobiles. After the preparatory phase, the final table consisted of 41 lines (including the name and type of attributes) and 10 columns: brand, model, fuel, year, color, price, number of doors, type, power and r.p.m. A small sample can be seen in Table 1. Table 1 Brasilian Car Data MAKE MODEL FUEL YEAR COLOR PRICE DOOR TYPE POWER RPM STRING STRING CADEIA INT STRING REAL INT STRING INT INT Fiat Uno gasolina 1993 prata hatch Kia Sportage diesel 1995 prata pickup volkswagen Parati gasolina 1993 branco wagon Visualization Techniques The 3D Scatterplot is the main technique used to visualize the objects. In this graphic model, the 3D objects are positioned according to x, y and z axis. Each visualized object has specific characteristics of color, shape and size that directly represent data items values, in order to magnify the perception of the data. This characterizes the implemented technique as multi-dimensional (information of x, y and z axis, color, shape and size). In the initial settings (Figure 3), the x axis is set to the year attribute, the y axis to the automobile price, the z axis to the automobile power, the color represents the brand, the size the number of doors and the shape represents the type of car.
7 Figure 3 Initial settings In Figure 3, the objects circled in red can be interpreted by the caption beside the graphic. The big pink circle is interpreted like Sedan Honda 4 doors and the small one as Sedan Honda 2 doors, the big red cylinder as Hatch Ford 4 doors and the small one as Hatch Ford 2 doors Augmented Graphic Interface The graphic interface consists of continuous and discrete filter controls and 3D scatterplot projected on marks. Each marker position was carefully determined to avoid frequent ARTookKit manipulation mistakes, such as undesired occlusion of markers. The group of markers and their functionalities is illustrated in Figure 4. Figure 4 Distribution of Markers
8 Figure 4 illustrates the real position and the virtual content of each marker used in the augmented interface. An example to filter the elements in the cone-shaped visualization is underlined in Figure 4. In order to do so, the user must fisrt choose an item from the Main Menu. In the example, the item must be Shape Filter. The item selection is done by blocking marker 1. Everytime the marker caption from the camera is blocked, a new item from the Main Menu becomes available in the sequence illustrated in Figure 4. The other markers are automatically reconfigured to attend to each sub-item from the Main Menu. The next step for the user is to select the shape of the visualization (cone, cube, sphere, and others), and it will be able to be seen through marker 3 and chosen through marker 2 or marker 4. Then the user should select Hide or Isolate the objects with the geometric shape selected and confirm the action with the Yes command, using marker 6. Figure 5 Creation of Dynamic Charts using Markers During the execution, the user s interaction with the graphic interface of the prototype happens in a direct way, occluding the marker where the desired virtual control is projected for a certain action to be executed. The interaction by occlusion consists in obstructing the capture of a marker by the webcam. The obstruction can be done by any kind of material capable of overlapping part of a marker symbol. A good suggestion is the use of one s own hands to perform this action Using Filter The developed filters were based on the dynamic queries concepts and support both discrete and continuous attributes. Dynamic queries allow the users to perform queries in a database without the need for command lines, using exclusively graphic interface components [Sheneiderman 1994]. The discrete (or nominal) attributes are usually used as setting options such as color, size and shape. Figures 6 and 7 illustrate the use of the shape filter, isolating only one shape (Figure 6) or removing that shape from the view (Figure 7). Continuous attributes are excellent candidates for axis representation. However, every continuous attribute has a related interval selection control, whether or not it is mapped to one of
9 the axis(figure 8). The prototype presents graphically the filter operations results in real time. Figure 6 Discrete attribute filter isolating Shape. Figure 7 Discrete attribute filter hiding Shape. Figure 8 Continuous attribute filter Power Details on Demand There are three forms of representation available: color, shape and size, but there is still more information to be analyzed about each object. A virtual mechanism, a virtual pointer, was developed to select a virtual object and present extra information (Figure 9). The virtual pointer is a virtual object also based on markers. In order to move it, the marker to which it s associated should be moved. Its goal is to select virtual objects in the visualization and it uses the concept of intersection.between objects to do so. At the end of the virtual pointer there is a spherical object that, when in contact with another virtual object, can take the shape of wireframe, identifying the object that was identified or selected. The virtual pointer uses red to identify a selection.
10 Figure 9 Retrieving information on an object. Figure 10 Semantic Zoom for the attribute Model Semantic Zoom The prototype already presents zoom, rotation and translation mechanisms. They are available on the menus which are appropriate to virtual and augmented reality applications. Additionally, the user may analyze the chart freely with the marker in his/her hands. Semantic zoom allows the user to observe the virtual objects in greater detail as his/her view approximates the objects (Figure 10) D Charts The 2D charts help the user providing new information on the visualized data. There are two types or charts available: histogram and pie. The pie chart for the attribute Fuel may be seen in Figure 11. Figure 11 Pie chart for the attribute Fuel. Figure 12 Use of the Help menu item Help The help item presents the user in detail the operation and content of each marker. The use of help is very easy. With the use of the virtual pointer, the user selects the help option first. The next step, the user should then select one of the menu items and read the available information about it. In order to disable the help command, the user must select the help option again (Figure 12).
11 5. Final Remarks and Future Work This paper presents a prototype for a multidimensional information visualization tool in an augmented reality environment. The AR environment provides a more intuitive and motivated interaction for the user. It also allows the user to manipulate the environment while interacting with other users in a collaborative fashion. The prototype aims to satisfy the main characteristics of a good visualization tool: overview, filter, details-ondemand and semantic zoom. The input is currently supported as text files but the development was generic enough to be adapted to any relational database. Other remarkable aspect is the implementation of menus in the mark cards. This allows a larger set of functionalities with the use of a lower number of markers. It is possible to set in real time axis, color, size and shape parameters, generating many views for the same environment. The use of dynamic queries allows the user to generate any combination of queries and filters without the need for command lines. The prototype also allows the use of 2D graphics to provide complementary information about visible data. Additionally, two implementation aspects contributed to make the interaction with the 3D virtual objects a lot easier: the virtual pointer and the help about virtual components in the AR interface. The main difficulties in the development of the prototype were: the instability of ARToolKit, specifically in environment lightening and marker detection; the comprehension of API such as OpenGL, especially when it comes to sequences of transformations; and the need for advanced hardware a 128mb video card, for example. As future work we intend to refine and optimize the code for publication in a website. It is also our intention to use a data glove to manipulate the objects and use the marker only to include 3D objects on the real scene. Incorporate the support for database access and generate multi-user collaborative version are also among our future goals. It could be studied the addition of another webcam to enlarge the user eye vision using two video monitors. Finally, a next step will be to perform usability and ergonomics tests comparing with similar desktop tools. References Bueno, et. al. Meta3D++ - Visualização de Informações em Realidade Aumentada, WRA 2005, Piracicaba, Anais. Piracicaba: UNIMEP, p Buk, et. al. Visualização de Informações em Ambientes de Realidade Aumentada, WRA 2005, Piracicaba, Anais. Piracicaba: UNIMEP, p Card, S., Mackinlay, J., and Shneiderman, B. eds. Readings in Information Visualization Using Vision to Think. Morgan Kaufmann, Carr, D. A. Guidelines for Designing Information Visualization Applications. Proceedings of ECUE 99. Estocolmo, Suécia. Dezembro Geiger, Christian. (2005) JARToolKit A Java binding for ARToolKit, IEEE JARToolKit. Available: Access in: 11/15/2005. Kato, H., Billinghurst, M., Poupyrev, I. (2003) ARTolKit version 2.33 Manual, Nov., Access in: 11/20/2005.
12 Milgram, P. e F. Kishino (1994). A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information Systems. Sheneiderman, B. The eyes have it: a task by data type taxonomy for information visualizations, Procedings of 1996 IEEE Visual Language Shneiderman, B., Dynamic queries for visual information seeking, IEEE Software 11, 6 (1994), Slay, H., Philips, M., Vernik, R., Thomas, B. Interaction Modes for Augmented Reality Visualization. Proceedings of Australian Symposium on Information Visualisation, Sydney, December Spence, Robert. Information Visualization. Addison-Wesley.(2001). Vallino, J. Interactive Augmented Reality, Department of Computer Science, University of Rochester, New York, Walsh, A., E., Gehringer, D. Java 3D API Jump -Start. Prentice Hall PTR. (2002).
We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors
We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 4,000 116,000 120M Open access books available International authors and editors Downloads Our
More informationpreface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...
v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)
More informationAn Implementation Review of Occlusion-Based Interaction in Augmented Reality Environment
An Implementation Review of Occlusion-Based Interaction in Augmented Reality Environment Mohamad Shahrul Shahidan, Nazrita Ibrahim, Mohd Hazli Mohamed Zabil, Azlan Yusof College of Information Technology,
More informationEffective Iconography....convey ideas without words; attract attention...
Effective Iconography...convey ideas without words; attract attention... Visual Thinking and Icons An icon is an image, picture, or symbol representing a concept Icon-specific guidelines Represent the
More informationA Kinect-based 3D hand-gesture interface for 3D databases
A Kinect-based 3D hand-gesture interface for 3D databases Abstract. The use of natural interfaces improves significantly aspects related to human-computer interaction and consequently the productivity
More informationAugmented Reality Lecture notes 01 1
IntroductiontoAugmentedReality Lecture notes 01 1 Definition Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated
More informationImmersive Authoring of Tangible Augmented Reality Applications
International Symposium on Mixed and Augmented Reality 2004 Immersive Authoring of Tangible Augmented Reality Applications Gun A. Lee α Gerard J. Kim α Claudia Nelles β Mark Billinghurst β α Virtual Reality
More informationAutomated Terrestrial EMI Emitter Detection, Classification, and Localization 1
Automated Terrestrial EMI Emitter Detection, Classification, and Localization 1 Richard Stottler James Ong Chris Gioia Stottler Henke Associates, Inc., San Mateo, CA 94402 Chris Bowman, PhD Data Fusion
More informationGuidelines for Implementing Augmented Reality Procedures in Assisting Assembly Operations
Guidelines for Implementing Augmented Reality Procedures in Assisting Assembly Operations Viviana Chimienti 1, Salvatore Iliano 1, Michele Dassisti 2, Gino Dini 1, and Franco Failli 1 1 Dipartimento di
More informationVIRTUAL REALITY AND SIMULATION (2B)
VIRTUAL REALITY AND SIMULATION (2B) AR: AN APPLICATION FOR INTERIOR DESIGN 115 TOAN PHAN VIET, CHOO SEUNG YEON, WOO SEUNG HAK, CHOI AHRINA GREEN CITY 125 P.G. SHIVSHANKAR, R. BALACHANDAR RETRIEVING LOST
More informationAugmented Reality- Effective Assistance for Interior Design
Augmented Reality- Effective Assistance for Interior Design Focus on Tangible AR study Seung Yeon Choo 1, Kyu Souk Heo 2, Ji Hyo Seo 3, Min Soo Kang 4 1,2,3 School of Architecture & Civil engineering,
More informationA Comparison of Histogram and Template Matching for Face Verification
A Comparison of and Template Matching for Face Verification Chidambaram Chidambaram Universidade do Estado de Santa Catarina chidambaram@udesc.br Marlon Subtil Marçal, Leyza Baldo Dorini, Hugo Vieira Neto
More informationVIRTUAL REALITY Introduction. Emil M. Petriu SITE, University of Ottawa
VIRTUAL REALITY Introduction Emil M. Petriu SITE, University of Ottawa Natural and Virtual Reality Virtual Reality Interactive Virtual Reality Virtualized Reality Augmented Reality HUMAN PERCEPTION OF
More informationGuidelines for Implementing Augmented Reality Procedures in Assisting Assembly Operations
Guidelines for Implementing Augmented Reality Procedures in Assisting Assembly Operations Viviana Chimienti, Salvatore Iliano, Michele Dassisti 2, Gino Dini, Franco Failli Dipartimento di Ingegneria Meccanica,
More informationDESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY
DESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY 1 RAJU RATHOD, 2 GEORGE PHILIP.C, 3 VIJAY KUMAR B.P 1,2,3 MSRIT Bangalore Abstract- To ensure the best place, position,
More informationApplication Areas of AI Artificial intelligence is divided into different branches which are mentioned below:
Week 2 - o Expert Systems o Natural Language Processing (NLP) o Computer Vision o Speech Recognition And Generation o Robotics o Neural Network o Virtual Reality APPLICATION AREAS OF ARTIFICIAL INTELLIGENCE
More informationiwindow Concept of an intelligent window for machine tools using augmented reality
iwindow Concept of an intelligent window for machine tools using augmented reality Sommer, P.; Atmosudiro, A.; Schlechtendahl, J.; Lechler, A.; Verl, A. Institute for Control Engineering of Machine Tools
More informationInteraction, Collaboration and Authoring in Augmented Reality Environments
Interaction, Collaboration and Authoring in Augmented Reality Environments Claudio Kirner1, Rafael Santin2 1 Federal University of Ouro Preto 2Federal University of Jequitinhonha and Mucury Valeys {ckirner,
More informationOcclusion based Interaction Methods for Tangible Augmented Reality Environments
Occlusion based Interaction Methods for Tangible Augmented Reality Environments Gun A. Lee α Mark Billinghurst β Gerard J. Kim α α Virtual Reality Laboratory, Pohang University of Science and Technology
More informationHUMAN COMPUTER INTERFACE
HUMAN COMPUTER INTERFACE TARUNIM SHARMA Department of Computer Science Maharaja Surajmal Institute C-4, Janakpuri, New Delhi, India ABSTRACT-- The intention of this paper is to provide an overview on the
More informationEyeScope: A 3D Interaction Technique for Accurate Object Selection in Immersive Environments
EyeScope: A 3D Interaction Technique for Accurate Object Selection in Immersive Environments Cleber S. Ughini 1, Fausto R. Blanco 1, Francisco M. Pinto 1, Carla M.D.S. Freitas 1, Luciana P. Nedel 1 1 Instituto
More informationIntelligent Modelling of Virtual Worlds Using Domain Ontologies
Intelligent Modelling of Virtual Worlds Using Domain Ontologies Wesley Bille, Bram Pellens, Frederic Kleinermann, and Olga De Troyer Research Group WISE, Department of Computer Science, Vrije Universiteit
More informationMECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL REALITY TECHNOLOGIES
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 4 & 5 SEPTEMBER 2008, UNIVERSITAT POLITECNICA DE CATALUNYA, BARCELONA, SPAIN MECHANICAL DESIGN LEARNING ENVIRONMENTS BASED ON VIRTUAL
More informationUniversidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Interaction in Virtual and Augmented Reality 3DUIs
Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática Interaction in Virtual and Augmented Reality 3DUIs Realidade Virtual e Aumentada 2017/2018 Beatriz Sousa Santos Interaction
More informationVirtual Grasping Using a Data Glove
Virtual Grasping Using a Data Glove By: Rachel Smith Supervised By: Dr. Kay Robbins 3/25/2005 University of Texas at San Antonio Motivation Navigation in 3D worlds is awkward using traditional mouse Direct
More informationSpatial Interfaces and Interactive 3D Environments for Immersive Musical Performances
Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances Florent Berthaut and Martin Hachet Figure 1: A musician plays the Drile instrument while being immersed in front of
More informationDevelopment of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
Journal of Communication and Computer 13 (2016) 329-337 doi:10.17265/1548-7709/2016.07.002 D DAVID PUBLISHING Development of a Finger Mounted Type Haptic Device Using a Plane Approximated to Tangent Plane
More informationINTELLIGENT GUIDANCE IN A VIRTUAL UNIVERSITY
INTELLIGENT GUIDANCE IN A VIRTUAL UNIVERSITY T. Panayiotopoulos,, N. Zacharis, S. Vosinakis Department of Computer Science, University of Piraeus, 80 Karaoli & Dimitriou str. 18534 Piraeus, Greece themisp@unipi.gr,
More informationR (2) Controlling System Application with hands by identifying movements through Camera
R (2) N (5) Oral (3) Total (10) Dated Sign Assignment Group: C Problem Definition: Controlling System Application with hands by identifying movements through Camera Prerequisite: 1. Web Cam Connectivity
More information2017 EasternGraphics GmbH New in pcon.planner 7.5 PRO 1/10
2017 EasternGraphics GmbH New in pcon.planner 7.5 PRO 1/10 Content 1 Your Products in the Right Light with OSPRay... 3 2 Exporting multiple cameras for photo-realistic panoramas... 4 3 Panoramic Images
More informationUbiquitous Home Simulation Using Augmented Reality
Proceedings of the 2007 WSEAS International Conference on Computer Engineering and Applications, Gold Coast, Australia, January 17-19, 2007 112 Ubiquitous Home Simulation Using Augmented Reality JAE YEOL
More informationCOLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES.
COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES. Mark Billinghurst a, Hirokazu Kato b, Ivan Poupyrev c a Human Interface Technology Laboratory, University of Washington, Box 352-142, Seattle,
More informationDesign and Development of a Marker-based Augmented Reality System using OpenCV and OpenGL
Design and Development of a Marker-based Augmented Reality System using OpenCV and OpenGL Yap Hwa Jentl, Zahari Taha 2, Eng Tat Hong", Chew Jouh Yeong" Centre for Product Design and Manufacturing (CPDM).
More informationA Virtual Environments Editor for Driving Scenes
A Virtual Environments Editor for Driving Scenes Ronald R. Mourant and Sophia-Katerina Marangos Virtual Environments Laboratory, 334 Snell Engineering Center Northeastern University, Boston, MA 02115 USA
More informationThe Mixed Reality Book: A New Multimedia Reading Experience
The Mixed Reality Book: A New Multimedia Reading Experience Raphaël Grasset raphael.grasset@hitlabnz.org Andreas Dünser andreas.duenser@hitlabnz.org Mark Billinghurst mark.billinghurst@hitlabnz.org Hartmut
More informationThumbsUp: Integrated Command and Pointer Interactions for Mobile Outdoor Augmented Reality Systems
ThumbsUp: Integrated Command and Pointer Interactions for Mobile Outdoor Augmented Reality Systems Wayne Piekarski and Bruce H. Thomas Wearable Computer Laboratory School of Computer and Information Science
More informationVirtual Environments. Ruth Aylett
Virtual Environments Ruth Aylett Aims of the course 1. To demonstrate a critical understanding of modern VE systems, evaluating the strengths and weaknesses of the current VR technologies 2. To be able
More informationInteractive System for Origami Creation
Interactive System for Origami Creation Takashi Terashima, Hiroshi Shimanuki, Jien Kato, and Toyohide Watanabe Graduate School of Information Science, Nagoya University Furo-cho, Chikusa-ku, Nagoya 464-8601,
More informationDesigning Semantic Virtual Reality Applications
Designing Semantic Virtual Reality Applications F. Kleinermann, O. De Troyer, H. Mansouri, R. Romero, B. Pellens, W. Bille WISE Research group, Vrije Universiteit Brussel, Pleinlaan 2, 1050 Brussels, Belgium
More informationAGENT PLATFORM FOR ROBOT CONTROL IN REAL-TIME DYNAMIC ENVIRONMENTS. Nuno Sousa Eugénio Oliveira
AGENT PLATFORM FOR ROBOT CONTROL IN REAL-TIME DYNAMIC ENVIRONMENTS Nuno Sousa Eugénio Oliveira Faculdade de Egenharia da Universidade do Porto, Portugal Abstract: This paper describes a platform that enables
More informationA Very High Level Interface to Teleoperate a Robot via Web including Augmented Reality
A Very High Level Interface to Teleoperate a Robot via Web including Augmented Reality R. Marín, P. J. Sanz and J. S. Sánchez Abstract The system consists of a multirobot architecture that gives access
More informationInteracting within Virtual Worlds (based on talks by Greg Welch and Mark Mine)
Interacting within Virtual Worlds (based on talks by Greg Welch and Mark Mine) Presentation Working in a virtual world Interaction principles Interaction examples Why VR in the First Place? Direct perception
More informationAUGMENTED VIRTUAL REALITY APPLICATIONS IN MANUFACTURING
6 th INTERNATIONAL MULTIDISCIPLINARY CONFERENCE AUGMENTED VIRTUAL REALITY APPLICATIONS IN MANUFACTURING Peter Brázda, Jozef Novák-Marcinčin, Faculty of Manufacturing Technologies, TU Košice Bayerova 1,
More informationChapter 1 - Introduction
1 "We all agree that your theory is crazy, but is it crazy enough?" Niels Bohr (1885-1962) Chapter 1 - Introduction Augmented reality (AR) is the registration of projected computer-generated images over
More informationEnabling Cursor Control Using on Pinch Gesture Recognition
Enabling Cursor Control Using on Pinch Gesture Recognition Benjamin Baldus Debra Lauterbach Juan Lizarraga October 5, 2007 Abstract In this project we expect to develop a machine-user interface based on
More informationUnderstanding OpenGL
This document provides an overview of the OpenGL implementation in Boris Red. About OpenGL OpenGL is a cross-platform standard for 3D acceleration. GL stands for graphics library. Open refers to the ongoing,
More informationA Mixed Reality Approach to HumanRobot Interaction
A Mixed Reality Approach to HumanRobot Interaction First Author Abstract James Young This paper offers a mixed reality approach to humanrobot interaction (HRI) which exploits the fact that robots are both
More informationSynergy Model of Artificial Intelligence and Augmented Reality in the Processes of Exploitation of Energy Systems
Journal of Energy and Power Engineering 10 (2016) 102-108 doi: 10.17265/1934-8975/2016.02.004 D DAVID PUBLISHING Synergy Model of Artificial Intelligence and Augmented Reality in the Processes of Exploitation
More informationARCHITECTURE AND MODEL OF DATA INTEGRATION BETWEEN MANAGEMENT SYSTEMS AND AGRICULTURAL MACHINES FOR PRECISION AGRICULTURE
ARCHITECTURE AND MODEL OF DATA INTEGRATION BETWEEN MANAGEMENT SYSTEMS AND AGRICULTURAL MACHINES FOR PRECISION AGRICULTURE W. C. Lopes, R. R. D. Pereira, M. L. Tronco, A. J. V. Porto NepAS [Center for Teaching
More informationImage Extraction using Image Mining Technique
IOSR Journal of Engineering (IOSRJEN) e-issn: 2250-3021, p-issn: 2278-8719 Vol. 3, Issue 9 (September. 2013), V2 PP 36-42 Image Extraction using Image Mining Technique Prof. Samir Kumar Bandyopadhyay,
More informationAttorney Docket No Date: 25 April 2008
DEPARTMENT OF THE NAVY NAVAL UNDERSEA WARFARE CENTER DIVISION NEWPORT OFFICE OF COUNSEL PHONE: (401) 832-3653 FAX: (401) 832-4432 NEWPORT DSN: 432-3853 Attorney Docket No. 98580 Date: 25 April 2008 The
More informationNeural Labyrinth Robot Finding the Best Way in a Connectionist Fashion
Neural Labyrinth Robot Finding the Best Way in a Connectionist Fashion Marvin Oliver Schneider 1, João Luís Garcia Rosa 1 1 Mestrado em Sistemas de Computação Pontifícia Universidade Católica de Campinas
More informationThe KNIME Image Processing Extension User Manual (DRAFT )
The KNIME Image Processing Extension User Manual (DRAFT ) Christian Dietz and Martin Horn February 6, 2014 1 Contents 1 Introduction 3 1.1 Installation............................ 3 2 Basic Concepts 4
More informationIssues and Challenges of 3D User Interfaces: Effects of Distraction
Issues and Challenges of 3D User Interfaces: Effects of Distraction Leslie Klein kleinl@in.tum.de In time critical tasks like when driving a car or in emergency management, 3D user interfaces provide an
More informationA Virtual Reality Environment Supporting the Design and Evaluation of Interior Spaces
A Virtual Reality Environment Supporting the Design and Evaluation of Interior Spaces Spyros Vosinakis, Philip Azariadis, Nickolas Sapidis, Sofia Kyratzi Department of Product and Systems Design Engineering,
More informationMobile Cognitive Indoor Assistive Navigation for the Visually Impaired
1 Mobile Cognitive Indoor Assistive Navigation for the Visually Impaired Bing Li 1, Manjekar Budhai 2, Bowen Xiao 3, Liang Yang 1, Jizhong Xiao 1 1 Department of Electrical Engineering, The City College,
More informationAugmented Reality. Virtuelle Realität Wintersemester 2007/08. Overview. Part 14:
Part 14: Augmented Reality Virtuelle Realität Wintersemester 2007/08 Prof. Bernhard Jung Overview Introduction to Augmented Reality Augmented Reality Displays Examples AR Toolkit an open source software
More informationAugmented reality for machinery systems design and development
Published in: J. Pokojski et al. (eds.), New World Situation: New Directions in Concurrent Engineering, Springer-Verlag London, 2010, pp. 79-86 Augmented reality for machinery systems design and development
More informationMarco Cavallo. Merging Worlds: A Location-based Approach to Mixed Reality. Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO
Marco Cavallo Merging Worlds: A Location-based Approach to Mixed Reality Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO Introduction: A New Realm of Reality 2 http://www.samsung.com/sg/wearables/gear-vr/
More informationIntegration and Communication: Teaching the Key Elements to Successful Product Interface Design Vicki Haberman Georgia Institute of Technology
Integration and Communication: Teaching the Key Elements to Successful Product Interface Design Vicki Haberman Georgia Institute of Technology Introduction The role of the user along with the goals of
More informationMission-focused Interaction and Visualization for Cyber-Awareness!
Mission-focused Interaction and Visualization for Cyber-Awareness! ARO MURI on Cyber Situation Awareness Year Two Review Meeting Tobias Höllerer Four Eyes Laboratory (Imaging, Interaction, and Innovative
More informationContext-Aware Interaction in a Mobile Environment
Context-Aware Interaction in a Mobile Environment Daniela Fogli 1, Fabio Pittarello 2, Augusto Celentano 2, and Piero Mussio 1 1 Università degli Studi di Brescia, Dipartimento di Elettronica per l'automazione
More informationInternational Journal of Computer Engineering and Applications, Volume XII, Issue IV, April 18, ISSN
International Journal of Computer Engineering and Applications, Volume XII, Issue IV, April 18, www.ijcea.com ISSN 2321-3469 AUGMENTED REALITY FOR HELPING THE SPECIALLY ABLED PERSONS ABSTRACT Saniya Zahoor
More informationHuman Computer Interaction (HCI, HCC)
Human Computer Interaction (HCI, HCC) AN INTRODUCTION Human Computer Interaction Why are we here? It may seem trite, but user interfaces matter: For efficiency, for convenience, for accuracy, for success,
More information3D Interaction Techniques Based on Semantics in Virtual Environments
ISSN 1000-9825, CODEN RUXUEW E-mail jos@iscasaccn Journal of Software, Vol17, No7, July 2006, pp1535 1543 http//wwwjosorgcn DOI 101360/jos171535 Tel/Fax +86-10-62562563 2006 by of Journal of Software All
More information3D Data Navigation via Natural User Interfaces
3D Data Navigation via Natural User Interfaces Francisco R. Ortega PhD Candidate and GAANN Fellow Co-Advisors: Dr. Rishe and Dr. Barreto Committee Members: Dr. Raju, Dr. Clarke and Dr. Zeng GAANN Fellowship
More informationA Hybrid Immersive / Non-Immersive
A Hybrid Immersive / Non-Immersive Virtual Environment Workstation N96-057 Department of the Navy Report Number 97268 Awz~POved *om prwihc?e1oaa Submitted by: Fakespace, Inc. 241 Polaris Ave. Mountain
More informationThe Application of Virtual Reality in Art Design: A New Approach CHEN Dalei 1, a
International Conference on Education Technology, Management and Humanities Science (ETMHS 2015) The Application of Virtual Reality in Art Design: A New Approach CHEN Dalei 1, a 1 School of Art, Henan
More informationCS 315 Intro to Human Computer Interaction (HCI)
CS 315 Intro to Human Computer Interaction (HCI) Direct Manipulation Examples Drive a car If you want to turn left, what do you do? What type of feedback do you get? How does this help? Think about turning
More informationRobot Task-Level Programming Language and Simulation
Robot Task-Level Programming Language and Simulation M. Samaka Abstract This paper presents the development of a software application for Off-line robot task programming and simulation. Such application
More informationToward an Augmented Reality System for Violin Learning Support
Toward an Augmented Reality System for Violin Learning Support Hiroyuki Shiino, François de Sorbier, and Hideo Saito Graduate School of Science and Technology, Keio University, Yokohama, Japan {shiino,fdesorbi,saito}@hvrl.ics.keio.ac.jp
More informationProject EAST Course Outline
Project EAST Course Outline Classroom 1 Orientation 5 Philosophy East Philosophy ROP Philosophy Working As A Team Interpersonal Skills Communication Role of the Team Team Goals and Success Responsibility
More informationTablet System for Sensing and Visualizing Statistical Profiles of Multi-Party Conversation
2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE) Tablet System for Sensing and Visualizing Statistical Profiles of Multi-Party Conversation Hiroyuki Adachi Email: adachi@i.ci.ritsumei.ac.jp
More informationINFO 424, UW ischool 11/15/2007
Today s Lecture Presentation where/how (& whether) to present represented items Presentation, Interaction, and Case Studies II Spence, Information Visualization Chapter 5 (Chapter 4 optional) Thursday
More information3D-Position Estimation for Hand Gesture Interface Using a Single Camera
3D-Position Estimation for Hand Gesture Interface Using a Single Camera Seung-Hwan Choi, Ji-Hyeong Han, and Jong-Hwan Kim Department of Electrical Engineering, KAIST, Gusung-Dong, Yusung-Gu, Daejeon, Republic
More informationLab 5: Advanced camera handling and interaction
Lab 5: Advanced camera handling and interaction Learning goals: 1. Understanding motion tracking and interaction using Augmented Reality Toolkit 2. Develop methods for 3D interaction. 3. Understanding
More informationActivities at SC 24 WG 9: An Overview
Activities at SC 24 WG 9: An Overview G E R A R D J. K I M, C O N V E N E R I S O J T C 1 S C 2 4 W G 9 Mixed and Augmented Reality (MAR) ISO SC 24 and MAR ISO-IEC JTC 1 SC 24 Have developed standards
More informationAR 2 kanoid: Augmented Reality ARkanoid
AR 2 kanoid: Augmented Reality ARkanoid B. Smith and R. Gosine C-CORE and Memorial University of Newfoundland Abstract AR 2 kanoid, Augmented Reality ARkanoid, is an augmented reality version of the popular
More informationAdvanced Techniques for Mobile Robotics Location-Based Activity Recognition
Advanced Techniques for Mobile Robotics Location-Based Activity Recognition Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Activity Recognition Based on L. Liao, D. J. Patterson, D. Fox,
More information5/17/2009. Digitizing Color. Place Value in a Binary Number. Place Value in a Decimal Number. Place Value in a Binary Number
Chapter 11: Light, Sound, Magic: Representing Multimedia Digitally Digitizing Color Fluency with Information Technology Third Edition by Lawrence Snyder RGB Colors: Binary Representation Giving the intensities
More informationCollaborative Multimodal Authoring of Virtual Worlds
Collaborative Multimodal Authoring of Virtual Worlds Vítor Sá 1,2 vitor.sa@dsi.uminho.pt 1 University of Minho Campus de Azurém P-4800-058 Guimarães Filipe Marreiros 3 filipe.marreiros@ccg.pt 2 Computer
More informationHandsIn3D: Supporting Remote Guidance with Immersive Virtual Environments
HandsIn3D: Supporting Remote Guidance with Immersive Virtual Environments Weidong Huang 1, Leila Alem 1, and Franco Tecchia 2 1 CSIRO, Australia 2 PERCRO - Scuola Superiore Sant Anna, Italy {Tony.Huang,Leila.Alem}@csiro.au,
More informationComputer Aided Draughting for Engineers
Higher National Unit Specification General information for centres Unit title: Computer Aided Draughting for Engineers Unit code: DR1X 34 Unit purpose: This Unit has been designed to enable candidates
More informationImmersive Simulation in Instructional Design Studios
Blucher Design Proceedings Dezembro de 2014, Volume 1, Número 8 www.proceedings.blucher.com.br/evento/sigradi2014 Immersive Simulation in Instructional Design Studios Antonieta Angulo Ball State University,
More informationMarkerless 3D Gesture-based Interaction for Handheld Augmented Reality Interfaces
Markerless 3D Gesture-based Interaction for Handheld Augmented Reality Interfaces Huidong Bai The HIT Lab NZ, University of Canterbury, Christchurch, 8041 New Zealand huidong.bai@pg.canterbury.ac.nz Lei
More informationVirtual Reality Devices in C2 Systems
Jan Hodicky, Petr Frantis University of Defence Brno 65 Kounicova str. Brno Czech Republic +420973443296 jan.hodicky@unbo.cz petr.frantis@unob.cz Virtual Reality Devices in C2 Systems Topic: Track 8 C2
More informationConsumer Behavior when Zooming and Cropping Personal Photographs and its Implications for Digital Image Resolution
Consumer Behavior when Zooming and Cropping Personal Photographs and its Implications for Digital Image Michael E. Miller and Jerry Muszak Eastman Kodak Company Rochester, New York USA Abstract This paper
More informationUsing Dynamic Views. Module Overview. Module Prerequisites. Module Objectives
Using Dynamic Views Module Overview The term dynamic views refers to a method of composing drawings that is a new approach to managing projects. Dynamic views can help you to: automate sheet creation;
More informationTHE VIRTUAL-AUGMENTED-REALITY ENVIRONMENT FOR BUILDING COMMISSION: CASE STUDY
THE VIRTUAL-AUGMENTED-REALITY ENVIRONMENT FOR BUILDING COMMISSION: CASE STUDY Sang Hoon Lee Omer Akin PhD Student Professor Carnegie Mellon University Pittsburgh, Pennsylvania ABSTRACT This paper presents
More informationVIRTUAL REALITY TECHNOLOGY APPLIED IN CIVIL ENGINEERING EDUCATION: VISUAL SIMULATION OF CONSTRUCTION PROCESSES
VIRTUAL REALITY TECHNOLOGY APPLIED IN CIVIL ENGINEERING EDUCATION: VISUAL SIMULATION OF CONSTRUCTION PROCESSES Alcínia Z. Sampaio 1, Pedro G. Henriques 2 and Pedro S. Ferreira 3 Dep. of Civil Engineering
More informationE90 Project Proposal. 6 December 2006 Paul Azunre Thomas Murray David Wright
E90 Project Proposal 6 December 2006 Paul Azunre Thomas Murray David Wright Table of Contents Abstract 3 Introduction..4 Technical Discussion...4 Tracking Input..4 Haptic Feedack.6 Project Implementation....7
More informationDirect Manipulation. and Instrumental Interaction. CS Direct Manipulation
Direct Manipulation and Instrumental Interaction 1 Review: Interaction vs. Interface What s the difference between user interaction and user interface? Interface refers to what the system presents to the
More informationDesign Principles of Virtual Exhibits in Museums based on Virtual Reality Technology
2017 International Conference on Arts and Design, Education and Social Sciences (ADESS 2017) ISBN: 978-1-60595-511-7 Design Principles of Virtual Exhibits in Museums based on Virtual Reality Technology
More informationAugmented Board Games
Augmented Board Games Peter Oost Group for Human Media Interaction Faculty of Electrical Engineering, Mathematics and Computer Science University of Twente Enschede, The Netherlands h.b.oost@student.utwente.nl
More informationIMAGE PROCESSING FOR EVERYONE
IMAGE PROCESSING FOR EVERYONE George C Panayi, Alan C Bovik and Umesh Rajashekar Laboratory for Vision Systems, Department of Electrical and Computer Engineering The University of Texas at Austin, Austin,
More informationHELPING THE DESIGN OF MIXED SYSTEMS
HELPING THE DESIGN OF MIXED SYSTEMS Céline Coutrix Grenoble Informatics Laboratory (LIG) University of Grenoble 1, France Abstract Several interaction paradigms are considered in pervasive computing environments.
More informationContent Based Image Retrieval Using Color Histogram
Content Based Image Retrieval Using Color Histogram Nitin Jain Assistant Professor, Lokmanya Tilak College of Engineering, Navi Mumbai, India. Dr. S. S. Salankar Professor, G.H. Raisoni College of Engineering,
More informationTheory and Practice of Tangible User Interfaces Tuesday, Week 9
Augmented Reality Theory and Practice of Tangible User Interfaces Tuesday, Week 9 Outline Overview Examples Theory Examples Supporting AR Designs Examples Theory Outline Overview Examples Theory Examples
More informationTactile Interface for Navigation in Underground Mines
XVI Symposium on Virtual and Augmented Reality SVR 2014 Tactile Interface for Navigation in Underground Mines Victor Adriel de J. Oliveira, Eduardo Marques, Rodrigo Peroni and Anderson Maciel Universidade
More informationRelease: 1. MEM30031A Operate computer-aided design (CAD) system to produce basic drawing elements
Release: 1 MEM30031A Operate computer-aided design (CAD) system to produce basic drawing elements MEM30031A Operate computer-aided design (CAD) system to produce basic drawing elements Modification History
More information