DESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY 1 RAJU RATHOD, 2 GEORGE PHILIP.C, 3 VIJAY KUMAR B.P 1,2,3 MSRIT Bangalore Abstract- To ensure the best place, position, model and color for an object in a smart home, efforts has been made to develop a planning tool that focuses on best spot to place the 3D object and also visualize in all orientation. With the development of Augmented Reality technology came an opportunity for collaborative and interactive scenario modeling of different computer generated objects into real world. Mobile Camera is used to detect the marker in the real world along with AR SDK and Unity 3D. Black and white markers are used to indicate the system where to place virtual object and its orientation. This paper presents a system for placing an object with respect to its context and also visualization in all angles. The resulting application is both easy to use and cheap, in that it does not require expensive equipment like Head Mounted Device (HMD). Keywords- Augmented Reality, Head Mounted Device, Marker, Unity 3D. I. INTRODUCTION. Augmented reality is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics, and GPS data [1]. Augmented reality is a form of virtual reality. Virtual reality allows users to fully integrate into the computer-generated virtual environment, but cannot see the reality of its surrounding environment. Whereas augmented reality allows the user to see the reality of the environment, as well as the synthesis of virtual objects in the real environment. Therefore augmented reality supplements the real environment rather than completely replace the real environment. Figure 1 shows the augmentation of virtual objects like Chair and Lamp, onto a table in a real environment. by augmenting the virtual objects or projecting virtual objects into real world. For Ex: Virtual or Projection keyboard which one can project onto a flat surface and use. 2) Recognition: Recognition is a type of AR that uses the recognition of shapes, faces or other real world items to provide supplementary virtual information to the user in real time. For Ex: A smart phone with proper software could use recognition to read product bar codes and provide relevant information. 3) Location: location uses GPS technology to instantaneously provide you the relevant direction information. For Ex: A smart phone app that determines his/her location and displays nearest public transportation station. 4) Outline: outline is a type of AR that merges the human body or part of the body with virtual materials. For Ex: trying out various cloths without actually wearing them, just by projecting them on the person in an image. III. VIRTUAL REALITY. Virtual reality is a computerized simulation of natural or imaginary reality. Often the user of VR is fully or partially immersed in the environments [2]. Fig 1: AR example with virtual chairs and virtual lamp[3]. II. TYPES OF AUGMENTED REALITY. Common types of AR are as follows [2]. 1) Projection Based: It is the most common type of AR, this type of AR enhances the user perception A) Advantages of Virtual Reality [2]. Total Immersion within environment. Increased user presence perception within system. Facilitating production of an entirely designed environment. Existing technology for advanced interaction. 78
Real time graphical environment generation possible. B) Disadvantages of Virtual Reality [2]. Not suited to real-world interaction. Despite advances in technology, equipment is still expensive. Auxiliary senses not stimulated. Possible lag in motion-display system. IV. AUGMENTED REALITY Augmented Reality also known as Mixed Reality, as shown in Figure 2, aims to combine virtual and real scenes together to achieve that virtual ones also belongs to real world. Being characteristic of integration of virtual and real scene, many applications of Augmented Reality are emerging, such as in the fields of education, medical treatment and entertainment [4]. VI. PROPOSED SYSTEM: The proposed system is a tool for design style of building interior 3D objects using marker based Augmented Reality, the proposed system uses a marker based AR system along with AR SDK in an android environment. The following figure shows the system and its core components [2, 5]. Fig 3: Shows the Architectural block diagram for the AR system. Fig 2: Relationships between AR, VR, MR [4]. A) Goals of Augmented Reality [2]. 1) To create virtual environment for a more rich user experience. 2) To integrate it into daily lives to help the masses. 3) To achieve feats which are limited in real world. V. TYPES OF AUGMENTED REALITY. There are two types of augmented reality [2] 1) Marker Based 2) Marker less. Marker Based: Different type of augmented reality markers are images that can be detected by a camera and used with software as the location for virtual assets placed in a scene. A camera is used with AR software to detect augmented reality markers as the location for virtual objects. The result is that an image can be viewed, even live, on a scene and digital assets are placed into the scene at the location of the markers. Marker less: In marker less AR the image is gathered through internet and displayed on any specific location i.e. by using GPS. This application does not require marker to display the content. Camera: The camera component ensures that every preview frame is captured and passed efficiently to the image capturing module. The user only has to initialize the camera to start and stop capturing, the camera frame is automatically delivered in a device-dependent image format and size. Image Capturing Module: The input to image Capturing Module is the live video feed from the camera of mobile device. This module analyses the camera feed by analyzing each frame in the video. This module generates binary images which is given as an input to the image processing module. Image Processing Module: The binary images are processed using an image processing technique to detect the AR marker. Detection of marker is essential to determine the position, where to place the virtual object. Once the the AR maker is detected its location is provided as an input to the marker tracking model. Marker Tracking Module: The tracking module is the heart of the augmented reality system. It calculates the relative pose of the camera in the real-time. The calculated pose is provided as an input to the rendering module. 79
Rendering Module: In Rendering Module there are two inputs 1) First is to calculate the pose from the tracking module. 2) Virtual object to augment. The rendering module combines the original images and the virtual components using the calculated pose and renders the augmented image on the display screen of the mobile device. Device Target Databases: Device databases are created using the Target Manager. The downloaded device target database assets contain an XML configuration file that allows the developer to configure certain tractable features and a binary file that contains the tractable database. These assets are compiled by image processing module and used at runtime by the Augmented Reality SDK. The following figure shows the creation of markers at target manager. 1) 3D computer graphics software: Autodesk, Blender. 2) Software Development Kit: AR SDK. 3) 3D Engine: Unity 3D 4) Development Environment: OpenGL and C#. VIII. AUGMENTED REALITY INTERACTION DESIGN. Unity 3D and Augmented Reality SDK are used to develop the application. The tool aims to construct 3D models for interior design of building. We design some marker to be recognized. With Image recognition AR, user holds camera over marker, and event happens in a virtual environment. The following are the brief development steps: 1. Launch the Unity and load Augmented Reality SDK. 2. Use the material dragged into the Unity project library. 3. Identify tag loading Unity. 4. Combine the connection function in Unity. 5. Make a proper alignment of 3D object with corresponding marker and finally create android app. The final view of augmented reality applications consisting of marker generated from target manager along with screen coordinates and camera coordinates are as follows. Fig 4 : Marker Generation at Target Manager. VII. Development Tools. The design tools of the Android Application are categorized into the following four items: Illustration Picture Description Fig 5: marker with camera coordinate XI. RESULTING TABLE WITH SCREEN SHOT AND DESCRIPTION. Augmented an early computer Webcam identification of the main tag for displaying corresponding model. 80
Ex1:HDTV Popular augmented the mobile device. Before First mobile camera with software will identify the assigned marker and then OpenGL will renders the corresponding model on the assigned marker in the real world and the model can be visualize in all angles. After Ex 2:Chair Popular augmented the mobile device. Before First mobile camera with software will identify the assigned marker and then OpenGL will renders the corresponding model on the assigned marker in the real world and the model can be visualize in all angles. After Augmentation CONCLUSIONS In this paper we have described a new Augmented Reality mobile Application and AR SDK along with the computer vision technique used in the application. Our computer vision methods give good results when the markers are close to the user, but accuracy decreases the further the cards are from the camera. Also our Mobile App calibration method which does not require a non-moving user give good results without user's patience. In future, we will improve this AR conferencing prototype and execute user testing for its evaluation as a communication system. 81
ACKNOWLEDGEMENTS: REFERENCES: Authors like to thank Dept. of Information Science and Eng., M.S Ramaih Institute of Technology for providing lab facilities for conducting the research work. Authors also like to thank management and Dr. S.Y kulkarni, Principal of M.S Ramaih Institute of Technology, for their constant support to carry the prospective research work. [1] http://mashable.com/category/augmented-reality/ [2] Marker Based Augmented Reality Using Android OS. By Mr. Raviraj S. Patkar, Pune University- ISSN-2277128X, Volume 3, Issue 5,May 2013, [3] Introduction to AR By R. Silva, J.C Oliveira, G. A. Giraldi National laboratory for scientific computation Brazil. [4] Theory and applications of marker-based augmented reality Sanni Siltanen ISSN 2242-1203, Copyright VTT 2012. [5] Vuforia developer portal. 82