Challenges and opportunities in ARToolKit development
|
|
- Leon West
- 5 years ago
- Views:
Transcription
1 Challenges and opportunities in ARToolKit development
2 Contents Introduction... 3 How does an ARToolKit function?... 4 Marker and Non-marker based techniques for selecting an ARToolKit... 5 Software toolkits available for building AR applications... 7 Considerations for building an ARToolKit... 9 Challenges with AR Development How does the future look for ARToolKits? hedgehoglab.com 2
3 Introduction Apple ARKit on iphone X To understand AR, it is thus essential to distinguish it from VR. The former overlays virtual computer graphic images on top of the real world, supplementing reality as we know it, rather than replacing it. Recent developments in the sphere of HCI (human-computer interaction) have opened new frontiers in immersive arenas including Virtual Reality (VR) and Augmented Reality (AR). Both technologies offer users a great interface and have been successfully used in areas ranging from gaming and entertainment to education and even health. Our previous white paper on the subject focused predominantly on the driver s, growth and challenges for VR. Now, by contrast, we would like to look at the growth of AR, and the ARToolKits that are taking the software development world by storm. Indeed, such tools have been instrumental in building some of the most powerful AR apps on the market, across various platforms, including ios and Android. In terms of investment, all looks promising. In 2016, the AR market was valued at US$2.39bn. By 2023, that figure is expected to reach US$61.39bn, growing at a CAGR of 55.71%. And, of course, advancements in computer graphics, hardware, vision and UI (user interface) will all add impetus to this expansion. AR, as we currently know it, represents a merger of several technologies, which aim to enhance the user s experience of the real world. Far from being a novel development, it has existed for more than 35 years, since Ivan Sutherland first introduced the Virtual Reality application. To understand AR, it is thus essential to distinguish it from VR. The former overlays virtual computer graphic images on top of the real world, supplementing reality as we know it, rather than replacing it. The latter, meanwhile, confines the user to a digitally constructed environment, with which he or she can interact. A sound AR system would therefore be capable of merging computer-generated graphics with the real world so seamlessly that it may even be hard to spot the difference between the two. An ideal AR platform should comprise the following features: The ability to combine real and virtual environments The potential for real time interaction with the user Potentially registering real and virtual objects with one another A review of scientific literature indicates that AR is currently being used across many fields - extensively when it comes to teaching geometry, spatial relationships and molecular structures. And although the majority of people remain unfamiliar with it, we have no doubt it will spread into the mainstream as more and more AR apps make their way on to the market. In saying this, developers need the best possible toolkits to build good quality apps, and these would combine a number of elements, such as voice, gesture, animation and persistent data to create a mesmerising impact on users. This technical white paper aims to improve understanding of the ARToolKit, explore the techniques for selecting toolkits, look at the popular toolkits available and consider what needs to be taken into account to build a high quality AR experience EXPECTED VALUATION $61.39bn CAGR of 55.71% 2016 AR MARKET VALUE $2.39bn hedgehoglab.com 3
4 How does an ARToolKit function? ARToolKits are mainly coded software libraries that enable developers to build Augmented Reality apps using languages like C and C++. Such libraries, which were initially available for free, were developed for research and non-commercial purposes. However, with the rise of powerful cellular devices, other digital gadgets and improved applications, newer commercial ARToolKits today assist developers in creating and constructing mindbending AR apps. So the pertinent questions are: how does toolkit function in an AR app? What role does the hardware play? What happens to the image when captured? How are markers identified and what roles do markers play in an ARToolKit? The answers to all of the above lie in five simple steps. First, an image is captured through a camera and transmitted to the app The image is then fragmented into black and white squares Computer vision algorithms calculate the position of the camera, relative to the black squares A process of homography transforms the image inside the black squares and compares the template with the patterns in the database. This process identifies the marker Once the marker is detected and the position of the camera is known, a computer graphics model is drawn from the top of the video. The next section throws light on two common techniques used for selecting an ARToolKit. hedgehoglab.com 4
5 Marker and Non-marker based techniques for selecting an ARToolKit Jelmer Verhoog - Tesla Model3 in Apple ARKit Camera-based ARToolKits can be selected using two techniques, marker-based and nonmarker-based. Most AR apps with image recognition are markerbased. Digital images are identified with the help of optical square markers, usually comprising black squares within white boxes of predefined sizes. The square markers are identified with the support of a camera or a digital device using an algorithm. The algorithm uses the image of the camera, as well as the decoded ID markers, to augment the virtual object onto the physical world model. Well-known examples of marker-based AR apps include: ScanLife, Popcode and, of course, Google Goggles. With the advent of powerful HMDs (head mounted devices) and wearables accompanied by the best built-in cameras, AR apps are now capable of running markerless tracking. This medium allows the use of all small parts of the environment as a base, replacing the superimposed virtual objects. Markerless AR is thus assisted by one s surroundings, rather than the static identified markers. Non-marker-based AR is capable of extracting and storing information about the surroundings for future use. The technology is preferred over marker-based technology, as it is non-invasive, light and can store larger images from the environment for future use. Google s Tango, for example, uses camera vision to detect and scan the environment in real time and creates virtual images to superimpose on it, without using external signals or the GPS. The camera-based techniques employed in AR have opened up new frontiers in commercial and entertainment spaces. We envisage that the following areas will be greatly impacted by AR tracking: Entertainment and Gaming Markerless technology has the potential to take the entertainment sector to previously unimagined places. Imagine walking into a room and being able to weave your own gaming world... just by scanning the information available to you. Hardware such as the Microsoft HoloLens can create incredible immersive experiences in the gaming sphere. The beauty of AR lies in the fact that it does not require a television, console or standard method of control. Markerless AR can convert any plane into a gaming field and we are certain it can change the face of the gaming world. ARKit-Powered Game The Machines on iphone X Product showcasing and visualisation Markerless AR has the potential to impact our buying habits, especially when it comes to assets requiring long-term investments. For instance, imagine you are considering buying an electric vehicle from the likes of Tesla. However, you re unsure which colour it might look best in, or what it might feel like to drive it in the city. How about taking a prototype experience? Jelmer Verhool released a recent prototype of such an interactive experience from Oslo, using an Apple ARKit to showcase the unreleased Tesla 3. On a similar note, imagine you want to get a new appliance fitted in your kitchen, but are unsure how the kitchen will look after this alteration. Markerless AR can help since it lets you use your mobile to scan the kitchen environment, and potentially place a virtual version of the product within it, taking customer visualisation to the next level. Such tools also allow customers to browse and shop in their own time, free from pushy salespeople. hedgehoglab.com 5
6 Marker and Non-marker based techniques for selecting an ARToolKit Healthcare education and surgery Medical tutoring apps are capable of making healthcare education more immersive and interactive. This is especially so with apps made with the recent ARToolkits, as compared to those developed without ARKit features. So, how would ARKit framework help improve learning in medicine? HoloLens Mixed Reality Surgery Plane detections make it possible for medical students to study virtual 3D models directly on their desks. The learning experience is thereby rendered richer and more interesting, compared to learning through photographs and videos. Visual Inertial Odometry supports training medical interns. 3D models mean the anatomy, including organs, can be viewed from any angle and distance. ARToolkits can even make it easier, safer and faster to carry out surgery, improving a number of processes, from tumour identification and removal to visualising blood flows. Military application In the army, HMDs with AR apps can provide real time assistance to soldiers in battle zones. The devices can transmit critical information, including the location of enemies, battle tanks or any other element that poses a threat. Similarly, fighter jets can be equipped with heads up AR apps featuring transparent displays to relay critical information such as altitude, airspeed, the horizon line and key data relevant to war zones. Limpid Armor AR system for armoured vehicles AR apps in Navigation Enhanced GPS combined with AR would allow easy movement from one location to another. Using a smartphone s camera in combination with the GPS, users could view selected routes overlaid on the live view in front of their vehicles. ARToolkits can even make it easier, safer and faster to carry out surgery, improving a number of processes, from tumour identification and removal to visualising blood flows. Repairs and maintenance in manufacturing Using HMDs, technicians can see superimposed images of machines and engines with detailed information in the actual line of sight. Detailed procedures for fixing the machines could also be displayed in the corner of the devices, with live 3D images showing exactly what has to done to repair broken parts. AR apps can label essential components and help simplify the complex steps involved in major repairs. Similarly, simulations can be used to train technicians, significantly reducing training expenses. hedgehoglab.com 6
7 Software toolkits available for building AR applications AR applications are built using different software toolkits. In this section, we will compare them to help developers make wise choices. Daqri Smart Glasses and Helmet Daqri-ARToolKit Initially introduced as an open source code, this toolkit was then acquired by Daqri, which now provides the commercialised version. The original toolkit still exists, though, and hence free libraries are available to all. The toolkit includes work instructions, data visualisation templates, and distinct methods and best practices for creating AR content. It supports the following functions: Tracking black square and planar images 2D image recognition, camera calibration and optical stereo calibration Single camera orientation tracking Optical HMD display support Mapping additional elements via OpenGL (graphics library) Plugins for Unity and OpenSceneGraph Supports optical head-mounted display Fast enough for real time AR applications Supported platforms: Android, ios, Linux, Windows and Mac OS. The open source comes with disadvantages of its own most significantly, the SDK s documentation is quite weak. And although the libraries contain prototypes for building test apps, the illustrations are fairly mediocre and offer no information on the plans for a framework update. Limpid Armor AR system for armoured vehicles Vuforia One of the most popular platforms for AR development, Vuforia - which is supported on Android, ios, UWP and Unity Editor - boasts the following features: recognises the different types of visual objects (a box, cylinder, planes), as well as text and environments facilitates scanning of targeted objects using Vuforia Object Scanner integrates powerful plugins at various levels incorporates virtual buttons and maps additional elements via OpenGL extends tracking to deliver a continuous visual experience, even when the target is out of sight Vuforia s framework is incomplete, which can complicate matters for developers working with the SDK for the first time. Commercial versions of the software are free from watermark, while the free versions are not particularly flexible to work with and less suited for cloud platforms. Wikitude Wikitude, another powerful library, allows developers to create AR apps with next level functions including: reconstructing places on virtual maps; facilitating AR gaming; and offering real time searching of events, articles and social media posts. The kit can be used in both Android and ios, and supports Unity. Moreover, the documentation of the library is well structured and elaborate. Developers can avail of the free versions initially. However, premium versions are chargeable on a regular basis. Wikitude SDK animated 3D models Features of Wikitude include: image recognition and tracking, 2D and 3D tracking technology, GEO data, cloud recognition and HTML augmentation. hedgehoglab.com 7
8 Software toolkits available for building AR applications ARCore Kudan Kudan boasts one of the fastest frameworks of all software toolkits. The SDK assists in mapping multi-polygonal models and facilitates easy import of 3D models from the modelling software packages. The libraries require minimal memory space to store images on devices. However, the toolkit library framework is short and developers would require more detailed information to build AR apps. The library also suffers from limited built-in functionality as it has no direct access to OpenGL. Kudan offers the following capabilities : Easy recognition of 2D and 3D images Compatibility with Unity and the ability to generate databases Allows markerless tracking (instead of fiducial marks, it relies on the use of natural features like edges, corners or textures) Maps additional elements through separate component over OpenGL Supported platforms: Android and ios. Apart from the above, two new kits, introduced Apple and Google have made their foray to the world of app development. It s certainly worth looking into these toolkits offered by the giants, and how they are capable of possibly changing the immersive landscape? ARKit Apple s ARToolKit, known as the ARKit, has been doing the rounds for quite some time, and was officially acknowledged at the WWDC It was introduced to help developers integrate AR experiences into apps and games. Working with the ios and using the phone s camera, processors and motion sensors, the toolkit aims to enhance immersive experiences. ARKit uses Visual Inertial Odometry (VIO) to track the space around Apple s devices, including ipads or iphones. VIO enables the devices to sense empty spaces while in motion. Further, the kit is capable of analysing room layouts and detecting horizontal planes like tables and floors. This means virtual objects can be placed on those surfaces. Take, for instance, IKEA s new app, developed using ARKit. This enables customers to visualise the placement and positioning of furniture on planes and empty spaces before making purchases. ARCore ARCore, Google s toolkit, is available on Android 7.0 Nougat and all more recent operating systems. Developers can use it for building apps for the Pixel, Galaxy S8 or any other OEM devices. It works with an OpenGL, Unity and Unreal, and boasts three distinct features: Motion tracking - Using the phone s camera to detect an individual s position in an open space Environmental understanding - capable of detecting plane and horizontal surfaces in the surroundings Light estimation - allows lighting and shadow of virtual objects to match the surroundings ARCore supports other 3D tools from Google like Blocks and Tilt Brush, as well as gaming projects from the likes of Epic Games, Niantic (the builders of Pokemon Go) and Wayfair. Given Android s huge market base - millions of devices are powered by the platform - the toolkit has the potential to become the biggest in the world. Apple ARKit hedgehoglab.com 8
9 Considerations for building an ARToolKit As discussed previously, one of the fundamental problems involved in developing AR applications is that of tracking the user s viewpoint. ARToolKit uses computer vision algorithms to solve this issue by calculating the real camera position and orientation relative to physical markers in real time. It s not an exact science, but is impressively accurate, resulting in realistic AR experiences. So the key question is: how does one build a robust, high-quality AR experience? What factors need to be considered? Lighting conditions Tracking becomes challenging and tedious when lighting conditions are poor, since the process involves image analysis. Indeed, tracking quality becomes abysmal when a camera is projected on a blank wall or used in an area that is too dark. Good quality lighting conditions are therefore advisable for generating amazing AR experiences. Generation of user feedback Tracking assists in analysing a real life image when a device is in motion. ARToolKit helps users understand the scene better, even if the device moves subtly. However, vigorous motion can result in a blurred image. Good quality AR cameras provide tracking state information, which programmers can use for developing UI and to resolve issues related to low-quality tracking scenarios. Plane detection Plane detection is an important phenomenon for AR, as it is capable of producing sharp, unequivocal images. ARToolKits refine the position and time extent once a plane is detected. ARCore plane detection hedgehoglab.com 9
10 Challenges with AR Development Building an AR application isn t easy and developers face challenges from two ends - firstly on the hardware front and secondly when it comes to software. Hardware related challenges Sensor readings are crucial for AR apps. However, accelerometer and compass mechanisms in digital devices are not capable of filtering electric inference from vastly populated surfaces. The problem can possibly be resolved through an exponential smoothing technique, used for smoothing time series data. Weak pattern recognitions Cameras in current hardware are well equipped to take high quality 2D images. However, they are still quite weak when it comes to identifying 3D images. One possible solution could be to use 2D QR and barcode as Augmented Reality markers. GPS faults Current digital devices can detect readings up to six metres away, quite enough for digital maps and navigation systems. However, GPS tracking can impact the AR software performance if the AR markers installed in the phones are not big enough. Integration and security issues Current web application designs restrict AR browsers to integrate their functions into social media platforms. AR solutions are still susceptible to data leaks and software is incapable of preventing hackers from invading the personal information of users. One possible solution, however, would be to use strong AR frameworks in the first place. Lack of multi-user experience AR solutions developed for digital devices are incapable of providing a multi-user experience, with apps being limited to single users. Therefore, ARToolkits need to develop libraries that allow multi-user software to be built. Google AR Experiments - Hidden World. Reveal an animated world at your feet. By Rachel Park Goto & Jane Friedhoff hedgehoglab.com 10
11 How does the future look for ARToolKits? With the current US$ 2bn market expected to grow around 30 times in 5-6 years the future certainly looks bright. Hardware improvements in digital devices combined with rapid strides in computer graphic development and UI design will also boost the growth of the sector. Development of non-invasive markerless technology is certainly set to disrupt the field, taking over marker-based technology and opening new avenues in areas like entertainment and commerce. The different ARToolKits discussed in this white paper offer various features - and a wide range of possibilities. As toolkits become better, they will provide an even wider range of options for developers looking to create world-class apps. A quantum leap in AR technology is certainly on the anvil, as the ARToolKit libraries present great opportunities for the prominent platforms like ios and Android. hedgehog lab AR projects Northumbria Water - read more. Road Respect - read more. Microsoft and Zero Carbon Futures - read more hedgehoglab.com 11
12 October 2017 References augmented_reality#see-also download?doi= &rep=rep1&type=pdf augmented_reality Phone_Note_rev3.pdf Blog references About us hedgehog lab is a global software consultancy that specialises in multiplatform software and connected device innovation. We architect, design, develop, and market apps, augmented reality, virtual reality, mixed reality & other digital solutions for phones, tablets, TV, kiosks & other post-pc devices. We help brands & enterprises prepare for a future dominated by post-pc technologies. We specialise in working with our clients on Innovation & R&D on mobile & emerging platforms. Founded as a pure play post-pc consultancy in 2010, and with offices in London, Newcastle Upon Tyne, Boston, Austin, India & Copenhagen, hedgehog lab has a team that is growing rapidly by focusing on delivering great post-pc experiences and campaigns to clients across the UK & abroad. hedgehog lab has architected and developed mobile solutions and software for clients like News International, Channel 4, Financial Times, Booths, Societe Bic, East Coast Trains, AkzoNobel, B&M, Mitsubishi, CBRE, England Rugby, NESN, Northumbrian Water, Camping and Caravanning Club, HULT, Thinking Digital and Grainger plc. With smartphone sales accelerating at a rapid pace and tablet technologies being spear-headed by the ipad, we have bet our future on a completely post-pc world where mobile devices, smart connected devices and touch screen technologies out-pace fixed desktop PC devices. We are one of the leading smart phone & tablet application developers in our region, working with cutting-edge mobile platforms like the ios, tvos, WatchOS, Android, Augmented Reality and Virtual Reality. w: hedgehoglab.com e: Newcastle, UK Generator Studios, Trafalgar Street, Newcastle upon Tyne, NE1 2LA London, UK Corsham Street, London, N1 6DR Boston, USA 15th Floor, 50 Milk Street, Boston, MA, Austin, USA 600 Congress Avenue, 14th Floor, Austin, TX, Copenhagen, Denmark Hejrevej 30, 2400 Nørrebro, Copenhagen, India Unit 301 Maple Celestia, Plot 49 Jayabheri Enclave, Gachibowli, Hyderabad, Telangana t: t: t: t: t: t:
Apple ARKit Overview. 1. Purpose. 2. Apple ARKit. 2.1 Overview. 2.2 Functions
Apple ARKit Overview 1. Purpose In the 2017 Apple Worldwide Developers Conference, Apple announced a tool called ARKit, which provides advanced augmented reality capabilities on ios. Augmented reality
More informationEnhancing Shipboard Maintenance with Augmented Reality
Enhancing Shipboard Maintenance with Augmented Reality CACI Oxnard, CA Dennis Giannoni dgiannoni@caci.com (805) 288-6630 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED. Agenda Virtual
More informationInterior Design with Augmented Reality
Interior Design with Augmented Reality Ananda Poudel and Omar Al-Azzam Department of Computer Science and Information Technology Saint Cloud State University Saint Cloud, MN, 56301 {apoudel, oalazzam}@stcloudstate.edu
More informationWhat is Augmented Reality?
What is Augmented Reality? Well, this is clearly a good place to start. I ll explain what Augmented Reality (AR) is, and then what the typical applications are. We re going to concentrate on only one area
More informationInterior Design using Augmented Reality Environment
Interior Design using Augmented Reality Environment Kalyani Pampattiwar 2, Akshay Adiyodi 1, Manasvini Agrahara 1, Pankaj Gamnani 1 Assistant Professor, Department of Computer Engineering, SIES Graduate
More informationDESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY
DESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY 1 RAJU RATHOD, 2 GEORGE PHILIP.C, 3 VIJAY KUMAR B.P 1,2,3 MSRIT Bangalore Abstract- To ensure the best place, position,
More informationREPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism
REPORT ON THE CURRENT STATE OF FOR DESIGN XL: Experiments in Landscape and Urbanism This report was produced by XL: Experiments in Landscape and Urbanism, SWA Group s innovation lab. It began as an internal
More informationJob Description. Commitment: Must be available to work full-time hours, M-F for weeks beginning Summer of 2018.
Research Intern Director of Research We are seeking a summer intern to support the team to develop prototype 3D sensing systems based on state-of-the-art sensing technologies along with computer vision
More informationRoadblocks for building mobile AR apps
Roadblocks for building mobile AR apps Jens de Smit, Layar (jens@layar.com) Ronald van der Lingen, Layar (ronald@layar.com) Abstract At Layar we have been developing our reality browser since 2009. Our
More informationA SURVEY OF MOBILE APPLICATION USING AUGMENTED REALITY
Volume 117 No. 22 2017, 209-213 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu A SURVEY OF MOBILE APPLICATION USING AUGMENTED REALITY Mrs.S.Hemamalini
More informationAugmented Reality And Ubiquitous Computing using HCI
Augmented Reality And Ubiquitous Computing using HCI Ashmit Kolli MS in Data Science Michigan Technological University CS5760 Topic Assignment 2 akolli@mtu.edu Abstract : Direct use of the hand as an input
More informationA Digital Reality Daniel Gilyana & Arielle Pineda
A Digital Reality Daniel Gilyana & Arielle Pineda Are you really using your iphone to its full potential? A New Reality Daniel Gilyana & Arielle Pineda Augmented reality allows us to see a window to an
More informationAugmented and Virtual Reality
CS-3120 Human-Computer Interaction Augmented and Virtual Reality Mikko Kytö 7.11.2017 From Real to Virtual [1] Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS
More informationHead Tracking for Google Cardboard by Simond Lee
Head Tracking for Google Cardboard by Simond Lee (slee74@student.monash.edu) Virtual Reality Through Head-mounted Displays A head-mounted display (HMD) is a device which is worn on the head with screen
More informationCONTENT RICH INTERACTIVE, AND IMMERSIVE EXPERIENCES, IN ADVERTISING, MARKETING, AND EDUCATION
CONTENT RICH INTERACTIVE, AND IMMERSIVE EXPERIENCES, IN ADVERTISING, MARKETING, AND EDUCATION USA 212.483.0043 info@uvph.com WORLDWIDE hello@appshaker.eu DIGITAL STORYTELLING BY HARNESSING FUTURE TECHNOLOGY,
More informationSMART GUIDE FOR AR TOYS AND GAMES
SMART GUIDE FOR AR TOYS AND GAMES Table of contents: WHAT IS AUGMENTED REALITY? 3 AR HORIZONS 4 WHERE IS AR CURRENTLY USED THE MOST (INDUSTRIES AND PRODUCTS)? 7 AR AND CHILDREN 9 WHAT KINDS OF TOYS ARE
More informationVisualizing the future of field service
Visualizing the future of field service Wearables, drones, augmented reality, and other emerging technology Humans are predisposed to think about how amazing and different the future will be. Consider
More informationIntroduction to Virtual Reality (based on a talk by Bill Mark)
Introduction to Virtual Reality (based on a talk by Bill Mark) I will talk about... Why do we want Virtual Reality? What is needed for a VR system? Examples of VR systems Research problems in VR Most Computers
More informationMobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt
Mobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt alexey.rybakov@dataart.com Agenda 1. XR/AR/MR/MR/VR/MVR? 2. Mobile Hardware 3. SDK/Tools/Development
More informationINTERIOR DESIGN USING AUGMENTED REALITY
INTERIOR DESIGN USING AUGMENTED REALITY Ms. Tanmayi Samant 1, Ms. Shreya Vartak 2 1,2Student, Department of Computer Engineering DJ Sanghvi College of Engineeing, Vile Parle, Mumbai-400056 Maharashtra
More informationLOOKING AHEAD: UE4 VR Roadmap. Nick Whiting Technical Director VR / AR
LOOKING AHEAD: UE4 VR Roadmap Nick Whiting Technical Director VR / AR HEADLINE AND IMAGE LAYOUT RECENT DEVELOPMENTS RECENT DEVELOPMENTS At Epic, we drive our engine development by creating content. We
More informationOculus Rift Development Kit 2
Oculus Rift Development Kit 2 Sam Clow TWR 2009 11/24/2014 Executive Summary This document will introduce developers to the Oculus Rift Development Kit 2. It is clear that virtual reality is the future
More informationRealizing Augmented Reality
Realizing Augmented Reality By Amit Kore, Rahul Lanje and Raghu Burra Atos Syntel 1 Introduction Virtual Reality (VR) and Augmented Reality (AR) have been around for some time but there is renewed excitement,
More informationAbout Us and Our Expertise :
About Us and Our Expertise : Must Play Games is a leading game and application studio based in Hyderabad, India established in 2012 with a notion to develop fun to play unique games and world class applications
More informationAugmented Reality Uses in Interior Design
Informatica Economică, vol. 22, no. 3/2018 5 Augmented Reality Uses in Interior Design Mihai SANDU, Ileana Simona SCARLAT Bucharest University of Economic Studies, Romania sandumihai123@gmail.com, simonascarlat6@gmail.com
More informationBoBoiBoy Interactive Holographic Action Card Game Application
UTM Computing Proceedings Innovations in Computing Technology and Applications Volume 2 Year: 2017 ISBN: 978-967-0194-95-0 1 BoBoiBoy Interactive Holographic Action Card Game Application Chan Vei Siang
More informationFig.1 AR as mixed reality[3]
Marker Based Augmented Reality Application in Education: Teaching and Learning Gayathri D 1, Om Kumar S 2, Sunitha Ram C 3 1,3 Research Scholar, CSE Department, SCSVMV University 2 Associate Professor,
More informationAugmented Reality in Transportation Construction
September 2018 Augmented Reality in Transportation Construction FHWA Contract DTFH6117C00027: LEVERAGING AUGMENTED REALITY FOR HIGHWAY CONSTRUCTION Hoda Azari, Nondestructive Evaluation Research Program
More informationimmersive visualization workflow
5 essential benefits of a BIM to immersive visualization workflow EBOOK 1 Building Information Modeling (BIM) has transformed the way architects design buildings. Information-rich 3D models allow architects
More informationpreface Motivation Figure 1. Reality-virtuality continuum (Milgram & Kishino, 1994) Mixed.Reality Augmented. Virtuality Real...
v preface Motivation Augmented reality (AR) research aims to develop technologies that allow the real-time fusion of computer-generated digital content with the real world. Unlike virtual reality (VR)
More informationYOUR PRODUCT IN 3D. Scan and present in Virtual Reality, Augmented Reality, 3D. SCANBLUE.COM
YOUR PRODUCT IN 3D Scan and present in Virtual Reality, Augmented Reality, 3D. SCANBLUE.COM Foreword Dear customers, for two decades I have been pursuing the vision of bringing the third dimension to the
More informationAbout us. What we do at Envrmnt
W W W. E N V R M N T. C O M 1 About us What we do at Envrmnt 3 The Envrmnt team includes over 120 employees with expertise across AR/VR technology: Hardware & software development 2D/3D design Creative
More informationOpen-source AR platform for the future
DAQRI ARToolKit 6/Open Source Open-source AR platform for the future Phil Oxford Brookes University 2017-01 ARToolKit 6: Future AR platform Tools Frameworks Tracking and localisation Tangible user interaction
More informationMixed / Augmented Reality in Action
Mixed / Augmented Reality in Action AR: Augmented Reality Augmented reality (AR) takes your existing reality and changes aspects of it through the lens of a smartphone, a set of glasses, or even a headset.
More informationPortfolio. Swaroop Kumar Pal swarooppal.wordpress.com github.com/swarooppal1088
Portfolio About Me: I am a Computer Science graduate student at The University of Texas at Dallas. I am currently working as Augmented Reality Engineer at Aireal, Dallas and also as a Graduate Researcher
More informationglossary of terms Helping demystify the word soup of AR, VR and MR
glossary of terms Helping demystify the word soup of AR, VR and MR Zappar Ltd. 2017 Contents Objective 2 Types of Reality 3 AR Tools 5 AR Elements / Assets 7 Computer Vision and Mobile App Terminology
More informationIndustrial AR Technology Opportunities and Challenges
Industrial AR Technology Opportunities and Challenges Charles Woodward, VTT Augmented Reality Industrial Reality VTT Research Seminar, 22 March 2018 AR/VR Markets Market predictions According to Digi-Capital,
More informationVirtual Reality in E-Learning Redefining the Learning Experience
Virtual Reality in E-Learning Redefining the Learning Experience A Whitepaper by RapidValue Solutions Contents Executive Summary... Use Cases and Benefits of Virtual Reality in elearning... Use Cases...
More informationReVRSR: Remote Virtual Reality for Service Robots
ReVRSR: Remote Virtual Reality for Service Robots Amel Hassan, Ahmed Ehab Gado, Faizan Muhammad March 17, 2018 Abstract This project aims to bring a service robot s perspective to a human user. We believe
More informationThe augmented world of tomorrow
The augmented world of tomorrow a futuristic mix of design and reality Research report By Dennis Dilweg Course: Seminar - DREAM DISCOVER DO Student number: 1623130 Specialisation: Visual Design (English)
More informationLearning Media Based on Augmented Reality Applied on the Lesson of Electrical Network Protection System
IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Learning Media Based on Augmented Reality Applied on the Lesson of Electrical Network Protection System To cite this article:
More informationVirtual Environments. Ruth Aylett
Virtual Environments Ruth Aylett Aims of the course 1. To demonstrate a critical understanding of modern VE systems, evaluating the strengths and weaknesses of the current VR technologies 2. To be able
More informationExploring Virtual Reality (VR) with ArcGIS. Euan Cameron Simon Haegler Mark Baird
Exploring Virtual Reality (VR) with ArcGIS Euan Cameron Simon Haegler Mark Baird Agenda Introduction & Terminology Application & Market Potential Mobile VR with ArcGIS 360VR Desktop VR with CityEngine
More informationAugmented Reality. ARC Industry Forum Orlando February Will Hastings Analyst ARC Advisory Group
Augmented Reality ARC Industry Forum Orlando February 2017 Will Hastings Analyst ARC Advisory Group whastings@arcweb.com Agenda Digital Enterprise: Set the stage Augmented Reality vs. Virtual Reality Industry
More informationA Quick Guide to ios 12 s New Measure App
A Quick Guide to ios 12 s New Measure App Steve Sande For the past several years, Apple has been talking about AR augmented reality a lot. The company believes that augmented reality, which involves overlaying
More informationAbout us. What we do at Envrmnt
W W W. E N V R M N T. C O M 1 About us What we do at Envrmnt 3 The Envrmnt team includes over 120 employees with expertise across AR/VR technology: Hardware & software development 2D/3D design Creative
More informationAugmented Presentation of Animal and Environmental Data
Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of Osnabrueck Christian Plass and Manfred Ehlers Institute for Geoinformatics and Remote Sensing
More informationEnhanced Virtual Transparency in Handheld AR: Digital Magnifying Glass
Enhanced Virtual Transparency in Handheld AR: Digital Magnifying Glass Klen Čopič Pucihar School of Computing and Communications Lancaster University Lancaster, UK LA1 4YW k.copicpuc@lancaster.ac.uk Paul
More informationImmersive Training. David Lafferty President of Scientific Technical Services And ARC Associate
Immersive Training David Lafferty President of Scientific Technical Services And ARC Associate Current Situation Great Shift Change Drive The Need For Training Conventional Training Methods Are Expensive
More informationUSTGlobal. VIRTUAL AND AUGMENTED REALITY Ideas for the Future - Retail Industry
USTGlobal VIRTUAL AND AUGMENTED REALITY Ideas for the Future - Retail Industry UST Global Inc, August 2017 Table of Contents Introduction 3 Focus on Shopping Experience 3 What we can do at UST Global 4
More informationAerospace Sensor Suite
Aerospace Sensor Suite ECE 1778 Creative Applications for Mobile Devices Final Report prepared for Dr. Jonathon Rose April 12 th 2011 Word count: 2351 + 490 (Apper Context) Jin Hyouk (Paul) Choi: 998495640
More informationVR/AR Concepts in Architecture And Available Tools
VR/AR Concepts in Architecture And Available Tools Peter Kán Interactive Media Systems Group Institute of Software Technology and Interactive Systems TU Wien Outline 1. What can you do with virtual reality
More informationImplementation of Augmented Reality System for Smartphone Advertisements
, pp.385-392 http://dx.doi.org/10.14257/ijmue.2014.9.2.39 Implementation of Augmented Reality System for Smartphone Advertisements Young-geun Kim and Won-jung Kim Department of Computer Science Sunchon
More informationTeam 4. Kari Cieslak, Jakob Wulf-Eck, Austin Irvine, Alex Crane, Dylan Vondracek. Project SoundAround
Team 4 Kari Cieslak, Jakob Wulf-Eck, Austin Irvine, Alex Crane, Dylan Vondracek Project SoundAround Contents 1. Contents, Figures 2. Synopsis, Description 3. Milestones 4. Budget/Materials 5. Work Plan,
More informationChapter 1 - Introduction
1 "We all agree that your theory is crazy, but is it crazy enough?" Niels Bohr (1885-1962) Chapter 1 - Introduction Augmented reality (AR) is the registration of projected computer-generated images over
More informationVR/AR with ArcGIS. Pascal Mueller, Rex Hansen, Eric Wittner & Adrien Meriaux
VR/AR with ArcGIS Pascal Mueller, Rex Hansen, Eric Wittner & Adrien Meriaux Agenda Introduction & Terminology Pascal Mobile VR with ArcGIS 360VR Eric Premium VR with CityEngine & Game Engines Pascal Dedicated
More informationGlobal Virtual Reality Market: Industry Analysis & Outlook ( )
Industry Research by Koncept Analytics Global Virtual Reality Market: Industry Analysis & Outlook ----------------------------------------- (2017-2021) October 2017 1 Executive Summary Virtual Reality
More informationINFORMATION DECK 2018
INFORMATION DECK 2018 COMPANY MISSION VRee platform facilitates multi-user full body VR applications for: Gaming & esports Training & Simulation Design & Testing - Software development kit to create high
More information6Visionaut visualization technologies SIMPLE PROPOSAL 3D SCANNING
6Visionaut visualization technologies 3D SCANNING Visionaut visualization technologies7 3D VIRTUAL TOUR Navigate within our 3D models, it is an unique experience. They are not 360 panoramic tours. You
More informationFuture Directions for Augmented Reality. Mark Billinghurst
Future Directions for Augmented Reality Mark Billinghurst 1968 Sutherland/Sproull s HMD https://www.youtube.com/watch?v=ntwzxgprxag Star Wars - 1977 Augmented Reality Combines Real and Virtual Images Both
More informationThe Holographic Human for surgical navigation using Microsoft HoloLens
EPiC Series in Engineering Volume 1, 2018, Pages 26 30 ReVo 2017: Laval Virtual ReVolution 2017 Transhumanism++ Engineering The Holographic Human for surgical navigation using Microsoft HoloLens Tomoki
More informationMarket Snapshot: Consumer Strategies and Use Cases for Virtual and Augmented Reality
Market Snapshot: Consumer Strategies and Use Cases for Virtual and Augmented A Parks Associates Snapshot Virtual Snapshot Companies in connected CE and the entertainment IoT space are watching the emergence
More informationLearning Based Interface Modeling using Augmented Reality
Learning Based Interface Modeling using Augmented Reality Akshay Indalkar 1, Akshay Gunjal 2, Mihir Ashok Dalal 3, Nikhil Sharma 4 1 Student, Department of Computer Engineering, Smt. Kashibai Navale College
More informationVIRTUAL AND AUGMENTED REALITY IN AUTOMOTIVE
VIRTUAL AND AUGMENTED REALITY IN AUTOMOTIVE IMMERSIVE TECHNOLOGIES WILL FORM THE NEXT WAVE OF DIGITAL DISRUPTION AR / VR / MR IF WE CONCLUDE FROM THE PAST, IMMERSIVE TECHNOLOGIES WILL REWRITE THE RULES
More informationAdmin. Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR
HCI and Design Admin Reminder: Assignment 4 Due Thursday before class Questions? Today: Designing for Virtual Reality VR and 3D interfaces Interaction design for VR Prototyping for VR 3D Interfaces We
More informationDepartment of Computer Science and Engineering The Chinese University of Hong Kong. Year Final Year Project
Digital Interactive Game Interface Table Apps for ipad Supervised by: Professor Michael R. Lyu Student: Ng Ka Hung (1009615714) Chan Hing Faat (1009618344) Year 2011 2012 Final Year Project Department
More informationAugmented Reality Lecture notes 01 1
IntroductiontoAugmentedReality Lecture notes 01 1 Definition Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated
More informationAugmented and Virtual Reality
Digital Transformation Monitor Augmented and Virtual Reality October 2017 Internal Market, Industry, Entrepreneurship and SMEs 7 Augmented and Virtual Reality Rapid technological progress in the areas
More informationAugmented Reality Application for Training in Maritime Operations
Faculty of Engineering Science and Technology Department of Computer Science and Computational Engineering Augmented Reality Application for Training in Maritime Operations A Proof of Concept AR Application
More informationAR 2 kanoid: Augmented Reality ARkanoid
AR 2 kanoid: Augmented Reality ARkanoid B. Smith and R. Gosine C-CORE and Memorial University of Newfoundland Abstract AR 2 kanoid, Augmented Reality ARkanoid, is an augmented reality version of the popular
More informationAdvances In Natural And Applied Sciences 2018 April; 12(4): pages DOI: /anas
Research Article Advances In Natural And Applied Sciences 2018 April; 12(4): pages 22-26 DOI: 10.22587/anas.2018.12.4.5 AENSI Publications Implementation of Chemical Reaction Based on Augmented Reality
More informationMarco Cavallo. Merging Worlds: A Location-based Approach to Mixed Reality. Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO
Marco Cavallo Merging Worlds: A Location-based Approach to Mixed Reality Marco Cavallo Master Thesis Presentation POLITECNICO DI MILANO Introduction: A New Realm of Reality 2 http://www.samsung.com/sg/wearables/gear-vr/
More informationThe development of a virtual laboratory based on Unreal Engine 4
The development of a virtual laboratory based on Unreal Engine 4 D A Sheverev 1 and I N Kozlova 1 1 Samara National Research University, Moskovskoye shosse 34А, Samara, Russia, 443086 Abstract. In our
More informationCREATING TOMORROW S SOLUTIONS INNOVATIONS IN CUSTOMER COMMUNICATION. Technologies of the Future Today
CREATING TOMORROW S SOLUTIONS INNOVATIONS IN CUSTOMER COMMUNICATION Technologies of the Future Today AR Augmented reality enhances the world around us like a window to another reality. AR is based on a
More informationTransforming Industries with Enlighten
Transforming Industries with Enlighten Alex Shang Senior Business Development Manager ARM Tech Forum 2016 Korea June 28, 2016 2 ARM: The Architecture for the Digital World ARM is about transforming markets
More informationMulti-Modal User Interaction
Multi-Modal User Interaction Lecture 4: Multiple Modalities Zheng-Hua Tan Department of Electronic Systems Aalborg University, Denmark zt@es.aau.dk MMUI, IV, Zheng-Hua Tan 1 Outline Multimodal interface
More informationCourier Drop - An Action Sandbox Game. CLJ Industries
Courier Drop - An Action Sandbox Game CLJ Industries Team Chris Eidsmoe Liyuan Chen JD Peak Background Augmented reality is a nascent field but has many useful applications Games (Pokemon Go, Ingress,
More informationBring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events
Bring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events 2017 Freeman. All Rights Reserved. 2 The explosive development of virtual reality (VR) technology in recent
More informationPROPOSED SYSTEM FOR MID-AIR HOLOGRAPHY PROJECTION USING CONVERSION OF 2D TO 3D VISUALIZATION
International Journal of Advanced Research in Engineering and Technology (IJARET) Volume 7, Issue 2, March-April 2016, pp. 159 167, Article ID: IJARET_07_02_015 Available online at http://www.iaeme.com/ijaret/issues.asp?jtype=ijaret&vtype=7&itype=2
More informationChapter 1 Virtual World Fundamentals
Chapter 1 Virtual World Fundamentals 1.0 What Is A Virtual World? {Definition} Virtual: to exist in effect, though not in actual fact. You are probably familiar with arcade games such as pinball and target
More informationEnSight in Virtual and Mixed Reality Environments
CEI 2015 User Group Meeting EnSight in Virtual and Mixed Reality Environments VR Hardware that works with EnSight Canon MR Oculus Rift Cave Power Wall Canon MR MR means Mixed Reality User looks through
More informationHOLO-BOARD: AN AUGMENTED REALITY APPLICATION MANAGER SUPPORTING MACHINE VISION
Technical University of Crete School of Electrician and Computer Engineering HOLO-BOARD: AN AUGMENTED REALITY APPLICATION MANAGER SUPPORTING MACHINE VISION Committee: Author: Daskalogrigorakis A. Grigorios
More informationIndoor Floorplan with WiFi Coverage Map Android Application
Indoor Floorplan with WiFi Coverage Map Android Application Zeying Xin Electrical Engineering and Computer Sciences University of California at Berkeley Technical Report No. UCB/EECS-2013-114 http://www.eecs.berkeley.edu/pubs/techrpts/2013/eecs-2013-114.html
More informationDALE KELLER, P.E. ASSHTO COD JUNE 14, 2018 NEVADA DOT
Interactive Visualization DALE KELLER, P.E. ASSHTO COD JUNE 14, 2018 NEVADA DOT 1 Interactive Visualization AII Overview The AASHTO Innovation Initiative (AII) advances innovation from the grassroots up:
More informationToward an Augmented Reality System for Violin Learning Support
Toward an Augmented Reality System for Violin Learning Support Hiroyuki Shiino, François de Sorbier, and Hideo Saito Graduate School of Science and Technology, Keio University, Yokohama, Japan {shiino,fdesorbi,saito}@hvrl.ics.keio.ac.jp
More informationNatural Gesture Based Interaction for Handheld Augmented Reality
Natural Gesture Based Interaction for Handheld Augmented Reality A thesis submitted in partial fulfilment of the requirements for the Degree of Master of Science in Computer Science By Lei Gao Supervisors:
More informationAugmented reality, ARToolKit, Computer vision, Image processing.
Academic Journal of Science, CD-ROM. ISSN: 2165-6282 :: 03(02):139 146 (2014) Augmented Reality (AR) is a technology that gained popularity in recent years. It is defined as placement of virtual images
More informationRestricted Siemens AG 2017 Realize innovation.
Virtual Reality Kilian Knoll, Siemens PLM Realize innovation. Agenda AR-VR Background Market Environment Use Cases Teamcenter Visualization Capabilities Data Privacy a reminder Demo Page 2 AR-VR - Background
More informationISCW 2001 Tutorial. An Introduction to Augmented Reality
ISCW 2001 Tutorial An Introduction to Augmented Reality Mark Billinghurst Human Interface Technology Laboratory University of Washington, Seattle grof@hitl.washington.edu Dieter Schmalstieg Technical University
More informationThe Essential Eight technologies Augmented and virtual reality
The Essential Eight technologies Augmented and virtual reality Augmented and virtual reality are no longer figments of the futuristic mind. They re transforming how some companies do business. What should
More informationDevelopment and Deployment of Embedded Vision in Industry: An Update. Jeff Bier, Founder, Embedded Vision Alliance / President, BDTI
Development and Deployment of Embedded Vision in Industry: An Update Jeff Bier, Founder, Embedded Vision Alliance / President, BDTI NIWeek August 7, 2013 The Big Picture Computer vision is crossing the
More informationA Modular Approach to the Development of Interactive Augmented Reality Applications.
Western University Scholarship@Western Electronic Thesis and Dissertation Repository December 2013 A Modular Approach to the Development of Interactive Augmented Reality Applications. Nelson J. Andre The
More informationAdvancements in Gesture Recognition Technology
IOSR Journal of VLSI and Signal Processing (IOSR-JVSP) Volume 4, Issue 4, Ver. I (Jul-Aug. 2014), PP 01-07 e-issn: 2319 4200, p-issn No. : 2319 4197 Advancements in Gesture Recognition Technology 1 Poluka
More informationVirtual Reality in Plant Design and Operations
Virtual Reality in Plant Design and Operations Peter Richmond Schneider Electric Software EYESIM Product Manager Peter.richmond@schneider-electric.com Is 2016 the year of VR? If the buzz and excitement
More informationISO JTC 1 SC 24 WG9 G E R A R D J. K I M K O R E A U N I V E R S I T Y
New Work Item Proposal: A Standard Reference Model for Generic MAR Systems ISO JTC 1 SC 24 WG9 G E R A R D J. K I M K O R E A U N I V E R S I T Y What is a Reference Model? A reference model (for a given
More informationWaves Nx VIRTUAL REALITY AUDIO
Waves Nx VIRTUAL REALITY AUDIO WAVES VIRTUAL REALITY AUDIO THE FUTURE OF AUDIO REPRODUCTION AND CREATION Today s entertainment is on a mission to recreate the real world. Just as VR makes us feel like
More informationSPIDERMAN VR. Adam Elgressy and Dmitry Vlasenko
SPIDERMAN VR Adam Elgressy and Dmitry Vlasenko Supervisors: Boaz Sternfeld and Yaron Honen Submission Date: 09/01/2019 Contents Who We Are:... 2 Abstract:... 2 Previous Work:... 3 Tangent Systems & Development
More informationComputer simulator for training operators of thermal cameras
Computer simulator for training operators of thermal cameras Krzysztof Chrzanowski *, Marcin Krupski The Academy of Humanities and Economics, Department of Computer Science, Lodz, Poland ABSTRACT A PC-based
More informationExploring Geoscience with AR/VR Technologies
Exploring Geoscience with AR/VR Technologies Tim Scheitlin Computational & Information Systems Laboratory (CISL), National Center for Atmospheric Research (NCAR), Boulder, Colorado, USA Using ECMWF's Forecasts
More information제 1 HCI Korea, 증강현실전시기술의적용사례및분석. Woontack Woo ( 우운택 ), Ph.D. KAIST GSCT UVR Lab. Tw
제 1 회전시공학워크샵 @ HCI Korea, 2013.2.1 증강현실전시기술의적용사례및분석 Woontack Woo ( 우운택 ), Ph.D. KAIST GSCT UVR Lab. Tw : @wwoo_ct FB: @wtwoo Virtual vs. Augmented Reality Virtual Reality (out there): Puts people in a
More information