Head Tracking for Google Cardboard by Simond Lee
|
|
- Angela Craig
- 5 years ago
- Views:
Transcription
1 Head Tracking for Google Cardboard by Simond Lee Virtual Reality Through Head-mounted Displays A head-mounted display (HMD) is a device which is worn on the head with screen displays in front of the user s eyes. It is hardware that can take someone into an immersive environment called virtual reality (VR). In 2012 a company named Oculus VR successfully received $2.4 million via crowdfunding (Oculus Rift: Step Into, n.d.) to produce a HMD called the Oculus Rift (Rift) that would provide VR using stereoscopic vision (figure 1). Stereoscopy is the illusion of depth by providing each eye different corresponding images. VR provided by HMD has been a popular idea and goal for a long time, appearing in films such as the 1983 Brainstorm (Passafiume, n.d.). However, technology was not ready to serve the idea until recently and after the release of Rift development kits to the public, many companies have raced to release their own VR HMDs. Google Cardboard (Cardboard) (figure 2) is a cardboard foldout with focal lenses that turns a mobile phone into a cheap accessible VR HMD (Cardboard, n.d.). Figure 1 Oculus Rift Development Kit 2. From File:Oculus Rift, (n.d.) Figure 2 Google Cardboard. From Cardboard (n.d.) Head Tracking The Rift has a head tracking system that offers six degrees of freedom (6DoF) (figure 3) and the latency is good enough that it can offer a convincing VR environment. However, it requires a computer to run simulations and it is tethered to it - this limits the physical movements of the user. Cardboard has no such physical limitations because it is running software on the phone. Unfortunately, Cardboard does not offer 6DoF because it cannot track the position (translation) of the phone (up-down, left-right and backforward). Figure 3 The six degrees of freedom. From File:6DOF en.jpg (n.d.) The use of fiducial markers is a common technique for head tracking. The most popular type of markers are QR codes and these are used for the implementation of augmented reality (AR). AR is the augmentation of the real-world, achieved by modifying the view of reality with a computer.
2 Figure 4 displays an example of achieving AR and is a screenshot of the user s view observing a marker modified by AR software. The Project Figure 4 Screenshot using AR software. From ARToolKit Documentation (n.d.) The goal of the project is to add head positional tracking for Cardboard software with the support of AR fiducial markers. Although the Cardboard software development kit (SDK) has a trackposition property, the effect is virtually minimal. The SDK mainly uses the phone s gyroscope to track head rotation. The gyroscope works great for tracking head rotation, although the biggest limitation is that the phone can have drift problems. Drift problems are most obvious when the user is stationary. The SDK has a drift correction setting, however the problem is not entirely eliminated. Integrating AR into Cardboard involves using the phone s camera to point at a special marker and set an object relative to the marker s position on the screen. Figure 5 demonstrates the setup of Cardboard pointing at a single marker. The tracking data from the AR can be applied to the translation of an object. ARToolKit, an open source tracking library will be used to integrate AR. Figure 6 is an example of a pattern marker supplied by ARToolKit that is printed on paper. An ARToolKit package for Unity, a cross-platform game engine, is available to add AR functionality to applications. C# is the language used for scripting in Unity. Figure 5 Google Cardboard integrating AR for head tracking Figure 6 Pattern marker. From Download ARToolKit (n.d.)
3 Marker setup The location of markers determines the software logic of the tracker. There are two main approaches: outside-looking-in and inside-looking-out. Figure 7 illustrates these two setups. Figure 7 Head tracking setups. From Welch, et al. (2001) We will attempt to replicate the two setups in Unity applications. Examples of Integrating AR for Head Tracking AR tracking with markers is a cheap way to test tracking software and has been used in prototypes by companies. StarVR, a HMD by Starbreeze, uses the outside-in method (figure 8). Valve Corporation has a room where there are many markers on the walls using the inside-out method (figure 9). Figure 8 StarVR HMD. From StarVR (2015) Figure 9 SteamVR room. From Speculation: HTC Vive's (2015)
4 Outside-Looking-In (Outside-In) Outside-in requires placing markers on the cardboard itself, attaching an external camera to the phone and pointing at the markers. It is called outside-in because the tracking device (camera) is placed on a location external to the HMD and tracks location by looking into the HMD. ARToolKit includes a configuration for a simple cube marker that has markers on the outside layers (figure 10). Markers are placed on the sides of the cardboard one on the front, two on the sides and two above and beneath. The camera tracks the markers as the user rotates and moves their head. Figure 10 A cube with markers The camera can be either attached with a USB On- The-Go cable or WiFi/Bluetooth by having the camera connected to a computer and the phone communicating to it - using WiFi/Bluetooth introduces wireless latency. Utilising the cube marker requires inversing translations up-down, and the rotations pitch and yaw. A similar system is used by the Oculus Rift an external camera tracks installed LEDs installed on the Rift. The camera only needs to find one of the markers to track the head. Inside-Looking-Out (Inside-Out) Inside-out involves using the phone s rear camera and pointing at markers placed on the wall or surface. It is the most direct method to integrate AR for head tracking. It is called inside-out because the tracking device is placed on the HMD and tracks location by looking out. Markers are either placed flat on a surface or hanging on the wall having the markers directly facing the user (figure 5). In the spirit of Cardboard - cheap accessible VR - this option will be explored most and applied. The only extra resource this setup requires is to print markers on paper. Limitations ARToolKit uses and provides different types of marker tracking. Traditional makers use contrasting black and white patterns, enclosed in a black square. Custom markers can be made and used, the constraint is it must be in black and white. Barcode markers (figure 11) are similar to pattern markers (figure 6), the difference is the pattern is predetermined black and white squares in a regular matrix (Using 2D Barcode, n.d.). Barcode marker recognition have a complexity of constant time, so adding multiple barcode markers requires little computational costs. The less complicated a pattern, the better range of tracking is available (About Traditional, n.d.) Barcode markers were mainly used in the research to test because anything that reduces CPU usage of the phone will be practical. Figure 11 Barcode marker. From Download ARToolKit (n.d.) Head tracking with the support of AR is able to track both rotation and translation. In practice, camera tracking requires certain conditions to work nicely lighting, movement and field of view not
5 exceeding camera capabilities. This is a problem of finesse and is a possible area of improvement. A possible solution is the idea of client-side prediction a network programming technique used in video games such as QuakeWorld (Client-side prediction, n.d.). Testing The main methods of testing are: Running test runs on Unity using an attached webcam, Deploying on Android and using the camera viewfinder on the screen to test AR tracking, Deploying the Cardboard SDK demo scene with AR functionality. The use of multiple markers requires them to be in predetermined fixed positions. Figure 12 is an example of a multi marker configuration. Multi-markers only require one marker to be in view for active tracking. The use of 8x6 multiple markers have not caused any CPU usage problems. Figure 13 illustrates the successful head tracking result of integrating AR tracking. The combination of using gyroscope and AR have been experimented. Two techniques are possible: Using gyroscope to track head rotation and AR to track head translation only. When markers are not visible to the camera, turn off AR tracking and use the gyroscope only. When a marker is visible, turn off gyroscope tracking and use AR to track both rotation and translation. Tests for both methods above have been successful - refinement is required to align the AR marker object positions with the default camera attached to the gyroscope. Using AR to track head translation only requires refinements also. The gyroscope provides very fast and accurate head rotation tracking, however its biggest disadvantage is that it introduces drift. Tracking with AR does not have this problem, but its constraints are related to the camera imaging variables. Figure 12 A multi-marker configuration. From Download ARToolKit (n.d.) Figure 13 Example application integrating AR for head tracking
6 Unity Implementation For the application, when a marker is in view the camera in Unity is setup to point relative to the marker s appearance in the real-world camera view (figure 14). Marker objects are reference points in Unity that display the relationship between the markers in Unity and the realworld. Figure 15 shows the Unity marker reference a square surrounding the cube marked as BARCODE0. For static scenes, for example, an application that allows a viewer to observe a 3D model, the user will only need to place the 3D object relative to the Unity marker - the marker object is in a fixed position. Figure 14 Unity editor - AR tracking Figure 15 Unity editor - AR marker object surrounding 3D cube Figure 16 shows a cube marker scene with a cube placed on one side. Gear VR Figure 16 Unity editor - AR cube marker objects with cube on one marker Oculus VR in collaboration with Samsung released Gear VR, a HMD designed specifically for its highend phones (figure 17). It adds touch input for navigation. VR-wise it is functionally the same as Cardboard and it also shares its limitations no positional head tracking. Figure 17 Gear VR. From Samsung Gear VR (n.d.)
7 To Be Solved Head tracking with fiducial markers, such as QR codes, for Google Cardboard works great (provided conditions are optimal) and can be cheap to setup, however setting up the markers and placing them on certain locations adds an extra installation step to VR. Initiatives for marker-less head tracking have been explored and the current well-known solution is Project Tango (Google s Project Tango, 2014). It is a project by Google for smartphones and tablets to support full head tracking by using a combination of a motion tracking camera and an integrated depth sensor (figure 18). Acknowledgements I want to thank my supervisors Dr. Maxime Cordeil and Dr. Karsten Klein, for their guidance and support. Without them, this report would not have been possible. Professor Jon McCormack, for his hospitality at sensilab, and Dr. Julian Garcia, for giving a first-year student the opportunity to undertake this research. References Figure 18 Project Tango design. From Google's Project Tango (2014) Oculus Rift: Step Into the Game. (n.d.). Retrieved October 23, 2015, from Cardboard Google Developers. (n.d.). Retrieved October 23, 2015, from Passafiume, A. (n.d.). Brainstorm. Retrieved October 23, 2015, from /Brainstorm.html ARToolKit Documentation (Tutorial 1: Tracking Stability). (n.d.). Retrieved October 23, 2015, from The world's most widely usedtracking library for augmented reality. (n.d.). Retrieved October 23, 2015, from Create and Connect with Unity 5. (n.d.). Retrieved October 23, 2015, from Download ARToolKit SDKs. (n.d.). Retrieved October 23, 2015, from Using 2D Barcode Markers. (n.d.). Retrieved October 23, 2015, from
8 About Traditional Template Marker Tracking. (n.d.). Retrieved October 23, 2015, from Welch, G., Bishop, G., Vicci, L., Brumback, S., Keller, K., & Colucci, D. N. (2001). High-performance wide-area optical tracking: The hiball tracking system. presence: teleoperators and virtual environments, 10(1), Client-side prediction. (n.d.). Retrieved October 23, 2015, from Speculation: HTC Vive's Tracking Uses Inivisible, Projected Markers for 360 Degree Inside-Out Tracking - Road to VR. (2015, March 2). Retrieved October 23, 2015, from degree-inside-out-tracking/ Step into the Rift. (n.d.). Retrieved October 23, 2015, from File:Oculus Rift development kit 2.jpg. (n.d.). Retrieved October 23, 2015, from Wheatstone, C. (1838). Contributions to the physiology of vision.--part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision. Philosophical transactions of the Royal Society of London, Craig, J. J. (1986). Introduction io Robotics, Mechanics and Control. File:6DOF en.jpg. (n.d.). Retrieved October 23, 2015, from Graham, M., Zook, M., & Boulton, A. (2013). Augmented reality in urban places: contested content and the duplicity of code. Transactions of the Institute of British Geographers, 38(3), Samsung Gear VR Browser - Pocket Lifestyle. (n.d.). Retrieved October 23, 2015, from StarVR 210-Degree VR Headset Receiving Tobii Eye-Tracking Support. (2015, September 24). Retrieved October 23, 2015, from Google's Project Tango is a smartphone with sensors to map the world around you. (2014, February 20). Retrieved October 23, 2015, from
HMD based VR Service Framework. July Web3D Consortium Kwan-Hee Yoo Chungbuk National University
HMD based VR Service Framework July 31 2017 Web3D Consortium Kwan-Hee Yoo Chungbuk National University khyoo@chungbuk.ac.kr What is Virtual Reality? Making an electronic world seem real and interactive
More informationBring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events
Bring Imagination to Life with Virtual Reality: Everything You Need to Know About VR for Events 2017 Freeman. All Rights Reserved. 2 The explosive development of virtual reality (VR) technology in recent
More informationREPORT ON THE CURRENT STATE OF FOR DESIGN. XL: Experiments in Landscape and Urbanism
REPORT ON THE CURRENT STATE OF FOR DESIGN XL: Experiments in Landscape and Urbanism This report was produced by XL: Experiments in Landscape and Urbanism, SWA Group s innovation lab. It began as an internal
More informationMobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt
Mobile Virtual Reality what is that and how it works? Alexey Rybakov, Senior Engineer, Technical Evangelist at DataArt alexey.rybakov@dataart.com Agenda 1. XR/AR/MR/MR/VR/MVR? 2. Mobile Hardware 3. SDK/Tools/Development
More informationImmersive Visualization On the Cheap. Amy Trost Data Services Librarian Universities at Shady Grove/UMD Libraries December 6, 2019
Immersive Visualization On the Cheap Amy Trost Data Services Librarian Universities at Shady Grove/UMD Libraries atrost1@umd.edu December 6, 2019 About Me About this Session Some of us have been lucky
More informationReVRSR: Remote Virtual Reality for Service Robots
ReVRSR: Remote Virtual Reality for Service Robots Amel Hassan, Ahmed Ehab Gado, Faizan Muhammad March 17, 2018 Abstract This project aims to bring a service robot s perspective to a human user. We believe
More informationLOOKING AHEAD: UE4 VR Roadmap. Nick Whiting Technical Director VR / AR
LOOKING AHEAD: UE4 VR Roadmap Nick Whiting Technical Director VR / AR HEADLINE AND IMAGE LAYOUT RECENT DEVELOPMENTS RECENT DEVELOPMENTS At Epic, we drive our engine development by creating content. We
More informationExploring Virtual Reality (VR) with ArcGIS. Euan Cameron Simon Haegler Mark Baird
Exploring Virtual Reality (VR) with ArcGIS Euan Cameron Simon Haegler Mark Baird Agenda Introduction & Terminology Application & Market Potential Mobile VR with ArcGIS 360VR Desktop VR with CityEngine
More informationA Guide to Virtual Reality for Social Good in the Classroom
A Guide to Virtual Reality for Social Good in the Classroom Welcome to the future, or the beginning of a future where many things are possible. Virtual Reality (VR) is a new tool that is being researched
More informationVR/AR Concepts in Architecture And Available Tools
VR/AR Concepts in Architecture And Available Tools Peter Kán Interactive Media Systems Group Institute of Software Technology and Interactive Systems TU Wien Outline 1. What can you do with virtual reality
More information1 Topic Creating & Navigating Change Make it Happen Breaking the mould of traditional approaches of brand ownership and the challenges of immersive storytelling. Qantas Australia in 360 ICC Sydney & Tourism
More informationOculus Rift Getting Started Guide
Oculus Rift Getting Started Guide Version 1.23 2 Introduction Oculus Rift Copyrights and Trademarks 2017 Oculus VR, LLC. All Rights Reserved. OCULUS VR, OCULUS, and RIFT are trademarks of Oculus VR, LLC.
More informationIntro to Virtual Reality (Cont)
Lecture 37: Intro to Virtual Reality (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A Overview of VR Topics Areas we will discuss over next few lectures VR Displays VR Rendering VR Imaging CS184/284A
More informationVirtual Reality. NBAY 6120 April 4, 2016 Donald P. Greenberg Lecture 9
Virtual Reality NBAY 6120 April 4, 2016 Donald P. Greenberg Lecture 9 Virtual Reality A term used to describe a digitally-generated environment which can simulate the perception of PRESENCE. Note that
More informationVirtual Reality Technology and Convergence. NBA 6120 February 14, 2018 Donald P. Greenberg Lecture 7
Virtual Reality Technology and Convergence NBA 6120 February 14, 2018 Donald P. Greenberg Lecture 7 Virtual Reality A term used to describe a digitally-generated environment which can simulate the perception
More informationRealizing Augmented Reality
Realizing Augmented Reality By Amit Kore, Rahul Lanje and Raghu Burra Atos Syntel 1 Introduction Virtual Reality (VR) and Augmented Reality (AR) have been around for some time but there is renewed excitement,
More informationDesign and Implementation of the 3D Real-Time Monitoring Video System for the Smart Phone
ISSN (e): 2250 3005 Volume, 06 Issue, 11 November 2016 International Journal of Computational Engineering Research (IJCER) Design and Implementation of the 3D Real-Time Monitoring Video System for the
More informationExploring Geoscience with AR/VR Technologies
Exploring Geoscience with AR/VR Technologies Tim Scheitlin Computational & Information Systems Laboratory (CISL), National Center for Atmospheric Research (NCAR), Boulder, Colorado, USA Using ECMWF's Forecasts
More informationVirtual Reality for Real Estate a case study
IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Virtual Reality for Real Estate a case study To cite this article: B A Deaky and A L Parv 2018 IOP Conf. Ser.: Mater. Sci. Eng.
More informationyour LEARNING EXPERIENCE
FORMING your LEARNING EXPERIENCE 76% Does the outcome OUTWEIGH the investment? Learning outcomes are significantly improved when using immersive technology over traditional teaching methods. 110% Improvements
More informationVirtual Reality I. Visual Imaging in the Electronic Age. Donald P. Greenberg November 9, 2017 Lecture #21
Virtual Reality I Visual Imaging in the Electronic Age Donald P. Greenberg November 9, 2017 Lecture #21 1968: Ivan Sutherland 1990s: HMDs, Henry Fuchs 2013: Google Glass History of Virtual Reality 2016:
More informationMoving Web 3d Content into GearVR
Moving Web 3d Content into GearVR Mitch Williams Samsung / 3d-online GearVR Software Engineer August 1, 2017, Web 3D BOF SIGGRAPH 2017, Los Angeles Samsung GearVR s/w development goals Build GearVRf (framework)
More informationIntegrating Virtual Reality (VR) into traditional instructional design. Abstract
Integrating Virtual Reality (VR) into traditional instructional design Osuagwu O.E 1, Ihedigbo C. E. 2, Ndigwe Chinwe 3 1 Department of Computer Science, Imo State University Owerri, Nigeria Tel: +2348037101792,
More informationEnSight in Virtual and Mixed Reality Environments
CEI 2015 User Group Meeting EnSight in Virtual and Mixed Reality Environments VR Hardware that works with EnSight Canon MR Oculus Rift Cave Power Wall Canon MR MR means Mixed Reality User looks through
More informationTrial code included!
The official guide Trial code included! 1st Edition (Nov. 2018) Ready to become a Pro? We re so happy that you ve decided to join our growing community of professional educators and CoSpaces Edu experts!
More informationTOUCH & FEEL VIRTUAL REALITY. DEVELOPMENT KIT - VERSION NOVEMBER 2017
TOUCH & FEEL VIRTUAL REALITY DEVELOPMENT KIT - VERSION 1.1 - NOVEMBER 2017 www.neurodigital.es Minimum System Specs Operating System Windows 8.1 or newer Processor AMD Phenom II or Intel Core i3 processor
More informationIs This Real Life? Augmented & Virtual Reality in Your Library
Is This Real Life? Augmented & Virtual Reality in Your Library Eric Schwab, Manager Toronto Public Library, Digitization & Preservation Ted Belke, Services Specialist Toronto Public Library, Service Innovation
More informationStep. A Big Step Forward for Virtual Reality
Step A Big Step Forward for Virtual Reality Advisor: Professor Goeckel 1 Team Members Ryan Daly Electrical Engineer Jared Ricci Electrical Engineer Joseph Roberts Electrical Engineer Steven So Electrical
More informationVirtual Reality Technology and Convergence. NBAY 6120 March 20, 2018 Donald P. Greenberg Lecture 7
Virtual Reality Technology and Convergence NBAY 6120 March 20, 2018 Donald P. Greenberg Lecture 7 Virtual Reality A term used to describe a digitally-generated environment which can simulate the perception
More informationComputer Graphics. Spring April Ghada Ahmed, PhD Dept. of Computer Science Helwan University
Spring 2018 10 April 2018, PhD ghada@fcih.net Agenda Augmented reality (AR) is a field of computer research which deals with the combination of real-world and computer-generated data. 2 Augmented reality
More informationNew AR/VR Trends in Aerospace
04.19.17 New AR/VR Trends in Aerospace Agenda Introductions The State of VR/AR VR/AR: What is Next Inhanced VR/AR in Aerospace VR/AR Demos 2 who we are Inhance Digital is an award-winning trans-media interactive
More informationAugmented Reality Lecture notes 01 1
IntroductiontoAugmentedReality Lecture notes 01 1 Definition Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated
More informationDESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY
DESIGN STYLE FOR BUILDING INTERIOR 3D OBJECTS USING MARKER BASED AUGMENTED REALITY 1 RAJU RATHOD, 2 GEORGE PHILIP.C, 3 VIJAY KUMAR B.P 1,2,3 MSRIT Bangalore Abstract- To ensure the best place, position,
More informationPortfolio. Swaroop Kumar Pal swarooppal.wordpress.com github.com/swarooppal1088
Portfolio About Me: I am a Computer Science graduate student at The University of Texas at Dallas. I am currently working as Augmented Reality Engineer at Aireal, Dallas and also as a Graduate Researcher
More informationUSTGlobal. VIRTUAL AND AUGMENTED REALITY Ideas for the Future - Retail Industry
USTGlobal VIRTUAL AND AUGMENTED REALITY Ideas for the Future - Retail Industry UST Global Inc, August 2017 Table of Contents Introduction 3 Focus on Shopping Experience 3 What we can do at UST Global 4
More informationOculus Rift Getting Started Guide
Oculus Rift Getting Started Guide Version 1.7.0 2 Introduction Oculus Rift Copyrights and Trademarks 2017 Oculus VR, LLC. All Rights Reserved. OCULUS VR, OCULUS, and RIFT are trademarks of Oculus VR, LLC.
More informationVirtual Reality. Lecture #11 NBA 6120 Donald P. Greenberg September 30, 2015
Virtual Reality Lecture #11 NBA 6120 Donald P. Greenberg September 30, 2015 Virtual Reality What is Virtual Reality? Virtual Reality A term used to describe a computer generated environment which can simulate
More informationAugmented and Virtual Reality
CS-3120 Human-Computer Interaction Augmented and Virtual Reality Mikko Kytö 7.11.2017 From Real to Virtual [1] Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS
More informationVR/AR with ArcGIS. Pascal Mueller, Rex Hansen, Eric Wittner & Adrien Meriaux
VR/AR with ArcGIS Pascal Mueller, Rex Hansen, Eric Wittner & Adrien Meriaux Agenda Introduction & Terminology Pascal Mobile VR with ArcGIS 360VR Eric Premium VR with CityEngine & Game Engines Pascal Dedicated
More informationAugmented Reality. ARC Industry Forum Orlando February Will Hastings Analyst ARC Advisory Group
Augmented Reality ARC Industry Forum Orlando February 2017 Will Hastings Analyst ARC Advisory Group whastings@arcweb.com Agenda Digital Enterprise: Set the stage Augmented Reality vs. Virtual Reality Industry
More informationGetting Real with the Library. Samuel Putnam, Sara Gonzalez Marston Science Library University of Florida
Getting Real with the Library Samuel Putnam, Sara Gonzalez Marston Science Library University of Florida Outline What is Augmented Reality (AR) & Virtual Reality (VR)? What can you do with AR/VR? How to
More informationAbout Us and Our Expertise :
About Us and Our Expertise : Must Play Games is a leading game and application studio based in Hyderabad, India established in 2012 with a notion to develop fun to play unique games and world class applications
More informationExploring Cost Effective AR & VR Options for your Library. Sandy Avila, MLIS, MA Interim Science Librarian University of Central Florida Libraries
Exploring Cost Effective AR & VR Options for your Library Sandy Avila, MLIS, MA Interim Science Librarian University of Central Florida Libraries What is Augmented Reality (AR)? Understanding the Terminology
More informationADVANCED WHACK A MOLE VR
ADVANCED WHACK A MOLE VR Tal Pilo, Or Gitli and Mirit Alush TABLE OF CONTENTS Introduction 2 Development Environment 3 Application overview 4-8 Development Process - 9 1 Introduction We developed a VR
More informationUnpredictable movement performance of Virtual Reality headsets
Unpredictable movement performance of Virtual Reality headsets 2 1. Introduction Virtual Reality headsets use a combination of sensors to track the orientation of the headset, in order to move the displayed
More informationVirtual Reality Mobile 360 Nanodegree Syllabus (nd106)
Virtual Reality Mobile 360 Nanodegree Syllabus (nd106) Join the Creative Revolution Before You Start Thank you for your interest in the Virtual Reality Nanodegree program! In order to succeed in this program,
More informationInput devices and interaction. Ruth Aylett
Input devices and interaction Ruth Aylett Contents Tracking What is available Devices Gloves, 6 DOF mouse, WiiMote Why is it important? Interaction is basic to VEs We defined them as interactive in real-time
More informationTobii Pro VR Integration based on HTC Vive Development Kit Description
Tobii Pro VR Integration based on HTC Vive Development Kit Description 1 Introduction This document describes the features and functionality of the Tobii Pro VR Integration, a retrofitted version of the
More informationStudents: Bar Uliel, Moran Nisan,Sapir Mordoch Supervisors: Yaron Honen,Boaz Sternfeld
Students: Bar Uliel, Moran Nisan,Sapir Mordoch Supervisors: Yaron Honen,Boaz Sternfeld Table of contents Background Development Environment and system Application Overview Challenges Background We developed
More informationUsing the Kinect body tracking in virtual reality applications
Ninth Hungarian Conference on Computer Graphics and Geometry, Budapest, 2018 Using the Kinect body tracking in virtual reality applications Tamás Umenhoffer 1, Balázs Tóth 1 1 Department of Control Engineering
More informationglossary of terms Helping demystify the word soup of AR, VR and MR
glossary of terms Helping demystify the word soup of AR, VR and MR Zappar Ltd. 2017 Contents Objective 2 Types of Reality 3 AR Tools 5 AR Elements / Assets 7 Computer Vision and Mobile App Terminology
More informationOne Size Doesn't Fit All Aligning VR Environments to Workflows
One Size Doesn't Fit All Aligning VR Environments to Workflows PRESENTATION TITLE DATE GOES HERE By Show of Hands Who frequently uses a VR system? By Show of Hands Immersive System? Head Mounted Display?
More informationDepartment of Computer Science and Engineering The Chinese University of Hong Kong. Year Final Year Project
Digital Interactive Game Interface Table Apps for ipad Supervised by: Professor Michael R. Lyu Student: Ng Ka Hung (1009615714) Chan Hing Faat (1009618344) Year 2011 2012 Final Year Project Department
More informationCreating original VR content from creation up to distribution. Grégoire PARAIN NOVELAB
Creating original VR content from creation up to distribution Grégoire PARAIN NOVELAB French think-tank dedicated to VR Why VR? Experience? VR is really about experience. In cinema you feel empathy for
More informationVR/AR Innovation Report August 2016
VR/AR Innovation Report August 2016 Presented by @GDC Welcome to the VRDC VR/AR Innovation Report, presented by the Virtual Reality Developers Conference! The data in this report was gathered from surveying
More informationImmersive Authoring of Tangible Augmented Reality Applications
International Symposium on Mixed and Augmented Reality 2004 Immersive Authoring of Tangible Augmented Reality Applications Gun A. Lee α Gerard J. Kim α Claudia Nelles β Mark Billinghurst β α Virtual Reality
More informationIntroduction.
VR Introduction The last few years have seen lots of changes in terms of technology used at events, as things become more focussed towards interactivity and creating memorable experiences that leave people
More informationPRODUCTS DOSSIER. / DEVELOPMENT KIT - VERSION NOVEMBER Product information PAGE 1
PRODUCTS DOSSIER DEVELOPMENT KIT - VERSION 1.1 - NOVEMBER 2017 www.neurodigital.es / hello@neurodigital.es Product information PAGE 1 Minimum System Specs Operating System Windows 8.1 or newer Processor
More informationMIXED REALITY BENEFITS IN BUSINESS
MIXED REALITY BENEFITS IN BUSINESS Denise E. White Founder, Digital Nomadic Living Slide 1: Introduction Hi, Good Morning! [pause] I m Denise White. I live a Mixed Reality life, today or as I like to say,
More informationVirtual Reality in Neuro- Rehabilitation and Beyond
Virtual Reality in Neuro- Rehabilitation and Beyond Amanda Carr, OTRL, CBIS Origami Brain Injury Rehabilitation Center Director of Rehabilitation Amanda.Carr@origamirehab.org Objectives Define virtual
More informationFLEXLINK DESIGN TOOL VR GUIDE. documentation
FLEXLINK DESIGN TOOL VR GUIDE User documentation Contents CONTENTS... 1 REQUIREMENTS... 3 SETUP... 4 SUPPORTED FILE TYPES... 5 CONTROLS... 6 EXPERIENCE 3D VIEW... 9 EXPERIENCE VIRTUAL REALITY... 10 Requirements
More informationLearning technology trends and implications
Learning technology trends and implications ISA s 2016 Annual Business Retreat By Anders Gronstedt, Ph.D., President, Gronstedt Group 1.15 pm, March 22, 2016 Disruptive learning trends Gamification Meta
More informationMarket Snapshot: Consumer Strategies and Use Cases for Virtual and Augmented Reality
Market Snapshot: Consumer Strategies and Use Cases for Virtual and Augmented A Parks Associates Snapshot Virtual Snapshot Companies in connected CE and the entertainment IoT space are watching the emergence
More informationA SURVEY OF MOBILE APPLICATION USING AUGMENTED REALITY
Volume 117 No. 22 2017, 209-213 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu A SURVEY OF MOBILE APPLICATION USING AUGMENTED REALITY Mrs.S.Hemamalini
More informationTeam Breaking Bat Architecture Design Specification. Virtual Slugger
Department of Computer Science and Engineering The University of Texas at Arlington Team Breaking Bat Architecture Design Specification Virtual Slugger Team Members: Sean Gibeault Brandon Auwaerter Ehidiamen
More informationTHE PINNACLE OF VIRTUAL REALITY CONTROLLERS
THE PINNACLE OF VIRTUAL REALITY CONTROLLERS PRODUCT INFORMATION The Manus VR Glove is a high-end data glove that brings intuitive interaction to virtual reality. Its unique design and cutting edge technology
More informationDexta Robotics Inc. DEXMO Development Kit 1. Introduction. Features. User Manual [V2.3] Motion capture ability. Variable force feedback
DEXMO Development Kit 1 User Manual [V2.3] 2017.04 Introduction Dexmo Development Kit 1 (DK1) is the lightest full hand force feedback exoskeleton in the world. Within the Red Dot Design Award winning
More informationMotion sickness issues in VR content
Motion sickness issues in VR content Beom-Ryeol LEE, Wookho SON CG/Vision Technology Research Group Electronics Telecommunications Research Institutes Compliance with IEEE Standards Policies and Procedures
More informationA Step Forward in Virtual Reality. Department of Electrical and Computer Engineering
A Step Forward in Virtual Reality Team Step Ryan Daly Electrical Engineer Jared Ricci Electrical Engineer Joseph Roberts Electrical Engineer Steven So Electrical Engineer 2 Motivation Current Virtual Reality
More informationpcon.planner PRO Plugin VR-Viewer
pcon.planner PRO Plugin VR-Viewer Manual Dokument Version 1.2 Author DRT Date 04/2018 2018 EasternGraphics GmbH 1/10 pcon.planner PRO Plugin VR-Viewer Manual Content 1 Things to Know... 3 2 Technical Tips...
More informationSUNY Immersive Augmented Reality Classroom. IITG Grant Dr. Ibrahim Yucel Dr. Michael J. Reale
SUNY Immersive Augmented Reality Classroom IITG Grant 2017-2018 Dr. Ibrahim Yucel Dr. Michael J. Reale Who are we Dr. Ibrahim Yucel Interactive Media and Game Design Dr. Mohammed Abdallah Engineering Technology
More informationQuick Guide for. Version 1.0 Hardware setup Forsina Virtual Reality System
Quick Guide for Version 1.0 Hardware setup Forsina Virtual Reality System Forsina system requirements Recommendation VR hardware specification 1- VR laptops XMG U727 Notebook (high performance VR laptops)
More informationHome Building Industry Innovations BIM and VR
Home Building Industry Innovations BIM and VR What is BIM 2D hand drafting. Historically we started from a point of documentation. Hand drafting all buildings to convey our ideas and construction methods.
More informationUMI3D Unified Model for Interaction in 3D. White Paper
UMI3D Unified Model for Interaction in 3D White Paper 30/04/2018 Introduction 2 The objectives of the UMI3D project are to simplify the collaboration between multiple and potentially asymmetrical devices
More informationDEVELOPMENT KIT - VERSION NOVEMBER Product information PAGE 1
DEVELOPMENT KIT - VERSION 1.1 - NOVEMBER 2017 Product information PAGE 1 Minimum System Specs Operating System Windows 8.1 or newer Processor AMD Phenom II or Intel Core i3 processor or greater Memory
More informationExtended Kalman Filtering
Extended Kalman Filtering Andre Cornman, Darren Mei Stanford EE 267, Virtual Reality, Course Report, Instructors: Gordon Wetzstein and Robert Konrad Abstract When working with virtual reality, one of the
More informationinteractive laboratory
interactive laboratory ABOUT US 360 The first in Kazakhstan, who started working with VR technologies Over 3 years of experience in the area of virtual reality Completed 7 large innovative projects 12
More informationrevolutionizing Subhead Can Be Placed Here healthcare Anders Gronstedt, Ph.D., President, Gronstedt Group September 22, 2017
How Presentation virtual reality Title is revolutionizing Subhead Can Be Placed Here healthcare Anders Gronstedt, Ph.D., President, Gronstedt Group September 22, 2017 Please introduce yourself in text
More informationMiguel Rodriguez Analogix Semiconductor. High-Performance VR Applications Drive High- Resolution Displays with MIPI DSI SM
Miguel Rodriguez Analogix Semiconductor High-Performance VR Applications Drive High- Resolution Displays with MIPI DSI SM Today s Agenda VR Head Mounted Device (HMD) Use Cases and Trends Cardboard, high-performance
More informationimmersive visualization workflow
5 essential benefits of a BIM to immersive visualization workflow EBOOK 1 Building Information Modeling (BIM) has transformed the way architects design buildings. Information-rich 3D models allow architects
More informationConstruction of visualization system for scientific experiments
Construction of visualization system for scientific experiments A. V. Bogdanov a, A. I. Ivashchenko b, E. A. Milova c, K. V. Smirnov d Saint Petersburg State University, 7/9 University Emb., Saint Petersburg,
More information4/23/16. Virtual Reality. Virtual reality. Virtual reality is a hot topic today. Virtual reality
CSCI 420 Computer Graphics Lecture 25 Virtual Reality Virtual reality computer-simulated environments that can simulate physical presence in places in the real world, as well as in imaginary worlds History
More informationExecutive Summary https://artillry.co/contact/. Copyright ARtillry 2017
ARTILLRY INTELLIGENCE BRIEFING THE STATE OF VIRTUAL REALITY JUNE 2017 Executive Summary ARtillry Insights are monthly installments of VR/AR data and analysis. They bring together original and third party
More informationWebVR: Building for the Immersive Web. Tony Parisi Head of VR/AR, Unity Technologies
WebVR: Building for the Immersive Web Tony Parisi Head of VR/AR, Unity Technologies About me Co-creator, VRML, X3D, gltf Head of VR/AR, Unity tonyp@unity3d.com Advisory http://www.uploadvr.com http://www.highfidelity.io
More informationMaking Virtual Reality a Reality. Surviving the hype cycle to achieve real societal benefit.
Making Virtual Reality a Reality Surviving the hype cycle to achieve real societal benefit. Game Changer? Fad? A Timeline of VR A Timeline of VR 1939 1939 - View-Master 3D Stereoscopic viewer A Timeline
More informationEnhancing Shipboard Maintenance with Augmented Reality
Enhancing Shipboard Maintenance with Augmented Reality CACI Oxnard, CA Dennis Giannoni dgiannoni@caci.com (805) 288-6630 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED. Agenda Virtual
More informationDraft TR: Conceptual Model for Multimedia XR Systems
Document for IEC TC100 AGS Draft TR: Conceptual Model for Multimedia XR Systems 25 September 2017 System Architecture Research Dept. Hitachi, LTD. Tadayoshi Kosaka, Takayuki Fujiwara * XR is a term which
More informationIntroduction to Virtual Reality (based on a talk by Bill Mark)
Introduction to Virtual Reality (based on a talk by Bill Mark) I will talk about... Why do we want Virtual Reality? What is needed for a VR system? Examples of VR systems Research problems in VR Most Computers
More informationImmersive Aerial Cinematography
Immersive Aerial Cinematography Botao (Amber) Hu 81 Adam Way, Atherton, CA 94027 botaohu@cs.stanford.edu Qian Lin Department of Applied Physics, Stanford University 348 Via Pueblo, Stanford, CA 94305 linqian@stanford.edu
More informationUniversidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática. Output Devices - I
Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática Output Devices - I Realidade Virtual e Aumentada 2017/2018 Beatriz Sousa Santos What is Virtual Reality? A high-end user
More informationVirtual Reality Setup Instructions and Troubleshooting Guide
Virtual Reality Setup Instructions and Troubleshooting Guide Table of Contents Topic Page What is the Oculus Rift? Pg. 3 How Does the Oculus Rift work? Pg. 4 What about Augmented Reality? Pg. 5 Item Check
More informationSpecial Topic: Virtual Reality
Lecture 24: Special Topic: Virtual Reality Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2016 Credit: Kayvon Fatahalian created the majority of these lecture slides Virtual Reality (VR)
More informationVR System Input & Tracking
Human-Computer Interface VR System Input & Tracking 071011-1 2017 년가을학기 9/13/2017 박경신 System Software User Interface Software Input Devices Output Devices User Human-Virtual Reality Interface User Monitoring
More informationEE 267: Introduction and Overview!
! EE 267: Introduction and Overview! Gordon Wetzstein! Stanford University! EE 267 Virtual Reality! Lecture 1! stanford.edu/class/ee267/!! vir tu al re al i ty! vərch(əw)əl rē alədē!!!! the computer-generated
More informationRKSLAM Android Demo 1.0
RKSLAM Android Demo 1.0 USER MANUAL VISION GROUP, STATE KEY LAB OF CAD&CG, ZHEJIANG UNIVERSITY HTTP://WWW.ZJUCVG.NET TABLE OF CONTENTS 1 Introduction... 1-3 1.1 Product Specification...1-3 1.2 Feature
More information2017 Virtual Reality Year In Review
2017 Virtual Reality Year In Review Lewis Ward (IDC) and Unity March, 2018 IDC Executive Summary 3 Methodology and Objectives 4 Key Analysis and Findings 5 Contact Information 22 IDC 2 Executive Summary
More informationInteractive Objects for Augmented Reality by Using Oculus Rift and Motion Sensor
Interactive Objects for Augmented Reality by Using and Motion Sensor Yap June Wai, Nurulfajar bin Abd Manap Machine Learning and Signal Processing (MLSP), Center of Telecommunication Research & Innovation
More informationEMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS
EMPOWERING THE CONNECTED FIELD FORCE WORKER WITH ADVANCED ANALYTICS MATTHEW SHORT ACCENTURE LABS ACCENTURE LABS DUBLIN Artificial Intelligence Security SILICON VALLEY Digital Experiences Artificial Intelligence
More informationLessons Learned From Experiments in Creating VR Content
Lessons Learned From Experiments in Creating VR Content Published May 2017 Topics Video, Advertising, Mobile Virtual Reality (VR) creates infinite storytelling possibilities. But VR for advertising has
More informationFig.1 AR as mixed reality[3]
Marker Based Augmented Reality Application in Education: Teaching and Learning Gayathri D 1, Om Kumar S 2, Sunitha Ram C 3 1,3 Research Scholar, CSE Department, SCSVMV University 2 Associate Professor,
More information