More Efficient and Intuitive PLM by Integrated AR/VR Round Table Session Georg Fiechtner
Service Portfolio PLM Consulting PLM Software Development Human- System Interaction AMS Processes Systems Technologies Design Customization Implementation Rollout Clients: Rich/Web/Mobile VR/AR/MR/VUI AI Global Support Models Levels 2-4 2
3
Which Industries are here today? What is your expectation on xr from a today s perspective? 4
Source: https://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/ 5
With Expectations Set Straight... VR/AR is gaining momentum In the Consumer Market 6
With Expectations Set Straight... VR/AR is gaining momentum Shorter innovation cycle of consumer electronics (< 2 years) especially due to strong competition 7
8
Source: https://readwrite.com/2017/07/10/vr-ar-headset-sales-2021-dl4/ With Expectations Set Straight... VR/AR is gaining momentum Most user friendly/intuitive systems win Standards emerge 9
What do you expect from the Consumer Market? In your opinion, how does it influence the industry? 10
How can this be applied to PLM? Examples? Why? 11
VR Product Configurator Mercedes Me Store in Hamburg Design & Engineering Productplanning Productionplanning Production Sales Service Recycling 85 percent of new car buyers still make use of the classic dealership touchpoints, three-quarters of these customers are dissatisfied with the quality of their experience there real-time gaming technology to create a photorealistic interactive scenario real-time rendering on the basis of CAD data and information from PDM time required for project: a few weeks Source: http://www.mackevision.com/references/mercedes-benz-w213-real-time-application/ 12
Source: http://www.mackevision.com/portfolio/shared-studio-vr/ Product Design & Engineering Collaboration in VR Design & Engineering Productplanning Productionplanning Production Sales Service Recycling Rapid presentation and testing of models in different (prepared) scenarios Photo-realistic presentation A collaborative VR space with multiple users (multi-user approach) Worldwide interaction with users in different locations Interaction with the VR model such as adding comments or voice notes 13
Product Design & Engineering BMW Mixed Reality Lab Design & Engineering Productplanning Productionplanning Production Sales Service Recycling Room-scale VR with an area of 5 x 5 metres Based on HTC Vive Merge between physical model and photorealistic virtual world More than 20 developer stations of this type(*) Can cheaply and quickly be updated with better and additional hardware, e.g. o New version of base stations (10 x 10 metres VR area) o Wireless HMD-Kit (TPCast,...) o Finger/Hand-capturing (Leap Motion,...) Based on Unreal(R) Game Development Platform / Engine Sources: (*) https://pro.merckgroup.com/archive/en/welcome-to-the-holodeck/ https://uploadvr.com/bmw-is-using-vr-mixed-reality-build-your-next-car/ https://www.unrealengine.com/en-us/blog/bmw-opts-to-incorporate-htc-vive-vr-headsets-and-mixed-realityinto-the-development-of-new-vehicle-models 14
Training for Assembly & Service PITERION Customer Studies Design & Engineering Productplanning Productionplanning Production Sales Service Recycling VR Assembly Training VR Repair Training Room-scale VR with an area of 5 x 5 metres Based on HTC Vive Based on Unity Game Development Platform / Engine For Mobile and VR devices Training context and content defined in dynamically loaded PLMXML Supports parts, tools, operational information, assembly/disassembly animations (from NX) Uses pre-defined scenes Semi-automatic CAD-data preparation (tesselation / cleanup) 15
How is it Done? Semi-automatic step from PLM to VR / Rise of content creation plattforms Design & Engineering Productplanning Productionplanning Production Sales Service Recycling Authoring Plattform/Pipeline Source: http://www.mackevision.com/portfolio/visualization-data-management/ 16
17
CAD Process Data Inspection Scene VR Scene & Model VR Inspection Design Validation Dealing with large and multi-format CAD-data sets PDM Automated CAD Conversion + Reference Mapping Update Changes Minutes Seconds Reference Mapping + Transfer Changes Update Changes 19
Process Simulate to VR Manufacturing Programming Robots in VR 20
(*) exluding application of materials 21
Usability Improvements VR/AR must be as immersive and intuitive as the real world Mitigate Motion Sickness Dynamic calibration of HMDs Natural User Interfaces (Gesture, Voice, Gaze) Adapt to User (experience, needs, limitations) Use of Cognitive Capabilities... (Machine Learning) 22
Source: http://www.ioxp.de/en/ioxpcognitive-ar/ Cognitive AR Machine Learning Methods + Augmented Reality Techniques Step 1: Record actions of expert 23
Source: http://www.ioxp.de/en/ioxpcognitive-ar/ Cognitive AR Machine Learning Methods + Augmented Reality Techniques Step 2: Understand workflow & automatically create service manual 24
Source: http://www.ioxp.de/en/ioxpcognitive-ar/ Cognitive AR Machine Learning Methods + Augmented Reality Techniques Step 3: Guide user from any step & understand progress 25
Source: http://www.ioxp.de/en/ioxpcognitive-ar/ Cognitive AR Machine Learning Methods + Augmented Reality Techniques Step 3: Guide user from any step & understand progress 26
Source: https://cognitive3d.com/ Cognitive VR Machine Learning Methods + Virtual Reality Techniques Measure action and engagement in immersive vehicle experiences Develop insights around showroom configurations Identify issues or compliance with training scenarios Test manufacturing and assembly line configurations Determine health and safety issues in manufacturing process 27
A Quick Glance into the Future
The Future of Industrial xr ~ 5+ years xr will be the medium to reduce complexity, transport information, create content (in combination with other technologies, like Machine Learning) xr Authoring Plattforms and Pipelines will emerge That either interface or merge with current PLM systems (only way to scale) xr is all about software it will become device agnostic People will become more and more xr savy (like with smartphones today) There will be standards and best practices on how to interact with xr (heavily influenced by the consumer market) 29
Cognitive Methods Plattform for PLM-VR/AR/MR Applications xr-plm Plattform PLM xr-authoring xr-bom/bop Materials Process Data Scenes CAx Functions xr-plattform Autom. CAD Import/Preparation Virtual Collaboration Device Abstraction 30
Start now and make xr a vital part of your Digitalization Strategy! 31
Where is your standing with xr? In Consideration/PoC/Large Scale Use? 32
Thank You for Your Attention!
Georg Fiechtner Innovation Management PITERION GmbH Reichenbachstraße 2 85737 Ismaning Tel.: Fax: Mob: +49 89-2000 395-62 +49 89-2000 395-80 +49 173 6041751 Email: Web: georg.fiechtner@piterion.com www.piterion.com 24.10.2017 34
... A membership funded alliance, helping to accelerate the adotion of Enterprise Augmented Reality by creating a comprehensive ecosystem. http://thearea.org/
The cross-platform VR standard eliminates industry fragmentation by enabling applications to be written once to run on any VR system, and to access VR devices integrated into those VR systems to be used by applications. https://www.khronos.org/openxr
More than a Hype? Source: https://uploadvr.com/oculus-nate-mitchell-oc4/ 37