Augmented Reality in Utilities

Transcription

1 Augmented Reality in Utilities John J. Simmins, Ph.D. Technical Executive Energy Huntsville July 17, 2018

2 EPRI s Mission Advancing safe, reliable, affordable and environmentally responsible electricity for society through global collaboration, thought leadership and science & technology innovation 2

3 Corporate Strategic Direction Innovative solutions that enable the transformation of power systems to be more flexible, resilient, and connected to provide society with safe, reliable, affordable, and environmentally responsible electricity + 3

4 Three Key Aspects of EPRI Independent Objective, scientifically based results address reliability, efficiency, affordability, health, safety, and the environment Nonprofit Chartered to serve the public benefit Collaborative Bring together scientists, engineers, academic researchers, and industry experts 4

5 Born in a Blackout Founded in 1972 as an independent, nonprofit center for public interest energy and environmental research New York City, The Great Northeast Blackout,

6 Our Members 450+ participants in more than 30 countries EPRI members generate approximately 90% of the electricity in the United States International funding nearly 25% of EPRI s research, development, and demonstrations 6

7 EPRI Membership Funding by Type January 12, 2018 (unaudited results) INVESTOR-OWNED INTERNATIONAL MUNICIPAL Cooperative FEDERAL/STATE 4% 55% 28% 6% 5% 5% INDEPENDENT POWER PRODUCER 1% COOPERATIVE 7

8 Three Dimensions of EPRI s Value To provide value to the public, our members, and the electricity sector Thought Leadership Industry Expertise Collaborative Model 8

9 EPRI s Role Stimulate innovation; help accelerate technology development 9

10 The Power of Collaboration Delivering greater value for our members investment Pool resources Share responsibility Increase efficiency COLLABORATION Answer research questions Share technical skills and expertise 10

11 About Our Research Power Delivery & Utilization Transmission, Distribution, and Substations Power Delivery & Utilization Distributed Energy Resources and the Customer Nuclear Generation Energy and Environment Technology Innovation 11

12 Definition of Augmented Reality View of the physical, real-world environment whose elements are augmented (or supplemented) by sensory input such as*: Video Graphic Sound GPS Haptics (touch) Additional input is usually provided in a Heads Up Display (HUD) on glasses (e.g. Google Glass) or helmet (e.g. DAQRI) 12 *Wikipedia (2015)

13 Augmented Reality Enhancing our Experiences 13

14 Augmented Reality Enhancing our Experiences 14

15 Real Examples - Is AR really effective or just a novelty? 15

16 Example AR Use Cases (Besides Football and the Rear Camera) Product Design Field Service Assembly Warehouse Picking Inspection Training Emergency Response Surgery Marketing and Sales Remote Inspection 16

17 EPRI Lessons Learned from Past AR project Field Force Data Visualization (FFDV) EPRI proof-of-concept AR App Project Members: Entergy Gas Natural Fenosa ConEd LIPA The Good Demonstrated promise in productivity and safety Value of Common Information Model (CIM) standard - reduce vendor lock-in Promise for ANY work or asset Effective at Storm damage assessment The Opportunities GPS location services can be enhanced Challenges with large data sets Inaccurate GIS data CIM standard has some gaps Economics of cost vs. benefit need to be assessed 17

18 EPRI Proof of Concept App Field Force Data Visualization LIPA Example of Underground Assets Requires Accurate GIS Data 18

19 19

20 Augmented Reality is the Pokémon Go for Field Workers 20

21 21

22 22

23 23

24 24

25 Why the Investment in AR Safety Aging workforce Efficiency 25

26 Boeing Study Results to Increase Productivity with AR* Complex Wing Assembly Study 50 steps to assemble 30 parts 46 Participants Three Control Groups 1. Desktop computer w/pdf 2. Mobile Tablet w/pdf 3. Mobile Table displaying AR Each subject did two assemblies Three areas of study First time quality (lowest errors) Fastest Time Worker efficiency ** * **MBI = Model Based Instruction 26

27 27 EPRI Cross-Sector Augmented Reality Research Environmental Sector Raptor protection Pollinator propagation Worker safety Nuclear Sector Steam pipe flaw visualization Maintenance training Generation Sector Maintenance (various) Power Delivery and Utilization Storm damage assessment Worker safety (with ENV) Substation switching Underground asset location Relay repair Solar panel repair Steam pipe flaw visualization (with NUC) Pollinator propagation (with ENV) Telecommunication install Others..

28 Example Utility Use Cases from AREA Damage Assessment Estimating time to restore services Work Order Creation Request, assign and track field work Asset Repair Procedures, history, documentation, video conferencing 28

29 Assessing Augmented Reality Goal: Complete assessment of factors to make a decision Economics Develop and insert AR technology into a work stream Measure efficiency improvements Ergonomics Measure impact on eyes, muscles, and joints Measure situational awareness impact Safety! 29

30 Members AEP NYPA ConEd Duke Southern Ameren National Grid EDF Enel KEPCO 30

31 Use Cases Duke Inventory Substation repair ConEd Visualize Equipment and Structures with Layered Data Troubleshooting, Maintenance and Repair Support Tool Visualize Conduits and Cable Switching Operations KEPCO Read sensors and take appropriate action. EDF Cable splices Ameren Security & ergonomics AEP Substation Repair/Remote Expert NYPA Safety ENEL Weld Inspections Substation Relay Repair 31

32 Accessing Augmented Reality for the Electricity Industry ( Supplemental) Duke Ideation Vendor Selection Design Construction Testing (12) Write-up (1/2) KEPCO Ideation Vendor Selection Design Construction Testing ConEd Ideation Vendor Selection Construction (1/2) EDF Ideation Vendor Selection (Almost) Construction AEP Ideation Vendor Selection Testing Write-up Ameren Ideation Vendor Selection Design Design Construction Testing Write-up Enel Ideation Vendor Selection Design Construction NYPA Ideation Vendor Selection Design Construction Testing Write-up Southern Ideation Vendor Selection Design Construction 32 National Grid Ideation

33 EPRI Sponsored Study: Augmented Reality for Electric Utility Field Workers Sept., 2017, to August, 2019 PI: Richard Marklin Co-PI: Mark Nagurka Focus on 4 areas: 1. Biomechanical loading on neck and shoulders 2. Eye strain (dry eyes) 3. Performance 4. Situational Awareness 33

34 AR Technology Microsoft HoloLens True AR Very popular AR Cost: $3,000 Realwear HMT-1 Pseudo AR Cost: $

35 Together Shaping the Future of Electricity 35

36 RealWear HMT-1 The RealWear HMT-1Z1 YouTube HMT-1 Arc-Flash Test - YouTube RealWear, Inc - YouTube 36

37 Impact **Model Based Instruction 37 *T. Richardson, S. Gilbert, J. Holub, F. Thompson, A. MacAllister, R. Radkowski, E. Winer, P.Davies, and S. Terry, Fusing Self-Reported and Sensor Data from Mixed-Reality Training, Interservice/Industry Training, Simulation, and Education

38 Together Shaping the Future of Electricity 38