Combining complementary skills, research, novel technologies.

Transcription

1

2 The Company Farextra is a Horizon 2020 project spinoff at the forefront of a new industrial revolution. Focusing on AR and VR solutions in industrial training, safety and maintenance Founded on January 2017 Grounded on the leading edge complementary experties of CERTH/ITI and Regola.

3 A full human and professional commitment of the key persons of two organizations. WHO ITI, a Greek top Information Technology Institute. WHAT Under the auspices of CERTH, a top Greek research institute with huge experience on AR, Computer Vision, IT technologies. Regola, a privately owned Italian SME. Battle proven industrial experience matured in a geographical context at the top of the Italian automotive, aerospace, mechanical and transportation industry. Combining complementary skills, research, novel technologies.

4 Key challenges of Industries under Factories 4.0 IOT DIGITAL TECHNOLOGIES IN TRADITIONAL PROCESSES TECHNOLOGY FOR SAFETY & ERGONOMICS TRAINING, SUPPORT, COOPERATION The Market Need: Competitiveness in the manufacturing industry is increasingly training-driven. Building up and maintaining a qualified and adaptable workforce is essential in responding quickly to technological/industrial/market advances. Ongoing shift from traditional training approaches to fully remotely-supported training platforms. Increasing need for incorporating intelligent techniques for digitally capturing, analyzing, and formulating SOP/EOP so that they can be converted into applicable on-the-job training toolkits. Integration of IOT into training for verification of trainee actions Remote assistance in training, maintenance and service

5 Opportunities identified A big potential demand in a wide market with interesting targets: - Big industrial companies; - SME as well, because they are quite behind the state of the art; Reshoring: supported by public financial aids, manufacturing companies are starting to bring back their plants: - Because the research could not be separated from production; - Companies have troubles in finding young and motivated workers for routine jobs. Current offer weaknesses: the offer is fragmented, mainly focused on technology. - Customer approach: me too. Little attention to the users. - Many solutions not integrated at plant level; - Solutions imported from gaming industry context, little or no focus on manufacturing; - No focus on human factors. Workers are dressed up with technology with no evaluation of the impact in the long term; - Technology is an opportunity not per se: it must be at the service of realneeds.

6 Opportunities identified Current offer weaknesses: the offer is fragmented, mainly focused on technology. - Customer approach: me too. Little attention to the users. - Many solutions not integrated at plant level; - Solutions imported from gaming industry context, little or no focus on manufacturing; - No focus on human factors. Workers are dressed up with technology with no evaluation of the impact in the long term; - Technology is an opportunity not per se: it must be at the service of real needs.

7 FAREXTRA addresses the key points FAREXTRA is ready to offer a cutting-edge VR/AR software platform for training personnel on manufacturing, maintenance, process operations and support functions. The platform s primary differentiator is its leading 3D simulation capabilities and its capacity for direct verification of trainees operations via gesture and object recognition modules. Resultsdriven Toolset Humancentered Design 3D Simulation Integrated Platform Direct Trainee Verification Standard training material High added-value practical, adaptive, comprehensive training software

8 The FAREXTRA AR On-the-Job Toolkit Procedures, procedures, procedures. Multi-modal information (text, images, video, PDF, 3D animations) Multiple AR Technologies (Marker-based, Markerless, Bespoke) Integration with Sensor middleware for real-time Emergency Event response and Augmented Assistance; IOT enabling Architecture. Easy SOP and EOP Annotation and Automatic training scenario generation without software skills expertise. 3D Object Detection & Recognition, Localization and Real-time data Overlay. Support for Wearable AR Devices (Mobile Devices, AR-Glasses and in-house Automatic Localization Module) Support for Open Standards.

9 Full command of the industrial procedures A complete command of procedure creation, editing, deploying. The toolkit allows a new definition of procedure: a versioned, downloadable, self consistent, richmedia digital bundle.

10 Delivering AR/VR in the context of procedures With rich media content; cost is scalable according to the budget. Condition-based: procedure flow based on rich logic. Dynamic sensor reading: procedure flow based on sensor values; Plugin based: new capabilities added easily; On the job training ready.

11 Delivering AR/VR in the context of procedures AR First-Person Holographic Point of View (MS Hololens support) Worker has first person view of the training procedure via see-through Head-mounted glasses. Gesture-based control. Deployed from the same training scenario Create once / Deploy on different platforms

12 Delivering AR/VR in the context of procedures

13 Delivering AR/VR in the context of procedures MARKERLESS AR ASSEMBLY TRAINING Using RGBD cameras to extract 3D Descriptors for each object in assembled and non-assembled states. Training driven by 3D animations of assembly operations in registration with actual assembly parts. FOR EACH STEP: Assembly parts are identified by software then their 3D models are spatially registered to match the actual ones. AR 3D animation of assembly operation are shown. Worker performs assembly accordingly. The system assesses if correct parts are correctly placed. If so, proceed to the next step of assembly, otherwise notify worker.

14 Delivering AR/VR in the context of procedures

15 Providing AR Remote Assistance View video stream from AR glasses/tablets. Text Chat with worker Talk to remote worker and send voice instructions Capture camera feed from worker, annotate and send images and text instructions

16 The Team Dr. Bruno Belliero, CEO President at REGOLA SRL Co-Director of the Mosaico consortium Roberto Belliero, CFO CEO and Sales Manager at REGOLA SRL Dr. Dimitrios Tzovaras, R&D Manager Director & Senior Researcher at CERTH/ITI Dimosthenis Ioannidis, CTO Senior Researcher at CERTH/ITI Thanos Tsakiris, Development Lead Senior Researcher at CERTH/ITI