C&D Summit 2018 / CIMON / May 31, 2018 / 2018 IBM Corporation Presentation should start with this video: https://www.youtube.com/watch?v=afutnx1weec
AI Technology up in Space: Project CIMON Matthias Biniok, Lead Watson Architect DACH & CIMON Project Lead Project CIMON 2018 / CIMON / May 31, 2018 / 2018 IBM Corporation 2
C&D Summit 2018 / CIMON / May 31, 2018 / 2018 IBM Corporation 3
Introducing CIMON Crew Interactive MObile companion DLR 4
Introduction Being an astronaut isn t easy Complex Environment Sophisticated Procedures Time Pressure Isolation 5
6
Get to know CIMON Who: CIMON s Profile Weight: 5kg (11 lbs) Diameter: 32cm (12.6 inch) Propulsion System: Air Autonomy: 2h DLR Guidance, Navigation & Control System: Video and Ultra Sonic Sensors Artificial Intelligence powered by IBM Watson 7
Get to know CIMON Goals & Success Factors Crystallization Experiment (Education & Public Outreach) Soft Goal Create a crewmate that is accepted as a real colleague by the crew. Skill Training Mobile Video Documentation 8
CIMON s Artificial Intelligence: Behind the Scenes 9
Behind the Scenes CIMON recognizes Voice IBM Watson Speech to Text Recognizing voice in English language Customization based on the environment-specific language of ISS ( Custom Language Model ) Customization based on the noise within the Columbus module of the ISS ( Custom Acoustic Model ) 10
Behind the Scenes CIMON understands Meaning IBM Watson Assistant (formerly Watson Conversation) Latest Update Watson Conversation is now called Watson Assistant and brings many new features! Understanding natural-language input to respond to users in a way that simulates a human conversation CIMON s brain Intents, entities, context Dialog flows & dynamic answers Deep integration with ground station (orchestrator) 11
Behind the Scenes CIMON speaks IBM Watson Text to Speech (TTS) Pronunciation & phonetic translation TTS Customization with specific dictionary Intonation & emotions Speech Synthesis Markup Language (SSML) 12
Behind the Scenes CIMON can see IBM Watson Visual Recognition Uses deep learning algorithms to analyze images for scenes, objects, faces, and other content Custom classifiers CIMON uses face detection & custom classifier for astronauts Other use cases already defined 13
Behind the Scenes CIMON could detect Emotions IBM Watson Tone Analyzer Deactivated The emotion extraction feature is currently deactivated. Uses linguistic analysis to detect emotional and language tones in written text Analyze emotions and adapt CIMON s behaviour accordingly Deactivated 14
Behind the Scenes The Artificial Intelligence components are not on board of the ISS. The IBM Watson services are delivered from the IBM Cloud. AI aboard or in Cloud? We had to implement a sophisticated process to reduce the latency since this is crucial for the acceptance of the crew. Data Privacy is an important aspect for both Airbus and DLR. IBM assures that sensitive data stays always secure and only Airbus can access the data. 15
Behind the Scenes CIMON s Personality Language & Linguistics Context Awareness Voice & Intonation Facial Expressions Movement 16
What s next? 17
What s next? Today s status CIMON is able to... Listen to astronauts Understand the meaning Talk to astronauts and conduct a real dialog, react emotional Recognize specific astronauts Support with experiments, procedures, and knowledge Move, dodge, orientate himself,... (Airbus) 18
What s next? Stability is key More features Next Steps until Commissioning Deeper understanding SpaceX CRS-15 launched on June, 29th 2018. Follow @astro_cimon on Twitter! 19
What s next? Long-term Vision Further Development of CIMON Deep Space Missions DLR, ESA, NASA, Roscosmos, SpaceX, and others are planning deep space missions to moon, mars, and beyond. CIMON 2.0 for ISS Deep Space Missions CIMON was developed and built by Airbus on behalf of the German Aerospace Center (DLR) Space Administration and funded by the German Federal Ministry for Economic Affairs and Energy (BMWi). 20
Thank you! Matthias Biniok Lead Watson Architect DACH, IBM matthias.biniok@de.ibm.com +49-172 4548976 ibm.com 21
22