NTT R&D on ICT Towards a prosperous future

Transcription

1 NTT R&D on ICT Towards a prosperous future May 18, 2017 Hiromichi Shinohara Senior Executive Vice President, CTO, CISO, and Head of R&D Planning

2 No.8 Rahboni Warren-Vosayaco WTB Franklin Calugay No.8 Amanaki lelei Mafi CTB No.8 Jeffreytsuyoshi Warren Ierome Whiteley FL Heinrich Brussow No.8 Willem Britz No.8 Leilua Murphy LO FB FL Isaac Brackin Wimpie van Ross Harauria-Henry der Walt SO Riaan Viljoen FB Jurgen Visser SO Elton Jantjies STB Shane Gates Coach Hugh Reece Edwards HC Rob Penney Coach Chris Latham Coach Marie Pedersen Coach Andre Tredoux HC Dawie Theron

3 - 2 -

4 NTT R&D formation R&D Number of researchers : 2,500 Communications Service Video & image Service Innovation Laboratory Group User experiences OSS support Information Network Laboratory Group Science & Core Technology Laboratory Group Information Network NFV Audio, speech & language Software development Cryptography & security SDN NW & operations technology Communication traffic & service quality Cutting-Edge Technologies Communication science Machine Learning Data-centric Science Physics & materials science AI IoT FTTH Mobile Cloud, Data center, Network integration System integration, Application

5 B2B2X models & Roles of R&D NTT R&D AI IoT Security Network Cloud Media Service Providers (different industries) Main Players Create new value Customers Enterprises Partners Co-Innovation - 4 -

6 - 5 -

7 Concepts of AI Simulate human intelligence / thinking Supplement and draw forth human abilities AI that creates new value through coexistence and co-creation with humans AI (Artificial intelligence) Big Data Deep learning Language/knowledge processing, etc AI IA (Intelligence amplifier)

8 NTT Group s AI Technology: corevo corevo: Co-revolution Create revolutionary change together with players and customers corevo HP Agent-AI Ambient-AI Heart-Touching-AI Network-AI - 7 -

9 Speech recognition technologies Agent-AI Speech recognition in noisy circumstance Language-identified speech recognition noisy circumstance (navigation, sales talk, etc.) Japanese Indonesian Vietnamese Korean Malay Thai English Speech recognition rate (%) NTT Top among 25 participating organizations Mandarin Chinese Taiwanese Supports 10 languages Supports dialects Cantonese (Hong Kong) Non-native speakers CHiME-3 (International contest) - 8 -

10 Sound processing technologies Noise suppression Intelligent microphone Ambient noise is reduced to 1/10,000 Agent-AI Mixed sounds Noise-suppressed signal Noise Amplitude Frequency Amplitude Frequency Speaker-separated voice pick-up Intelligent microphone processing E-call Automatic Emergency Call System Specific speaker can be identified Voices of different speakers (directions) are separated - 9 -

11 Free dialog at SXSW2016 Android (Osaka University) Free dialog technology Agent-AI Please watch the video JAPAN HOUSE@SXSW 2016

12 Natural discussion at SXSW2017 Agent-AI Osaka University Discussion type conversation technology Android USA TODAY

13 Sports Brain Science Clarify brain mechanism Heart-Touching-AI NTT R&D s targets Sensorimotor coordination Decision making Skill Mind Motivation Tension / relaxation Tactics Muscle force Cardiopulmonary Physical fitness Targets of conventional sports science Create effective training methodology Brain science ICT Machine learning Multimodal feedback Wearable sensors VR

14 Deformation Lamps Heart-Touching-AI Please watch the video

15 Communication Engine: COTOHA Agent-AI Understands natural language Operator End user Question Answer or request clarification Escalation Automatic learning If the question is nebulous, COTOHA asks specific questions Natural language processing

16 Deviation Failure prediction technology Collect and accumulate Ambient-AI Detect Anomaly sound detection Alert! Machine operating sounds Visualize operating sound Minimize impacts on production Noise Microphone Operating sound analysis system Intelligent microphone Noise suppression

17 Detection of dangerous driving Collect and accumulate Detect Ambient-AI Assessment of movement status Multimodal information Drive recorder Video data Sensor data 映像 Speed, acceleration Automatically detects dangerous driving with about 85% accuracy Educating drivers to reduce accidents

18 Reducing traffic congestion Collect and accumulate Beacons Visualize accident conditions 1 Grapon Large-scale graph mining Forecast Ambient-AI Reduce traffic congestion Predict jams Traffic information 事故渋滞 自動車事故 8 4 Visualize congested conditions Control signals and lanes Jilin, China (field trial since Nov. 2014) Guiyang, China (field trial since Feb. 2016) Exeter, UK (field trial scheduled from 2017)

19 Taxi demand forecasting Ambient-AI Collect and accumulate Operation data Demographic data Weather data Event data Facility data Real-time mobile demand forecasting High demand Area with high demand forecast 30 minutes ahead 30 分後に高需要と予測されたエリア 30 minutes from now 低需要中需要高需要 Low demand Medium demand High demand 効果 1 乗務員ごとのスキルのバラツキ解消 Forecast Boost sales by improving utilization rate +50% 効果 2 電車遅延等の Reduce waiting times 非日常的な状況への対応 Alternative means Delay Congestion Accident A Tokyo-based taxi company A Nagoya-based taxi company

20 Secure IoT targeted by NTT R&D Use data Create value React Sentient-IoT [Data] Mashup AI Forecast Visualize Read [Network/cloud] Real time [Sensing] Natural Collect Provide data Enterprises Undisclosed data Open data Device sensors Citizens Organizations

21 Sensing fabric: hitoe Fatigue estimation Central fatigue, heat stroke Fabric of hitoe Human skin Electrocardiogram (ECG) Electromyogram (EMG) Mental state Balance between sympathetic and parasympathetic nerves, remaining physical strength Amount of activity Muscle fatigue, estimation of lactate threshold, action state

22 Support vehicle operation by Hitoe A B Round trip distance 400km Instantaneous Stream-type data processing Application High-speed distributed processing Natural Devices /sensors Obtain data from human body Sensing fabric: hitoe Bus /truck Network Driver Launched a service

23 Medical care applications of hitoe Registered as a general medical device in Japan Non-irritant Does not restrict movement Continuous measurement Enhanced detection of illness Medical electrode Medical lead wire Support for patients undergoing rehabilitation Promote early discharge from hospital

24 Sports Medicine applications of hitoe

25 Professional sports applications of hitoe Indy 500 (USA) Super Formula (Japan) Monitor racer s reserves of physical strength in real time Monitor the physical loads CeBIT

26 Innovation of manufacturing by IoT Like Google Play in manf. industry Real time Integrated operation of multiple devices Open Open for Appl. Developer Mashup Circulate various types of data Software component management Application Edge computing IoT data exchange Robots / Machines / Sensors Global ICT Operational data Service to be started (Autumn 2017) Open platform Raise production efficiency

27 Collaboration in the Connected Car field the automotive vehicle-related technologies Platform for data collection, accumulation, and analysis edge computing the information and communication technologies Data Centers IoT networks 5G Agents

28 Security R&D activities IoT Security Data Security Network Security Attacks on social infrastructures Create world-leading basic technologies Authentication technologies - Cryptographic theory - Secure computing Attack detection, malware collection and analysis

29 - 28 -

30 Roles to be played by NTT

31 Multilingual support for international tourists Sign Field trial on public transportation Point a smartphone Cloud Only 2 or 3 photos are pre-registered Angle-free object search Front Oblique Close-up Partially hidden Intuitive UX of just directing a smartphone

32 Navigation for international tourists Intuitive navigation 2.5D map representation Field trial with Tokyo Metro 2D + height Outdoor Underground D representation Indoor Angle-free object search Detect location w/o beacons

33 Provision of product information through a smartphone Point a smartphone Joint trial started Product information Description, ingredients Food allergy information Other information 15 languages

34 Athlete first-person vision synthesis tech. Kei Nishikori Virtual space various sports Live-action video Delete Virtual space 3D-CG Video of a player Baseball park Live-action video + 3D-CG Ball generated by CG Ball trajectory data - Velocity - Spinning level - Trajectory

35 VR experience of being an athlete Please watch the video

36 Immersive tele-presence : Kirari! Particular location Remote location Visuals Sounds Lights y z x

37 Kirari! demonstration Keynote Speech at NTT R&D forum 2016 Please watch the video Live broadcast by Kirari!

38 Kirari! demonstration Please watch the video A music concert by Kirari!

39 Challenges undertaken with Kirari! Live broadcast High-definition wide All direction Judo 3D projection Viewing from an arena-shaped spectator area

40 Summary R&D or Innovation plays a crucial role for any enterprises to grow & change. NTT R&D will continue to co-innovate with various players to create new value & revolutionary change. We will pursue basic & fundamental research to strengthen our ability for innovation.

41