Building Perceptive Robots with INTEL Euclid Development kit

Transcription

1 Building Perceptive Robots with INTEL Euclid Development kit Amit Moran Perceptual Computing Systems Innovation

2 2 2

3 3

4 A modern robot should Perform a task Find its way in our world and move safely Understand the environment and adapt to it Interact (naturally) 4

5 Hi Fred, Water the flowers for me please. Intel

6 Robot Scene Understanding Intel

7 Intel Robot Scene Understanding Human Recognition Indoor navigation Obstacle identification Object Recognition

8 Human Robot Interaction Intel

9 Intel Hi Fred, Water the flowers for me please. Speech Recognition Human Robot Interaction Emotion Recognition Speech (text to speech) Humanoid Behavior Gesture Recognition Intent Understanding

10 Intel Robot Scene Understanding Human Robot Interaction Human Recognition Speech Recognition Speech (text to speech) Obstacle identification Indoor navigation Object Recognition Gesture Recognition Emotion Recognition Intent Understanding Humanoid Behavior

11 Intel Robotics capabilities Sensing and perception Human-robot interaction Task execution Mechanics System engineering Legend: Perception needed Relative position and velocity estimation Semantic understanding 3D perception Object recognition Object classification Scene understanding Sensor fusion Sensing materials Sources: NASA; eurobotics; internal analysis. Multi-modal interaction Relating over time (Know Me) Social interaction Emotion recognition Human activity recognition Intent recognition Meaningful expression Safe interaction User-aware design Dynamic and compliant control Task and motion planning Navigation, mapping, and localization Multi-agent coordination Automatic feedback and adaptation Training and skill acquisition Cost efficient arms and grippers Real-time reaction and replanning Modeling contact dynamics Cost efficient actuators Object Manipulation Inherently safe mechanics Locomotion System integration Serviceability and error recovery Modularity and interoperability Verification and validation Power-efficient computing Learning and data management Cooperative robot networks Security Privacy

12 Perception is in the heart of modern robotics Unstructured Environment Dynamic and changing environment Perception Multi Robot collaboration Operate around and with Humans Learn and adapt to new situations 12

13 Intel RealSense Robotics Innovation Support roboticists in their quest to innovate and create the next big thing in robotics 13

14 14

15 Intel Euclid Development Kit. *The product, product specifications and data may be subject to change without notice 15

16 Intel Euclid - Highlights Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 16 16

17 Intel Euclid - Highlights Environmental Sensors Audio: Mics, Speaker Detachable Battery Soft buttons ZR300 (Depth & Motion) Intel Atom Quad-Core SOC Coms: WiFi, BT, USB3, UART, HDMI Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice Internal Storage Memory 17 Disclaimer THE PRODUCT, PRODUCT SPECIFICATIONS AND DATA MAY BE SUBJECT TO CHANGE WITHOUT NOTICE 17

18 Intel Euclid - Highlights Tracking Module - Color - RGB Stream FOV (D x V x H) 2MP, Up to 30fps, 16:9, rolling shutter, fixed focus 75 x 41.5 x 68 Fisheye Stream 30 fps FOV (D V H): IMU - 3-axis accel. Time Stamp: 50 μsec accuracy & 3-axis gyro. Depth - Active IR Stereo Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation Depth Stream Depth Output Format Range Stereo Imagers FOV (D x V x H) *The product, product specifications and data may be subject to change without notice Up to fps, global shutter 16-bit 0.5m (480x360) - 4m (Varies depending on light conditions) 70 x 46 x

19 Intel Euclid - Highlights Person Library SLAM Library Object Library Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 19

20 Intel Euclid - Highlights * * Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice *

21 Intel Euclid - Highlights Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 21 21

22 Intel Euclid - C&C Web interface Scenarios Dynamic Reconfigure ROS nodes configuration standard *The product, product specifications and data may be subject to change without notice 22 22

23 Intel Euclid Development Kit. *The product, product specifications and data may be subject to change without notice 23

24