Building Perceptive Robots with INTEL Euclid Development kit

Building Perceptive Robots with INTEL Euclid Development kit Amit Moran Perceptual Computing Systems Innovation

2 2

3

A modern robot should Perform a task Find its way in our world and move safely Understand the environment and adapt to it Interact (naturally) 4

Hi Fred, Water the flowers for me please. Intel

Robot Scene Understanding Intel

Intel Robot Scene Understanding Human Recognition Indoor navigation Obstacle identification Object Recognition

Human Robot Interaction Intel

Intel Hi Fred, Water the flowers for me please. Speech Recognition Human Robot Interaction Emotion Recognition Speech (text to speech) Humanoid Behavior Gesture Recognition Intent Understanding

Intel Robot Scene Understanding Human Robot Interaction Human Recognition Speech Recognition Speech (text to speech) Obstacle identification Indoor navigation Object Recognition Gesture Recognition Emotion Recognition Intent Understanding Humanoid Behavior

Intel Robotics capabilities Sensing and perception Human-robot interaction Task execution Mechanics System engineering Legend: Perception needed Relative position and velocity estimation Semantic understanding 3D perception Object recognition Object classification Scene understanding Sensor fusion Sensing materials Sources: NASA; eurobotics; internal analysis. Multi-modal interaction Relating over time (Know Me) Social interaction Emotion recognition Human activity recognition Intent recognition Meaningful expression Safe interaction User-aware design Dynamic and compliant control Task and motion planning Navigation, mapping, and localization Multi-agent coordination Automatic feedback and adaptation Training and skill acquisition Cost efficient arms and grippers Real-time reaction and replanning Modeling contact dynamics Cost efficient actuators Object Manipulation Inherently safe mechanics Locomotion System integration Serviceability and error recovery Modularity and interoperability Verification and validation Power-efficient computing Learning and data management Cooperative robot networks Security Privacy

Perception is in the heart of modern robotics Unstructured Environment Dynamic and changing environment Perception Multi Robot collaboration Operate around and with Humans Learn and adapt to new situations 12

Intel RealSense Robotics Innovation Support roboticists in their quest to innovate and create the next big thing in robotics 13

http://www.robotstorehk.com/lego/images/nxt-bricks-large.jpg 14

Intel Euclid Development Kit. *The product, product specifications and data may be subject to change without notice 15

Intel Euclid - Highlights Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 16 16

Intel Euclid - Highlights Environmental Sensors Audio: Mics, Speaker Detachable Battery Soft buttons ZR300 (Depth & Motion) Intel Atom Quad-Core SOC Coms: WiFi, BT, USB3, UART, HDMI Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice Internal Storage Memory 17 Disclaimer THE PRODUCT, PRODUCT SPECIFICATIONS AND DATA MAY BE SUBJECT TO CHANGE WITHOUT NOTICE 17

Intel Euclid - Highlights Tracking Module - Color - RGB Stream FOV (D x V x H) 2MP, Up to 1080p @ 30fps, 16:9, rolling shutter, fixed focus 75 x 41.5 x 68 Fisheye Stream VGA @ 30 fps FOV (D V H): 166 100 133 IMU - 3-axis accel. Time Stamp: 50 μsec accuracy & 3-axis gyro. Depth - Active IR Stereo Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation Depth Stream Depth Output Format Range Stereo Imagers FOV (D x V x H) *The product, product specifications and data may be subject to change without notice Up to 628 468 @ 60 fps, global shutter 16-bit 0.5m (480x360) - 4m (Varies depending on light conditions) 70 x 46 x 59 18 18

Intel Euclid - Highlights Person Library SLAM Library Object Library Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 19

Intel Euclid - Highlights * * Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice * 16.04 20 20

Intel Euclid - Highlights Roboticist/Makers vision solution Complete Standard/Community Easy to use/ zero-installation *The product, product specifications and data may be subject to change without notice 21 21

Intel Euclid - C&C Web interface Scenarios Dynamic Reconfigure ROS nodes configuration standard *The product, product specifications and data may be subject to change without notice 22 22

Intel Euclid Development Kit. *The product, product specifications and data may be subject to change without notice 23