KINECT CONTROLLED HUMANOID AND HELICOPTER Muffakham Jah College of Engineering & Technology Presented by : MOHAMMED KHAJA ILIAS PASHA ZESHAN ABDUL MAJEED AZMI SYED ABRAR MOHAMMED ISHRAQ SARID MOHAMMED WASAY AHMED SABA AHMED JALAL
INTRODUCTION: ROBOT: Robots for many people, it s a machine that imitates like a human and it can be programmed to move, control objects and accomplish work while interacting with the environment. Robots are able to perform repetitive tasks more quickly, and accurately than humans. MICROSOFT KINECT XBOX 360 SENSOR: A significant development in gesture recognition can be seen with the Kinect sensor, which is a motion sensing device developed by Microsoft for Xbox 360 gaming console. At the input or the user end, the Kinect is programmed for some predefined gestures which are tracked using the Skeleton tracking feature of the Kinect sensor. When the gesture is sensed, it is been processed in the system and a signal is transmitted.
SERVO MOTORS: A servomotor is a rotary actuator or linear actuator that allows for precise control of angular or linear position, velocity and acceleration. It consists of a suitable motor coupled to a sensor for position feedback. It also requires a relatively sophisticated controller, often a dedicated module designed specifically for use with servomotors. MICROSOFT KINECT SENSOR: Kinect is a device that can interpret specific gestures, making completely hand free control of electronic devices possible by using an infrared projector and camera and a special microchip to track the movement of objects and individuals in three dimensions. The device features a Depth sensor, RGB camera and multi-array microphone running proprietary software, which provide full body three dimensional motion capture, voice recognition and facial recognition capabilities.
Humanoid: The skeletal image of the user s arm obtained from the Kinect consists of joints and vectors and angle is calculated between these two vectors. The angles thus obtained are sent using the system to the Arduino MEGA Board, which in turn generates signals which are sent to the six servo motors of the humanoid robot. Helicopter: While for the helicopter, a transmitting module is made consisting of Arduino Uno Board which receives inputs from the kinect sensors and processes them. The angles thus obtained are sent using the system to the Arduino Uno Board, which in turn generates signals which are sent to the receiver of the helicopter. When the predefined gestures are done, the helicopter moves left and right, yaws and rolls and throttles.
OBJECTIVES: The main objective of this project is to demonstrate the applications of Microsoft Kinect Xbox 360. Recently, strong efforts have been carried out to develop natural and intelligent interfaces between computer and user based system on human gestures. Gestures provide an intuitive interface to both computer and human. BLOCK DIAGRAM: HUMANOID
HELICOPTER
WORKING HUMANOID A humanoid robot is used to imitate the human motion, like move hands the way humans do and many more human motions. With proper stability, a robot becomes much more versatile as compared to the wheeled robots because of the fact that the base level of a bipedal is not fixed, thereby enabling the robot to move around with more degrees of freedom wirelessly from the system to the Arduino MEGA Board on the humanoid robot. Arduino MEGA Board processes the received input and responds accordingly to move the servo motors in the robot. HELICOPTER When the user is calibrated to the Kinect sensor, and the predefined inputs are given, the skeletal image of the user s arm obtained from the Kinect consists of joints and vectors and angle is calculated between these two vectors. The angles obtained are sent using the system to the Arduino Uno Board, which generates signals which are sent to the receiver of the Helicopter according to which it can roll, yaw and throttle in the horizontal range of the IR Sensors
Advantages: Control over the robot at unmanned missions. This technology is used without any sensor suit or remote. Can be used in Defence and Warfare. Prevention of involvement of humans in dangerous tasks. APPLICATIONS: Surgeons interacting with a CT Scan or MRI As a Security Camera Controlling Robots in Space
CONCLUSION: SOCIAL BENEFITS: We aim to promote technology innovation to achieve a reliable and efficient outcome from various instruments. With a common digitized platform, these latest instruments will enable increased flexibility in control, operation and expansion, allows embedded intelligence, and eventually benefits the customers with improved services, reliability and increase convenience. FUTURE SCOPES: 1. Control over the robot at unmanned missions. 2. This technology is used without any sensor suit or remote. 3. Can be used in Defence and Warfare. 4. Prevention of involvement of humans in dangerous tasks.
WORKING MODEL OF THE PROJECT HUMANOID
HELICOPTER
THANK YOU