Smart Robot Arm Motion Using Computer Vision

Abstract

In this study computer vision and robot arm are used together to design a smart robot arm system which can identify objects from images automatically and perform given tasks. A serving robot application, in which specific tableware can be identified and lifted from a table, is presented in this work. A new database was created by using images of objects used in serving a meal. This study consists of two phases: First phase includes recognition of the objects through computer vision algorithms and determining the specified objects' coordinates. Second phase is the realization of the robot arm's movement to the given coordinates. Artificial neural network is used for object recognition in this system. 98.30 % overall accuracy of recognition is achieved. Robot arm's joint angles were calculated by using coordinate dictionary for moving the arm to desired coordinates and the robot arm's movement was performed.