The following paper presents the development of an algorithm, in charge of detecting, classifying and grabbing occluded objects, using artificial intelligence techniques, machine vision for the recognition of the environment, an anthropomorphic manipulator for the manipulation of the elements. 5 types of tools were used for their detection and classification, where the user selects one of them, so that the program searches for it in the work environment and delivers it in a specific area, overcoming difficulties such as occlusions of up to 70%. These tools were classified using two CNN (convolutional neural network) type networks, a fast R-CNN (fast region-based CNN) for the detection and classification of occlusions, and a DAG-CNN (directed acyclic graph-CNN) for the classification tools. Furthermore, a Haar classifier was trained in order to compare its ability to recognize occlusions with respect to the fast R-CNN. Fast R-CNN and DAG-CNN achieved 70.9% and 96.2% accuracy, respectively, Haar classifiers with about 50% accuracy, and an accuracy of grip and delivery of occluded objects of 90% in the application, was achieved.
<span>This article exposes the design and implementation of an automation system based on a robotic arm for hex-nut classification, using pattern recognition and image processing. The robotic arm work based on three servo motors and an electromagnetic end effector. The pattern recognition implemented allows classifying three different types of hex-nut through deep learning algorithms based on convolutional neural network architectures. The proposed methodology exposes four phases: the first is the design, implementation, and control of a robotic arm. The second is the capture, classification, and image treatment; the third allows gripping the nut through the robot’s inverse kinematic. The final phase is the re-localization of the hex-nut in the respective container. The automation system successfully classifies all the types of hex-nuts, where the convolutional network used is an efficient and recent pattern recognition method, with an accuracy of 100% in 150 iterations. This development allows for obtaining a novel algorithm for robotic applications in hex-nut sorting.</span>
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.