Object Recognition System in Remote Controlled Weapon Station using SIFT and SURF Methods

Abstract

Object recognition system using computer vision that is implemented on Remote Controlled Weapon Station (RCWS) is discussed. This system will make it easier to identify and shoot targeted object automatically. Algorithm was created to recognize real time multiple objects using two methods i.e. Scale Invariant Feature Transform (SIFT) and Speeded Up Robust Features (SURF) combined with K-Nearest Neighbors (KNN) and Random Sample Consensus (RANSAC) for verification. The algorithm is designed to improve object detection to be more robust and to minimize the processing time required. Objects are registered on the system consisting of the armored personnel carrier, tanks, bus, sedan, big foot, and police jeep. In addition, object selection can use mouse to shoot another object that has not been registered on the system. Kinect™ is used to capture RGB images and to find the coordinates x, y, and z of the object. The programming language used is C with visual studio IDE 2010 and opencv libraries. Object recognition program is divided into three parts: 1) reading image from kinect™ and simulation results, 2) object recognition process, and 3) transfer of the object data to the ballistic computer. Communication between programs is performed using shared memory. The detected object data is sent to the ballistic computer via Local Area Network (LAN) using winsock for ballistic calculation, and then the motor control system moves the direction of the weapon model to the desired object. The experimental results show that the SIFT method is more suitable because more accurate and faster than SURF with the average processing time to detect one object is 430.2 ms, two object is 618.4 ms, three objects is 682.4 ms, and four objects is 756.2 ms. Object recognition program is able to recognize multi-objects and the data of the identified object can be processed by the ballistic computer in realtime.

Accuracy analysis of geometrical and numerical approaches for two degrees of freedom robot manipulator

“…The algorithm of numerical approach is carried out through iteration process using pseudo-inverse Jacobian matrix [1] as Figure 3.…”

“…Modern TDOF robot manipulator has been equipped with object detection and identifies features using certain sensors, such as acoustic sensors and visual sensors. In the study conducted by Mirdanies [1], object detection and identification was performed using Kinect TM camera with sift and surf methods. Visual sensors and algorithm are used to convert the coordinates of the target to the aiming direction which is the key to this technology.…”

Implementation of Parallel Processing on Multi-Object Recognition System Software

“…The image processing applications are the application that requires a high specification computer or parallel processing techniques to speed up the processing time, especially in applications that use a complex algorithms or methods. Some publication about image processing have been reported, Park et al have implemented the direct calculation of interparticle distance in suspension by image processing using monte carlo method [1], Saleem et al explain a comparison of feature points method on multisensor images [2], Husin et al [3] on the poisonous shrimp detection system for litopenaeus vannamei using k-Nearest Neighbor (k-NN) method, and Mirdanies et al [4] has also successfully implemented the multi-object object recognition software on Remote Controlled Weapon Station (RCWS) using Scale Invariant Feature Transform (SIFT) and Speeded Up Robust Features (SURF) methods.…”

A Trajectory Generation Method Based on Edge Detection for Auto-Sealant Cartesian Robot

“…The data from database was compared to capturing image from camera in real time object recognition. The name of captured object will be displayed if has suitable data with registered object [6].…”