The ball-wheeled robot relies on a camera for receiving information on the object to be followed. Object tracing is one of the methods that can be used for detecting object movement. In recognizing objects around it, the robot requires an image analysis process that involves visual perception. Image processing is the process of processing and analyzing images that involves visual perception, and is characterized by input data and output information in the form of images. This is how the robot can see objects around it and then be assisted by computer vision to make a decision. The object tracking method with hue-saturation-value (HSV) colour filtering and shape recognition with circle hough transform (CHT) is applied to the ball-wheeled robot. The front vision of the robot uses HSV colour filtering with various test values to determine the thresholding value, and it was found that the ball could be identified up to a distance of 1,000 cm. To further improve the performance of recognizing the ball object, CHT was applied. It was found that the ball could be identified up to a distance of 700 cm. Furthermore, the ball can be identified in obstructed conditions up to 75%.