Nowadays, vision systems are used in many things to run the industries error free with great accuracy, and for that, image processing is one of the keys that is used in this paper. This paper focuses on product differentiation using the colour detection method in real time with the help of MATLAB software. First task is to take snapshot from the web cam and convert that RGB image into HSV image, in this HSV image plays a vital role in colour description as it makes easier, they need luminous of the image. Threshold value of HSV used for differentiating colour, after applying the threshold values some of the corrections are done for avoiding any kind of error like erosion, dilution and holes.

Gesture recognition is a type of technology that can be used to control robots, manipulators, and other devices. Human-Computer Interaction (HCI) and research into creating simple-to-use interfaces by utilising natural communication have gotten a lot of press recently, as have human manipulation skills. When using gesture recognition, the user who is making the gesture is not necessary to wear any equipment or gadgets on their body. A camera linked to a device reads the body’s gestures and produces an output. The major purpose of this paper is to use MATLAB to control motor direction in proteus while also combining both software with VSPE (visual serial port emulator). Before immediately implementing this method on a robot, we can first simulate the outcomes to improve accuracy or correct models.