.With the rapid development of the intelligent rail field, the intelligent rail traffic signal control system plays an increasingly important role, bringing greater convenience to people’s travel. Under normal circumstances, the trains are dispatched strictly according to the schedule, but in the daily operation of urban rail transit, the service is inevitably affected by many unpredictable uncertain factors. To ensure the safety of vehicles and smooth traffic, we proposed an intelligent rail traffic signal control system based on image processing technology. When the system detects that there are too many people waiting, it automatically adjusts the display time of the signal lights in real time according to the image, thus ensuring more time for passengers to get on the train, so as to realize the intelligent control of the track. The experimental results of our paper show that the accuracy of the improved vehicle target detection and recognition algorithm is more than 90%, which is higher than that of the algorithm without the improvement. Applying the proposed algorithm to image processing improved the recognition rate and accuracy. Through the test of the intelligent rail traffic signal control system based on image processing, it was found that the system effectively identified the number of people waiting in the lane and automatically adjusted the train closing time. The time required was only 1 s, and the responsiveness reached 99% to ensure the safety of vehicles and smooth traffic.