In this paper, an advanced thermal camera-based system for detection of objects on rail tracks is presented. Developed system is powered by advanced image processing algorithm, in order to achieve greater reliability and robustness, and tested on set of infrared images captured at night conditions. The goal of this system is to detect objects on rail tracks and next to them and estimate distances between camera stand and detected objects. For that purpose, different edge detection methods are tested, and finally Canny edge detector is selected for rail track detection and for determination of region of interest, further used for analysis in object detection process. In determined region of interest, region-based segmentation is used for object detection. For estimation of distances between camera stand and detected objects, homography based method is used. Validation of estimated distances is done, in respect to real measured distances from camera stand to objects (humans) involved in experiment. Distances are estimated with a maximum error of 2%. System can provide reliable object detection, as well as distance estimation, and for improved robustness and adaptability, artificial intelligence tools can be used.
One of the most important parameters in an edge detection process is setting up the proper threshold value. However, that parameter can be different for almost each image, especially for infrared (IR) images. Traditional edge detectors cannot set it adaptively, so they are not very robust. This paper presents optimization of the edge detection parameter, i.e. threshold values for the Canny edge detector, based on the genetic algorithm for rail track detection with respect to minimal value of detection error. First, determination of the optimal high threshold value is performed, and the low threshold value is calculated based on the well-known method. However, detection results were not satisfactory so that, further on, the determination of optimal low and high threshold values is done. Efficiency of the developed method is tested on set of IR images, captured under night-time conditions. The results showed that quality detection is better and the detection error is smaller in the case of determination of both threshold values of the Canny edge detector.
One of the most challenging technical implementations of today is self-driving vehicles. An important segment of self-driving is the ability of the computer to “see/detect” objects of interest at a distance which enables safe vehicle operation. An algorithm for the detection of railway infrastructure objects, namely, track and signals, is proposed in this paper to enable detection of signals which are relevant for the track the train is moving along. The algorithm integrates traditional computer vision (CV) algorithms, including Canny edge detection, Hough transform, and You Only Look Once (YOLO) algorithm, based on convolutional neural networks (CNNs). Each of the concepts (CV and CNNs) deals with a different object of detection which together form a unique system that aims to detect both the rails and the relevant signals. This approach ensures that the artificial intelligence (AI) system is “aware” of which route the signal belongs to. The reliability of the proposed algorithm in detection of a relevant signal, verified by the performed tests, is up to 99.7%. The metric method used for validation was intersection over union (IoU). The obtained value of IoU applied on the entire validation dataset exceeds 0.7. Calculated values of average precision and recall were 0.89 and 0.76, respectively. The algorithm created in this way solves the problem of detection of relevant signals along the train route, especially in multitrack scenarios such as stations and yards.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.