Purpose: To develop a head and neck normal structures auto-contouring tool that could be used to automatically detect the errors in auto-contours from a clinically-validated auto-contouring tool. Methods: An auto-contouring tool based on convolutional neural networks (CNN) was developed for 16 normal structures of the head and neck and tested to identify the contour errors from a clinically-validated multi-atlas-based auto-contouring system (MACS). The CT scans and clinical contours from 3495 patients were semi-automatically curated and used to train and validate the CNN-based auto-contouring tool. The final accuracy of the tool was evaluated by calculating the Sørensen-Dice similarity coefficients (DSC) and Hausdorff distances between the automatically generated contours and physician-drawn contours on 174 internal and 24 external CT scans. Lastly, the CNN-based tool was evaluated on 60 patients’ CT scans to investigate the possibility to detect contouring failures. The contouring failures on these patients were classified as either minor or major errors. The criteria to detect contouring errors were determined by analyzing the DSC between the CNN- and MACS-based contours under two independent scenarios: 1. contours with minor error are clinically acceptable and 2. contours with minor errors are clinically unacceptable. Results: The average DSC and Hausdorff distance of our CNN-based tool were 98.4%/1.23cm for brain, 89.1%/0.42cm for eyes, 86.8%/1.28cm for mandible, 86.4%/0.88cm for brainstem, 83.4%/0.71cm for spinal cord, 82.7%/1.37cm for parotids, 80.7%/1.08cm for esophagus, 71.7%/0.39cm for lenses, 68.6%/0.72 for optic nerves, 66.4%/0.46cm for cochleas, and 40.7%/0.96cm for optic chiasm. With the error detection tool, the proportions of the clinically unacceptable MACS contours that were correctly detected were 0.99/0.80 on average except for the optic chiasm, when contours with minor errors are clinically acceptable/unacceptable respectively. The proportions of the clinically acceptable MACS contours that were correctly detected were 0.81/0.60 on average except for the optic chiasm, when contours with minor errors are clinically acceptable/unacceptable respectively. Conclusion: Our CNN-based auto-contouring tool performed well on both the publically-available and the internal datasets. Furthermore, our results show that CNN-based algorithms are able to identify ill-defined contours from a clinically-validated and used multi-atlas-based auto-contouring tool. Therefore, our CNN-based tool can effectively perform automatic verification of MACS contours.

To develop a tool for the automatic contouring of clinical treatment volumes (CTVs) and normal tissues for radiotherapy treatment planning in cervical cancer patients. Methods: An auto-contouring tool based on convolutional neural networks (CNN) was developed to delineate three cervical CTVs and 11 normal structures (seven OARs, four bony structures) in cervical cancer treatment for use with the Radiation Planning Assistant, a web-based automatic plan generation system. A total of 2254 retrospective clinical computed tomography (CT) scans from a single cancer center and 210 CT scans from a segmentation challenge were used to train and validate the CNN-based auto-contouring tool. The accuracy of the tool was evaluated by calculating the Sørensen-dice similarity coefficient (DSC) and mean surface and Hausdorff distances between the automatically generated contours and physician-drawn contours on 140 internal CT scans. A radiation oncologist scored the automatically generated contours on 30 external CT scans from three South African hospitals.