The new crack luminescence method offers the possibility of making fatigue surface cracks in metallic materials more visible during inspections through a special coating system. This coating system consists of two layers, whereby the first layer has fluorescent properties and emits visible light as soon as it is irradiated by UV light. The top layer is black and is designed to prevent the fluorescent layer from emitting if no crack develops in the underlying material.The technique proved particularly useful in a wide variety of fatigue tests of steel components under laboratory conditions. Moreover, it has the potential to be used in various industrial applications. To enable industrial deployment and integration into maintenance strategies, a concept study is developed in this contribution, resulting in a qualification framework that can serve as a foundation for determining the reliability of the crack luminescence system in terms of a probability of detection curve. Within this study, factors causing measurement variability and uncertainty are being determined and their influences assessed. Due to the extension of the system by a moving computer vision system for automated crack detection using artificial intelligence, additional long-term effects associated with structural health monitoring systems need to be incorporated into an extended probability of detection study as part of the technical justification.Finally, important aspects and findings related to design of experiments are discussed, and a framework for reliability assessment of a new optical crack monitoring method is presented, emphasizing the influence of various uncertainty parameters, including long-term effects such as system ageing.