The roughness of a surface is a decisive parameter of a material. In rehabilitation of concrete structures, for example, it significantly affects the adhesion between the coating material and the base concrete. However, the standard measurement procedure in construction suffers from considerable disadvantages, which leads to the demand for more sophisticated methods. In a research project, we, therefore, developed a novel camera-based measurement system, which is customized to meet the prevailing requirements for practical use on construction sites. In this article, we provide an overview of the measurement system and present comprehensive examinations to evaluate the accuracy and to provide evidence of validity. First, we examined the accuracy of the system by empirically assessing both trueness and precision of measurements using three concrete specimens. Trueness was determined by comparing the surface measurements to those of a highly accurate microscope system, revealing RMSE values of around 40–50 µm. Precision, on the other hand, was assessed considering the scattering of the roughness measurements under repeat conditions, which led to standard deviations of less than 6 µm. Furthermore, to proof validity, a comparative study was conducted based on sixteen concrete specimens, which includes the sand patch method and laser triangulation as established roughness measurement methods in practice. The empirically determined correlation coefficients between all three methods were greater than 0.99, indicating extraordinarily high linear relationships. Among them, the greatest correlation was between the camera-based system and laser triangulation.