Absolute distance measurement is a field of research with a large variety of applications. Laser triangulation is a well-tested and developed technique using geometric relations to calculate the absolute distance to an object. The advantages of laser triangulation include its simple and cost-effective setup with yet a high achievable accuracy and resolution in short distances. A main problem of the technology is that even small changes of the optomechanical setup, e.g., due to thermal expansion, lead to significant measurement errors. Therefore, in this work, we introduce an optical setup containing only a beam splitter and a mirror, which splits the laser into a measurement beam and a reference beam. The reference beam can then be used to compensate for different error sources, such as laser beam dithering or shifts of the measurement setup due to the thermal expansion of the components. The effectiveness of this setup is proven by extensive simulations and measurements. The compensation setup improves the deviation in static measurements by up to 75%, whereas the measurement uncertainty at a distance of 1 m can be reduced to 85 μm. Consequently, this compensation setup can improve the accuracy of classical laser triangulation devices and make them more robust against changes in environmental conditions.