In this paper, we present a novel single stage quantum frequency conversion (QFC) scheme based on an enhancement cavity, which allows for high conversion efficiencies with record low noise levels, 100 times smaller than in previous systems and close to the thermal background. Our approach represents a significant improvement over traditional QFC methods that rely on periodically poled waveguide crystals, which typically produce high levels of noise with input wavelengths in the visible spectrum.One of the key challenges in QFC is the generation of noise photons -photons that are not part of the desired output state. Those noise photons are one of the major limitations of today's quantum network experiments. It has been widely believed that single stage QFC of qubit photons in the visible range would result in too many noise photons in the telecom band, because of SPDC induced by the short wavelength driver laser. However, using the enhancement cavity design, we are able to overcome this challenge and demonstrate high-fidelity QFC from the visible to telecom band.Our results have important implications for the development of practical QFC devices for a range of applications, including quantum communication and quantum networks, where low noise levels are critical.