The massless QCD Lagrangian is conformally invariant and, as a consequence, so are the tree-level scattering amplitudes. However, the implications of this powerful symmetry at loop level are only beginning to be explored systematically. Even for finite loop amplitudes, the way conformal symmetry manifests itself may be subtle, e.g. in the form of anomalous conformal Ward identities. As they are finite and rational, the oneloop all-plus and single-minus amplitudes are a natural first step towards understanding the conformal properties of Yang-Mills theory at loop level. Remarkably, we find that the one-loop all-plus amplitudes are conformally invariant, whereas the single-minus are not. Moreover, we present a formula for the one-loop all-plus amplitudes where the symmetry is manifest term by term. Surprisingly, each term transforms covariantly under directional dual conformal variations. We prove the formula directly using recursive techniques, and check that it has the correct physical factorisations.