Amorphous solids exhibit quasi-universal low-temperature thermal anomalies whose origin has been ascribed to a distribution of localized tunneling defects. Using an advanced Monte Carlo procedure, we create in silico glasses spanning from hyperquenched to vapor-deposited ultrastable glasses. Using a multidimensional path-finding protocol, we locate tunneling defects with energy splittings smaller than kBTQ, with TQ the temperature below which quantum effects are relevant (TQ ≈ 1 K in most experiments). We find that the evolution of the energy landscape with the quench rate, as well as the manner in which the landscape is explored, conspire to deplete the density of tunneling defects in well-annealed glasses, as observed in recent experiments. We systematically explore the real-space nature of tunneling defects, finding that they are mostly localized to the participation of a few atoms, but are occasionally dramatically delocalized.