Certain zero-bias anomalies (ZBAs) in the voltage, temperature and magnetic field dependence of the conductance G(V, T, H) of quenched Cu point contacts have previously been interpreted to be due to non-magnetic 2-channel Kondo (2CK) scattering from near-degenerate atomic two-level tunneling systems (Ralph and Buhrman, 1992;, and hence to represent an experimental realization of the non-Fermi-liquid physics of the T = 0 fixed point of the 2-channel Kondo model. In this, the first in a series of three papers (I,II,III) devoted to 2-channel Kondo physics, we present a comprehensive review of the quenched Cu ZBA experiments and their 2CK interpretation, including new results on ZBAs in constrictions made from Ti or from metallic glasses. We first review the evidence that the ZBAs are due to electron scattering from stuctural defects that are not static, but possess internal dynamics. In order to distinguish between several mechanisms proposed to explain the experiments, we then analyze the scaling properties of the conductance at low temperature and voltage and extract from the data a universal scaling function Γ(v). The theoretical calculation of the corresponding scaling function within the 2CK model is the subject of papers II and III. The main conclusion of our work is that the properties of the ZBAs, and most notably their scaling behavior, are in good agreement with the 2CK model and clearly different from several other proposed mechanisms.