Degradation of glass under zero applied load in the presence of humidity at ambient temperature is of great interest to the container and fiber glass industries. The phenomenon is well documented for fused silica used in optical fibers, but has not been studied in detail for multi‐component glasses. In this work notches of varying length (500‐1500 nm) were placed with a focused ion beam into two types of multi‐component glass fibers, E‐glass (48 μm diameter) and soda‐lime‐silicate (35 μm diameter). Notched specimens were exposed to dry and humid conditions for up to 32 days. Transmission electron microscopy revealed the presence of extensive reaction products within the root of the notch, even after only 1 day of aging in the nominally dry environment for the soda‐lime‐silicate glass. Surprisingly, the extensive reactions have no measurable effect on the fiber strength. The uniaxial tensile strength of the notched glass fibers, measured with the fracture surface mirror radius method, does not follow a classic fracture mechanics prediction, implying that the notches are not classic Griffith flaws. Fracture mechanics is applied to show that sharpness at the notch base may be important, especially when subcritical crack growth is present during the strength measurement.