The so-called Golden Mass Relation provides a testable correlation between charged-lepton and down-type quark masses, that arises in certain flavor models that do not rely on Grand Unification. Such models typically involve broken family symmetries. In this work, we demonstrate that realistic fermion mass relations can emerge naturally in modular invariant models, without relying on ad hoc flavon alignments. We provide a model-independent derivation of a class of mass relations that are experimentally testable. These relations are determined by both the Clebsch-Gordan coefficients of the specific finite modular group and the expansion coefficients of its modular forms, thus offering potential probes of modular invariant models. As a detailed example, we present a set of viable mass relations based on the Γ4 ≅ S4 symmetry, which have calculable deviations from the usual Golden Mass Relation.