Second harmonic generation (SHG) in glass optical fibers calls for creating a second order susceptibility in the fiber glass and for achieving phase matching between the pump and the second harmonic signal. The latter is very challenging when using ultrashort pulses, given that the group velocities of the pump and the second harmonic should also be matched. We have shown in previous work that it is possible to achieve simultaneous modal phase matching (MPM) and group velocity matching (GVM) when the pump and the second harmonic are propagating in the LP01 and LP02 modes, respectively, in high GeO2-content double-clad optical fibers. However, simultaneous MPM and GVM can only be obtained in optical fibers with dedicated designs and within very tight geometrical tolerances. In this paper, we show that instead of considering the matching of phase and group velocities separately, we can consider a more general or “effective” phase matching approach, in which we consider all the dispersion terms up to the second order in the expressions of the propagation constants of the pump and second harmonic signals. This allows introducing the pulse duration as a controllable parameter that helps to enforce the said effective phase matching in fibers with designs that deviate by as much as 10% from the target, while providing for temporal walk-off lengths in excess of several centimeters. The impact of this finding goes beyond SHG only and can be applied to other ultrashort laser pulse-based nonlinear optical processes in fibers and waveguides.