During magnetic reconnection, field lines interconnect in electron diffusion regions (EDRs). In some EDRs, the reconnection and energy conversion rates are controlled by a steady out-of-plane electric field. In other EDRs, the energy conversion rate [Formula: see text] is “patchy,” with electron-scale large-amplitude positive and negative peaks. We investigate 22 EDRs observed by NASA's Magnetospheric Multiscale mission in a wide range of conditions to determine the cause of patchy [Formula: see text]. The patchiness of the energy conversion is quantified and correlated with seven parameters describing various aspects of the asymptotic inflow regions that affect the structure, stability, and efficiency of reconnection. We find that (1) neither the guide field strength nor the asymmetries in the inflow ion pressure, electron pressure, nor number density are well correlated with the patchiness of the EDR energy conversion; (2) the out-of-plane axes of the 22 EDRs are typically fairly well aligned with the “preferred” axes, which bisect the time-averaged inflow magnetic fields and maximize the reconnection rate; and (3) the time-variability in the upstream magnetic field direction is best correlated with the patchiness of the EDR [Formula: see text]. A 3D fully kinetic simulation of reconnection with a non-uniform inflow magnetic field is analyzed; the variation in the magnetic field generates secondary X-lines, which develop to maximize the reconnection rate for the time-varying inflow magnetic field. The results suggest that magnetopause reconnection, for which the inflow magnetic field direction is often highly variable, may commonly be patchy in space, at least at the electron scale.