The yielding transition that occurs in amorphous solids under athermal quasistatic deformation has been the subject of many theoretical and computational studies. Here, we extend this analysis to include thermal effects at finite shear rate, focusing on how temperature alters avalanches. We derive a nonequilibrium phase diagram capturing how temperature and strain rate effects compete, when avalanches overlap, and whether finite-size effects dominate over temperature effects. The predictions are tested through simulations of an elastoplastic model in two dimensions and in a mean-field approximation. We find a new scaling for temperature-dependent softening in the lowstrain rate regime when avalanches do not overlap, and a temperature-dependent Herschel-Bulkley exponent in the high strain rate regime when avalanches do overlap.