Soon after the recent first ever detection of gravitational waves from merging black holes it has been suggested that their origin is primordial. Appealingly, a sufficient number of primordial black holes (PBHs) could also partially or entirely constitute the dark matter (DM) in the Universe. However, recent studies on PBHs in ultrafaint dwarf galaxies (UFDGs) suggest that they would dynamically heat up the stellar component due to two-body relaxation processes. From the comparison with the observed stellar velocity dispersions and the stellar half-light radii it was claimed that only PBHs with masses 10 M can significantly contribute to the DM. In this work, we improve the latter constraints by considering the largest observational sample of UFDGs and by allowing the PBH masses to follow an extended (log-normal) distribution. By means of collisional Fokker-Planck simulations, we explore a wide parameter space of UFDGs containing PBHs. The analysis of the half-light radii and velocity dispersions resulting from the simulations leads to three general findings that exclude PBHs with masses ∼ O(1-100) M from constituting all of the DM: (i) We identify a critical sub-sample of UFDGs that only allows for ∼ O(1) M PBH masses; (ii) for any PBH mass, there is an UFDG in our sample that disfavours it; (iii) for a majority of UFDGs, dynamical heating by PBHs would be too efficient to match the observed stellar half-light radii.