Hot electron emission from waveguide integrated graphene has been recently shown to occur at optical power densities multiple orders of magnitude lower than metal tips excited by subworkfunction photons. However, the experimentally observed electron emission currents were small, limiting the practical uses of such a mechanism. Here, we explore the performance limits of hot electron emission in graphene through experimentally calibrated simulations. Two regimes of non-equilibrium emission in graphene are identified, (i) single particle hot electron emission, where an electron is excited by a photon, and is emitted before losing significant energy through scattering, and (ii) ensemble hot electron emission, where the photon source causes nonequilibrium heating of the electron population beyond the electron lattice temperature. It is shown that through appropriate selection of photon energy, optical power density, and applied electric field hot electron emission can be used to create ultra-high current electron emitters with ultra-fast temporal responses in both the single particle and ensemble heating regimes. These results suggest that through appropriate design, hot electron emitters may overcome the limitations of thermionic and field emitters.