This work reports the first experimental study of graphene transferred on β‐Si3N4(0001)/Si(111). A comprehensive quantitative understanding of the physics of ultrathin Si3N4 as a gate dielectric for graphene‐based devices is provided. The Si3N4 film is grown on Si(111) under ultra‐high vacuum (UHV) conditions and investigated by scanning tunneling microscopy (STM). Subsequently, a graphene flake is deposited on top of it by a polymer‐based transfer technique, and a Hall bar device is fabricated from the graphene flake. STM is employed again to study the graphene flake under UHV conditions after device fabrication and shows that the surface quality is preserved. Electrical transport measurements, carried out at low temperature in magnetic field, reveal back gate modulation of carrier density in the graphene channel and show the occurrence of weak localization. Under these experimental conditions, no leakage current between back gate and graphene channel is detected.