Memory plays a vital role in modern information society. High‐speed and low‐power nonvolatile memory is urgently demanded in the era of big data. However, ultrafast nonvolatile memory with nanosecond‐timescale operation speed and long‐term retention is still unavailable. Herein, an ultrafast nonvolatile memory based on van der Waals heterostructure is proposed, where a charge‐trapping material, graphdiyne (GDY), serves as the charge‐trapping layer. With the band‐engineered heterostructure and excellent charge‐trapping capability of GDY, charges are directly injected into the GDY layer and are persistently captured by the trapping sites in GDY, which result in an ultrafast writing speed (8 ns), a low operation voltage (30 mV), and a long retention time (over 104 s). Moreover, a high on/off ratio of 106 is demonstrated by this memory, which enables the achievement of multibit storage with 6 discrete storage levels. This device fills the blank of ultrafast nonvolatile memory technology, which makes it a promising candidate for next‐generation high‐speed and low‐power‐consumption nonvolatile memory.