In this Perspective, the evolutionary and revolutionary developments of ultrafast electron imaging are overviewed with focus on the “single-electron concept” for probing methodology. From the first electron microscope of Knoll and Ruska [Z. Phys. 78, 318 (1932)], constructed in the 1930s, to aberration-corrected instruments and on, to four-dimensional ultrafast electron microscopy (4D UEM), the developments over eight decades have transformed humans’ scope of visualization. The changes in the length and time scales involved are unimaginable, beginning with the micrometer and second domains, and now reaching the space and time dimensions of atoms in matter. With these advances, it has become possible to follow the elementary structural dynamics as it unfolds in real time and to provide the means for visualizing materials behavior and biological functions. The aim is to understand emergent phenomena in complex systems, and 4D UEM is now central for the visualization of elementary processes involved, as illustrated here with examples from past achievements and future outlook.