The genome packaging motor of bacteriophages and herpesviruses is built by two terminase subunits, known as large (TerL) and small (TerS), both essential for viral genome packaging. TerL structure, composition, and assembly to an empty capsid, as well as the mechanisms of ATP-dependent DNA packaging, have been studied in depth, shedding light on the chemo-mechanical coupling between ATP hydrolysis and DNA translocation. Instead, significantly less is known about the small terminase subunit, TerS, which is dispensable or even inhibitory in vitro, but essential in vivo. By taking advantage of the recent revolution in cryo-electron microscopy (cryo-EM) and building upon a wealth of crystallographic structures of phage TerSs, in this review, we take an inventory of known TerSs studied to date. Our analysis suggests that TerS evolved and diversified into a flexible molecular framework that can conserve biological function with minimal sequence and quaternary structure conservation to fit different packaging strategies and environmental conditions.