Human herpesviruses are a ubiquitous family of viruses that infect individuals of all ages and are present at a high prevalence worldwide. Herpesviruses are responsible for a broad spectrum of diseases, ranging from skin and mucosal lesions to blindness and life-threatening encephalitis, and some of them, such as Kaposi’s sarcoma-associated herpesvirus (KSHV) and Epstein–Barr virus (EBV), are known to be oncogenic. Furthermore, recent studies suggest that some herpesviruses may be associated with developing neurodegenerative diseases. These viruses can establish lifelong infections in the host and remain in a latent state with periodic reactivations. To achieve infection and yield new infectious viral particles, these viruses require and interact with molecular host determinants for supporting their replication and spread. Important sets of cellular factors involved in the lifecycle of herpesviruses are those participating in intracellular membrane trafficking pathways, as well as autophagic-based organelle recycling processes. These cellular processes are required by these viruses for cell entry and exit steps. Here, we review and discuss recent findings related to how herpesviruses exploit vesicular trafficking and autophagy components by using both host and viral gene products to promote the import and export of infectious viral particles from and to the extracellular environment. Understanding how herpesviruses modulate autophagy, endolysosomal and secretory pathways, as well as other prominent trafficking vesicles within the cell, could enable the engineering of novel antiviral therapies to treat these viruses and counteract their negative health effects.