The Golgi apparatus lies at the heart of the secretory pathway where it receives, modifies, and sorts protein cargo to the proper intracellular or extracellular location. Although this secretory function is highly conserved throughout the eukaryotic kingdom, the structure of the Golgi complex is arranged very differently among species. In particular, Golgi membranes in vertebrate cells are integrated into a single compact entity termed the Golgi ribbon that is normally localized in the perinuclear area and in close vicinity to the centrosomes. This organization poses a challenge for cell division when the single Golgi ribbon needs to be partitioned into the two daughter cells. To ensure faithful inheritance in the progeny, the Golgi ribbon is divided in three consecutive steps in mitosis, namely disassembly, partitioning, and reassembly. However, the structure of the Golgi ribbon is only present in higher animals and Golgi disassembly during mitosis is not ubiquitous in all organisms. Therefore, there must be unique reasons to build up the Golgi in this particular conformation and to preserve it over generations. In this review, we first highlight the diversity of the Golgi architecture in different organisms and revisit the concept of the Golgi ribbon. Following on, we discuss why the ribbon is needed and how it forms in vertebrate cells. Lastly, we conclude with likely purposes of mitotic ribbon disassembly and further propose mechanisms by which it regulates mitosis.