The eukaryotic genome is packaged in the three-dimensional nuclear space by forming loops, domains and compartments in a hierarchical manner. However, when duplicated genomes prepare for segregation, mitotic cells eliminate topologically associating domains and abandon the compartmentalized structure. Alongside chromatin architecture reorganization during the transition from interphase to mitosis, cells halt most DNA-templated processes such as transcription and repair. The intrinsically condensed chromatin serves as a sophisticated signaling module subjected to selective relaxation for programmed genomic activities. To understand the elaborate genome-epigenome interplay during cell cycle progression, the steady three-dimensional genome requires a time scale to form a dynamic four-dimensional and a more comprehensive portrait. In this review, we will dissect the functions of critical chromatin architectural components in constructing and maintaining an orderly packaged chromatin environment. We will also highlight the importance of the spatially-and-temporally-conscious orchestration of chromatin remodeling to ensure high-fidelity genetic transmission.