Cellular identity in both normal and disease processes is determined by programmed epigenetic activation or silencing of specific gene subsets. Here, we have used human cells harboring epigenetically silent GFP-reporter genes to perform a genome-wide siRNA knockdown screen for the identification of cellular factors that are required to maintain epigenetic gene silencing. This unbiased screen interrogated 21,121 genes, and we identified and validated a set of 128 protein factors. This set showed enrichment for functional categories, and protein-protein interactions. Among this set were known epigenetic silencing factors, factors with no previously identified role in epigenetic gene silencing, as well as unstudied factors. The set included non-nuclear factors, for example, components of the integrin-adhesome. A key finding was that the E1 and E2 enzymes of the small ubiquitin-like modifier (SUMO) pathway (SAE1, SAE2/UBA2, UBC9/UBE2I) are essential for maintenance of epigenetic silencing. This work provides the first genome-wide functional view of human factors that mediate epigenetic gene silencing. The screen output identifies novel epigenetic factors, networks, and mechanisms, and provides a set of candidate targets for epigenetic therapy and cellular reprogramming.