POGZ, which encodes a multi-domain transcription factor, has been found frequently mutated in neurodevelopmental disorders, particularly autism spectrum disorder (ASD) and intellectual disability (ID). However, little is known about its function in ESC self-renewal and pluripotency, cell fate determination as well as in transcriptional regulation. Here, using embryonic stem cells (ESCs) as model, we show that POGZ plays key roles in the maintenance of ESC and cell fate determination by association with the SWI-SNW chromatin remodeler complex and heterochromatin protein 1 (HP1) proteins. POGZ is essential for the maintenance of ESC undifferentiated state, and loss of POGZ leads to ESC differentiation, likely by up-regulation of primitive endoderm and mesoderm lineage genes and by down-regulation of pluripotency-related genes. Mechanistically, POGZ may control ESC-specific gene expression by association with chromatin remodeler complex esBAF and HP1s, and they can form a PBH triplex. POGZ functions primarily to maintain an open chromatin, as loss of POGZ leads to a reduced chromatin accessibility. Regulation of chromatin under control of POGZ depends on esBAF complex. POGZ is extensively co-localized with OCT4/NANOG genome wide. Taken together, we propose that POGZ is a pluripotency-associated factor, and its absence in ESCs causes failure to maintain a proper ESC-specific chromatin state and transcriptional circuitry of pluripotency, which eventually leads to ESC self-renewal and pluripotency defects. Our work provides important insights into the role of POGZ in ESC self-renewal and pluripotency as well as regulation of transcription, which will be useful for understanding the etiology of neurodevelopmental disorders by POGZ mutation.