Mammalian chromosomes are folded by converging and opposing forces. Here, we tested the role of RNAPII across different scales of interphase chromatin folding in a cellular system allowing for its auxin-mediated degradation. We used Micro-C and computational modeling to characterize subsets of loops differentially gained or lost upon RNAPII depletion. Gained loops, extrusion of which was antagonized by RNAPII, almost invariably formed by engaging new or rewired CTCF anchors. Lost loops selectively concerned contacts between enhancers and promoters anchored by RNAPII. Surprisingly, promoter-promoter contacts were almost insensitive to polymerase depletion and sustained cohesin occupancy in its absence. Selective loss of enhancer-promoter contacts explains the repression of most genes. Together, our findings reconcile the role of RNAPII in transcription with that in setting-up regulatory 3D chromatin architectures genome-wide, while also revealing a direct impact on cohesin loop extrusion.