NusG is a general transcription elongation factor that stimulates transcription pausing in Gram+ bacteria including Bacillus subtilis by sequence-specific interaction with a conserved pause-inducing -11TTNTTT-6 motif found in the non-template DNA (ntDNA) strand within the transcription bubble. To reveal the structural basis of NusG-dependent pausing, we determined the cryo-electron microscopy (cryo-EM) structure of a paused transcription complex containing RNAP, NusG, and the TTNTTT motif in the ntDNA strand. The interaction of NusG with the ntDNA strand expands the transcription bubble by positioning three consecutive T residues in a cleft between NusG and the β subunit lobe domain (β-lobe) of RNAP. We revealed that the RNAP swivel module rotation (swiveling), which widens (swiveled state) and narrows (non-swiveled state) a cleft between NusG and the β-lobe, is an intrinsic motion of RNAP and is directly linked to nucleotide binding at the active site and to trigger loop folding, an essential conformational change of all cellular RNAPs for the RNA synthesis reaction. We also determined cryo-EM structures of RNAP escaping from a paused transcription complex. These structures revealed the NusG-dependent pausing mechanism by which NusG-ntDNA interaction inhibits the transition from swiveled to non-swiveled states, thereby preventing trigger loop folding and RNA synthesis allosterically. This motion is also inhibited by formation of an RNA hairpin within the RNA exit channel. Thus, the pause half-life can be modulated by the strength of the NusG-ntDNA interaction and/or the stability of the RNA hairpin. NusG residues that interact with the TTNTTT motif are widely conserved in bacteria, suggesting that NusG-dependent pausing of transcription is widespread.