Communication between the prefrontal cortex and subcortical nuclei underpins the control and inhibition of behavior. However, the interactions in such pathways remain controversial. Using a stop-signal response inhibition task and functional imaging with analysis of effective connectivity, we show that the lateral prefrontal cortex influences the strength of communication between regions in the frontostriatal motor system. We compared 20 generative models that represented alternative interactions between the inferior frontal gyrus, presupplementary motor area (preSMA), subthalamic nucleus (STN), and primary motor cortex during response inhibition. Bayesian model selection revealed that during successful response inhibition, the inferior frontal gyrus modulates an excitatory influence of the preSMA on the STN, thereby amplifying the downstream polysynaptic inhibition from the STN to the motor cortex. Critically, the strength of the interaction between preSMA and STN, and the degree of modulation by the inferior frontal gyrus, predicted individual differences in participants' stopping performance (stop-signal reaction time). We then used diffusion-weighted imaging with tractography to assess white matter structure in the pathways connecting these three regions. The mean diffusivity in tracts between preSMA and the STN, and between the inferior frontal gyrus and STN, also predicted individual differences in stopping efficiency. Finally, we found that white matter structure in the tract between preSMA and STN correlated with effective connectivity of the same pathway, providing important cross-modal validation of the effective connectivity measures. Together, the results demonstrate the network dynamics and modulatory role of the prefrontal cortex that underpin individual differences in inhibitory control.