Active broadband terahertz (THz) polarization manipulation devices are challenging to realize, but also of great demand in broadband terahertz systems. Vanadium dioxide (VO2) shows a promising phase transition for active control of THz waves and provides broadband polarization characteristics when integrated within grating-type structures. We creatively combine a VO2-based grating structure with a total internal reflection (TIR) geometry providing a novel interaction mechanism between the electromagnetic waves and the device, to realize a powerful active broadband THz polarization-controlling device. The device is based on a Si-substrate coated with a VO2 layer and a metal grating structure on top, attached to a prism for generating the TIR condition on the Si-VO2-grating interface. The grating is connected to electrodes for electrically switching the VO2 between its insulating and conducting phases. By properly selecting the incident angle of the THz waves, the grating direction, and the incident polarization state, we first achieved a broadband intensity modulator under a fused silica prism with an average modulation depth of 99.75% in the 0.2-1.1 THz region. Additionally, we realized an active ultra-broadband quarter-wave converter under a Si prism that can be switched between a 45° linear rotator and a quarter wave converter in the 0.8-1.5 THz region. This is the first demonstration of an active quarter-wave converter with ultra-broad bandwidth performance. Our work shows a highly flexible and multifunctional polarization-controlling device for broadband THz applications.