A resurgence in the use of the donor-acceptor (DA) approach in synthesizing conjugated polymers has resulted in a family of high-mobility ambipolar systems with exceptionally narrow energy bandgaps below 1 eV. The ability to transport both electrons and holes is critical for device applications such as organic light-emitting diodes (OLEDs) and transistors (OLETs). Infrared spectroscopy offers direct access to the low-energy excitations associated with injected charge carriers. Here we use a diffraction-limited IR microscope to probe the spectroscopic signatures of electron and hole injection in the conduction channel of an organic field-effect transistor (OFET) based on an ambipolar DA polymer polydiketopyrrolopyrrole-benzobisthiadiazole (PDPPBBT). We observe distinct polaronic absorptions for both electrons and holes, and spatially map the carrier distribution from the source to drain electrodes for both unipolar and ambipolar biasing regimes. For ambipolar device configurations, we observe the spatial evolution of hole-induced to electron-induced polaron absorptions throughout the transport path. Our work provides a platform for combined transport and infrared studies of organic semiconductors on micron length scales relevant to functional devices.