Interfaces such as grain boundaries (GBs) and heterointerfaces (HIs) are known to play a crucial role in structure-property relationships of polycrystalline materials. While several methods have been used to characterize such interfaces, advanced transmission electron microscopy (TEM) and scanning TEM (STEM) techniques have proven to be uniquely powerful tools, enabling quantification of atomic structure, electronic structure, chemistry, order/disorder, and point defect distributions below the atomic scale. This review focuses on recent progress in characterization of polycrystalline oxide interfaces using S/TEM techniques including imaging, analytical spectroscopies such as energy dispersive X-ray spectroscopy (EDXS) and electron energy-loss spectroscopy (EELS) and scanning diffraction methods such as precession electron nano diffraction (PEND) and 4D-STEM. First, a brief introduction to interfaces, GBs, HIs, and relevant techniques is given. Then, experimental studies which directly correlate GB/HI S/TEM characterization with measured properties of polycrystalline oxides are presented to both strengthen our understanding of these interfaces, and to demonstrate the instrumental capabilities available in the S/TEM. Finally, existing challenges and future development opportunities are discussed. In summary, this article is prepared as a guide for scientists and engineers interested in learning about, and/or using advanced S/TEM techniques to characterize interfaces in polycrystalline materials, particularly ceramic oxides.