Understanding ionic transport across interfaces between dissimilar materials and the intrinsic chemical stability of such interfaces is a fundamental challenge spanning many disciplines and is of particular importance for designing conductive and stable solid electrolytes for solid-state Li-ion batteries. In this work, we establish a surface science-based approach for assessing the intrinsic stability of oxide materials in contact with Li metal. Through a combination of experimental and computational insights, using Nb-doped SrTiO (Nb/STO) single crystals as a model system, we were able to understand the impact of crystallographic orientation and surface morphology on the extent of the chemical reactions that take place between surface Nb, Ti, and Sr upon reaction with Li. By expanding our approach to investigate the intrinsic stability of the technologically relevant, polycrystalline Nb-doped lithium lanthanum zirconium oxide (LiLaZrNbO) system, we found that this material reacts with Li metal through the reduction of Nb, similar to that observed for Nb/STO. These results clearly demonstrate the feasibility of our approach to assess the intrinsic (in)stability of oxide materials for solid-state batteries and point to new strategies for understanding the performance of such systems.