Rhombohedral boron carbide, often referred to as r-B4C, is a potential material for applications in optoelectronic and thermoelectric devices. From fundamental thin film growth and characterization, we investigate the film-substrate interface between the r-B4C films grown on 4H-SiC (0001 ̅) (C-face) and 4H-SiC (0001) (Si-face) during chemical vapor deposition (CVD) to find the origin for epitaxial growth solely observed on the C-face. We used high-resolution (scanning) transmission electron microscopy and electron energy loss spectroscopy to show that there is no surface roughness or additional carbon-based interlayer formation for either substrate. Based on Raman spectroscopy analysis, we also argue that carbon accumulation on the surface hinders the growth of continued epitaxial r-B4C in CVD.