Boron carbide (B4C) is one of the few materials that is expected to be most resilient with respect to the extremely high brilliance of the photon beam generated by free electron lasers (FELs) and is thus of considerable interest for optical applications in this field. However, as in the case of many other optics operated at light source facilities, B4C-coated optics are subject to ubiquitous carbon contaminations. Carbon contaminations represent a serious issue for the operation of FEL beamlines due to severe reduction of photon flux, beam coherence, creation of destructive interference, and scattering losses. A variety of B4C cleaning technologies were developed at different laboratories with varying success. We present a study regarding the low-pressure RF plasma cleaning of carbon contaminated B4C test samples via inductively coupled O2/Ar, H2/Ar, and pure O2 RF plasma produced following previous studies using the same ibss GV10x downstream plasma source. Results regarding the chemistry, morphology as well as other aspects of the B4C optical coating before and after the plasma cleaning are reported. We conclude that among the above plasma processes only plasma based on pure O2 feedstock gas exhibits the required chemical selectivity for maintaining the integrity of the B4C optical coatings.