The main task of this work is to study the tribological performance of nanolubricants formed by trimethylolpropane trioleate (TMPTO) base oil with magnetic nanoparticles coated with oleic acid: Fe3O4 of two sizes 6.3 nm and 10 nm, and Nd alloy compound of 19 nm. Coated nanoparticles (NPs) were synthesized via chemical co-precipitation or thermal decomposition by adsorption with oleic acid in the same step. Three nanodispersions of TMPTO of 0.015 wt% of each NP were prepared, which were stable for at least 11 months. Two different types of tribological tests were carried out: pure sliding conditions and rolling conditions (5% slide to roll ratio). With the aim of analyzing the wear by means of the wear scar diameter (WSD), the wear track depth and the volume of the wear track produced after the first type of the tribological tests, a 3D optical profiler was used. The best tribological performance was found for the Nd alloy compound nanodispersion, with reductions of 29% and 67% in friction and WSD, respectively, in comparison with TMPTO. On the other hand, rolling conditions tests were utilized to study friction and film thickness of nanolubricants, determining that Fe3O4 (6.3 nm) nanolubricant reduces friction in comparison to TMPTO.