Thanks to the strong magnetic anisotropy shown by the multiferroic RMn 2 O 5 (R = magnetic rare earth) compounds, a large adiabatic temperature change can be induced (around 10 K) by rotating them in constant magnetic fields instead of the standard magnetization-demagnetization method. Particularly, the TbMn 2 O 5 single crystal reveals a giant rotating magnetocaloric effect (RMCE) under relatively low constant magnetic fields reachable by permanent magnets. On the other hand, the nature of R 3+ ions strongly affects their RMCEs. For example, the maximum rotating adiabatic temperature change exhibited by TbMn 2 O 5 is more than five times larger than that presented by HoMn 2 O 5 in a constant magnetic field of 2 T. In this paper, we mainly focus on the physics behind the RMCE shown by RMn 2 O 5 multiferroics. We particularly demonstrate that the rare earth size could play a crucial role in determining the magnetic order, and accordingly, the rotating magnetocaloric properties of RMn 2 O 5 compounds through the modulation of exchange interactions via lattice distortions. This is a scenario that seems to be supported by Raman scattering measurements.