The study of generalized Jeffreys and generalized Oldroyd-B fluids with fractional derivatives has made rapid progress as an example of applications of fractional calculus in rheology. However, their thermodynamic compatibility and mechanical analogue have not yet been properly considered. In the present study, by discussing both these issues, we find that the two orders of fractional derivatives in the constitutive equation of the generalized Jeffreys fluid must be the same in order to ensure that the equation is physically correct. Based on this generalized Jeffreys fluid, a thermodynamically compatible generalized Oldryd-B fluid is also proposed by the convected coordinates approach. generalized Jeffreys fluid, generalized Oldroyd-B fluid, thermodynamic compatibility, mechanical analogue PACS: 47.50.Cd, 47.57.Qk, 47.57.Ng