In finite-time quantum heat engines, some work is consumed to drive a working fluid accompanying coherence, which is called 'friction'. To understand the role of friction in quantum thermodynamics, we present a couple of finite-time quantum Otto cycles with two different baths: Agarwal versus Lindbladian. We exactly solve them and compare the performance of the Agarwal engine with that of the Lidbladian one. Particularly, we find remarkable and counterintuitive results that the performance of the Agarwal engine due to friction can be much higher than that in the quasi-static limit with the Otto efficiency, and the power of the Lindbladian engine can be non-zero in the short-time limit. Based on additional numerical calculations of these outcomes, we discuss possible origins of such differences between two engines and reveal them. Our results imply that even with equilibrium bath, a non-equilibrium working fluid brings on the higher performance than what an equilibrium one does.