Cost-effective biomass drying is a key challenge for energy recovery from biomass by direct combustion, gasification, and pyrolysis. The aim of the present study was to optimize the process of biomass drying using hot air convection (HA), infrared (IR), and combined drying systems (IR-HA). The specific energy consumption (SEC) decreased significantly by increasing the drying temperature using convective drying, but higher air velocities increased the SEC. Similarly, increasing air velocity in the infrared dryer resulted in a significant increase in SEC. The lowest SEC was recorded at 7.8 MJ/kg at an air velocity of 0.5 m/s and an IR intensity of 0.30 W/cm2, while a maximum SEC (20.7 MJ/kg) was observed at 1.0 m/s and 0.15 W/cm2. However, a significant reduction in the SEC was noticed in the combined drying system. A minimum SEC of 3.8 MJ/kg was recorded using the combined infrared-hot air convection (IR-HA) drying system, which was 91.7% and 51.7% lower than convective and IR dryers, respectively. The present study suggested a combination of IR and hot air convection at 60 °C, 0.3 W/cm2 and 0.5 m/s as optimum conditions for efficient drying of biomass with a high water content.