For this experimental work, the solar dryer system has been fabricated. Various experiments have been performed to evaluate the performance of the fabricated dryer system. Energy and exergy concepts have been used for the assessment. And comparative analyses have also been done with smooth and rough surfaces: Grade 150 and Grade 300. This experimental work has been concluded as the maximum collector (i.e., 74°C) and cabinet temperatures (i.e., 66°C) are attained at 13:00 p.m. with Grade 300 surface. Maximum moisture loss (i.e., 35 g) and percentage moisture loss (i.e., 7.53%) are recorded at 13:00 p.m. again with a rough surface. Minimum exergy destruction rate (i.e., 0.294 W) but minimum exergy efficiency (i.e., 20.82%) are found at 17:00 p.m. with a black painted surface, which is not an acceptable condition. Maximum energy efficiency (i.e., 35.98%) and heat removal factor (i.e., 0.56) are obtained at 13:00 p.m. with a rough surface. The best performance from the fabricated solar system is received between 12:00 and 14:00 p.m. This study recommends rough surfaces and 12:00–13:00 p.m. timings for the solar drying system as the performance of the system is better in terms of energy–exergy.