This paper investigates the combined effect of the kiln or brick surface roughness and the brick lattice setting density on the fluid flow and heat transfer characteristics in tunnel kilns. The flow uniformity, pressure drop, convective heat transfer coefficient (CHTC), and pumping power are studied. A high-density setting (HDS), which comprises 768 bricks, and a low-density setting (LDS), which comprises 512 bricks, are tested for kiln boundaries and brick surface roughness levels of 0, 1, 2, 3, and 4 mm. The investigation is conducted using a 3D-CFD model with the k-ω turbulence model. The surface roughness changes from 0 to 4 mm for either kiln walls or bricks while fixing the other. The results show that increasing the tunnel kiln surface roughness from 0 to 4 mm increases the pressure drop of both the HDS and LDS by about 13.5%. It also increases the established CHTC value of the LDS more than the HDS by about 23% for all tested roughness levels. Changing the brick surface roughness from 0 to 4 mm increases the pressure drop and CHTC value for the LDS more than for the HDS by about 10% and 12%, respectively. Additionally, the total heat transfer rate-to-pumping power ratio for the LDS is larger than for the HDS by 17.4% for smooth bricks and 23.1% for the brick roughness of 2 mm, i.e., the brick roughness provides a greater advantage to the LDS. The results confirm that the LDS for rough and smooth bricks loaded in tunnel kilns attains a better brick quality, a higher heat transfer rate, and a lower pumping power than the HDS.