Interface-resolved direct numerical simulations of downward particle-laden turbulent channel flows are performed by using a direct-forcing fictitious domain method. The effects of the particle settling coefficient, the density ratio (2, 10, and 100), and the particle size on fluid-turbulence interactions are investigated at a bulk Reynolds number of 5746 and a particle volume fraction of 2.36%. Our results indicate that the significant particle-induced reduction in the turbulence intensity does not take place for the downflow at a low density ratio of 2, and the turbulence intensity generally increases with an increasing particle Reynolds number at the same other control parameters, unlike the upflow case. The total turbulent kinetic energy (TKE) in the channel is larger for the downflow than for the upflow at the same particle Reynolds number, whereas the TKE at the channel center is roughly independent of the flow direction when the particle inertia is very large. For a density ratio of 2, the particles aggregate and are preferentially located in the low-speed streaks in the near-wall region, whereas for a density ratio of 10, the particles migrate toward the channel center, similar to the zero-gravity case. The flow friction increases with an increasing settling coefficient for the same density ratio and particle size, and the friction at the density ratio of order (10) is smallest. The pair distribution function shows the transition from the turbulence-dominated feature to the sedimentation-dominated feature, as the settling coefficient increases.