A comparative molecular dynamics simulation study of collision cascades in two elemental semiconductors and five fcc metals is performed to elucidate how different material characteristics affect primary defect production during ion irradiation. By using simulations of full 400 eV-10 keV collision cascades and contrasting the results on different materials with each other, we probe the effect of the mass, melting temperature, material strength, and crystal structure on the modification of the material due to the cascade. The results show that the crystal structure has a strong effect on many aspects of damage production, while other material characteristics are of lesser overall importance. In all materials studied, isolated point defects produced by the cascade are predominantly interstitials. In semiconductors, amorphous clusters are produced in the cascade core, whereas in metals most of the crystal regenerates, leaving only small vacancy-rich clusters. Large interstitial clusters found in a few events in the heavy metals were observed to form by the isolation of a high-density liquid zone during the recrystallization phase of a cascade. ͓S0163-1829͑98͒01813-X͔