The coefficient of restitution (COR) represents the fraction of pre-collision kinetic energy remained after the collision between two bodies. The COR parameter plays an important role in the discrete numerical analysis of granular flows or the design of protective barriers to reduce flow energy. This work investigated the COR for grain-block type impacts through comprehensive experiments using a custom-built impact loading apparatus. Glass balls of three different sizes were used as grains.The impact experiments were performed on three different types of materials as base blocks, namely brass, granite and rubber. Experiments on the brass block showed a decrease in COR values with increasing grain size. On the contrary, impacts on granite and rubber blocks showed an increase in COR values with increasing grain size. Additionally, the effect of surface roughness on the COR was investigated. It was revealed that the increase in surface roughness of either the grain or the block reduced the COR values due to the increased plastic deformations of surface asperities.