Granular dampers are passive devices used to attenuate mechanical vibrations. The most common configuration consists in an enclosure, partiallyfilled with particles, attached to the vibrating structure that needs to be damped. The energy is dissipated due to inelastic collisions and friction between the grains and between the grains and the inner walls of the container as the structure vibrates. As a result of the collisions, the mechanical response of the system often results in chaotic motion even if the driving is harmonic. Despite the vibration attenuation achieved, this chaotic response may render the granular damper unsuitable for a range of applications. In this work, we showcase two simple modifications of the enclosure design that are able to mitigate the chaotic response of the granular damper. To this end we use Discrete Element Method simulations of: (a) a granular damper with a conical base, and (b) a granular damper with obstaclesfixed inside the enclosure. We compare results against a standardflat-base enclosure damper. The basic mechanical response of the dampers is characterized by measuring the apparent mass and the loss factor. The suppression of the chaotic response is assessed qualitatively via the phase space diagram.