Gadolinium-based contrast agents (GBCAs) are widely used in magnetic resonance imaging (MRI) to help with the diagnostic and monitoring processes of many diseases, including neurological disorders. Initially, it was assumed that GBCAs carry minimal risk, are safe and well tolerated. But recent reports of GBCA-associated deposition in many body tissues have raised concerns about the broader health impacts of gadolinium exposure. The aim of this review was to summarise knowledge regarding gadolinium deposition, primarily in the brain structures, and of potential GBCA-associated toxicity. Moreover, we discuss the current recommendations on the use of GBCAs, as well as alternative contrast agents and imaging techniques.