The (18 kDa) Translocator Protein (TSPO), was initially identified in 1977 as peripheral binding site for the benzodiazepine diazepam and named "Peripheral-type benzodiazepine receptor (PBR)". It is an evolutionarily well-conserved protein particularly located at the outer/inner mitochondrial membrane contact sites, in closely association with the 32 kDa voltage-dependent anion channel (VDAC) and the 30 kDa adenine nucleotide translocase (ANT), thus forming the mitochondrial permeability transition pore (MPTP). TSPO is ubiquitary expressed in peripheral tissues (steroid producing tissues, liver, heart, kidney, lung, immune system) and in lower levels in the central nervous system, where it is mainly located in glial cells, and in neurons. TSPO is involved in a variety of biological processes such as cholesterol transport, steroidogenesis, calcium homeostasis, lipid metabolism, mitochondrial oxidation, cell growth and differentiation, apoptosis induction, and regulation of immune functions. In the last decade, many studies have reported that TSPO basal expression is altered in a number of human pathologies, such as cancer and neurodegenerative disorders (Huntington's and Alzheimer's diseases), as well as in various forms of brain injury and inflammation and anxiety. Consequently, TSPO has not only been suggested as a promising drug target for a number of therapeutic applications (anticonvulsant, anxiolytic, immunomodulating, etc.), but also as valid diagnostic marker for related-disease state and progression, prompting the development of specific labelled ligands as powerful tools for imaging techniques. A number of structurally different classes of ligands have been reported, showing high affinity and selectivity towards TSPO. Indeed, most of these ligands have been designed starting from selective CBR ligands which were structurally modified in order to shift their affinity towards TSPO. Extensive structure-activity relationship studies were performed allowing to hypothesize various TSPO pharmacophore models. The purpose of this paper is to highlight the structural requirements needed to obtain TSPO ligands with high affinity and selectivity.