For decades, borides have been primarily studied as crystallographic oddities. With such a wide variety of structures (a quick survey of the Inorganic Crystal Structure Database counts 1253 entries for binary boron compounds!), it is surprising that the applications of borides have been quite limited despite a great deal of fundamental research. If anything, the rich crystal chemistry found in borides could well provide the right tool for almost any application. The interplay between metals and the boron results in even more varied material's properties, many of which can be tuned via chemistry. Thus, the aim of this review is to reintroduce to the scientific community the developments in boride crystal chemistry over the past 60 years. We tie structures to material properties, and furthermore, elaborate on convenient synthetic routes toward preparing borides.