Improving on the standard of care for a given disease is predicated on better treatments, which in turn relies on finding and developing new drugs. However, drug discovery is a complex, cross-disciplinary and costly process. Adoption of recently developed methods from machine learning has given rise to creation of drug discovery knowledge graphs which utilize the inherent interconnected nature of the domain. Graph-based modelling of the data, combined with knowledge graph embedding methods which aim to learn meaningful representations of biological entities, are promising as they provide a more intuitive representation of the domain and are suitable for inference tasks such as predicting missing links. In this context, one such example would be producing ranked lists of likely associated genes for a given disease, often referred to as target discovery. It is thus critical that these predictions are not only pertinent but also biologically meaningful.