The osteochondral (OC) interface is not only the interface between two tissues, but also the evolution of hard and stiff bone tissue to the softer and viscoelastic articular cartilage covering the joint surface. To generate a smooth transition between two tissues with such differences in many of their characteristics, several gradients are recognizable when moving from the bone side to the joint surface. It is, therefore, necessary to implement such gradients in the design of scaffolds to regenerate the OC interface, so to mimic the anatomical, biological, and physicochemical properties of bone and cartilage as closely as possible. In the past years, several scaffolds were developed for OC regeneration: biphasic, triphasic, and multilayered scaffolds were used to mimic the compartmental nature of this tissue. The structure of these scaffolds presented gradients in mechanical, physicochemical, or biological properties. The use of gradient scaffolds with already differentiated or progenitor cells has been recently proposed. Some of these approaches have also been translated in clinical trials, yet without the expected satisfactory results, thus suggesting that further efforts in the development of constructs, which can lead to a functional regeneration of the OC interface by presenting gradients more closely resembling its native environment, will be needed in the near future. The aim of this review is to analyze the gradients present in the OC interface from the early stage of embryonic life up to the adult organism, and give an overview of the studies, which involved gradient scaffolds for its regeneration.