Various types of materials have been traditionally used to restore damaged bones. In the late 1960s, a strong interest was raised in studying ceramics as potential bone grafts due to their biomechanical properties. A short time later, such synthetic biomaterials were called bioceramics. Bioceramics can be prepared from diverse inorganic substances, but this review is limited to calcium orthophosphate (CaPO4)-based formulations only, due to its chemical similarity to mammalian bones and teeth. During the past 50 years, there have been a number of important achievements in this field. Namely, after the initial development of bioceramics that was just tolerated in the physiological environment, an emphasis was shifted towards the formulations able to form direct chemical bonds with the adjacent bones. Afterwards, by the structural and compositional controls, it became possible to choose whether the CaPO4-based implants would remain biologically stable once incorporated into the skeletal structure or whether they would be resorbed over time. At the turn of the millennium, a new concept of regenerative bioceramics was developed, and such formulations became an integrated part of the tissue engineering approach. Now, CaPO4-based scaffolds are designed to induce bone formation and vascularization. These scaffolds are usually porous and harbor various biomolecules and/or cells. Therefore, current biomedical applications of CaPO4-based bioceramics include artificial bone grafts, bone augmentations, maxillofacial reconstruction, spinal fusion, and periodontal disease repairs, as well as bone fillers after tumor surgery. Prospective future applications comprise drug delivery and tissue engineering purposes because CaPO4 appear to be promising carriers of growth factors, bioactive peptides, and various types of cells.