The main aim of bone tissue engineering is to fabricate highly biocompatible, osteoconductive and/or osteoinductive biomaterials for tissue regeneration. Bone implants should support bone growth at the implantation site via promotion of osteoblast adhesion, proliferation, and formation of bone extracellular matrix. Moreover, a very desired feature of biomaterials for clinical applications is their osteoinductivity, which means the ability of the material to induce osteogenic differentiation of mesenchymal stem cells toward bone-building cells (osteoblasts). Nevertheless, the development of completely biocompatible biomaterials with appropriate physicochemical and mechanical properties poses a great challenge for the researchers. Thus, the current trend in the engineering of biomaterials focuses on the surface modifications to improve biological properties of bone implants. This review presents the most recent findings concerning surface modifications of biomaterials to improve their osteoconductivity and osteoinductivity. The article describes two types of surface modifications: (1) Additive and (2) subtractive, indicating biological effects of the resultant surfaces in vitro and/or in vivo. The review article summarizes known additive modifications, such as plasma treatment, magnetron sputtering, and preparation of inorganic, organic, and composite coatings on the implants. It also presents some common subtractive processes applied for surface modifications of the biomaterials (i.e., acid etching, sand blasting, grit blasting, sand-blasted large-grit acid etched (SLA), anodizing, and laser methods). In summary, the article is an excellent compendium on the surface modifications and development of advanced osteoconductive and/or osteoinductive coatings on biomaterials for bone regeneration.