The impact of the development of sulfur therapeutics is instrumental to the evolution of the pharmaceutical industry. Sulfur-derived functional groups can be found in a broad range of pharmaceuticals and natural products. For centuries, sulfur continues to maintain its status as the dominating heteroatom integrated into a set of 362 sulfur-containing FDA approved drugs (besides oxygen or nitrogen) through the present. Sulfonamides, thioethers, sulfones and Penicillin are the most common scaffolds in sulfur containing drugs, which are well studied both on synthesis and application during the past decades. In this review, these four moieties in pharmaceuticals and recent advances in the synthesis of the corresponding core scaffolds are presented.