The development of heterocyclic derivatives has progressed considerably over the past decades, and many new carbonic anhydrase inhibitors (CAIs) fall into this field. In particular, five-membered heterocyclic sulfonamides have been generally shown to be more effective inhibitors compared to six-membered rings ones. Despite the importance of oxygen and nitrogen five-membered heterocyclic aromatic rings in medicinal chemistry, the installation of sulfonamide moiety on such heterocycles has not received much attention. On the other hand, 1,3,4-thiadiazole/thiadiazoline ring-bearing sulfonamides are the scaffolds which have been widely used in a variety of pharmaceutically important CAIs such as acetazolamide, metazolamide and their many derivatives obtained by using the tail approach. Here, we reviewed the field focusing on the diverse biological activities of these CAIs, such as antiglaucoma, antiepileptic, antitumor and antiinfective properties. This review highlights developments involving five-membered heterocyclic sulfonamides over the last years, with a focus on their pharmacological/clinical applications.