A series of novel N-substituted-β-d-glucosamine derivatives that incorporate benzenesulfonamides were designed using a fragment-based drug design strategy. Each derivative was synthesized and evaluated in vitro for its inhibitory activity against human carbonic anhydrase (hCA) IX; several derivatives displayed desirable potency profiles against this enzyme. The molecular docking studies provided the design rationale and predicted potential binding modes for carbonic anhydrase (CA) IX and three target compounds, including the most potent inhibitor, compound 7f (IC50 = 10.01 nM). Moreover, the calculated Log P (cLog P) values showed that all the compounds tended to be hydrophilic. In addition, topological polar surface area (TPSA) value-based predictions highlighted the selectivity of these carbohydrate-based inhibitors for membrane-associated CA IX.