A series of saccharide-modified thiadiazole sulfonamide derivatives has been designed and synthesized by the “tail approach” and evaluated for inhibitory activity against carbonic anhydrases II, IX, and XII. Most of the compounds showed high topological polar surface area (TPSA) values and excellent enzyme inhibitory activity. The impacts of some compounds on the viability of HT-29, MDA-MB-231, and MG-63 human cancer cell lines were examined under both normoxic and hypoxic conditions, and they showed certain inhibitory effects on cell viability. Moreover, it was found that the series of compounds had the ability to raise the pH of the tumor cell microenvironment. All the results proved that saccharide-modified thiadiazole sulfonamides have important research prospects for the development of CA IX inhibitors.