In this work, two classes of Carbonic Anhydrase (CA) inhibitors, sulfonamide and coumarin derivatives linked to pyta moiety (2a-b) and their corresponding rhenium complexes (3a-b), were designed. These compounds were synthesized and fully characterized by classical analytical methods and X-ray diffraction. All the synthesized compounds were evaluated for their inhibitory activity against the hCA isoforms I, II, IX and XII. They exhibited high inhibitory activities in the range of nanomolar for both hCA IX and hCA XII isoforms. The sulfonamide compound 2a showed the strongest inhibition against the tumour-associated hCA IX isoform with a Ki of 11.7 nM. The tumour-associated isoforms hCA IX and hCA XII were selectively inhibited by all the coumarin derivatives, with inhibition constants ranging from 12.7 nM (2b) to 44.5 nM (3b), while the hCA I and II isoforms were slightly inhibited (in the micromolar range), as expected. In terms of selectivity, compared to previously published rhenium complex-based CA inhibitors, complex 3b showed one of the highest selectivities against hCA IX and hCA XII compared to the off-target isoforms hCA I and hCA II, making it a potential anti-cancer drug candidate. Molecular docking calculations were performed to investigate the inhibition profiles of the investigated compounds at the tumour-associated hCA IX active site and to rationalize our results.