Fungal keratitis, a severe ocular disease, is one of the leading causes of ocular morbidity and blindness, yet it is often neglected, especially in developing countries. Therapeutic efficacy of traditional treatment such as eye drops is very limited due to poor bioavailability, whereas intraocular injection might cause serious side effects. Herein, we designed and fabricated a hybrid hydrogel-based contact lens which comprises quaternized chitosan (HTCC), silver nanoparticles, and graphene oxide (GO) with a combination of antibacterial and antifungal functions. The hydrogel is cross-linked through electrostatic interactions between GO and HTCC, resulting in strong mechanical properties. Voriconazole (Vor), an antifungal drug, can be loaded onto GO which retains the drug and promotes its sustained release from the hydrogel-based contact lenses. The contact lenses also exhibited good antimicrobial functions in view of glycidyltrimethylammonium chloride and silver nanoparticles. The results from in vitro and in vivo experiments demonstrate that contact lenses loaded with Vor have excellent efficacy in antifungal activity in vitro and could significantly enhance the therapeutic effects on a fungus-infected mouse model. The results indicate that this hydrogel contact lenses-based drug delivery system might be a promising therapeutic approach for a rapid and effective treatment of fungal keratitis.