III‐V colloidal quantum dots (CQDs) are of interest in infrared photodetection, and recent developments in CQDs synthesis and surface engineering have improved performance. Here this work investigates photodetector stability, finding that the diffusion of zinc ions from charge transport layers (CTLs) into the CQDs active layer increases trap density therein, leading to rapid and irreversible performance loss during operation. In an effort to prevent this, this work introduces organic blocking layers between the CQDs and ZnO layers; but these negatively impact device performance. The device is then, allowing to use a C60:BCP as top electron‐transport layer (ETL) for good morphology and process compatibility, and selecting NiOX as the bottom hole‐transport layer (HTL). The first round of NiOX‐based devices show efficient light response but suffer from high leakage current and a low open‐circuit voltage (Voc) due to pinholes. This work introduces poly[bis(4‐phenyl) (2,4,6‐trimethylphenyl)amine] (PTAA) with NiOX NC to form a hybrid HTL, an addition that reduces pinhole formation, interfacial trap density, and bimolecular recombination, enhancing carrier harvesting. The photodetectors achieve 53% external quantum efficiency (EQE) at 970 nm at 1 V applied bias, and they maintain 95% of initial performance after 19 h of continuous illuminated operation. The photodetectors retain over 80% of performance after 80 days of shelf storage.