It is extremely challenging to accomplish second‐harmonic generation (SHG) in the whole mid‐infrared (MIR) region for oxide crystals due to their short IR absorption cutoff wavelengths. Herein, a new MIR nonlinear optical (NLO) crystal of K4ZnV5O15Cl (KZVC) is designed and synthesized by the aliovalent substitution of [VIIIO5] with [ZnIIO4Cl] based on the K2(VO)(V2O7) matrix. KZVC features an ordered 2D [ZnV5O15Cl]∞ layered structure comprising [ZnO4Cl] / [VO5] square pyramids and [VO4] tetrahedron as functional units. Importantly, KZVC shows excellently balanced performances of strong SHG responses (12 × KDP @ 1064 nm, 1.1 × AgGaS2 @ 2.05 µm), broad IR transparency range (0.52‒10 µm), congruent‐melting behavior, and highest laser‐induced damage threshold (LIDT) (60 × AgGaS2 @ 1064 nm) among the reported vanadates. Most remarkably, KZVC represents the first example in the oxide‐based IR NLO crystals that can achieve phase matching in a wide wavelength range extending from 1.8 to 10 µm, fully covering the important MIR atmospheric windows (3‒5 µm).