This article focused on segregation of low concentration CO2 from CO2/N2 mixture gas by implementing high‐performance facilitated transport mixed matrix membranes (MMMs) in large‐scale carbon capture techniques. These advanced, novel CO2‐selective membrane materials were developed by embedding silica nanoparticles at different loading into the poly(vinyl alcohol) (PVA)/poly(ethylene glycol) (PEG) matrix using solution casting. In situ sol–gel technique was applied for the synthesis of the hydrophilic SiO2 nanoparticles. The compatibility of filler‐polymer matrix plays a crucial role in the optimization of the membrane performance. The dispersion and interaction of the filler into the polymer matrix were confirmed by thermogravimetric analysis, differential scanning calorimetry, Fourier transform infrared spectroscopy, X‐ray diffraction, field emission scanning electron microscopy, contact angle tests, and swelling ratio analysis. Field emission scanning electron microscopy analysis of the synthesized MMMs established the homogeneous dispersion of the fillers in the polymer matrix. Owing to its good compatibility with PVA/PEG matrix, the inclusion of fillers significantly increased the overall separation efficiency of CO2 within the membrane. Compared to pristine PVA/PEG membrane, PVA/PEG/silica membrane with 3.34 wt % silica loading showed pronounced improvement in its gas separation properties with 78% augmentation in CO2 permeability and 45% enhancement in CO2/N2 selectivity for fixed conditions pertaining to sweep side water flow rate of 0.04 mL/min and 100 °C temperature. © 2018 Wiley Periodicals, Inc. J. Appl. Polym. Sci. 2018, 135, 46481.