PPMG-based composite electrolytes were fabricated via the solution method using the polyvinyl alcohol and polyvinylpyrrolidone blend reinforced with various contents of sulfonated inorganic filler. Sulfuric acid was employed as the sulfonating agent to functionalize the external surface of the inorganic filler, i.e., graphene oxide. The proton conductivities of the newly prepared proton exchange membranes (PEMs) were increased by increasing the temperature and content of sulfonated graphene oxide (SGO), i.e., ranging from 0.025 S/cm to 0.060 S/cm. The induction of the optimum level of SGO is determined to be an excellent route to enhance ionic conductivity. The single-cell performance test was conducted by sandwiching the newly prepared PEMs between an anode (0.2 mg/cm2 Pt/Ru) and a cathode (0.2 mg/cm2 Pt) to prepare membrane electrode assemblies, followed by hot pressing under a pressure of approximately 100 kg/cm2 at 60 °C for 5–10 min. The highest power densities achieved with PPMG PEMs were 14.9 and 35.60 mW/cm2 at 25 °C and 70 °C, respectively, at ambient pressure with 100% relative humidity. Results showed that the newly prepared PEMs exhibit good electrochemical performance. The results indicated that the prepared composite membrane with 6 wt% filler can be used as an alternative membrane for applications of high-performance proton exchange membrane fuel cell.