The diversification of current forms of energy storage and the reduction of fossil fuel consumption are issues of high importance for reducing environmental pollution. Zinc and magnesium are multivalent ions suitable for the development of environmentally friendly rechargeable batteries. Nanocomposite polymer electrolytes (NCPEs) are currently being researched as part of electrochemical devices because of the advantages of dispersed fillers. This article aims to review and compile the trends of different types of the latest NCPEs. It briefly summarizes the desirable properties the electrolytes should possess to be considered for later uses. The first section is devoted to NCPEs composed of poly(vinylidene Fluoride-co-Hexafluoropropylene). The second section centers its attention on discussing the electrolytes composed of poly(ethylene oxide). The third section reviews the studies of NCPEs based on different synthetic polymers. The fourth section discusses the results of electrolytes based on biopolymers. The addition of nanofillers improves both the mechanical performance and the ionic conductivity; key points to be explored in the production of batteries. These results set an essential path for upcoming studies in the field. These attempts need to be further developed to get practical applications for industry in large-scale polymer-based electrolyte batteries.