The deployment of charging infrastructure is one of the main challenges that need to be tackled due to the increasing demand for electric vehicles (EVs). Moreover, EVs associated with different charging standards can face compatibility issues while charging via public or private infrastructure. Many solutions were surveyed by researchers on EVs, but they were not focused on addressing the issue of charging infrastructure standardization. Motivated by this, we present a comprehensive survey on standardizing EV charging infrastructure. We also present a taxonomy on various aspects such as charging levels, charging modes, charging standards, charging technologies (based on the different charging types such as conductive charging and wireless charging), and types of vehicle (i.e., 2-wheeler (2W), 3-wheeler (3W), and 4-wheeler (4W)). Furthermore, we target the benefits associated with community EV charging operated by the community charging service operator. Furthermore, we propose an architecture for standardized EV community charging infrastructure to provide adaptability for EVs with different charging standards. Finally, the research challenges and opportunities of the proposed survey have been discussed for efficient EV charging.