Reducing energy consumption is one of the major concerns in modern building design and construction because buildings account for ≈40% of the total energy consumption in modern society. Among various technologies for saving energy, electrochromic smart windows are considered as a highly promising one. Except for the application in saving energy, electrochromism has also attracted extensive attention in many other fields, such as, anti‐glare rearview mirrors, displays, military camouflage, flexible wearable fabric, etc. However, there are still many challenges needed to be solved, such as, the response rate and durability of electrochromic materials (ECMs). The transmission rate of ions in ECMs determines the response rate of the whole electrochromic device. Besides, the embedding depth and total amount of ions directly affect the contrast, durability, and coloration efficiency of ECMs. It is crucial to select suitable electrolyte ions to obtain high‐efficiency ECMs. Here, the challenges in ECMs based on ions insertion/extraction are presented, which are focused on advanced nanostructured ECMs’ design and electrochromic devices’ practical application. Recent advances in ECMs are presented to discuss the important questions, which are especially focused on the connection between suitable ions and advanced nanostructural ECMs. Finally, a perspective for next‐generation electrochromic devices is presented.