All-solid-state lithium-ion batteries (ASSLIBs), with their exceptional attributes, have captured the attention of researchers. They offer a viable solution to the inherent flaws of traditional lithium-ion batteries. The crux of an ASSLB lies in its solid-state electrolyte (SSE) which shows higher stability and safety compared to liquid electrolyte. Additionally, it holds the promise of being compatible with Li metal anode, thereby realizing higher capacity. Inorganic SSEs have undergone tremendous developments in the last few decades; however, their practical applications still face difficulties such as the electrode–electrolyte interface, air stability, and so on. The structural composition of inorganic electrolytes is inherently linked to the advantages and difficulties they present. This article provides a comprehensive explanation of the development, structure, and Li-ion transport mechanism of representative inorganic SSEs. Moreover, corresponding difficulties such as interface issues and air stability as well as possible solutions are also discussed.