Rare-earth dopants are arguably one of the most studied optical centers in solids, with applications spanning from laser optoelectronics, biosensing, lighting to displays. Nevertheless, harnessing rare-earth dopants’ extraordinary coherence properties for quantum information technologies is a relatively new endeavor, and has been rapidly advancing in recent years. Leveraging the state-of-the-art photonic technologies, on-chip rare-earth quantum devices functioning as quantum memories, single photon sources and transducers have emerged, often with potential performances unrivaled by other solid-state quantum technologies. These existing quantum devices, however, nearly exclusively rely on macroscopic bulk materials as substrates, which may limit future scalability and functionalities of such quantum systems. Thus, the development of new platforms beyond single crystal bulk materials has become an interesting approach. In this review article, we summarize the latest progress towards nanoscale, low-dimensional rare-earth doped materials for enabling next generation rare-earth quantum devices. Different platforms with a variety of synthesis methods are surveyed. Their key metrics measured to date are presented and compared. Special attention is placed on the connection between the topology of each platform to its target device applications. Lastly, an outlook for near term prospects of these platforms are given, with a hope to spur broader interests in rare-earth doped materials as a promising candidate for quantum information technologies.