Topological chemical reaction methods are indispensable for fabricating new materials or optimizing their functional properties, which is particularly important for two-dimensional (2D)-layered compounds with versatile structures. Herein, we demonstrate a low-temperature (∼350 °C) ion exchange approach to prefabricate metastable phosphors ALaTaO: xBi (A = K and Na) with RbLaTaO: xBi serving as precursors. The as-prepared ALaTaO:0.02 Bi (A = Rb, K, and Na) share the same Dion-Jacobson type 2D-layered perovskite phase, and photoluminescence analyses show that ALaTaO:0.02 Bi (A = Rb, K, and Na) phosphors exhibit broad emission bands peaking at 540, 550, and 510 nm, respectively, which are attributed to the nonradiative transition of Bi from excited state P or P to ground state S. The various Bi local environments at the crystallographic sites enable the different distributions of emission and excitation spectra, and the photoluminescence tuning of ALaTaO:0.02 Bi (A = Rb, K, and Na) phosphors are realized through alkali metal ion exchange. Notably, the combination of superior trivalent bismuth emission and low-temperature ion exchange synthesis leads to a novel yellow-emitting K(LaBi)TaO phosphor which is successfully applied in a white LED device based on a commercially available 365 nm LED chip. Our realizable cases of this low-temperature ion exchange strategy could promote exploration into metastable phosphors with intriguing properties.