Semiconductor nanocrystals, or quantum dots (QDs), are candidates for biological sensing, photovoltaics, and catalysis due to their unique photophysical properties. The most studied QDs are composed of heavy metals like cadmium and lead. However, this engenders concerns over heavy metal toxicity. To address this issue, numerous studies have explored the development of nontoxic (or more accurately less toxic) quantum dots. In this Review, we select three major classes of nontoxic quantum dots composed of carbon, silicon and Group I-III-VI elements and discuss the myriad of synthetic strategies and surface modification methods to synthesize quantum dots composed of these material systems.