Tremendous research efforts have been devoted to nanoparticles for applications in optoelectronics and biomedicine. Over the past decade, quantum dots (QDs) have become one of the fastest growing areas of research in nanotechnology because of outstanding photophysical properties, including narrow and symmetrical emission spectrum, broad fluorescence excitation spectrum, the tenability of the emission wavelength with the particle size and composition, anti-photobleaching ability and stable fluorescence. These characteristics are suitable for optical imaging, drug delivery and other biomedical applications. Research on QDs toxicology has demonstrated QDs affect or damage the biological system to some extent, and this situation is generally caused by the metal ions and some special properties in QDs, which hinders the further application of QDs in the biomedical field. The toxicological mechanism mainly stems from the release of heavy metal ions and generation of reactive oxygen species (ROS). At the same time, the contact reaction with QDs also cause disorders in organelles and changes in gene expression profiles. In this review, we try to present an overview of the toxicity and related toxicity mechanisms of QDs in different target organs. It is believed that the evaluation of toxicity and the synthesis of environmentally friendly QDs are the primary issues to be addressed for future widespread applications. However, considering the many different types and potential modifications, this review on the potential toxicity of QDs is still not clearly elucidated, and further research is needed on this meaningful topic.