Acute myeloid leukemia (AML) is a hematological malignancy characterized by cytogenetic and genomic alterations. Up to now, combination chemotherapy remains the standard treatment for leukemia. However, many individuals diagnosed with AML develop chemotherapeutic resistance and relapse. Recently, it has been pointed out that leukemic stem cells (LSCs) are the fundamental cause of drug resistance and AML relapse. LSCs only account for a small subpopulation of all leukemic cells, but possess stem cell properties, including a self-renewal capacity and a multi-directional differentiation potential. LSCs reside in a mostly quiescent state and are insensitive to chemotherapeutic agents. When LSCs reside in a bone marrow microenvironment (BMM) favorable to their survival, they engage into a steady, continuous clonal evolution to better adapt to the action of chemotherapy. Most chemotherapeutic drugs can only eliminate LSC-derived clones, reducing the number of leukemic cells in the BM to a normal range in order to achieve complete remission (CR). LSCs hidden in the BM niche can hardly be targeted or eradicated, leading to drug resistance and AML relapse. Understanding the relationship between LSCs, the BMM, and the generation and evolution laws of LSCs can facilitate the development of effective therapeutic targets and increase the efficiency of LSCs elimination in AML.