Alzheimer’s disease (AD) is the most common type of human dementia and is responsible for over 60% of diagnosed dementia cases worldwide. Abnormal deposition of β-amyloid and the accumulation of neurofibrillary tangles have been recognised as the two pathological hallmarks targeted by AD diagnostic imaging as well as therapeutics. With the progression of pathological studies, the two hallmarks and their related pathways have remained the focus of researchers who seek for AD diagnostic and therapeutic strategies in the past decades. In this work, we reviewed the development of the AD biomarkers and their corresponding target-specific small molecule drugs for both diagnostic and therapeutic applications, underlining their success, failure, and future possibilities.