Alzheimer’s disease (AD), a neurodegenerative disorder, is characterized by its ability to cause memory loss and damage other cognitive functions. Aggregation of amyloid beta (Aβ) plaques and neurofibrillary tangles in the brain are responsible for the development of Alzheimer’s disease (AD). While attempts targeting Aβ and tau proteins have been extensively conducted in the past decades, only two FDA-approved drugs (i.e., monoclonal antibodies) tackle the underlying biology of Alzheimer’s disease. In this study, an integrated computational framework was developed to identify new drug targets for Alzheimer’s disease and identify small molecules as potential therapeutical options. A systematic investigation of the gene networks firstly revealed that the Apolipoprotein E4 (ApoE4) gene plays a central role among genes associated with Alzheimer’s disease. The ApoE4 protein was then chosen as the protein target based on its role in the main pathological hallmarks of AD, which has been shown to increase Aβ accumulation by directly binding to Aβ as well as interfering with Aβ clearance that is associated with other receptors. A library of roughly 1.5 million compounds was then virtually screened via a ligand-protein docking program to identify small-molecule compounds with potential binding capacity to the ApoE4 N-terminal domain. On the basis of compound properties, 312 compounds were selected, analyzed and clustered to further identify common structures and essential functional groups that play an important role in binding ApoE4. The in silico prediction suggested that compounds with four common structures of sulfon-amine-benzene, 1,2-benzisothiazol-3-amine 1,1-dioxide, N-phenylbenzamide, and furan-amino-benzene presented strong hydrogen bonds with residues E27, W34, R38, D53, D153, or Q156 in the N terminal of ApoE4. These structures might also form strong hydrophobic interactions with residues W26, E27, L28, L30, G31, L149, and A152. While the 312 compounds can serve as drug candidates for further experiment assays, the four common structures, along with the residues for hydrogen bond or hydrophobic interaction, pave the foundation to further optimize the compounds as better binders of ApoE4.