Alzheimer’s disease (AD) remains one of the most extensively researched neurodegenerative disorders due to its widespread prevalence and complex risk factors. Age is a crucial risk factor for AD, which can be estimated by the disparity between physiological age and estimated brain age. To model AD risk more effectively, integrating biological, genetic, and cognitive markers is essential. Here, we utilized mouse models expressing the major APOE human alleles and human nitric oxide synthase 2 to replicate genetic risk for AD and a humanized innate immune response. We estimated brain age employing a multivariate dataset that includes brain connectomes, APOE genotype, subject traits such as age and sex, and behavioral data. Our methodology used Feature Attention Graph Neural Networks (FAGNN) for integrating different data types. Behavioral data were processed with a 2D Convolutional Neural Network (CNN), subject traits with a 1D CNN, brain connectomes through a Graph Neural Network using quadrant attention module. The model yielded a mean absolute error for age prediction of 31.85 days, with a root mean squared error of 41.84 days, outperforming other, reduced models. In addition, FAGNN identified key brain connections involved in the aging process. The highest weights were assigned to the connections between cingulum and corpus callosum, striatum, hippocampus, thalamus, hypothalamus, cerebellum, and piriform cortex. Our study demonstrates the feasibility of predicting brain age in models of aging and genetic risk for AD. To verify the validity of our findings, we compared Fractional Anisotropy (FA) along the tracts of regions with the highest connectivity, the Return-to-Origin Probability (RTOP), Return-to-Plane Probability (RTPP), and Return-to-Axis Probability (RTAP), which showed significant differences between young, middle-aged, and old age groups. Younger mice exhibited higher FA, RTOP, RTAP, and RTPP compared to older groups in the selected connections, suggesting that degradation of white matter tracts plays a critical role in aging and for FAGNN’s selections. Our analysis suggests a potential neuroprotective role of APOE2, relative to APOE3 and APOE4, where APOE2 appears to mitigate age-related changes. Our findings highlighted a complex interplay of genetics and brain aging in the context of AD risk modeling.