Amyloid-β (Aβ) deposition as seen on PET using an Aβ-binding agent is a critical diagnostic biomarker for Alzheimer disease (AD). Some reports suggest using white matter (WM) as a reference region for quantification of serial Aβ PET studies; however, nonspecific WM retention in Aβ PET in people with dementia or cognitively unimpaired (CU) has been widely reported and is poorly understood. To investigate the suitability of WM as a reference region and the factors affecting WMC-Pittsburgh compound B (C-PiB) uptake variability, we conducted a retrospective study on 2 large datasets: a longitudinal study of participants ( = 577) who were CU, had mild cognitive impairment, or had dementia likely due to AD; and a cross-sectional study of single-scan PET imaging in CU subjects ( = 1,349). In the longitudinal study, annual changes in WM C-PiB uptake were assessed, and in the cross-sectional study, WMC-PiB uptake was assessed relative to subject age. Overall, we found that WMC-PiB uptake showed age-related increases, which varied with the WM regions selected. Further, variable annual WM C-PiB uptake changes were seen with different gray matter (GM)C-PiB baseline uptake levels. WM binding increases with age and varies with GMC-PiB. These correlations should be considered when using WM for normalization in C-PiB PET studies. The cerebellar crus1+crus2 showed no increase with age and cerebellar GM+WM showed minimal increase, supporting their use as reference regions for cross-sectional studies comparing wide age spans. In longitudinal studies, the increase in WM uptake may be minimal in the short-term and thus using WM as a reference region in these studies seems reasonable. However, as participants age, the findings may be affected by changes in WM uptake. Changes in WMC-PiB uptake may relate to disease progression, warranting examination of the causes of WM C-PiB uptake.