The goal of the Caenorhabditis Intervention Testing Program is to identify robust and reproducible pro-longevity interventions that are efficacious across genetically diverse cohorts in the Caenorhabditis genus. The project design features multiple experimental replicates collected by three different laboratories. Our initial effort employed fully manual survival assays. With an interest in increasing throughput, we explored automation with flatbed scanner-based Automated Lifespan Machines (ALMs). We used ALMs to measure survivorship of 22 Caenorhabditis strains spanning three species. Additionally, we tested five chemicals that we previously found extended lifespan in manual assays. Overall, we found similar sources of variation among trials for the ALM and our previous manual assays, verifying reproducibility of outcome. Survival assessment was generally consistent between the manual and the ALM assays, although we did observe radically contrasting results for certain compound interventions. We found that particular lifespan outcome differences could be attributed to protocol elements such as enhanced light exposure of specific compounds in the ALM, underscoring that differences in technical details can influence outcomes and therefore interpretation. Overall, we demonstrate that the ALMs effectively reproduce a large, conventionally scored dataset from a diverse test set, independently validating ALMs as a robust and reproducible approach towards aging-intervention screening.