The digital revolution has widened the array of curriculum materials available to history teachers. Given the variable quality of these new materials and the deeply contextual nature of teaching, educators need better tools for selecting among the vast options available. This study aimed to validate a device designed for that purpose, called the Curriculum Materials Evaluation Tool (CMET). Using a questionnaire and think-aloud interview, the study examined how four social studies teachers evaluated a novel material set for potential classroom use, and how the CMET mediated their analysis. Findings showed that the teachers preferred when materials are readily accessible and adaptable for their specific teaching context, in contrast to “one-size-fits-all” resources that dominate the Web. The CMET appeared to foster a deeper and broader analysis of the given material set, especially regarding its political and cultural orientation. The study suggests that teachers’ role in vetting and adapting digital materials be recognized and embraced. The CMET can contribute to that end through its use in district adoption committees, teacher professional development, and collaborative curriculum research.