Results of NAEP Reading Item Automated Scoring Data Challenge (Fall 2021)

Abstract

This brief describes the results of a data challenge to evaluate the potential of using automated scoring techniques to score open-ended responses to reading assessment items. The purpose of the challenge was to help NAEP determine the existing capabilities, accuracy metrics, the underlying validity evidence of assigned scores, and costs and efficiencies of using automated scoring.