Physics problems have been deconstructed into testlet items using templates. These items have been generated based on the functional requirements of a developed automatic item generator. Empirical testing needs to be conducted to verify the conformity with automatic item generation characteristics. This paper aims to address the extent of template compliance with the generator features. Black-box testing procedure was used to verify the function conformities by exploring the execution of the generator and its input and output. 25 Physics templates were examined. The testlet variants generated from the execution of the generator showed that the template characteristics adhered to the input requirements of the generator. It can be concluded that the validation of the testlet templates by the generator showed that the templates support the automatic item generation.