Differences in the calibration conditions and the real-life applications of infrared pyrometers, radiometers, or imagers can contribute to significant measurement errors due to the presence of scattered light from the areas surrounding the reference source during the calibration process or the measured object in the field measurements. This out-of-field scatter (also known as size-of-source effect, SSE) has to be analyzed separately for each artifact to ensure applicability of the calibration results to the scene of actual measurement. This article discusses SSE characterization methods and specific requirements for calibrating single-element radiometers in the near-and mid-IR parts of the optical radiation spectrum. Two new SSE tools developed at National Institute of Standards and Technology to support routine calibration of IR pyrometers, radiometers, and imagers at the recently developed Advanced Infrared Radiometry and Imaging (AIRI) facility are described. The results of characterization of different commonly used radiometers, including an industrial-grade pyrometer, a high-accuracy pyrometer, two different infrared spectrometers, and an infrared imager, are presented.