Background: Several instruments are currently used to assess Coronavirus Disease 2019 (COVID-19) -induced psychological distress, including the 22-item Impact of Event Scale-Revised (IES-R). The IES-R is a self-administered scale used to assess post-traumatic stress disorder (PTSD). The current study aimed to examine the construct validity of the IES-R, based on the Rasch model, with COVID-19-related data, as well as to test the multilevel construct validity of the IES-R within and among countries during the pandemic crisis. Methods: A multi-country web-based cross-sectional survey was conducted utilizing the 22-item IES-R. A total of 1020 participants enrolled in our survey, of whom 999 were included in the analyses. Data were analyzed using Rasch modeling and multilevel confirmatory factor analysis (MCFA). Results: The Rasch modeling results of the IES-R demonstrated that the IES-R is a satisfactory instrument with the five-point Likert scale, asserting that its 22 items are significant contributors to assessing PTSD as a unidimensional construct covered by the items of the IES-R. The MCFA confirmed that the 22-item IES-R, with its three factors, including intrusion, avoidance, and hyperarousal, demonstrates adequate construct validity at the within- and among-country levels. However, the results of the Akaike information criterion (AIC) model determined that the 16-item IES-R is better than the 22-item IES-R. Conclusion: The results suggested that the 22-item IES-R is a reliable screening instrument for measuring PTSD related to the COVID-19 pandemic, and can be utilized to provide timely psychological health support, when needed, based on the screening results.