Operational method of reliability and content-validity analysis: Taking “trait-symptoms” screening of individuals at high-risk for OCD as an example

Abstract

A well-designed self-reported scale is highly applicable to current clinical and research practices. However, the problems with the scale method, such as quantitative analysis of content validity and test-retest reliability analysis of state-like variables are yet to be resolved. The main purpose of this paper is to propose an operational method for solving these problems. Additionally, it aims to enhance understanding of the research paradigm for the scale method (excluding criterion-related validity). This paper used a study that involved screening of high-risk groups for OCD (Obsessive-Compulsive Disorder), conducted 5 rounds of tests, and developed scales, reliability, and validity analysis (using sample sizes of 496, 610, 600, 600 and 990). The operational method we propose is practical, feasible, and can be used to develop and validate a scale. Public health significance Preventive screening of OCD among the general population has great practical significance due to its high prevalence, high costs, and diagnostic difficulty. Additionally, a well-designed self-reported screening scale is generally used in preventive, clinical, and personality studies. However, when using the scale method, there are few practical and quantitative methods for content validity analysis. Additionally, the test-retest reliability analysis of state-like variables, often conducted by traditional methods (such as the alpha coefficient (α)) is inappropriate and often incorrect. To overcome these problems, using screening of high-risk groups of OCD, the author explored and improved reliability and validity analysis. This study proposes an operational method for reliability and validity analysis that is practicable and feasible.