Face, content, criterion and construct validity assessment of a newly developed tool to assess and classify work–related stress (TAWS– 16)

Abstract

Introduction As work-stress, is associated with Non Communicable Diseases, and decreased work productivity, health and economic benefits are expected from periodic work-stress screening among employees using valid and reliable tools. Tool to Assess and classify Work Stress (TAWS– 16) was developed to overcome limitations in existing work-stress assessment tools in India. This study aims to test face, content, criterion and construct validity of TAWS– 16 in a sample of managerial-supervisory employees. Methods Nine domain experts rated face and content validity of TAWS– 16. Content validity was measured by Content Validity Indices (I-CVI, S-CVI) and Modified Kappa statistics. Empirical validity was tested by analysing data reported from 356 Information Technology (IT) professionals wherein Exploratory Factor Analysis was conducted for the assessment of Construct Validity. Self-reported data was collected in an unlinked and anonymous manner using a web-link, which was emailed to the study subjects, after initial introductory telephone or personal conversation. Criterion Validity was tested against stress sub-scale of DASS– 21. This study was approved by NIMHANS ethics committee. Results Findings revealed that TAWS– 16 has good face validity. The content validity is acceptable (CVI = 0.829). Construct Validity is appropriate as 60.8% of the total variance was explained by the factors identified in our study. Criterion Validity was moderate (Kappa Value 0.208) due to inappropriate work-stress instrument for comparison with TAWS– 16. Conclusions Overall, TAWS– 16 demonstrated good face, content and construct validity. It measures work-stressors, coping abilities and psycho-somatic symptoms associated with work-stress. We recommend use of TAWS– 16 for periodic screening and classification of work-stress among employees.

Need for developing unified workplace mental health screening tool for the Indian population: Commenting on the Tool to assess and classify work (TAWS-16)

“…psychosomatic symptoms suggestive of work-stress in section B. The TAWS-16 is indeed similar to the concept contemporarily published 2 The completeness of assessing workplace factors such as those listed by Roy et al (2023) have always been debated and will be far-fetched goal, therefore will continue to be debated 1 In continuation to research on workplace factors affecting mental health, a recent study reviewed the workplace factors contributing to occupational mental health and narrowed to six major factors viz. "workload", "control", "reward", "community", "fairness" and "values" 5 .…”

“…Workplace stress is indeed a neglected component of health research in India and the authors deserve appreciation for developing on a tool for its assessment and publishing them recently 1 . Further, unlike the conventional workplace assessments that involves either of these factors alone, the workplace stress being assessed by both perceived factors in workplace and psychological experiences is desirable 2 .…”

“…Leiter & Maslasch (1999) defined each of the six factors and attempted to include all workplace factors including majority of those identified by Roy et al (2023) 1,6 . The advantages of narrowing it to the 6 factors is the wider application of tool among broad spectrum of occupations.…”

Levels of work stress among information technology professionals during COVID-19 pandemic in an Indian metropolis

“…The Tool to Assess and classify Work Stress (TAWS-16) is a validated tool, and details of face, content, criterion, and construct validity are published elsewhere. [ 14 ] It has been used earlier to assess work stress among industrial employees, and the prevalence of work stress varied between 10 and 17%. Expecting 10% prevalence of work stress, 5% allowable error, and 80% power of test, the sample size was estimated at 139 (Sample size n = [DEFF*Np (1-p)]/[(d2/Z21-α/2*(N-1) +p*(1-p)]).…”

“…Existing tools assess stress in general, are too lengthy, and do not consider coping to define the construct of work stress. Toward this direction, a work-stress assessment tool, TAWS-16 (Tool to Assess and classify Work Stress),[ 12 ] was developed by the Centre for Public health and is used to estimate the prevalence of work-related stress and identify factors associated with work stress among IT professionals in Bengaluru during the COVID-19 pandemic.…”