Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study

Abstract

SUMMARY Background Existing studies on quality of tuberculosis care mostly reflect knowledge, not actual practice. Methods We conducted a validation study on the use of standardized patients (SPs) for assessing quality of TB care. Four cases, two for presumed TB and one each for confirmed TB and suspected MDR-TB, were presented by 17 SPs, with 250 SP interactions among 100 consenting providers in Delhi, including qualified (29%), alternative medicine (40%) and informal providers (31%). Validation criteria were: (1) negligible risk and ability to avoid adverse events for providers and SPs; (2) low detection rates of SPs by providers, and (3) data accuracy across SPs and audio verification of SP recall. We used medical vignettes to assess provider knowledge for presumed TB. Correct case management was benchmarked using Standards for TB Care in India (STCI). Findings SPs were deployed with low detection rates (4.7% of 232 interactions), high correlation of recall with audio recordings (r=0.63; 95% CI: 0.53 – 0.79), and no safety concerns. Average consultation length was 6 minutes with 6.2 questions/exams completed, representing 35% (95% confidence interval [CI]: 33%–38%) of essential checklist items. Across all cases, only 52 of 250 (21%; 95% CI: 16%–26%) were correctly managed. Correct management was higher among MBBS doctors (adjusted OR=2.41, 95% CI: 1.17–4.93) as compared to all others. Provider knowledge in the vignettes was markedly more consistent with STCI than their practice. Interpretation The SP methodology can be successfully implemented to assess TB care. Our data suggest a big gap between provider knowledge and practice.

Enhancing quality of medical care in low income and middle income countries through simulation-based initiatives: recommendations of the Simnovate Global Health Domain Group

“…Sylvia et al 6 report correct case management rates of 52–53% among village clinicians in rural China for chest pain and child diarrhoea, and Mohanan et al 7 report that rates of Oral Rehydration Salts were only 3.5% for child diarrhoea in Bihar. Similarly, low rates are also reported for other tracer conditions: for tuberculosis, correct case management rates were 21% for a sample of providers from Delhi, India 8. Overall, there is significant potential for improvement of medical care across both the private and public sectors, and among major types of healthcare providers in LMICs, whether formally or informally educated due to poor logistics, funding and infrastructure, among the main factors 9–11.…”

Evaluating clinicians’ user experience and acceptability of LearnTB, a smartphone application for tuberculosis in India

“…Studies show complicated, long care seeking pathways and extensive diagnostic delays (12), widespread empirical management (13), and poor adherence to established standards of care in the private sector (14). Often this is due to poor knowledge about TB, especially among informal care providers, inaccessibility to proper training, and inadequate supervision and re-training.…”

How patients navigate the diagnostic ecosystem in a fragmented health system: a qualitative study from India

“…For instance, the inability of private providers to diagnose TB was reported by almost all the TB patients interviewed in this study. Private providers ordered lab tests that were not specific to TB, a finding recently confirmed by a ‘mystery clients’ study [20]. This made the patient’s pathway to TB care a complex and costly experience.…”