Validation of Chest Radiograph Reading and Recording System (CRRS) in Three Sites in Indonesia
Abstract
One of the main challenges in Tuberculosis (TB) management is the lack of tools for early and accurate diagnosis. Chest X-ray remains one of the most convenient ways for TB diagnosis. Even though chest X-ray result can be obtained quickly, it requires accurate interpretation from radiologist. Chest Radiograph Reading and Recording System (CRRS) can be used to standardize the interpretation process for TB diagnosis. This study aims to determine the validity of CRRS in hospital and primary health center. This is a cross-sectional observational study in Cipto Mangunkusumo Hospital, Jatinegara, and Matraman Healthcare Centers. The study was conducted from May to November 2015. Participants were recruited with consecutive sampling. The eligibility criteria were age ≥ 15 years old, new or previously treated patients with current TB treatment ≤ 1 months, and having symptoms consistent with TB, or having a contact history with patients with smear positive or having extra-pulmonary TB. Recruited patients underwent anamnesis, physical examination, morning sputum examination, and chest X-ray examination. Acid-fast bacilli smears and culture of the morning
sputum was conducted in Microbiology Laboratory of Faculty of Medicine, Universitas Indonesia. Chest X-ray examination was conducted in Cipto Mangunkusumo Hospital. The radiologists filled the CRRS form that contains the scoring based on four features: Score 2 is given for Upper lobe large opacity (> 1 cm), cavity in any location, and adenopathy in any location, and score 1 for unilateral pleural effusion. The total
number of the score was then categorized using different cut-offs (≥ 1, ≥ 2, ≥ 3, and ≥ 4) to evaluate the validity of the method compared with the sputum examination. Two radiologists read the same chest X-ray, and when there was a disagreement, a senior radiologist made the final decision. The agreement between the two radiologists was determined using the Cohen’s kappa. As many as 210 chest Xx-ray results were read
using CRRS method. The highest Cohen’s Kappa coefficient between the two readers was 0.84 for large opacity feature, while the lowest was 0.52 for lymphadenopathy. The validity of the scoring with cut-off ≥ 1 showed the highest accuracy of 76% with sensitivity 76.2%; specificity 61.4%; positive predictive value 68.6%; and negative
predictive value 63.6%. The lowest accuracy showed on the cut-off ≥ 3 and ≥ 4, with accuracy of 60.8%. On each radiological feature, the best accuracy (almost 80%) was showed by large opacity feature. The interpretation using CRRS method has good inter-reader agreement.
Keywords: Tuberculosis, CRRS, validity, agreement
References
[1] World Health Organization. (2013). Global tuberculosis report 2013. European Communicable Disease Bulletin.
[2] Badan Perencanaan Pembangunan Nasional. (2012). Laporan Pencapaian Tujuan Pembangunan Milenium di Indonesia 2011.
[3] Badan Litbangkes. (2010). Riset Kesehatan Dasar 2007.
[4] Badan Litbangkes. (2016). Riset Kesehatan Dasar 2013.
[5] Dirjen P2&PL Kementerian Kesehatan RI. (2011). Terobosan Menuju Akses Universal, Strategi Nasional Pengendalian TB di Indonesia 2010-2014. Stop TB, pp. 1–80.
[6] Menteri Kesehatan Republik Indonesia. (2009). Keputusan Menteri Kesehatan Republik Indonesia Nomor 364/Menkes/SK/V/2009.
[7] Sukartini, N. (1998). Perkembangan Diagnostik Tuberkulosis Paru. Indonesian Journal of Clinical Pathology, vol. 5, pp. 7–12.
[8] Ahmad, U. F. (2004). Masalah Tuberkulosis di Indonesia dan Upaya Percepatan Penanggulangan Tuberkulosis, ‘Stop TB Sekarang Juga’, in Buku Makalah Seminar Tuberkulosis, Dinas Kesehatan Sumatera Utara, PPTI, pp. 52–61.
[9] Amraeni, Y. and Rahmawati. (2013). Sensitifitas dan spesifisitas screening tuberkulosisi di Rumah Sakit Bahtera Mas Tahun 2013. STIKES Mandala Waluya.
[10] Kumar, B. D., Bhargava, S. K., Agrawal, C. S., et al. (2005). Chest radiographs and their reliability in the diagnosis of tuberculosis. Journal of Nepal Medical Association, vol. 44, pp. 138–142.
[11] Den Boon, S., et al. (2005). Development and evaluation of a new chest radiograph reading and recording system for epidemiological surveys of tuberculosis and lung disease. International Journal of Tuberculosis and Lung Disease, vol. 9, no. 10, pp. 1088–1096.
[12] Dawson, R., et al. (2010). Chest radiograph reading and recording system: Evaluation for tuberculosis screening in patients with advanced HIV. International Journal of Tuberculosis and Lung Disease, vol. 14, no. 1, pp. 52–58.
[13] Pinto, L. M., et al. (2013). Development of a simple reliable radiographic scoring system to aid the diagnosis of pulmonary tuberculosis. PLoS One, vol. 8, no. 1.
[14] Kementerian Kesehatan Republik Indonesia. (2014). Profil Kesehatan Indonesia 2013. Profil Kesehatan Indonesia 2013. Retrieved from http://www.depkes.go. id/resources/download/pusdatin/profil-kesehatan-indonesia/profil-kesehatanindonesia-2013.pdf
[15] Badan Penelitian dan Pengembangan Kesehatan Kementerian Republik Indonesia. (2011). Laporan Akhir Riset Fasilitas Kesehatan 2011. Laporan Akhir Riset Fasilitas Kesehatan 2011.
[16] Viera, A. J. and Garrett, J. M. (2005). Understanding interobserver agreement: The kappa statistic. Family Medicine, vol. 37, no. 5, pp. 360–363.
[17] Grozdanovic, Z., et al. (2015). A novel reading scheme for assessing the extent of radiographic abnormalities and its association with disease severity in sputum smear-positive tuberculosis: An observational study in Hyderabad/India. PloS One.