Computer-Based Clinical Examination (CCE) in Surgery: Would It Complement or Replace the OSCE in the Post-COVID-19 Era?

Abstract

Objectives: Surgical clinical assessment of medical students is confronted by many challenges particularly the increasing numbers of students with limited resources, and pandemics. The search for new tools of assessment continues. Our objectives were: (1) To develop a computer-based clinical exam (CCE) and identify its characteristics (2) To assess its acceptability of the students.
Method: The study was conducted at the Surgical Department, Alzaiem Alazhari University (AAU) between February and August, 2017. We used the modular objectoriented dynamic learning environment (MOODLE) program as a platform to upload and deliver the exam. The exam consisted of 45 questions (stations). Each consisted of a clinical scenario accompanied by a photograph (of a patient or investigation) or short video followed by multiple choice questions (MCQs). A questionnaire was designed to get the students’ feedback. We analyzed the questionnaire and scores obtained by the students and compared them to their performance in other tools of the surgical exam, using SPSS statistical program.
Results: The study included 188 final year medical students. There was a highly significant correlation of the CCE scores of each student with their final result (r= 0.67), and with other tools of the surgery exam particularly the objective structured clinical examination (OSCE). Students’ acceptability was high.
Conclusion: The CCE is valid and practicable. It saves time and is popular with the students and tutors. It complements the OSCE in the assessment of clinical competency and allows wide coverage of the curriculum. It is expected to gain importance and popularity in the post-COVID-19 era.

References
[1] El Shallaly, G. E. H. A., & Makki, A. (2012). Use of computer based examination for assessment of medical students. Education for Health, 25(3), 148–152. https://doi.org/10.4103/1357-6283.109789

[2] El Shallaly G. Ali E. Use of a Video-Projected Structured Clinical Examination (ViPSCE) instead of Oral Examination in the Assessment of Final Year Medical Students. Education for Health: Change in Learning & Practice 2004. Mar; 17(1): 17-26.

[3] El Shallaly Gamal, Ali Eltayeb. Abstract: Use of a Video-Projected Structured Clinical Examination (ViPSCE) instead of Oral Examination in the Assessment of Final Year Medical Students. Medical Education “Really Good Stuff”, report of new ideas in medical education. 2003 Nov; 37 (11): 1048.

[4] https://docs.moodle.org/34/en/About_Moodle

[5] https://en.wikipedia.org/wiki/Moodle

[6] Barman, A. (2005). Critiques on the objective structured clinical exams. Annals of the Academy of Medicine, Singapore, 34(8), 478–482.

[7] Swets, J. A., & Feurzeig, W. (1965). Computer-aided instruction. Science, 150, 572– 576. https://doi.org/10.1126/science.150.3696.572

[8] Cantillon, P., Irish, B., & Sales, D. (2004). Using computers for assessment in medicine. BMJ (Clinical Research Ed.), 329, 606–609. https://doi.org/10.1136/bmj.329.7466.606

[9] Hochlehnert, A., Brass, K., Moeltner, A., & Juenger, J. (2011). Does medical students’ preference of test format (computer-based vs. paper-based) have an influence on performance? BMC Medical Education, 11, 89. https://doi.org/10.1186/1472-6920-11-89

[10] Lara, S., Foster, C. W., Hawks, M., & Montgomery, M. (2020). Remote Assessment of Clinical Skills During COVID-19: A virtual, high-Stakes, summative pediatric objective structured clinical examination. Academic Pediatrics, 20, 760–761. https://doi.org/10.1016/j.acap.2020.05.029

[11] Blythe, J., Patel, N. S. A., Spiring, W., Easton, G., Evans, D., Meskevicius-Sadler, E., Noshib, H., & Gordon, H. (2021). Undertaking a high stakes virtual OSCE (“VOSCE”) during Covid-19. BMC Medical Education, 21,https://doi.org/10.1186/s12909-021- 02660-5

[12] Hytönen, H., Näpänkangas, R., Karaharju-Suvanto, T., Eväsoja, T., Kallio, A., Kokkari, A., Tuononen, T., & Lahti, S. (2021). Modification of national OSCE due to COVID-19 - Implementation and students’ feedback. European Journal of Dental Education, 25, 679–688. https://doi.org/10.1111/eje.12646

[13] Kakadia, R., Chen, E., & Ohyama, H. (2020). Implementing an online OSCE during the COVID-19 pandemic. Journal of Dental Education, 85(Suppl 1), 1006–1008. https://doi.org/10.1002/jdd.12323

[14] Updike, W. H., Cowart, K., Woodyard, J. L., Serag-Bolos, E., Taylor, J. R., & Curtis, S. D. (2021). Protecting the Integrity of the Virtual Objective Structured Clinical Examination. American Journal of Pharmaceutical Education, 85(6),https://doi.org/10.5688/ajpe8438

[15] Major, S., Sawan, L., Vognsen, J., & Jabre, M. (2020). COVID-19 pandemic prompts the development of a Web-OSCE using Zoom teleconferencing to resume medical students’ clinical skills training at Weill Cornell Medicine-Qatar. BMJ Simulation & Technology Enhanced Learning, 6, 376–377. https://doi.org/10.1136/bmjstel-2020- 000629