Computer Based Test Using the Fisher-Yates Shuffle and Smith Waterman Algorithm
Abstract
Tests are used to determine a person’s level of understanding of a subject. The inhibiting factors in tests are less varied questions, questions with insufficient difficulty, subjective assessments, and the length of time in their correction. This research aimed to develop a Computer Based Test (CBT) application. The type of questions in this CBT are multiple choice and essays. This CBT employs categorization of questions, randomization of the questions, and automatic assessment. Questions were categorized manually based on Bloom’s Taxonomy of a lecture. Then the randomization process was carried out using the Fisher-Yates Shuffle algorithm for each question category. The Smith Waterman algorithm was used to automatically assess the essay-type questions. The steps of the Smith Waterman algorithm were preprocessing, data comparison using Smith Waterman, and percentage similarities conversion to test scores. The results of the study showed that the CBT application was able to randomize questions using the Fisher-Yates Shuffle algorithm and automatically assess answers using the Smith Waterman algorithm. RMSE was used to measure of the accuracy of the Smith Waterman algorithm: a value of 1.86 was obtained.
Keywords: Computer based test, assessment, Fisher-Yates Shuffle, Smith Waterman
References
[1] Nikou, S. A., & Economides, A. A. (2015). The impact of paper-based, computer-based and mobile-based self-assessment on students’ science motivation and achievement. Computers in Human Behavior.
[2] Arends, R. I. (2012). Learning to teach (9th ed.). McGraw-Hill.
[3] Scheuermann, F., & Bjornsson, J. (2009). The transition to computer-based assessment: New approaches to skills assessment and implications for large-scale testing (JRC Scientific and Technical Reports). European Commission Joint Research Centre Institute for the Protection and Security of the Citizen.
[4] Timmers, C. F., Walraven, A, & Veldkamp, B. P. (2015). The effect of regulation feedback in a computerbased formative assessment on information problem solving. Computers & Education, 87.
[5] Attali, Y., & Arieli-Attali, M. (2015). Gamification in assessment: Do points affect test performance? Computers & Education, 83.
[6] Munro, A., Cumming, K., Cleland, J., Denison, A., & Currie, G. (2018). Paper versus electronic feedback in high stakes assessment. Journal of the Royal College of Physicians of Edinburgh, 48(2), 148–152.
[7] Kementerian Pendidikan dan Kebudayaan. (2018). Pendidikan dan Kebudayaan, Peraturan Menteri Pendidikan dan Kebudayaan Republik Indonesia nomor 4 tahun 2018 tentang penilaian hasil belajar oleh pemerintah.
[8] Ristekdikti, K. (2018). Peraturan Menteri Riset, Teknologi, dan Pendidikan Tinggi Republik Indonesia nomor 60 tahun 2018 tentang penerimaan mahasiswa baru program sarjana pada perguruan tinggi negeri.
[9] Rane, S. S., & Shekokar, N. (2016). 3D socio graphical CAPTCHA based on reCAPTCHA against spammers and bots [Conference presentation]. IEEE International Conference on Advances in Electronics, Communication and Computer Technology (ICAECCT), Rajarshi Shahu College of Engineering, Pune India.
[10] Castillo, R. E., Cheng, C. J., Agustin, J. S., & Aragon, M. C. R. (2019). Development of an educational mobile game application for grade 5 for Knowledge Channel Inc. [Conference presentation]. ICISS 2019, Tokyo, Japan.
[11] Hazra, T. K., Gosh, R., Kumar, S., Dutta, S., & Chakraborty, A. K. (2015). File encryption using Fisher-Yates Shuffle: Shuffling scheme employing pseudo-random permutations.
[12] Yadav, M., Gautam, P. R., Shokeen, V., & Singhal, P. K. (2017). Modern Fisher-Yates shuffling based random interleaver design for SCFDMA-IDMA systems. Wireless Pers Communication, 97, 63–73.
[13] Olu, A. (2012). A simulated enhancement of Fisher-Yates algorithm for shuffling in virtual card games using domain-specific data structures. International Journal of Computer Applications, 54(11).
[14] Irving, R. W. (2004). Plagiarism and collusion detection using the Smith Waterman algorithm: Technical report. DCS.