Sentiment Analysis on the Quality of Public Services with User Satisfaction Prediction of YuhSinau Application Managed by BKPSDM Kabupaten Kebumen Using LSTM Method
Abstract
The quality of public services is critical in providing effective and responsive governance in an increasingly digital society. The development of the YuhSinau application by the Personnel and Human Resource Development Agency (BKPSDM) of Kebumen Regency offers an innovative response to the growing need for e-learning solutions for local government civil servants (Pegawai Negeri Sipil or PNS). However, determining the app’s effectiveness and user satisfaction is critical. This demands a thorough sentiment analysis in order to acquire insights into users’ thoughts and opinions about the quality of public services supplied by YuhSinau. The Long Short-Term Memory (LSTM) approach is used in this article to examine feelings and forecast customer pleasure. Data collection from multiple sources, initial data preprocessing, LSTM model construction, training, validation, and prediction are all part of the process. The results show that the model has some drawbacks, most notably its failure to appropriately explain variation in target data due to a negative R-squared value. Enhancements to the LSTM architecture, hyperparameter adjustment, and the use of more diverse and representative training data are proposed to improve the model. Continuous review and responsiveness to user comments are critical for improving the quality of public services via the YuhSinau application.
Keywords: sentiment analysis, public service quality, user satisfaction, YuhSinau application,LSTM method
References
[1] Putra TI, Suprapto S, Bukhori AF. Model Klasifikasi Berbasis Multiclass Classification dengan Kombinasi Indobert Embedding dan Long Short-Term Memory untuk Tweet Berbahasa Indonesia. Jurnal Ilmu Siber dan Teknologi Digital. 2022 Nov 11;1(1):1-28.
[2] Saputra AW, Wibawa AP, Pujianto U, Utama AB, Nafalski A. LSTM-based Multivariate Time-Series Analysis: A Case of Journal Visitors Forecasting. ILKOM Jurnal Ilmiah. 2022 Apr;14(1):57–62.
[3] Zhou X, Pranolo A, Mao Y. AB-LSTM: Attention Bidirectional Long Short-Term Memory for Multivariate Time-Series Forecasting. In2023 International Conferenceon Computer, Electronics & Electrical Engineering & their Applications (IC2E3) 2023 Jun 8 (pp. 1-6). IEEE.
[4] Arnomo SA, Yulia Y, Ukas U. Building The Prediction of Sales Evaluation on Exponential Smoothing using The OutSystems Platform. ILKOM Jurnal Ilmiah. 2023 Aug;15(2):222–8.
[5] Pratama ED. Implementasi Model Long-Short Term Memory (LSTM) pada Klasifikasi Teks Data SMS Spam Berbahasa Indonesia [ JMLCI]. The Journal on Machine Learning and Computational Intelligence. 2022 Jul;1(2).
[6] Mahjoub S, Chrifi-Alaoui L, Marhic B, Delahoche L. Predicting Energy Consumption Using LSTM, Multi-Layer GRU and Drop-GRU Neural Networks. Sensors (Basel). 2022 May;22(11):4062.
[7] Poczeta K, Papageorgiou EI. Energy Use Forecasting with the Use of a Nested Structure Based on Fuzzy Cognitive Maps and Artificial Neural Networks. Energies. 2022 Oct;15(20):7542.
[8] Staudemeyer RC, Morris ER. Understanding LSTM—a tutorial into long short-term memory recurrent neural networks. arXiv preprint arXiv:1909.09586. 2019 Sep 12.
[9] Le XH, Ho HV, Lee G, Jung S. Application of long short-term memory (LSTM) neural network for flood forecasting. Water. 2019 Jul;11(7):1387.
[10] Sudriani Y, Ridwansyah IA, Rustini H. Long short term memory (LSTM) recurrent neural network (RNN) for discharge level prediction and forecast in Cimandiri river, Indonesia. InIOP Conference Series: Earth and Environmental Science 2019 Jul 29 (Vol. 299, p. 012037). IOP Publishing.
[11] Chandra R, Goyal S, Gupta R. Evaluation of deep learning models for multi-step ahead time series prediction. IEEE Access. 2021 May;9:83105–23.
[12] Zhang Z, Qin H, Yao L, Lu J, Cheng L. Interval prediction method based on Long- Short Term Memory networks for system integrated of hydro, wind and solar power. Energy Procedia. 2019 Feb;158:6176–82.
[13] Wisyaldin MK, Luciana GM, Pariaman H. Pendekatan Long Short-Term Memory untuk Memprediksi Kondisi Motor 10 kV pada PLTU Batubara. J. Kilat. 2020;9(2):311–8.
[14] Afika R, Suprih W, Atikah DA, Fadlan BH. Next word prediction using lstm. Journal of Information Technology and Its Utilization. 2022 Jun;5(1):10–3.
[15] Elsworth S, Güttel S. Time series forecasting using LSTM networks: A symbolic approach. arXiv preprint arXiv:2003.05672. 2020 Mar 12.