Feature Management Approaches and Predictive Methods in Machine Learning and Deep Learning for Student Performance Prediction: A Systematic Review
DOI:
https://doi.org/10.70609/gtech.v9i1.6501Keywords:
Deep Learning, Feature Management Approach, Machine Learning, Student Performance PredictionAbstract
Research on student performance prediction has advanced rapidly in recent years, driven by the increasing volume of educational data generated by digital learning platforms. This data can be analyzed using Machine Learning (ML) and Deep Learning (DL) techniques, integrated with feature management strategies tailored to specific needs. However, selecting the most relevant features and optimizing predictive models remain significant challenges. Different studies apply various feature selection and engineering techniques, leading to inconsistent results and limited generalizability. This study conducts as a Systematic Literature Review (SLR) to explore ML and DL approaches for student performance prediction, emphasizing their relationship with feature management techniques. The reviewed studies span publications from 2019 to 2024. This SLR aims to assist researchers in identifying effective strategies for predicting student performance, including the selection of methods, datasets, or feature management techniques. Most studies utilized publicly available datasets due to their accessibility and ease of use. Among ML methods, Random Forest emerged as the most frequently applied, achieving an F-measure of 99.5% integration of filter-based and wrapper-based feature selection techniques. Among DL approaches, the ANN-PCACSN model, employing Principal Component Analysis (PCA) for dimensionality reduction, achieved the highest accuracy of 99.32%. These findings highlight the importance of aligning preprocessing strategies with dataset properties and algorithm capabilities to enhance predictive performances.
References
Abubakari, M. S. (2020). Educational Data Mining to Predict Students Performance Based on Deep Learning Neural Network.
Mahmood AB, & Khalfan AM. (2020). Machine Learning Based Predicting Student Academic Success. IEEE.
Al-azazi, F. A., & Ghurab, M. (2023). ANN-LSTM: A deep learning model for early student performance prediction in MOOC. Heliyon, 9(4). https://doi.org/10.1016/j.heliyon.2023.e15382
Alhazmi, E., & Sheneamer, A. (2023). Early Predicting of Students Performance in Higher Education. IEEE Access, 11, 27579–27589. https://doi.org/10.1109/ACCESS.2023.3250702
Ali, M., Liaquat, M. D., Atta, M. N., Khan, A., Lashari, S. A., & Ramli, D. A. (2023). Improving Student Performance Prediction Using a PCA-based Cuckoo Search Neural Network Algorithm. Procedia Computer Science, 225, 4598–4610. https://doi.org/10.1016/j.procs.2023.10.458
Alnasyan, B., Basheri, M., Alassaa, M., & Alassafi, M. (2024). Deep Learning Techniques for Predicting Student’s Academic Performance on Virtual Learning Environments: A Review. https://doi.org/10.21203/rs.3.rs-3888441/v1
Alshdaifat, E. (2020). The Impact of Data Normalization on Predicting Student Performance: A Case Study from Hashemite University. International Journal of Advanced Trends in Computer Science and Engineering, 9(4), 4580–4588. https://doi.org/10.30534/ijatcse/2020/57942020
Alturki, S., Cohausz, L., & Stuckenschmidt, H. (2022). Predicting Master’s students’ academic performance: an empirical study in Germany. Smart Learning Environments, 9(1). https://doi.org/10.1186/s40561-022-00220-y
Alyahyan, E., & Düştegör, D. (2020). Predicting academic success in higher education: literature review and best practices. In International Journal of Educational Technology in Higher Education (Vol. 17, Issue 1). Springer. https://doi.org/10.1186/s41239-020-0177-7
Al-Zawqari, A., Peumans, D., & Vandersteen, G. (2022). A flexible feature selection approach for predicting students’ academic performance in online courses. Computers and Education: Artificial Intelligence, 3. https://doi.org/10.1016/j.caeai.2022.100103
Beckham, N. R., Akeh, L. J., Mitaart, G. N. P., & Moniaga, J. V. (2022). Determining factors that affect student performance using various machine learning methods. Procedia Computer Science, 216, 597–603. https://doi.org/10.1016/j.procs.2022.12.174
Ben Said, A., Abdel-Salam, A. S. G., & Hazaa, K. A. (2024). Performance prediction in online academic course: a deep learning approach with time series imaging. Multimedia Tools and Applications, 83(18), 55427–55445. https://doi.org/10.1007/s11042-023-17596-9
Brahim, G. Ben. (2022). Predicting Student Performance from Online Engagement Activities Using Novel Statistical Features. Arabian Journal for Science and Engineering, 47(8), 10225–10243. https://doi.org/10.1007/s13369-021-06548-w
Bujang, S. D. A., Selamat, A., Ibrahim, R., Krejcar, O., Herrera-Viedma, E., Fujita, H., & Ghani, N. A. M. (2021). Multiclass Prediction Model for Student Grade Prediction Using Machine Learning. IEEE Access, 9, 95608–95621. https://doi.org/10.1109/ACCESS.2021.3093563
Chen, Z., Cen, G., Wei, Y., & Li, Z. (2023). Student Performance Prediction Approach Based on Educational Data Mining. IEEE Access, 11, 131260–131272. https://doi.org/10.1109/ACCESS.2023.3335985
Dervenis, C., Kyriatzis, V., Stoufis, S., & Fitsilis, P. (2022, September 16). Predicting Students’ Performance Using Machine Learning Algorithms. ACM International Conference Proceeding Series. https://doi.org/10.1145/3564982.3564990
Dien, T. T., Luu, S. H., Thanh-Hai, N., & Thai-Nghe, N. (2020). Deep Learning with Data Transformation and Factor Analysis for Student Performance Prediction. In IJACSA) International Journal of Advanced Computer Science and Applications (Vol. 11, Issue 8). www.ijacsa.thesai.org
El-Keiey, S., Elmenshawy, D., & Hassanein, E. (n.d.). Student’s Performance Prediction based on Personality Traits and Intelligence Quotient using Machine Learning. In IJACSA) International Journal of Advanced Computer Science and Applications (Vol. 13, Issue 9). www.ijacsa.thesai.org
Feng, G., Fan, M., & Chen, Y. (2022). Analysis and Prediction of Students’ Academic Performance Based on Educational Data Mining. IEEE Access, 10, 19558–19571. https://doi.org/10.1109/ACCESS.2022.3151652
Gámez-Granados, J. C., Esteban, A., Rodriguez-Lozano, F. J., & Zafra, A. (2023). An algorithm based on fuzzy ordinal classification to predict students’ academic performance. Applied Intelligence, 53(22), 27537–27559. https://doi.org/10.1007/s10489-023-04810-2
Ghosh, S. K., Janan, F., & Ahmad, I. (2022). Application of the Classification Algorithms on the Prediction of Student’s Academic Performance. Trends in Sciences, 19(14). https://doi.org/10.48048/tis.2022.5070
Gupta, R., & Gueneau, C. (n.d.). Feature Correlation with Student Education Performance. www.JSR.org
Haris, M., Pustaka, T., Diponegoro, M. H., Kusumawardani, S., & Hidayah, I. (2021). Tinjauan Pustaka Sistematis: Implementasi Metode Deep Learning pada Prediksi Kinerja Murid (Implementation of Deep Learning Methods in Predicting Student Performance: A Systematic Literature Review). In Jurnal Nasional Teknik Elektro dan Teknologi Informasi | (Vol. 10, Issue 2).
Haziq Muhammad, & Chen Jen Chwen. (2022). 9.View of Educational Data Mining for Student Performance Prediction_ A Systematic Literature Review (2015-2021). IJET, Vol. 17. https://doi.org/https://doi.org/10.3991/ijet.v17i05.27685
Jiao, X. (2022). A Factorization Deep Product Neural Network for Student Physical Performance Prediction. Computational Intelligence and Neuroscience, 2022, 1–8. https://doi.org/10.1155/2022/4221254
Khairy, D., Alharbi, N., Amasha, M. A., Areed, M. F., Alkhalaf, S., & Abougalala, R. A. (2024). Prediction of student exam performance using data mining classification algorithms. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12619-w
Liu, D., Zhang, Y., Zhang, J., Li, Q., Zhang, C., & Yin, Y. (2020). Multiple features fusion attention mechanism enhanced deep knowledge tracing for student performance prediction. IEEE Access, 8, 194894–194903. https://doi.org/10.1109/ACCESS.2020.3033200
Mastour, H., Dehghani, T., Moradi, E., & Eslami, S. (2023). Early prediction of medical students’ performance in high-stakes examinations using machine learning approaches. Heliyon, 9(7). https://doi.org/10.1016/j.heliyon.2023.e18248
Mengash, H. A. (2020). Using data mining techniques to predict student performance to support decision making in university admission systems. IEEE Access, 8, 55462–55470. https://doi.org/10.1109/ACCESS.2020.2981905
Nachouki, M., Mohamed, E. A., Mehdi, R., & Abou Naaj, M. (2023). Student course grade prediction using the random forest algorithm: Analysis of predictors’ importance. Trends in Neuroscience and Education, 33. https://doi.org/10.1016/j.tine.2023.100214
Namraiza, Abid, K., Aslam, N., Fuzail, M., Maqbool, M. S., & Kainat Sajid. (2023). An Efficient Deep Learning Approach for Prediction of Student Performance Using Neural Network. VFAST Transactions on Software Engineering, 11(4), 67–79. https://doi.org/10.21015/vtse.v11i4.1647
Nasser Alsubaie, M. (2023). Predicting student performance using machine learning to enhance the quality assurance of online training via Maharat platform. Alexandria Engineering Journal, 69, 323–339. https://doi.org/10.1016/j.aej.2023.02.004
Nawang, H., Makhtar, M., & Hamzah, W. M. A. F. W. (2021). A systematic literature review on student performance predictions. In International Journal of Advanced Technology and Engineering Exploration (Vol. 8, Issue 84, pp. 1441–1453). Accent Social and Welfare Society. https://doi.org/10.19101/IJATEE.2021.874521
Ojajuni, O., Ayeni, F., Akodu, O., Ekanoye, F., Adewole, S., Ayo, T., Misra, S., & Mbarika, V. (2021). Predicting Student Academic Performance Using Machine Learning. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12957 LNCS, 481–491. https://doi.org/10.1007/978-3-030-87013-3_36
Orji Fidelia A., & Vassileva Julita. (2022). Machine Learning Approach for Predicting Students Academic Performance and Study Strategies based on their Motivation. https://doi.org/https://doi.org/10.48550/arXiv.2210.08186
Pérez Sánchez, C. J., Calle-Alonso, F., & Vega-Rodríguez, M. A. (2022). Learning analytics to predict students’ performance: A case study of a neurodidactics-based collaborative learning platform. Education and Information Technologies, 27(9), 12913–12938. https://doi.org/10.1007/s10639-022-11128-y
Priyambada, S. A., Usagawa, T., & ER, M. (2023). Two-layer ensemble prediction of students’ performance using learning behavior and domain knowledge. Computers and Education: Artificial Intelligence, 5. https://doi.org/10.1016/j.caeai.2023.100149
Resce, G., Zinilli, A., & Cerulli, G. (2022). Machine learning prediction of academic collaboration networks. Scientific Reports, 12(1). https://doi.org/10.1038/s41598-022-26531-1
Santos, R. M., & Henriques, R. (2023). Accurate, timely, and portable: Course-agnostic early prediction of student performance from LMS logs. Computers and Education: Artificial Intelligence, 5. https://doi.org/10.1016/j.caeai.2023.100175
Syed Mustapha, S. M. F. D. (2023). Predictive Analysis of Students’ Learning Performance Using Data Mining Techniques: A Comparative Study of Feature Selection Methods. Applied System Innovation, 6(5). https://doi.org/10.3390/asi6050086
Ünal, F. (2020). Data Mining for Student Performance Prediction in Education. www.intechopen.com
Yağcı, M. (2022). Educational data mining: prediction of students’ academic performance using machine learning algorithms. Smart Learning Environments, 9(1). https://doi.org/10.1186/s40561-022-00192-z
Yağcı, M., & Olpak, Y. Z. (2021). Predicting Academic Failure: Estimating Semester Grade Point Average with Data Mining Methods. https://doi.org/10.21203/rs.3.rs-698647/v1
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Desty Yani, Kusrini
This work is licensed under a Creative Commons Attribution 4.0 International License.
