Comparative Analysis of Machine Learning Models for Predicting Diabetes: Unveiling the Superiority of Advanced Ensemble Methods
DOI:
https://doi.org/10.33379/gtech.v8i2.4246Keywords:
Extra Trees, LightGBM, DNN, Diabetes, Ensemble LearningAbstract
This study presents a comprehensive analysis of various machine learning models to predict diabetes. The research evaluates and compares the predictive performance of advanced ensemble techniques Extra Trees Classifier and LightGBM with traditional machine learning algorithms and simpler deep neural network (DNN) architectures. The dataset comprises numerous features pertinent to diabetes diagnosis, such as glucose concentration, BMI, and insulin levels, among others. A methodology, including polynomial feature transformation and ten-fold cross-validation, was employed to ensure the study's reliability and the models' capability to generalize. The advanced ensemble models, Extra Trees and LightGBM, achieved stellar predictive metrics, with the former attaining a near-perfect ROC AUC, accuracy, precision, and an F1 score close to 1. LightGBM followed closely, demonstrating the high efficacy of ensemble methods in complex data settings. These results were contrasted with significantly lower performance metrics from DNNs and respectable, albeit lower, scores from traditional models like Decision Trees, Random Forest, KNN, and XGBoost.
References
Aboelnaga, E. (2023). Diabetes Dataset. Kaggle. https://www.kaggle.com/datasets/ehababoelnaga/diabetes-dataset
Afsaneh, E., Sharifdini, A., Ghazzaghi, H. & Ghobadi, M. Z. (2022). Recent applications of machine learning and deep learning models in the prediction, diagnosis, and management of diabetes: a comprehensive review. Diabetology & Metabolic Syndrome, 14(1), 196.
Agarwal, S., Simmonds, I. & Myers, A. K. (2022). The use of diabetes technology to address inequity in health outcomes: limitations and opportunities. Current Diabetes Reports, 22(7), 275–281.
Ahmad, H. F., Mukhtar, H., Alaqail, H., Seliaman, M. & Alhumam, A. (2021). Investigating health-related features and their impact on the prediction of diabetes using machine learning. Applied Sciences, 11(3), 1173.
Alam, M. S., Al-Ismail, F. S., Hossain, M. S. & Rahman, S. M. (2023). Ensemble machine-learning models for accurate prediction of solar irradiation in Bangladesh. Processes, 11(3), 908.
Alinsaif, S. (2024). COVID-19 Image Classification: A Comparative Performance Analysis of Hand-Crafted vs. Deep Features. Computation, 12(4), 66.
Buaroiu, A.-C. & Bâra, A. (2024). A Descriptive-Predictive--Prescriptive Framework for the Social-Media--Cryptocurrencies Relationship. Electronics, 13(7), 1277.
Bode, B., King, A., Russell-Jones, D. & Billings, L. K. (2021). Leveraging advances in diabetes technologies in primary care: a narrative review. Annals of Medicine, 53(1), 805–816.
Carlucci, S., De Simone, M., Firth, S. K., Kjærgaard, M. B., Markovic, R., Rahaman, M. S., Annaqeeb, M. K., Biandrate, S., Das, A., Dziedzic, J. W. & others. (2020). Modeling occupant behavior in buildings. Building and Environment, 174, 106768.
Chekroud, A. M., Bondar, J., Delgadillo, J., Doherty, G., Wasil, A., Fokkema, M., Cohen, Z., Belgrave, D., DeRubeis, R., Iniesta, R. & others. (2021). The promise of machine learning in predicting treatment outcomes in psychiatry. World Psychiatry, 20(2), 154–170.
Das, S. K., Roy, P. & Mishra, A. K. (2021). Deep learning techniques dealing with diabetes mellitus: a comprehensive study. Health Informatics: A Computational Perspective in Healthcare, 295–323.
Francis, A., Harhay, M. N., Ong, A. C. M., Tummalapalli, S. L., Ortiz, A., Fogo, A. B., Fliser, D., Roy-Chaudhury, P., Fontana, M., Nangaku, M. & others. (2024). Chronic kidney disease and the global public health agenda: an international consensus. Nature Reviews Nephrology, 1–13.
Gamel, S. A., Ghoneim, S. S. M. & Sultan, Y. A. (2024). Improving the accuracy of diagnostic predictions for power transformers by employing a hybrid approach combining SMOTE and DNN. Computers and Electrical Engineering, 117, 109232.
Ge, Y., Guo, Y., Das, S., Al-Garadi, M. A. & Sarker, A. (2023). Few-shot learning for medical text: A review of advances, trends, and opportunities. Journal of Biomedical Informatics, 104458.
Glennie, J. L., Berard, L. & Levrat-Guillen, F. (2022). Sensor-based technology: bringing value to people with diabetes and the healthcare system in an evolving world. ClinicoEconomics and Outcomes Research, 75–90.
Gobi, N., Singh, B. P. & Yadav, S. (2023). Machine Learning and Data Mining for Predictive Modeling of Stroke Risk and Post-Stroke Care Management. 2023 IEEE International Conference on ICT in Business Industry & Government (ICTBIG), 1–6.
González, S., Garc’ia, S., Del Ser, J., Rokach, L. & Herrera, F. (2020). A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities. Information Fusion, 64, 205–237.
Jayaprabha, M. S. & Priya, V. V. (2024). Early Prediction of Chronic Kidney Disease: A Comprehensive Survey. 2024 5th International Conference on Mobile Computing and Sustainable Informatics (ICMCSI), 45–51.
Li, M., Jiang, Y., Zhang, Y. & Zhu, H. (2023). Medical image analysis using deep learning algorithms. Frontiers in Public Health, 11, 1273253.
Li, T., Xia, Q., Ouyang, Y., Zeng, R., Liu, Q. & Li, T. (2024). Prospectivity and Uncertainty Analysis of Tungsten Polymetallogenic Mineral Resources in the Nanling Metallogenic Belt, South China: A Comparative Study of AdaBoost, GBDT, and XgBoost Algorithms. Natural Resources Research, 1–23.
Lin, E.-C., Chiang, Y.-C., Lin, H.-Y., Tseng, S.-Y., Hsieh, Y.-T., Shieh, J.-A., Huang, Y.-H., Tsai, H.-T., Feng, S.-W., Peng, T.-Y. & others. (2023). Unraveling the link between periodontitis and coronavirus disease 2019: exploring pathogenic pathways and clinical implications. Biomedicines, 11(10), 2789.
Livieris, I. E., Iliadis, L. & Pintelas, P. (2021). On ensemble techniques of weight-constrained neural networks. Evolving Systems, 12, 155–167.
Mahbub, M. F., Shuvo, W. O. K. & Momen, S. (2023). Prediction of Glycemic Control in Diabetes Mellitus Patients Using Machine Learning. In Proceedings of the Computational Methods in Systems and Software (pp. 216–242). Springer.
Modak, S. K. S. & Jha, V. K. (2023). Diabetes prediction model using machine learning techniques. Multimedia Tools and Applications, 1–27.
Motala, A. A., Mbanya, J. C., Ramaiya, K., Pirie, F. J. & Ekoru, K. (2022). Type 2 diabetes mellitus in sub-Saharan Africa: challenges and opportunities. Nature Reviews Endocrinology, 18(4), 219–229.
Nguyen, M. H., Trinh, S. H., Ly, H.-B. & others. (2023). Toward improved prediction of recycled brick aggregate concrete compressive strength by designing ensemble machine learning models. Construction and Building Materials, 369, 130613.
Shehadeh, A., Alshboul, O., Al Mamlook, R. E. & Hamedat, O. (2021). Machine learning models for predicting the residual value of heavy construction equipment: An evaluation of modified decision tree, LightGBM, and XGBoost regression. Automation in Construction, 129, 103827.
Subramaniyan, V., Lubau, N. S. A., Mukerjee, N. & Kumarasamy, V. (2023). Alcohol-induced liver injury in signalling pathways and curcumin’s therapeutic potential. Toxicology Reports.
Suryanarayana, G., Kumar, G. B., Anudeep, G., Sai, G. V. & others. (2024). A Comprehensive Survey on Diabetes Type-2 (T2D) Forecast Using Machine Learning. Archives of Computational Methods in Engineering, 1–19.
Vamvakas, A., Tsivaka, D., Logothetis, A., Vassiou, K. & Tsougos, I. (2022). Breast cancer classification on multiparametric MRI--increased performance of boosting ensemble methods. Technology in Cancer Research & Treatment, 21, 15330338221087828.
Zeinelabdeen, Y., Abaza, T., Yasser, M. B., Elemam, N. M. & Youness, R. A. (2024). MIAT LncRNA: A multifunctional key player in non-oncological pathological conditions. Non-Coding RNA Research, 9(2), 447–462.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Gregorius Airlangga
This work is licensed under a Creative Commons Attribution 4.0 International License.
