Comparison of Machine Learning Classification Methods for Weather Prediction: A Performance Analysis
DOI:
https://doi.org/10.70609/gtech.v9i2.6649Keywords:
Machine Learning, Data Analysis, Weather Prediction, Hyperparameter Tuning, ClassificationAbstract
Weather classification is crucial in various sectors, including agriculture, transportation, and disaster management. Accurate weather prediction can help mitigate risks and improve decision-making in these fields. However, classifying weather conditions remains challenging due to the complex and dynamic nature of meteorological data. This study aims to compare different machine learning classification methods to determine the most effective model for weather classification. The research employs a structured methodology consisting of seven key steps: literature study, data understanding, exploratory data analysis, data preparation, modeling, evaluation, and hyperparameter tuning. The study used Decision Tree, Random Forest, Support Vector Machine, K-Nearest Neighbors, Gradient Boosting, AdaBoost, and Extra Trees to identify the best-performing classifier. Model evaluation was conducted using accuracy, precision, recall, and F1-score. The results indicate that Gradient Boosting achieved the highest performance, surpassing other models with an accuracy of 90.15%. To optimize the model further, hyperparameter tuning was conducted using GridSearchCV, and feature selection was done using SelectKBest. This process resulted in an improved accuracy of 90.22%, demonstrating the effectiveness of model optimization.
References
Abdullah, D. M., & Abdulazeez, A. M. (2021). Machine Learning Applications based on SVM Classification A Review. Qubahan Academic Journal, 1(2), 81–90. https://doi.org/10.48161/qaj.v1n2a50
Antoniadis, A., Lambert-Lacroix, S., & Poggi, J. (2020). Random forests for global sensitivity analysis: A selective review. Reliability Engineering & System Safety, 206, 107312. https://doi.org/10.1016/j.ress.2020.107312
Belete, D. M., & Huchaiah, M. D. (2021). Grid search in hyperparameter optimization of machine learning models for prediction of HIV/AIDS test results. International Journal of Computers and Applications, 44(9), 875–886. https://doi.org/10.1080/1206212x.2021.1974663
Bochenek, B., & Ustrnul, Z. (2022). Machine Learning in Weather Prediction and Climate Analyses—Applications and Perspectives. Atmosphere, 13(2), 180. https://doi.org/10.3390/atmos13020180
Bolan, S., Padhye, L. P., Jasemizad, T., Govarthanan, M., Karmegam, N., Wijesekara, H., Amarasiri, D., Hou, D., Zhou, P., Biswal, B. K., Balasubramanian, R., Wang, H., Siddique, K. H., Rinklebe, J., Kirkham, M., & Bolan, N. (2023). Impacts of climate change on the fate of contaminants through extreme weather events. The Science of the Total Environment, 909, 168388. https://doi.org/10.1016/j.scitotenv.2023.168388
Charbuty, B., & Abdulazeez, A. (2021). Classification based on decision tree algorithm for machine learning. Journal of Applied Science and Technology Trends, 2(01), 20–28. https://doi.org/10.38094/jastt20165
Darmawan, Z. M, E., & Dianta, A. F. (2023). Implementasi Optimasi Hyperparameter GridSearchCV Pada Sistem Prediksi Serangan Jantung Menggunakan SVM. Teknologi: Jurnal Ilmiah Sistem Informasi, 13(1), 8–15. https://doi.org/10.26594/teknologi.v13i1.3098
Demir, S., & Sahin, E. K. (2022). An investigation of feature selection methods for soil liquefaction prediction based on tree-based ensemble algorithms using AdaBoost, gradient boosting, and XGBoost. Neural Computing and Applications, 35(4), 3173–3190. https://doi.org/10.1007/s00521-022-07856-4
Fatihia, W. M., Fariza, A., & Karlita, T. (2023). CNN with Batch Normalization Adjustment for Offline Hand-written Signature Genuine Verification. JOIV International Journal on Informatics Visualization, 7(1), 200. https://doi.org/10.30630/joiv.7.1.1443
Fatihia, W. M., Fariza, A., & Karlita, T. (2024). Convolutional neural network enhancement for mobile application of offline handwritten signature verification. TELKOMNIKA (Telecommunication Computing Electronics and Control), 22(4), 931. https://doi.org/10.12928/telkomnika.v22i4.25849
Feld, L., Da Silva, V. H., & Strand, J. (2022). Characterization of foamed plastic litter on Danish reference beaches – Pollution assessment and multivariate exploratory analysis. Marine Pollution Bulletin, 180, 113774. https://doi.org/10.1016/j.marpolbul.2022.113774
Hamami, F., & Dahlan, I. A. (2022). Klasifikasi Cuaca Provinsi DKI Jakarta menggunakan Algoritma Random Forest dengan Teknik Oversampling. Jurnal Teknoinfo, 16(1), 87. https://doi.org/10.33365/jti.v16i1.1533
Javed, U., Ijaz, K., Jawad, M., Ansari, E. A., Shabbir, N., Kütt, L., & Husev, O. (2021). Exploratory Data Analysis Based Short-Term Electrical Load Forecasting: A Comprehensive analysis. Energies, 14(17), 5510. https://doi.org/10.3390/en14175510
Markovics, D., & Mayer, M. J. (2022). Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction. Renewable and Sustainable Energy Reviews, 161, 112364. https://doi.org/10.1016/j.rser.2022.112364
Meenal, R., Michael, P. A., Pamela, D., & Rajasekaran, E. (2021). Weather prediction using random forest machine learning model. Indonesian Journal of Electrical Engineering and Computer Science, 22(2), 1208. https://doi.org/10.11591/ijeecs.v22.i2.pp1208-1215
Pal, M., & Parija, S. (2021). Prediction of Heart Diseases using Random Forest. Journal of Physics Conference Series, 1817(1), 012009. https://doi.org/10.1088/1742-6596/1817/1/012009
Peng, J., Wu, W., Lockhart, B., Bian, S., Yan, J. N., Xu, L., Chi, Z., Rzeszotarski, J. M., & Wang, J. (2021). DataPrEP.EDA: Task-Centric Exploratory Data Analysis for statistical modeling in Python. Proceedings of the 2022 International Conference on Management of Data, 2271–2280. https://doi.org/10.1145/3448016.3457330
Popenoe, R., Langius-Eklöf, A., Stenwall, E., & Jervaeus, A. (2021). A practical guide to data analysis in general literature reviews. Nordic Journal of Nursing Research, 41(4), 175–186. https://doi.org/10.1177/2057158521991949
Price, I., Sanchez-Gonzalez, A., Alet, F., Andersson, T. R., El-Kadi, A., Masters, D., Ewalds, T., Stott, J., Mohamed, S., Battaglia, P., Lam, R., & Willson, M. (2024). Probabilistic weather forecasting with machine learning. Nature. https://doi.org/10.1038/s41586-024-08252-9
Rachmawati, O. C. R., & Darmawan, Z. M. E. (2024). The comparison of deep learning models for Indonesian political hoax news detection. CommIT (Communication and Information Technology) Journal, 18(2), 123–135. https://doi.org/10.21512/commit.v18i2.10929
Rachmawati, O. C. R., Barakbah, A. R., & Karlita, T. (2024). Programming language selection for the development of deep learning library. JOIV International Journal on Informatics Visualization, 8(1), 434. https://doi.org/10.62527/joiv.8.1.2437
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021). Can deep learning beat numerical weather prediction? Philosophical Transactions of the Royal Society a Mathematical Physical and Engineering Sciences, 379(2194), 20200097. https://doi.org/10.1098/rsta.2020.0097
Sharma, D., Kumar, R., & Jain, A. (2022). Breast cancer prediction based on neural networks and extra tree classifier using feature ensemble learning. Measurement Sensors, 24, 100560. https://doi.org/10.1016/j.measen.2022.100560
Uddin, S., Haque, I., Lu, H., Moni, M. A., & Gide, E. (2022). Comparative performance analysis of K-nearest neighbour (KNN) algorithm and its different variants for disease prediction. Scientific Reports, 12(1). https://doi.org/10.1038/s41598-022-10358-x
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Zakha Maisat Eka Darmawan; Ashafidz Fauzan Dianta; Kholid Fathoni, Oktavia Citra Resmi Rachmawati; Kevin Ilham Apriandy
This work is licensed under a Creative Commons Attribution 4.0 International License.
