Evaluation of AI Predictability on Crop Yield using XAI - An Experimental Approach

Ramesh VarathanP. Kumaresan

DOI 10.7160/aol.2026.180307
No 3/2026, September
pp. 79-101

Varathan, R. and Kumaresan P. (2026) "Evaluation of AI Predictability on Crop Yield using XAI - An Experimental Approach", AGRIS on-line Papers in Economics and Informatics, Vol. 18, No. 3, pp. 79-101. ISSN 1804-1930 DOI 10.7160/aol.2026.180307.

Abstract

Accurate crop yield prediction is essential for improving agricultural planning and sustainability. This study explores the integration of explainable artificial intelligence (XAI) with machine learning models to enhance transparency in agricultural decision-support systems. A comparative evaluation of multiple regression algorithms - Linear, Ridge, Lasso, Elastic Net, Decision Tree, Random Forest, AdaBoost, XGBoost, CatBoost, LightGBM, Gradient Boosting, and K-Nearest Neighbour Regression (KNR) is performed for crop yield prediction. Categorical attributes are transformed using One-Hot Encoding, while model reliability is ensured through 5-Fold Cross-Validation and hyperparameter optimization using Grid Search. Among the evaluated approaches, KNR demonstrated the best predictive capability with an R² value of 0.9827 and reduced errors (MAE:9.03, RMSE:117.58, MSE:13824.73). To improve interpretability, SHAP, LIME, and ELI5 techniques are employed to explain feature contributions and model decision. The proposed framework provides transparent and reliable insights, supporting data-driven agricultural management and sustainable crop production strategies.

Keywords

XAI, SHAP, LIME, CYP, Agriculture, ML, KNR

References

  1. Abbas, F., Afzaal, H., Farooque, A. A. and Tang, S. (2020) "Crop Yield Prediction through Proximal Sensing and Machine Learning Algorithms", Agronomy, Vol. 10, No. 7, p. 1046. ISSN 2073-4395 DOI 10.3390/agronomy10071046.
  2. Abdel-Salam, M., Kumar, N. and Mahajan, S. (2024) "A proposed framework for crop yield prediction using hybrid feature selection approach and optimized machine learning", Neural Computing and Applications, Vol. 36, No. 33, pp. 20723-20750. ISSN 1433-3058. DOI 10.1007/s00521-024-10226-x.
  3. Abekoon, T., Hirushan, S., Namal, R., Imesh, U. E., Anuradha, J. and Upaka, R. (2025) "A Novel Application with Explainable Machine Learning (SHAP and LIME) to Predict Soil N, P and K Nutrient Content in Cabbage Cultivation", Smart Agricultural Technology, Vol. 11 (March), p. 100879. ISSN 2772-3755. DOI 10.1016/j.atech.2025.100879.
  4. Abhasha, J., Pradhan, B., Chakraborty, S., Varatharajoo, R., Alamri, A., Gite, S. and Lee, C.-L. (2025) "An Explainable Bi-LSTM Model for Winter Wheat Yield Prediction", Frontier in Plant Science, Vol. 15, pp. 1-17. ISSN 1664-462X. DOI 10.3389/fpls.2024.1491493.
  5. Abasha, K., Pradhan, B., Gite, S. and Chakraborty, S. (2023) "Remote-Sensing Data and Deep-Learning Techniques in Crop Mapping and Yield Prediction: A Systematic Review", Remote Sensing, Vol. 15, No. 8, p. 2014. ISSN 2072-4292. DOI 10.3390/rs15082014.
  6. Agarwal, N., Choudhry, N. and Tripathi, K. C. (2025) "A novel hybrid time series deep learning model for forecasting of cotton yield in India", International Journal of Information Technology (Singapore), pp. 1745-1752. ISSN 2511-2104. DOI 10.1007/s41870-024-02327-6.
  7. Akkem, Y., Biswas, S. K. and Varanasi, A. (2024) "Streamlit-based enhancing crop recommendation systems with advanced explainable artificial intelligence for smart farming", Neural Computing and Applications, Vol. 36, No. 32, pp. 20011-20025. ISSN 1433-3058. DOI 10.1007/s00521-024-10208-z.
  8. Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R and Herrera, F. (2020) "Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI", Information Fusion, Vol. 58, pp. 82-115. ISSN 1566-2535. DOI 10.1016/j.inffus.2019.12.012.
  9. Bhattacharya, A. (2022) "Applied Machine Learning Explainability Techniques", Birmingham, UK: Packt Publishing Ltd., 1st ed.. ISBN 978-1803246154.
  10. Bolikulov, F., Nasimov, R., Rashidov, A., Akhmedov, F. and Cho, Y. I. (2024) "Effective Methods of Categorical Data Encoding for Artificial Intelligence Algorithms", Mathematics, Vol. 12, No. 16. ISSN 2227-7390. DOI 10.3390/math12162553.
  11. Burdett, H. and Wellen, C. (2022) "Statistical and Machine Learning Methods for Crop Yield Prediction in the Context of Precision Agriculture", Precision Agriculture, Vol. 23, No. 5, p. 1553-74. ISSN 1385-2256. DOI 10.1007/s11119-022-09897-0.
  12. de Villiers, C., Mashaba-Munghemezulu, Z., Munghemezulu, C., Chirima, G. J. and Tesfamichael, S. G. (2024) "Assessing Maize Yield Spatiotemporal Variability Using Unmanned Aerial Vehicles and Machine Learning", Geomatics, Vol. 4, No. 3, pp. 213-236. ISSN 2673-7418. DOI 10.3390/geomatics4030012.
  13. Dilli, P., Boogaard, H., de Wit, A., Janssen, S., Osinga, S., Pylianidis, C. and Athanasiadis, I. N. (2021) "Machine Learning for Large-Scale Crop Yield Forecasting", Agricultural Systems, Vol. 187, (June 2020), p. 103016. ISSN 0308-521X. DOI 10.1016/j.agsy.2020.103016.
  14. Fegade, T. K. and Pawar, B. V. (2020) "Crop prediction using artificial neural network and support vector machine", In Data Management, Analytics and Innovation: Proceedings of ICDMAI 2019, Springer Singapore, Vol. 2, pp. 311-324. ISBN 978-981-13-9363-1.
  15. Jagan Mohan, R. N. V., Rayanoothala, P. S. and Sree, R. P. (2024) "Next-Gen Agriculture: Integrating AI and XAI for Precision Crop Yield Predictions", Frontiers in Plant Science, Vol. 15, pp. 1-16. ISSN 1664-462X. DOI 10.3389/fpls.2024.1451607.
  16. Khaki, S. and Wang, L. (2019) "Crop yield prediction using deep neural networks", Frontiers in Plant Science, Vol. 10, pp. 1-10. ISSN 1664-462X. DOI 10.3389/fpls.2019.00621.
  17. Khan, M. and Noor, S. (2019) "Irrigation runoff volume prediction using machine learning algorithms", European Journal of Science, Innovation and Technology, Vol. 8, pp. 1-22. ISSN 2304-9693.
  18. Khosla, E., Dharavath, R. and Priya, R. (2020) "Crop yield prediction using aggregated rainfall-based modular artificial neural networks and support vector regression", Environment, Development and Sustainability, Vol. 22, No. 6, pp. 5687-5708. ISSN 1387-585X. DOI 10.1007/s10668-019-00445-x.
  19. Kuruguntu Mohan, K., Maheswari, N. and Sivagami, M. (2022) "Models for Feature Selection and Efficient Crop Yield Prediction in the Groundnut Production", Research in Agricultural Engineering, Vol.68, No. 3, pp. 131-41. ISSN 1212-9151. DOI 10.17221/15/2021-RAE.
  20. LeCun, Y., Bengio, Y. and Hinton, G. (2015) "Deep learning", Nature, Vol. 521, pp. 436-444. ISSN 0028-0836. DOI 10.1038/nature14539.
  21. Liaw, A. and Wiener, M. (2002) "Classification and regression by randomForest", R News, Vol. 2, No. 3, pp. 18-22. ISSN 1609-3631.
  22. Malashin, I., Tynchenko, V., Gantimurov, A., Nelyub, V., Borodulin, A. and Tynchenko, Y. (2024) "Predicting Sustainable Crop Yields: Deep Learning and Explainable AI Tools", Sustainability (Switzerland), Vol. 16, No. 21, pp. 1-29. ISSN 2071-1050. DOI 10.3390/su16219437.
  23. Maya Gopal, P. S. and Bhargavi, R. (2019) "Performance Evaluation of Best Feature Subsets for Crop Yield Prediction Using Machine Learning Algorithms", Applied Artificial Intelligence, Vol. 33, No. 7, pp. 621-642. ISSN 1087-6545. DOI 10.1080/08839514.2019.1592343.
  24. Mishra, P., Khan, R. and Baranidharan, D. B. (2020) "Crop Yield Prediction using Gradient Boosting Regression", International Journal of Innovative Technology and Exploring Engineering, Vol. 9, No. 3, pp. 2293-2297. ISSN 2278-3075. DOI 10.35940/ijitee.c8879.019320.
  25. Mitra, A., Beegum, S., Fleisher, D., Reddy, V. R., Sun, W., Ray, C., Timlin, D. and Malakar, A. (2024) "Cotton Yield Prediction: A Machine Learning Approach with Field and Synthetic Data", IEEE Access, Vol. 12, p. 101273-88. ISSN 2169-3536. DOI 10.1109/ACCESS.2024.3418139.
  26. Molnar, C. (2020) "Interpretable machine learning", Lulu.com. ISBN 978-0244768522. [Online].Available: https://christophm.github.io/interpretable-ml-book. [Accessed: 10 Jan. 10, 2022].
  27. Nguyen, N. and Ngo, D. (2025) "Comparative Analysis of Boosting Algorithms for Predicting Personal Default", Cogent Economics and Finance, Vol. 13, No. 1. ISSN 2332 - 2039. DOI 10.1080/23322039.2025.2465971.
  28. Oikonomidis, A., Cagatay Catal, C. and Kassahun, A. (2022) "Hybrid Deep Learning-Based Models for Crop Yield Prediction", Applied Artificial Intelligence, Vol. 36, No. 1. ISSN 1087-6545. DOI 10.1080/08839514.2022.2031823.
  29. Pavithra, M. and Soundrapandiyan, R. 2024. "Yield Prediction for Crops by Gradient-Based Algorithms", PLoS ONE, Vol. 19, No. 8, pp. 1-20. ISSN 1932-6203. DOI 10.1371/journal.pone.0291928.
  30. Ponce-Bobadilla, A. V., Schmitt, V., Maier, C. S., Mensing, S. and Stodtmann, S. (2024) "Practical Guide to SHAP Analysis: Explaining Supervised Machine Learning Model Predictions in Drug Development", Clinical and Translational Science, Vol. 17, No. 11, pp. 1-15. ISSN 1752 - 8062. DOI 10.1111/cts.70056.
  31. Ribeiro, M. T., Singh, S. and Guestrin, C. (2016) ""Why Should I Trust You?": Explaining the Predictions of Any Classifier", In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, ACM. pp. 1135-1144. ISSN 2157-0161. DOI 10.1145/2939672.2939778.
  32. Saadio, C. D., Adoni, W. Y. H., Aworka, R., Zoueu, J. T., Mutombo, F. K., Krichen, M. and Kimpolo, C. L. M. (2022) "Crops Yield Prediction Based on Machine Learning Models: Case of West African Countries", Smart Agricultural Technology, Vol. 2 (December 2021). ISSN 2772-3755. DOI 10.1016/j.atech.2022.100049.
  33. Samira, S. S., Shahhosseini, M., Huber, I., Hu, G. and Archontoulis, S. V. (2022) "County-Scale Crop Yield Prediction by Integrating Crop Simulation with Machine Learning Models", Frontiers in Plant Science, Vol. 13, pp. 1-16. ISSN 1664-462X. DOI 10.3389/fpls.2022.1000224.
  34. Sarr, A. B. and Sultan, B. (2023) "Predicting crop yields in Senegal using machine learning methods", International Journal of Climatology, Vol. 43, No. 4, pp. 1817-1838. ISSN 0899-8418. DOI 10.1002/joc.7947.
  35. Sathya, P. and Gnanasekaran, P. (2023) "Paddy Yield Prediction in Tamilnadu Delta Region Using MLR-LSTM Model", Applied Artificial Intelligence, Vol. 37, No. 1. ISSN 1087-6545. DOI 10.1080/08839514.2023.2175113.
  36. Shams, M. Y., Gamel, S. A. and Talaat, F. M. (2024). "Enhancing crop recommendation systems with explainable artificial intelligence: a study on agricultural decision-making", Neural Computing and Applications, Vol. 36, No. 11, pp. 5695-5714. ISSN 1433-3058. DOI 10.1007/s00521-023-09391-2.
  37. Sharma, P., Dadheech, P., Aneja, N. and Aneja, S. (2023) "Predicting Agriculture Yields Based on Machine Learning Using Regression and Deep Learning", IEEE Access, Vol. 11, No. October, pp. 111255-111264. ISSN 2169-3536. DOI 10.1109/ACCESS.2023.3321861.
  38. Sudha, M. K., Manorama, M. and Aditi, T. (2022) "Smart agricultural decision support systems for predicting soil nutrition value using IoT and ridge regression", AGRIS on-line Papers in Economics and Informatics, Vol. 14, No. 1, pp. 95-106. ISSN 1804-1930. DOI 10.7160/aol.2022.140108.
  39. Uribeetxebarria, A., Castellón, A. and Aizpurua, A. (2023) "Optimizing Wheat Yield Prediction Integrating Data from Sentinel-1 and Sentinel-2 with CatBoost Algorithm", Remote Sensing, Vol. 15, No. 6. ISSN 2072-4292. DOI 10.3390/rs15061640.
  40. Vijayan, S. and Chowdhary, C. L. (2025) "Hybrid feature optimized CNN for rice crop disease prediction", Scientific Reports, Vol. 15, No. 1, pp. 1-20. ISSN 2045-2322. DOI 10.1038/s41598-025-92646-w.

Full paper

  Full paper (.pdf, 15.56 MB).