From Prediction to Intervention: Explainable Learning Analytics for Early Warning in Data-Intensive Construction Management Courses and the Causal Effect of Advisor-Led Outreach
DOI:
https://doi.org/10.62051/jedss.v1n7.04Keywords:
Learning analytics, Early warning, Explainable artificial intelligence, SHAP, Cluster-randomized trial, Construction management education, Self-regulated learningAbstract
Python programming and big data analytics now anchor the digital turn in construction management curricula-and they have quietly become the courses where students fail. Institutional responses usually arrive late and reach few. This two-phase study, conducted at a regional applied university in China, asks whether that failure pattern can be interrupted. Phase 1 built early-warning models from learning management system (LMS) and programming-practicum logs covering 269 student–course observations in seven courses; a gradient-boosted model reached AUC = .806 by Week 4, and its SHAP explanations were compared with the judgments of experienced teachers. Phase 2 then tested what the warnings should trigger: a cluster-randomized trial across seven class sections (N = 203) evaluated advisor-led outreach for flagged students. Failure fell from 13.0% to 6.3% (OR = 0.45, 95% CI [0.17, 1.23]) and examination scores rose (d = 0.29), with the largest gains among middle prior-achievement students-achievement gaps narrowed rather than widened. Model explanation and teacher judgment agreed on most features but diverged in places the teachers themselves judged diagnostically valuable. Taken together, the results offer randomized pilot evidence that explainable early warning can be turned into effective, low-cost pedagogical action.
Downloads
References
[1] Antwi, S., Nnaji, B., & Shapira, A. (2023). Enhancing understanding of AI in construction through problem based learning. Journal of Civil Engineering Education, 149(3), 04023003. https://doi.org/10.1061/JCEECD.EIENG 1821
[2] Arnold, K. E., & Pistilli, M. D. (2012). Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK ’12) (pp. 267–270). ACM. DOI: https://doi.org/10.1145/2330601.2330666
[3] Azizah, Z., Ohyama, T., Zhao, X., Ohkawa, Y., & Mitsuishi, T. (2024). Predicting at risk students in the early stage of a blended learning course via machine learning using limited data. Computers and Education: Artificial Intelligence, 7, 100261. https://doi.org/10.1016/j.caeai.2024.100261 DOI: https://doi.org/10.1016/j.caeai.2024.100261
[4] Baker, R. S. J. d., & Siemens, R. (2013). Educational data mining and learning analytics. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (2nd ed.). Cambridge University Press. DOI: https://doi.org/10.1017/CBO9781139519526.016
[5] Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. DOI: https://doi.org/10.1023/A:1010933404324
[6] Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). ACM. DOI: https://doi.org/10.1145/2939672.2939785
[7] Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410–8415. DOI: https://doi.org/10.1073/pnas.1319030111
[8] Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. DOI: https://doi.org/10.1007/s11528-014-0822-x
[9] Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. DOI: https://doi.org/10.3102/003465430298487
[10] Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., & Hlosta, M. (2019). Predictive learning analytics: A large scale implementation to support student success at the Open University. British Journal of Educational Technology, 50(6). DOI: https://doi.org/10.1111/bjet.12853
[11] Ifenthaler, D., & Yau, J. Y. K. (2020). Utilising learning analytics to support study success in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1961–1990. DOI: https://doi.org/10.1007/s11423-020-09788-z
[12] Kizilcec, R. F., Pérez Sanagustín, M., & Maldonado, J. J. (2017). Self regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers & Education, 114, 18–33. DOI: https://doi.org/10.1016/j.compedu.2016.10.001
[13] Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems 30 (pp. 4765–4774).
[14] Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40. DOI: https://doi.org/10.1037/0022-0663.82.1.33
[15] Siemens, G. (2013). Learning analytics: The emergence of a new field. American Behavioral Scientist, 57(10), 1380–1400. DOI: https://doi.org/10.1177/0002764213498851
[16] Summers, R. (2024). Using learning analytics to prompt student support interventions: Findings from two randomised controlled trials. TASO (Centre for Transforming Access and Student Outcomes in Higher Education).
[17] Tiukhova, E., Vemuri, P., López Flores, N., Islind, A. S., Óskarsdóttir, M., Poelmans, S., Baesens, B., & Snoeck, M. (2024). Explainable learning analytics: Assessing the stability of student success prediction models by means of explainable AI. Decision Support Systems, 182, 114229. https://doi.org/10.1016/j.dss.2024.114229 DOI: https://doi.org/10.1016/j.dss.2024.114229
[18] Ujkani, B., Minkovska, D., & Hinov, N. (2024). Course success prediction and early identification of at risk students using explainable artificial intelligence. Electronics, 13(21), 4157. https://doi.org/10.3390/electronics13214157 DOI: https://doi.org/10.3390/electronics13214157
[19] Zimmerman, B. J. (2002). Becoming a self regulated learner: An overview. Theory Into Practice, 41(2), 64–70. DOI: https://doi.org/10.1207/s15430421tip4102_2
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Journal of Educational Development and Social Sciences

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







