RETHINKING EXPLAINABILITY IN EDUCATIONAL ARTIFICIAL INTELLIGENCE: A CRITICAL SYSTEMATIC REVIEW OF MODELS, APPLICATIONS, AND ETHICAL DIMENSIONS
DOI:
https://doi.org/10.18623/rvd.v22.n3.3553Keywords:
Explainable Artificial Intelligence, Educational Technology, Epistemic Agency, Pedagogical Explainability, XAI, Systematic Review, AI Ethics, Instructional DesignAbstract
The increasing integration of Artificial Intelligence (AI) into educational technologies has elevated the importance of explainability to ensure transparency, pedagogical relevance, and ethical accountability. This systematic review critically examines empirical studies on Explainable Artificial Intelligence (XAI) in educational contexts published between 2015 and 2025. Guided by the PRISMA 2020 protocol, the review synthesizes findings from 106 peer-reviewed studies across K–12, higher education, and teacher training environments. The analysis identifies six interrelated themes: (1) types of XAI models and techniques, (2) domains of application in educational technologies, (3) operationalization of explainability, (4) impacts on learning and teaching, (5) challenges and limitations, and (6) ethical and epistemological considerations. Results reveal that while technical implementations of XAI are expanding, their pedagogical grounding remains limited, with explanations frequently framed as system outputs rather than tools for epistemic engagement. Explainability is often operationalized through vague definitions and evaluated using affective or behavioral proxies, with minimal attention to learning outcomes or cognitive development. Furthermore, ethical and cultural considerations are inconsistently addressed, raising concerns about inclusion, equity, and user agency. The review proposes a tripartite framework—pedagogical, epistemic, and ethical explainability—to guide future research and design. It calls for participatory, theory-informed, and context-sensitive approaches to ensure that educational XAI fosters critical thinking, learner autonomy, and instructional equity.
References
Abbas, H. (2024). Transforming education: The role of artificial intelligence. Studies in Engineering and Exact Sciences, 5(3), Article e12579. https://doi.org/10.54021/seesv5n3-041
Abu Bakar, M. A., & Ismail, N. (2020). Exploring metacognitive regulation and students’ interaction in mathematics learning: An analysis of needs to enhance students’ mastery. Humanities & Social Sciences Reviews, 8(2), 67–74. https://doi.org/10.18510/hssr.2020.82e07
Agarwal, A. (2023). Exploring the landscape of explainable artificial intelligence: Benefits, challenges, and future perspectives. International Journal of Advanced Research, 11(12), 1042–1046. https://doi.org/10.21474/IJAR01/18074
Allahverdiyeva, N. (2024). The role, importance and application of artificial intelligence in the creation of digital education. SCIENTIFIC WORK, 18(2), 120–125. https://doi.org/10.36719/2663-4619/99/120-125
Alrayes, A., Henari, T. F., & Ahmed, D. A. (2024). ChatGPT in education – Understanding the Bahraini academics perspective. Electronic Journal of e-Learning, 22(2), 112–134. https://doi.org/10.34190/ejel.22.2.3250
Arianto, F. (2021). Metacognitive strategy and science problem-solving abilities in elementary school students. International Journal of Social Science and Human Research, 4(9). https://doi.org/10.47191/ijsshr/v4-i9-42
Boppiniti, S. (2020). A survey on explainable AI: Techniques and challenges. International Journal of Innovative Engineering Research and Technology, 7(3), 57–66. https://doi.org/10.26662/ijiert.v7i3.pp57-66
Braaten, M., & Windschitl, M. (2011). Working toward a stronger conceptualization of scientific explanation for science education. Science Education, 95(4), 639–669. https://doi.org/10.1002/sce.20449
Chan, K. S., & Zary, N. (2019). Applications and challenges of implementing artificial intelligence in medical education: Integrative review. JMIR Medical Education, 5(1), Article e13930. https://doi.org/10.2196/13930
Chaudhry, M. A., Cukurova, M., & Luckin, R. (2022). A transparency index framework for AI in education. In M. M. Rodrigo, N. Matsuda, A. I. Cristea, & V. Dimitrova (Eds.). Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners’ and Doctoral Consortium (pp. 195–198). Springer International Publishing. https://doi.org/10.1007/978-3-031-11647-6_33
Choi, J.-I., Yang, E., & Goo, E.-H. (2024). The effects of an ethics education program on artificial intelligence among middle school students: Analysis of perception and attitude changes. Applied Sciences, 14(4), 1588. https://doi.org/10.3390/app14041588
Darwish, A. (2022). Explainable artificial intelligence: A new era of artificial intelligence. Digital Technologies Research and Applications, 1(1), 1. https://doi.org/10.54963/dtra.v1i1.29
Darwish, D. (2025). Classroom assessment and evaluation with artificial intelligence. In Deep Science Publishing (pp. 34–43). Deep Science Publishing. https://doi.org/10.70593/978-81-984306-7-0_3
Davis, R. O. (2024). Korean in-service teachers’ perceptions of implementing artificial intelligence (AI) education for teaching in schools and their AI teacher training programs. International Journal of Information and Education Technology, 14(2), 214–219. https://doi.org/10.18178/ijiet.2024.14.2.2042
Ewals, L. J. S., Heesterbeek, L. J. J., Yu, B., van der Wulp, K., Mavroeidis, D., Funk, M., Snijders, C. C. P., Jacobs, I., Nederend, J., Pluyter, J. R., & e/MTIC Oncology group. (2024). The impact of expectation management and model transparency on radiologists’ trust and utilization of AI recommendations for lung nodule assessment on computed tomography: Simulated use study. JMIR AI, 3, Article e52211. https://doi.org/10.2196/52211
Feldman-Maggor, Y., Nazaretsky, T., & Alexandron, G. (2024). Explainable AI for unsupervised machine learning: A proposed scheme applied to a case study with science teachers. In Proceedings of the 16th International Conference on Computer Supported Education (pp. 436–444). SCITEPRESS - Science and Technology Publications. https://doi.org/10.5220/0012687000003693
Fricker, M. (2007). Epistemic injustice: Power and the ethics of knowing. Oxford University Press.
Gaur, A. S., Sharan, H. O., & Kumar, R. (2024). AI in education. In R. Kumar, A. Joshi, H. O. Sharan, S.-L. Peng, & C. R. Dudhagara (Eds.), Artificial intelligence applications (pp. 39–54). IGI Global. https://doi.org/10.4018/979-8-3693-2964-1.ch003
Göçen, A., & Aydemir, F. (2020). Artificial intelligence in education and schools. Research on Education and Media, 12(1), 13–21. https://doi.org/10.2478/rem-2020-0003
Gomez, M. J., Armada Sánchez, Á., Albaladejo-González, M., García Clemente, F. J., & Ruipérez-Valiente, J. A. (2025). Utilising explainable AI to enhance real‐time student performance prediction in educational serious games. Expert Systems, 42(3). https://doi.org/10.1111/exsy.70008
Gorantla, B., & Devineni, S. (2024). Evaluation of explainable artificial intelligence using TOPSIS method. Computer Science, Engineering and Technology, 2(2), 10–20. https://doi.org/10.46632/cset/2/2/2
Guan, H. (2023). Advantages and challenges of using artificial intelligence in primary and secondary school education. Journal of Education, Humanities and Social Sciences, 22, 377–383. https://doi.org/10.54097/ehss.v22i.12469
Gumabay, D. C. A. N., & Gumabay, D. M. V. N. (2024). Opportunities and challenges for information technology and business educators in implementing generative artificial intelligence in instruction. International Journal of Management and Humanities, 11(4), 1–7. https://doi.org/10.35940/ijmh.D1769.11041224
Gunning, D., & Aha, D. W. (2019). DARPA’s explainable artificial intelligence program. AI Magazine, 40(2), 44–58. https://doi.org/10.1609/aimag.v40i2.2850
Hamida, S. U., Chowdhury, M. J. M., Chakraborty, N. R., Biswas, K., & Sami, S. K. (2024). Exploring the landscape of explainable artificial intelligence (XAI): A systematic review of techniques and applications. Big Data and Cognitive Computing, 8(11), 149. https://doi.org/10.3390/bdcc8110149
Hoya, F., Mah, D., Prilop, C., Jacobsen, L., & Weber, K. (2024). Preservice teachers’ AI usage: The effects of perceived usefulness, subjective norm, behavioral intention, and self-efficacy. OSF Preprints. https://doi.org/10.31219/osf.io/284gk
Huang, J. (2023). Engineering ChatGPT prompts for EFL writing classes. International Journal of TESOL Studies. https://doi.org/10.58304/ijts.20230405
Kaharuddin, K., Ahmad, D., Mardiana, M., Latif, I., Arafah, B., & Suryadi, R. (2024). Defining the role of artificial intelligence in improving English writing skills among Indonesian students. Journal of Language Teaching and Research, 15(2), 568–678. https://doi.org/10.17507/jltr.1502.25
Karpouzis, K. (2024). Explainable AI for intelligent tutoring systems. In M. Farmanbar, M. Tzamtzi, A. K. Verma, & A. Chakravorty (Eds.), Frontiers of artificial intelligence, ethics, and multidisciplinary applications (pp. 59–70). Springer Nature. https://doi.org/10.1007/978-981-99-9836-4_6
Kim, J., Ham, Y., & Lee, S.-S. (2024). Differences in student-AI interaction process on a drawing task: Focusing on students’ attitude towards AI and the level of drawing skills. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.8859
Kristiawan, D., Bashar, K., & Pradana, D. A. (2024). Artificial intelligence in English language learning: A systematic review of AI tools, applications, and pedagogical outcomes. The Art of Teaching English as a Foreign Language, 5(2), 207–218. https://doi.org/10.36663/tatefl.v5i2.912
Li, Z. (2023). The significance of educational application of artificial intelligence and its current state in China. Science Insights Education Frontiers, 16(2), 2589–2597. https://doi.org/10.15354/sief.23.re215
Liefooghe, B., & van Maanen, L. (2022). Three levels at which the user’s cognition can be represented in artificial intelligence. Frontiers in Artificial Intelligence, 5, Article 1092053. https://doi.org/10.3389/frai.2022.1092053
Lin, M. P.-C., Liu, A. L., Poitras, E., Chang, M., & Chang, D. H. (2024). An exploratory study on the efficacy and inclusivity of AI technologies in diverse learning environments. Sustainability, 16(20), 8992. https://doi.org/10.3390/su16208992
Liu, Q., Pinto, J. D., & Paquette, L. (2024). Applications of explainable AI (XAI) in education. In D. Kourkoulou, A.-O. Tzirides, B. Cope, & M. Kalantzis (Eds.), Trust and inclusion in AI-mediated education (pp. 93–109). Springer. https://doi.org/10.1007/978-3-031-64487-0_5
Liulka, V., Savenkova, O., & Dedukhno, A. (2024). The peculiarities of using artificial intelligence in teaching foreign languages in higher education institutions in Ukraine. Humanities Science Current Issues, 2(73), 195–201. https://doi.org/10.24919/2308-4863/73-2-30
Madi, I. A. E., Redjdal, A., Bouaud, J., & Séroussi, B. (2024). Exploring explainable AI techniques for text classification in healthcare: A scoping review. Studies in Health Technology and Informatics, 316, 846–850. https://doi.org/10.3233/SHTI240544
Maity, S., & Deroy, A. (2024). Human-centric explainable AI in education. https://doi.org/10.35542/osf.io/k5u9b
Marrone, R., Zamecnik, A., Joksimović, S., Johnson, J., & De Laat, M. (2024). Understanding student perceptions of artificial intelligence as a teammate. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-024-09780-z
Mehendale, P. (2022). Bridging the gap: Enhancing trust and transparency in machine learning with explainable AI. Journal of Artificial Intelligence & Cloud Computing, 1–4. https://doi.org/10.47363/JAICC/2022(1)E123
Meske, C., Abedin, B., Junglas, I., & Rabhi, F. (2021). Introduction to the Minitrack on explainable artificial intelligence (XAI). Proceedings of the Annual Hawaii International Conference on System Sciences. https://doi.org/10.24251/HICSS.2021.153
Milad, A., & Whiba, M. (2024). Exploring explainable artificial intelligence technologies: Approaches, challenges, and applications. International Science and Technology Journal, 34(1), 1–21. https://doi.org/10.62341/amia8430
Morandín-Ahuerma, F. (2024). A critical analysis of the European Union’s considerations on the ethical use of artificial intelligence in education. OSF Preprints. https://doi.org/10.31219/osf.io/escqj
Najdawi, M. H. A., Shwedeh, F., Abdelmoghies, M. M., Kitana, A., & Ali, A. (2024). Applying artificial intelligence in predicting educational excellence in higher education institutions: A case study in Jordanian universities. Edelweiss Applied Science and Technology, 8(6), 7273–7289. https://doi.org/10.55214/25768484.v8i6.3579
Ng, D. T. K., Leung, J. K. L., Chu, K. W. S., & Qiao, M. S. (2021). AI literacy: Definition, teaching, evaluation and ethical issues. Proceedings of the Association for Information Science and Technology, 58(1), 504–509. https://doi.org/10.1002/pra2.487
Nobles, C. (2025). Human factors engineering in explainable AI: Putting people first. International Conference on Cyber Warfare and Security, 20(1), 313–322. https://doi.org/10.34190/iccws.20.1.3348
Nurjanah, A., Salsabila, I. N., Azzahra, A., Rahayu, R., & Marlina, N. (2024). Artificial intelligence (AI) usage in today’s teaching and learning process: A review. Syntax Idea, 6(3), 1517–1523. https://doi.org/10.46799/syntax-idea.v6i3.3126
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., . . . Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71:contentReference[oaicite:1]{index=1}
Ren, X., & Wu, M. L. (2025). Examining teaching competencies and challenges while integrating artificial intelligence in higher education. TechTrends. https://doi.org/10.1007/s11528-025-01055-3
Robinson, C. L., D’Souza, R. S., Yazdi, C., Diejomaoh, E. M., Schatman, M. E., Emerick, T., & Orhurhu, V. (2024). Reviewing the potential role of artificial intelligence in delivering personalized and interactive pain medicine education for chronic pain patients. Journal of Pain Research, 17, 923–929. https://doi.org/10.2147/JPR.S439452
Sadvakassova, A., Kydyrbekova, A., & Chetin, O. (2024). Using of virtual reality and artificial intelligence in education: Literature review. "Bilim” Scientific and Pedagogical Jornal, 110(3), 10–18. https://doi.org/10.59941/2960-0642-2024-3-10-18
Sandoval, W. (2014). Science Education’s Need for a Theory of Epistemological Development. Science Education, 98(3), 383–387. https://doi.org/10.1002/sce.21107
Song, D. (2024). Artificial intelligence for human learning: A review of machine learning techniques used in education research and a suggestion of a learning design model. American Journal of Education and Learning, 9(1), 1–21. https://doi.org/10.55284/ajel.v9i1.1024
Susantini, E., Puspitawati, R. P., Raharjo, R., & Suaidah, H. L. (2021). E-book of metacognitive learning strategies: Design and implementation to activate student’s self-regulation. Research and Practice in Technology Enhanced Learning, 16(1). https://doi.org/10.1186/s41039-021-00161-z
Türkmen, G. (2025). The review of studies on explainable artificial intelligence in educational research. Journal of Educational Computing Research, 63(2), 277–310. https://doi.org/10.1177/07356331241310915
Yildirim, Y., & Celepcikay, A. (2021). Artificial intelligence and machine learning applications in education. Eurasian Journal of Higher Education, 2(4), 1–11. https://doi.org/10.31039/ejohe.2021.4.49
Yildiz Durak, H., Eğin, F., & Onan, A. (2025). A comparison of human-written versus AI -Generated text in discussions at educational settings: Investigating features for ChatGPT, Gemini and BingAI. European Journal of Education, 60(1). https://doi.org/10.1111/ejed.70014
Zhai, G., Guo, K., & Li, S. (2023). Research on innovation of ideological and political education in universities based on artificial intelligence. In K. M. Salleh, M. I. R. M. Mohammad Ismail, & L. Yuan (Eds.). Proceedings of the 2023 International Conference on Applied Psychology and Modern Education (ICAPME 2023) (pp. 27–32). Atlantis Press sarl. https://doi.org/10.2991/978-2-38476-158-6_5
Zhang, H., Lee, I., Ali, S., DiPaola, D., Cheng, Y., & Breazeal, C. (2022). Integrating ethics and career futures with technical learning to promote AI literacy for middle school students: An exploratory study. International Journal of Artificial Intelligence in Education, 33(2), 1–35. https://doi.org/10.1007/s40593-022-00293-3
Downloads
Published
How to Cite
Issue
Section
License
I (we) submit this article which is original and unpublished, of my (our) own authorship, to the evaluation of the Veredas do Direito Journal, and agree that the related copyrights will become exclusive property of the Journal, being prohibited any partial or total copy in any other part or other printed or online communication vehicle dissociated from the Veredas do Direito Journal, without the necessary and prior authorization that should be requested in writing to Editor in Chief. I (we) also declare that there is no conflict of interest between the articles theme, the author (s) and enterprises, institutions or individuals.
I (we) recognize that the Veredas do Direito Journal is licensed under a CREATIVE COMMONS LICENSE.
Licença Creative Commons Attribution 3.0
