Efektivitas Kecerdasan Buatan Generatif terhadap Hasil Belajar Peserta Didik: Meta-Analisis Studi Eksperimen dan Kuasi-Eksperimen
DOI:
https://doi.org/10.31004/jpion.v5i3.1469Keywords:
generative AI, learning outcomes, meta-analysis, pedagogical guidance, effect sizeAbstract
Penelitian ini bertujuan menganalisis secara kuantitatif pengaruh penggunaan kecerdasan buatan generatif (GenAI) terhadap hasil belajar peserta didik serta mengidentifikasi karakteristik intervensi yang berkaitan dengan variasi pengaruh tersebut. Metode yang digunakan adalah meta-analisis atas studi eksperimen dan kuasi-eksperimen yang terbit pada 2021–2026 dengan pelaporan mengikuti PRISMA 2020. Pencarian dilakukan pada Scopus, ResearchGate, dan Google Scholar, dan sebanyak 20 studi dengan total 3.005 peserta didik disertakan dalam sintesis. Ukuran efek gabungan diestimasi dengan model efek acak, disertai analisis subkelompok dan analisis sensitivitas. Hasil menunjukkan pengaruh positif pada kisaran sedang menuju besar (Hedges’ g = 0,707; interval kepercayaan 95%: 0,339–1,074) dengan heterogenitas tinggi (I² = 93,1%). Pengaruh cenderung lebih besar pada penggunaan GenAI yang terstruktur dengan panduan pedagogis (g = 0,839) daripada penggunaan tanpa panduan (g = 0,034), serta pada perbandingan dengan pembelajaran tanpa GenAI (g = 0,861) daripada dengan umpan balik manusia (g = 0,200). Disimpulkan bahwa efektivitas GenAI berkaitan dengan rancangan pedagogis dan konteks penerapannya, sehingga integrasinya perlu dirancang secara terarah.
References
Alnemrat, A., Aldamen, H., Almashour, M., Al-Deaibes, M., & AlSharefeen, R. (2025). AI vs. teacher feedback on EFL argumentative writing: a quantitative study. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1614673
Alneyadi, S., & Wardat, Y. (2023). ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools. Contemporary Educational Technology, 15(4), ep448–ep448. https://doi.org/10.30935/cedtech/13417
Barcaui, A. (2025). ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention. Social Sciences & Humanities Open, 12, 102287. https://doi.org/10.1016/j.ssaho.2025.102287
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26). https://doi.org/10.1073/pnas.2422633122
Cen, X., & Shakibaei, G. (2026). Enhancing creative writing through AI-powered co-creation with cognitive and emotional outcomes. Scientific Reports, 16(1), 4407. https://doi.org/10.1038/s41598-025-34416-2
Chen, S., & Cheung, A. C. K. (2025). Effect of generative artificial intelligence on university students learning outcomes: A systematic review and meta-analysis. Educational Research Review, 49, 100737. https://doi.org/10.1016/j.edurev.2025.100737
Dai, X., Gong, Y., & Ma, L.-Y. (2026). Effects of ChatGPT-generated immediate feedback integrated into VR-based OSCEs on nursing students’ performance: a randomized crossover study. BMC Nursing, 25(1), 396. https://doi.org/10.1186/s12912-026-04633-9
de la Puente, M., Torres, J., Troncoso, A. L. B., Meza, Y. Y. H., & Carrascal, J. X. M. (2024). Investigating the use of chatGPT as a tool for enhancing critical thinking and argumentation skills in international relations debates among undergraduate students. Smart Learning Environments, 11(1), 55. https://doi.org/10.1186/s40561-024-00347-0
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025). Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies. Computers & Education, 227, 105224. https://doi.org/10.1016/j.compedu.2024.105224
El Fathi, T., Saad, A., Larhzil, H., Lamri, D., & Al Ibrahmi, E. M. (2025). Integrating generative AI into STEM education: enhancing conceptual understanding, addressing misconceptions, and assessing student acceptance. Disciplinary and Interdisciplinary Science Education Research, 7(1), 6. https://doi.org/10.1186/s43031-025-00125-z
Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1), 57. https://doi.org/10.1186/s41239-023-00425-2
Gan, W., Ouyang, J., Li, H., Xue, Z., Zhang, Y., Dong, Q., Huang, J., Zheng, X., & Zhang, Y. (2024). Integrating ChatGPT in Orthopedic Education for Medical Undergraduates: Randomized Controlled Trial. Journal of Medical Internet Research, 26, e57037. https://doi.org/10.2196/57037
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021). Doing Meta-Analysis with R. Chapman and Hall/CRC. https://doi.org/10.1201/9781003107347
Heung, Y. M. E., & Chiu, T. K. F. (2025). How ChatGPT impacts student engagement from a systematic review and meta-analysis study. Computers and Education: Artificial Intelligence, 8, 100361. https://doi.org/10.1016/j.caeai.2025.100361
Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., & Page, M. J. (2024). Cochrane Handbook for Systematic Reviews of Interventions version 6.5. Cochrane. https://www.cochrane.org/handbook
Hsu, L. (2025). Entangled cognition in EFL education: The role of generative AI. Contemporary Educational Technology, 17(4), ep619–ep619. https://doi.org/10.30935/cedtech/17621
Hu, H., Gong, Q., & Hashim, H. (2026). The Impact of ChatGPT-Generated Feedback on English Academic Writing Proficiency and Engagement: A Mixed-Methods Study. Sage Open, 16(3). https://doi.org/10.1177/21582440261480859
Huang, S., Wen, C., Bai, X., Li, S., Wang, S., Wang, X., & Yang, D. (2025). Exploring the Application Capability of ChatGPT as an Instructor in Skills Education for Dental Medical Students: Randomized Controlled Trial. Journal of Medical Internet Research, 27, e68538–e68538. https://doi.org/10.2196/68538
Huu Hoang, N. (2025). ChatGPT-assisted language learning: Effects on Vietnamese English majors’ writing skills and motivation. The JALT CALL Journal, 21(2), 102429. https://doi.org/10.29140/jaltcall.v21n2.102429
Kestin, G., Miller, K., Klales, A., Milbourne, T., & Ponti, G. (2025). AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting. Scientific Reports, 15(1), 17458. https://doi.org/10.1038/s41598-025-97652-6
Liu, Z., Zuo, H., & Lu, Y. (2025). The Impact of ChatGPT on Students’ Academic Achievement: A Meta‐Analysis. Journal of Computer Assisted Learning, 41(4). https://doi.org/10.1111/jcal.70096
Lu, D. (Jason), & Zeng, Y. (2025). Exploring the use of ChatGPT-generated model texts as a feedback instrument: EFL students’ text quality and perceptions. Innovation in Language Learning and Teaching, 1–21. https://doi.org/10.1080/17501229.2025.2525341
Maria Ilyas, Rehan Ahmed Khan, Rahila Yasmeen, Zainab Kamal, & Ul Ain, N. (2026). Impact of ChatGPT-assisted personalized learning on teaching acute abdomen to undergraduate medical students: A randomized crossover study. Pakistan Journal of Medical Sciences, 42(8), 1943–1948. https://doi.org/10.12669/pjms.42.8.14827
Min Young, D., & Park, Y. (2026). Meta-Analysis of ChatGPT’s Influence on Learning Achievement. The International Review of Research in Open and Distributed Learning, 27(1), 265–289. https://doi.org/10.19173/irrodl.v27i1.8775
Nathaniel, J., Oyelere, S. S., Suhonen, J., & Tedre, M. (2026). An experimental study of structured generative AI integration to mitigate pedagogical, cognitive, and ethical barriers in programming education. Frontiers in Computer Science, Volume 8-2026. https://doi.org/10.3389/fcomp.2026.1789829
Ng, D. T. K., Tan, C. W., & Leung, J. K. L. (2024). Empowering student self‐regulated learning and science education through ChatGPT : A pioneering pilot study. British Journal of Educational Technology, 55(4), 1328–1353. https://doi.org/10.1111/bjet.13454
Niloy, A. C., Akter, S., Sultana, N., Sultana, J., & Rahman, S. I. U. (2024). Is Chatgpt a menace for creative writing ability? An experiment. Journal of Computer Assisted Learning, 40(2), 919–930. https://doi.org/10.1111/jcal.12929
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, n71–n71. https://doi.org/10.1136/bmj.n71
Pustejovsky, J. E., & Tipton, E. (2022). Meta-analysis with Robust Variance Estimation: Expanding the Range of Working Models. Prevention Science, 23(3), 425–438. https://doi.org/10.1007/s11121-021-01246-3
Roza, V., Melani, M., reflinda, R., Rianto, R., Ahida, R., Arsyad, S., Sakti, G., & Mellian, Y. (2026). AI vs. Human Feedback in EFL Writing: Examining the Interplay Between Feedback Modalities and Digital Proficiency. Teaching English as a Second or Foreign Language--TESL-EJ, 30(1). https://doi.org/10.55593/ej.30117int2
Shahsavar, Z., Kafipour, R., Khojasteh, L., & Pakdel, F. (2024). Is artificial intelligence for everyone? Analyzing the role of ChatGPT as a writing assistant for medical students. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1457744
Sun, L., & Zhou, L. (2024). Does Generative Artificial Intelligence Improve the Academic Achievement of College Students? A Meta-Analysis. Journal of Educational Computing Research, 62(7), 1676–1713. https://doi.org/10.1177/07356331241277937
Wu, X., Zhu, P., Zhang, J., Yin, M., & Wang, Y. (2026). ChatGPT’s impact on student learning outcomes: a meta-analysis of 35 experimental studies. Humanities and Social Sciences Communications, 13(1), 684. https://doi.org/10.1057/s41599-026-07019-z
Yang, C. C. Y., Li, M., & Huang, A. Y. Q. (2026). Leveraging Large Language Models to Enhance Self‐Regulated Learning in Programming Education With Explainable AI. Journal of Computer Assisted Learning, 42(2). https://doi.org/10.1002/jcal.70206
Yang, T.-C., Hsu, Y.-C., & Wu, J.-Y. (2025). The effectiveness of ChatGPT in assisting high school students in programming learning: evidence from a quasi-experimental research. Interactive Learning Environments, 33(6), 3726–3743. https://doi.org/10.1080/10494820.2025.2450659
Zhang, K. (2025). Enhancing Critical Writing Through AI Feedback: A Randomized Control Study. Behavioral Sciences, 15(5), 600. https://doi.org/10.3390/bs15050600
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Roy Marthin Sihombing, Yeremia Christoper Sihotang, Anggina Pertiwi Nasution, Balqis Hijriaulia, Siska Anzani, Yosua Nathanael Nainggolan, Daldi Altamerando Suramana Sembiring, Elsa Sabrina
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
