Measuring the Impact of ChatGPT Feedback on Saudi Undergraduate EFL Learners' Writing Skills
DOI:
https://doi.org/10.17507/tpls.1602.32Keywords:
ChatGPT feedback, effective supplement, instructional effectiveness, precise correction, tech-savvy young generationAbstract
As the conventional methods of instruction no longer seem to effectively conform to the taste of today's tech-savvy young generation, AI-powered tools are increasingly being incorporated in ESL/EFL classrooms for their efficiency, precise correction, and specific feedback. Despite multiple studies, the empowering role of ChatGPT in enhancing English writing skills, particularly in Saudi Arabia, remains largely unexplored. Therefore, this study employed a quasi-experimental design to compare and contrast the efficacy of ChatGPT with that of conventional feedback. While the students in the experimental group received feedback on their writing errors from ChatGPT for seven weeks, students in the control group received feedback from their teachers. To collect data, pre-and post-tests were carried out, which required respondents to draft tales based on pictures. It was revealed that the experimental group, which used an intervention, demonstrated fewer errors for all inflected morphemes than the control group, which used conventional instruction. These findings suggest that the use of AI tools like ChatGPT for language education courses serves as an effective supplement to traditional instructional methods, providing immediate feedback and personalized corrections that enhance instructional effectiveness.
References
Alam, S., & Usama, M. (2023). Does E-Feedback Impact Minimizing ESL Writing Errors? An Experimental Study. Int. J. Emerg. Technol. Learn., 18(4), 156-169. https://doi.org/10.3991/ijet.v18i04.36349
AlGhamdi, R. (2024). Exploring the impact of ChatGPT-generated feedback on technical writing skills of computing students: A blinded study. Education and Information Technologies, 1-26. https://doi.org/10.1007/s10639-024-12594-2
Ali, I. (2024). An analysis of English writing errors of Kurdish EFL postgraduate students. Humanities Journal of University of Zakho, 12(1), 67–80. https://doi.org/10.26436/hjuoz.2024.12.1.1270
Almashy, A., Ahmed, A. S. M. M., Jamshed, M., Ansari, M. S., Banu, S., & Warda, W. U. (2024). Analyzing the Impact of CALL Tools on English Learners' Writing Skills: A Comparative Study of Error Correction. World Journal of English Language, 14(6). https://doi.org/10.5430/wjel.v14n6p657
Bhutoria, A. (2022). Personalized education and artificial intelligence in the United States, China, and India: A systematic review using a humanin-the-loop model. Computers and Education: Artificial Intelligence, 3, https://doi.org/10.1016/j.caeai.2022.100068
Bodaubekov, A., Agaidarova, S., Zhussipbek, T., Gaipov, D., & Balta, N. (2025). Leveraging AI to enhance writing skills of senior TFL students in Kazakhstan: A case study using “Write & Improve”. Contemporary Educational Technology, 17(1), ep548. https://doi.org/10.30935/cedtech/15687
Cavalcanti, A. P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y. S., Gašević, D., & Mello, R. F. (2021). Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence, 2, 100027. https://doi.org/10.1016/j.caeai.2021.100027
Chan, S. T. S., Lo, N. P. K., & Wong, A. M. H. (2024). Enhancing university level English proficiency with generative AI: Empirical insights into automated feedback and learning outcomes. Contemporary Educational Technology, 16(4), ep541. https://doi.org/10.30935/cedtech/15607
Chaudhary, A., & Al Zahrani, S. (2020). Error analysis in the written compositions of EFL students: A classroom study. International Journal of English Linguistics, 10(2), 357-366. https://doi.org/10.5539/ijel.v10n2p357
Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1), 57. https://doi.org/10.1186/s41239-023-00425-2
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023). Automated feedback and writing: A multi-level meta-analysis of effects on students' performance. Frontiers in Artificial Intelligence, 6, 1162454. https://doi.org/10.3389/frai.2023.1162454
Graham, S. (2019). Changing How Writing Is Taught. Review of Research in Education, 43(1), 277-303. https://doi.org/10.3102/0091732X18821125
Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605
Jamshed, M., Allehyani, B., Albedah, F., & Banu, S. (2024). Analyzing ChatGPT's Sustainability as a Language Learning Tool: Saudi EFL Learners' Perspectives, Problems and Pedagogical Prospects. Theory and Practice in Language Studies, 14(12), 3836-3844. https://doi.org/10.5430/wjel.v14n6p657
Koltovskaia, S., Rahmati, P., & Saeli, H. (2024). Graduate students’ use of ChatGPT for academic text revision: Behavioral, cognitive, and affective engagement. Journal of Second Language Writing, 65, 101130. https://doi.org/10.1016/j.jslw.2024.101130
Krashen, S. D. (2006). The input hypothesis: issues and implications. Crane Resource Centre.
Lingard, L. (2023). Writing with ChatGPT: An illustration of its capacity, limitations & implications for academic writers. Perspectives on Medical Education, 12(1), 261–270. https://doi.org/10.5334/pme.1072
Long, M. H. (1980). Input, interaction, and second language acquisition. University of California, Los Angeles.
Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments, 11(1), 9. https://doi.org/10.1186/s40561-024-00295-9
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2). https://doi.org/10.1080/2331186X.2023.2236469
McAteer, M. (2013). Action research in education. London: Sage.
McMartin-Miller, C. (2014). How much feedback is enough?: Instructor practices and student attitudes toward error treatment in second language writing. Assessing Writing, 19, 24-35. https://doi.org/10.1016/j.asw.2013.11.003
Mohammadi, T., & Mustafa, H. R. (2020). Errors in English writing of ESL/EFL students: A systematic review. Theory and Practice in Language Studies, 10(5), 520-526. http://dx.doi.org/10.17507/tpls.1005.05
Mun, C. Y. (2024). EFL learners’ English writing feedback and their perception of using ChatGPT. STEM Journal, 25(2), 26-39. https://doi.org/10.16875/stem.2024.25.2.26
Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024). Human-AI collaboration patterns in AI-assisted academic writing. Studies in Higher Education, 49(5), 847–864. https://doi.org/10.1080/03075079.2024.2323593
Nugroho, A., Andriyanti, E., Widodo, P., & Mutiaraningrum, I. (2024). Students’ appraisals post-ChatGPT use: Students’ narrative after using ChatGPT for writing. Innovations in Education and Teaching International, 1–13. https://doi.org/10.1080/14703297.2024.2319184
Ozfidan, B., El-Dakhs, D. A. S., & Alsalim, L. A. (2024). The use of AI tools in English academic writing by Saudi undergraduates. Contemporary Educational Technology, 16(4), ep527. https://doi.org/10.30935/cedtech/15013
Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023). Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: A meta-analytic review. Educational Psychology Review, 35(4), 113. https://doi.org/10.1007/s10648-023-09823-4
Polakova, P., & Ivenz, P. (2024). The impact of ChatGPT feedback on the development of EFL students’ writing skills. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2410101
Rahimi, M., & Fathi, J. (2022). Exploring the impact of wiki-mediated collaborative writing on EFL students’ writing performance, writing self- regulation, and writing self-efficacy: a mixed methods study. Computer Assisted Language Learning, 35(9), 2627-2674. https://doi.org/10.1080/09588221.2021.1888753
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., ... & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students’ writing. Learning and Instruction, 91, 101894. https://doi.org/10.1016/j.learninstruc.2024.101894
Stokel-Walker, C. (2022). AI bot ChatGPT writes smart essays—Should professors worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
Storch, N. (2018). Written corrective feedback from sociocultural theoretical perspectives: A research agenda. Language Teaching, 51(2), 262–277. https://doi.org/10.1017/S0261444818000034
Taskıran, A., & Goksel, N. (2022). Automated feedback and teacher feedback: Writing achievement in learning English as a foreign language at a distance. Turkish Online Journal of Distance Education, 23(2), 120-139. https://doi.org/10.17718/tojde.1096260
Teng, F. M. (2024). A Systematic Review of ChatGPT for English as a Foreign Language Writing: Opportunities, Challenges, and Recommendations. International Journal of TESOL Studies, 6(3), 36-57. https://doi.org/10.58304/ijts.20240304
Teng, M. F., & Teng, L. S. (2024). Validating the multi-dimensional structure of self-efficacy beliefs in peer feedback for L2 writing: A bifactor-exploratory structural equation modeling approach. Research Methods in Applied Linguistics, 3(3). https://doi.org/10.1016/j.rmal.2024.100136
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (Vol. 86). Harvard university press.
Wang, M., & Guo, W. (2023). The potential impact of ChatGPT on education: Using history as a rearview mirror. ECNU Review Education. https://doi.org/10.1177/20965311231189826
Wang, C., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B. (2024). Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment? Education Sciences, 14(9), 976. https://doi.org/10.3390/educsci14090976
Werdiningsih, I., Marzuki, & Rusdin, D. (2024). Balancing AI and authenticity: EFL students’ experiences with ChatGPT in academic writing. Cogent Arts & Humanities, 11(1). https://doi.org/10.1080/23311983.2024.2392388
Wiboolyasarin, W., Wiboolyasarin, K., Suwanwihok, K., Jinowat, N., & Muenjanchoey, R. (2024). Synergizing collaborative writing and AI feedback: An investigation into enhancing L2 writing proficiency in wikibased environments. Computers and Education: Artificial Intelligence, 6, 100228. https://doi.org/10.1016/j.caeai.2024.100228
Wu, Y. (2024). Study on the Impact of Utilizing ChatGPT and Other AI Tools for Feedback in EAP Writing Classrooms on the Discursive Writing Performance of English Major Students. Transactions on Social Science, Education and Humanities Research, 4, 143-150. https://doi.org/10.62051/4se95x52
Zebua, J. A. Z., & Katemba, C. V. (2024). Students’ Perceptions of Using the OpenAI ChatGPT Application in Improving Writing Skills. Journal of Language and Literature Studies, 4(1), 110–123. https://doi.org/10.36312/jolls.v4i1.1805
