EFL Students Develop Cognitive and Metacognitive Self-Regulated Writing Strategies Using Automated Feedback: A Case Study
DOI:
https://doi.org/10.17507/tpls.1405.26Keywords:
automated feedback, cognitive strategies, metacognitive strategies, self-regulated approachAbstract
This study investigated the impacts of automated feedback on EFL students’ development of cognitive and metacognitive self-regulated writing strategies, using ProWritingAid online tool. Data were collected from students enrolled in level one writing course at the College of Languages and Translation, Imam Mohammed Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia. The results indicated significant impacts of automated feedback on students' self-regulated writing strategies, reflected in an overall mean score of (3.75 ± 0.69).Findings after using automated feedback showed participants’ development of cognitive strategies, including language usage (e.g., grammar, spelling, punctuation), which reached 73%. The cognitive strategies of writing revision, encompassing revise cohesiveness and connection among sentences, reached 70%. Participants’ development of metacognitive strategies, including idea planning and goal-oriented monitoring and evaluation, reached 75% and 77%, respectively. The results also indicated significant impacts of automated feedback on motivational and social strategies, with scores of 87% and 80%, respectively. Comparing participants’ written assignment scores before and after using automated feedback, the results showed a 62% improvement in performance among low-proficient students. One implication of the study is that, with the aid of automated feedback, EFL students have the abilities to autonomously improve their writing skills. The adoption of a self-regulated approach, within the utilization of automated feedback, significantly influences students' performance. These findings suggest that integrating automated feedback into the EFL curriculum and instruction can foster students' self-reliance and proficiency in writing.
References
Barrot, J. S. (2023). Using automated written corrective feedback in the writing classrooms: effects on L2 writing accuracy. Computer Assisted Language Learning, 36(4), 584-607.
Bellhäuser, H., Dignath, C., & Theobald, M. (2023). Daily automated feedback enhances self-regulated learning: a longitudinal randomized field experiment. Frontiers in Psychology, 18(14), 1125873.
Brenner, C. A. (2022). Self-regulated learning, self-determination theory and teacher candidates’ development of competency-based teaching practices. Smart Learning Environments, 9, 3-10.
Burstein J, Riordan B, & McCaffrey D. (2020). Expanding automated writing evaluation: Handbook of automated scoring, (pp. 329–346). eBook. https://doi.org/10.1201/9781351264808
Camacho, A., Alves, R. A., De Smedt, F. et al. (2021). Relations among motivation, behavior, and performance in writing: a multiple-group structural equation modeling study. British Journal of Education Psychology, 91, 1456–1480.
Chen, J., Zhang, J., & Chen, X. (2022). L2 learners’ self-regulated learning strategies and self-efficacy for writing achievement: A latent profile analysis. Language Teaching Research, 9, 3-62.
Cotos, E. (2023). Automated feedback on writing. In Kruse, O., et al. Digital Writing Technologies in Higher Education. Springer, 347-254.
DeSmedt, F., Landrieu, Y., DeWever, B. & VanKeer, H. (2023). The role of writing motives in the interplay between implicit theories, achievement goals, self-efficacy, and writing performance. Frontiers in Psychology, 14, 1149923.
Dizon, G., & Gayed, M. (2021). Examining the impact of Grammarly on the quality of mobile L2 writing. JALT CALL Journal, 17(2), 74-92.
Fan, N., & Ma, Y. (2022). The effects of automated writing evaluation (AWE) feedback on students’ English writing quality: systematic literature review. Language Teaching Research Quarterly, 28, 53–73.
Finn, B. (2021). Exploring interactions between motivation and cognition to better shape self-regulated learning. Journal of Applied Research in Memory and Cognition, 9(4), 461–467.
Fu, Q., Zou, D., Xie, H., & Cheng, G. (2022). A review of AWE feedback: Types, learning outcomes, and implications. Computer Assisted Language Learning, 1–43.
Gayed, J., Carlon, M., Oriola, A. et al. (2022). Exploring an AI-based writing assistant's impact on English language learners. Computers and Education: Artificial Intelligence, 3, 1-7.
Geng, J. & Razali, A. (2022).Effectiveness of the automated writing evaluation program on improving undergraduates’ writing performance. English Language Teaching, 15(7), 49-60.
Godwin-Jones, R. (2022). Partnering with AI: intelligent writing assistance and instructed language learning. Language. Learning & Technology, 26(2), 5–24.
Golparvar, S., & Khafi, A. (2023). The role of L2 writing self-efficacy in integrated writing strategy use and performance. Assessing Writing, 47(1), 100504.
Guo W., & Bai, B. (2022). Effects of self-regulated learning strategy use on motivation in EFL writing: a comparison between high and low achievers in Hong Kong primary schools. Applied Linguistics Review, 13, 117–139.
Han, T., & Sari, E. (2022). An investigation on the use of automated feedback in Turkish EFL students’ writing classes. Computer Assisted Language Learning, 1–24.
Hayes J., & Hayes A. (ed.). (2022). Introduction to mediation, moderation, and conditional process analysis: a regression- based approach (3rd ed.). Guilford.
Karagul, B., & Seker, M. (2021). Improving language learners’ use of self-regulated writing strategies through screencast feedback. SAGE Open, 11(4), 1-14.
Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: s multiple case study. Assessing Writing, 44, 100450.
Kormos, J. (2023). The role of cognitive factors in second language writing and writing to learn a second language. Studies in Second Language Acquisition, 45(3), 622-646.
Lee, Y. (2020). The long-term effect of automated writing evaluation feedback on writing development. English Teaching, 75(1), 67-92.
Li, R. (2021). Modeling continuance intention to use automated writing among Chinese EFL learners. SAGE Open, 1-10.
Ling, Guangming, Elliot, N., Burstein, J. C., McCaffrey et al. (2021). Writing motivation: a validation study of self-judgement and performance. Assessing Writing, 48, 1-15.
Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement. Computer Assisted Language Learning, 35(4), 605–634.
Mayordomo, R. Espasa, A., Guasch, T., & Martínez-Melo, M. (2022). Perception of online feedback and its impact on cognitive and emotional engagement with feedback. Education and Information Technologies, 27(6), 7947–7971.
Mitchell, K., Zumbrunn, S., Berry, D. et al. (2023). Writing self-efficacy in postsecondary students: a scoping review. Education Psychology Review, 35(82), 45-80.
Nazari, N., Shabbir, M., & Setiawan, R. (2021). Application of artificial intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon, 7(5), e07014.
Orpheus Tech. (2023). Pro-writing aid automate feedback. Retrieved March, 2023, https://powritingaid.com/
Rusdin, D., Mukminatien, N., Suryati, N. et al. (2023). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11, 2290342, 1-18.
Shi, H. & Aryadoust, V. (2022). A systematic review of automated writing evaluation systems. Education and Information Technologies, 1–25.
Sun, T., & Wang, C. (2020). College learners’ writing self-efficacy and writing self-regulated learning strategies in learning English as a foreign language. System, 90, 102221.
Sun, T., Wang, C., & Wang, Y. (2022). The effectiveness of self-regulated strategy development on improving English writing: Evidence from the last decade. Reading &Writing, 35(10), 2497-2522.
Sun, Q., Pan, H., & Zhan, J. (2023). Untangling the relationship between English as a foreign language learners’ metacognitive experience and writing proficiency: A mixed-methods approach, System, 117, 103100.
Teng, F. (2020). The role of metacognitive knowledge and regulation in mediating university EFL learners’ writing performance. Innovation in Language Learning and Teaching, 14(5), 436–450.
Teng, L., & Zhang, L. (2016). A questionnaire-based validation of multidimensional models of self-regulated learning strategies. Modern Language Journal, 100, 674–701.
Teng, M., & Zhan, Y. (2023). Assessing self-regulated writing strategies, self-efficacy, task complexity, and performance in English academic writing. Assessing Writing, 57,100728.
Teng, M., & Zhan, Y. (2024). Assessing self-regulated writing strategies, working memory, L2 proficiency level, and multimedia writing performance. Language Awareness, 1-28.
Theobald, M., & Bellhäuser, H. (2022). How am I going and where to next? Elaborated online feedback improves university students' self-regulated learning and performance. Internet &Higher Education, 55, 1-49.
Tian, L., Liu, Q., & Zhang, X. (2022). Self- students’ revision regulated writing strategy use when revising upon automated, peer, and teacher feedback in an online English as a foreign language writing course. Frontiers in Psychology, 13, 1–12.
Uwe, M. & Klotz, C. (2022). Personalized feedback in digital learning environments: Classification framework and literature review. Computers and Education: Artificial Intelligence, 3, 100080.
Waer, H. (2021). The effect of integrating automated writing evaluation on EFL writing apprehension and grammatical knowledge. Innovation in Language Learning and Teaching, 1–25.
Wambsganss, T., Janson, A., & Leimeister, J. (2022). Enhancing argumentative writing with automated feedback and social comparison nudging. Computers & Education, 191,104644.
Wei, P., Wang, X. & Dong, H. (2023). The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial. Frontiers in Psychology, 14, 124999.
Wijaya, K.F. (2021). English education master students’ self-regulated learning strategies in academic writing. Journal of English teaching, 7(1), 15-29.
Woodworth, J., & Barkaoui, K. (2020). Perspectives on using automated writing evaluation systems to provide written corrective feedback in ESL classroom. TESL Canada Journal, 37(2), 234–247.
Yang, H., Gao, C. & Shen, H. (2023). Learner interaction with, and response to, AI-programmed automated writing evaluation feedback in EFL writing: exploratory study. Education &Information Technologies, 1-22.
Zhang, Z. (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Assessing Writing, 43, 100439–100414.
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70.
Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45, 166–183.
Zimmerman, B. J. (2013). Self-regulated learning and academic achievement: Theoretical perspectives. Routledge.
