Effects of Pigai.org on College English Writing Competency: The Complexity, Accuracy and Fluency
DOI:
https://doi.org/10.17507/tpls.1501.11Keywords:
Pigai.org, college English writing, complexity, accuracy, fluencyAbstract
Online applications in teaching and learning have been widely used in recent years. Pigai.org has become extremely popular for second language learning in China, and the study aims to examine its application to enhance students’ college English writing competency. Despite numerous studies on the use of Pigai.org, there has been rare research on its effects on college English writing competency in Chinese polytechnics. The current study investigates the effectiveness of its application over five weeks in a polytechnic college. Pigai.org has been applied in a College English Test-oriented writing class with 30 second-year students majoring in English. Sixty writing samples are collected in the first and fifth weeks, respectively, as the data analysis to evaluate writing complexity, accuracy, and fluency in pre-and post-tests. The study utilises a quantitative research approach, incorporating descriptive statistics, paired samples t-tests, and repeated measures ANOVA. The results show that the complexity, accuracy, and fluency significantly increased after applying Pigai.org in writing. Despite the decreases in very few items, most items measured in the study had higher scores in the post-test than in the pretest. The findings indicate that the use of Pigai.org positively affected college English writing and shed light on the pedagogical implications.
References
Bai, L. & Hu, G. (2016). In the face of fallible AWE feedback: How do students respond? Educ. Psychol, 37, 67-81. https://doi.org/10.1080/01443410.2016.1223275
Cabual, R. A. (2021). Learning styles and preferred learning modalities in the new normal. Open Access Library Journal, 8(4), 1–14. https://doi.org/10.4236/oalib.1107305
Cai, Y. & Yan, F. (2017). Universities and higher education. In Handbook of Education in China (pp. 169-193). Edward Elgar Publishing. https://doi.org/10.4337/9781783470662.00018
Carrillo, C. & Flores, M. A. (2020). COVID-19 and teacher education: a literature review of online teaching and learning practices. European journal of teacher education, 43(4), 466-487. https://doi.org/10.1080/02619768.2020.1821184.
Dash, B. B. (2022). Digital tools for teaching and learning English language in 21st century. International Journal of English and Studies, 4(2), 8–13.
Ding, L. & Wu, S. (2024). Digital transformation of education in China: A review against the backdrop of the 2024 World Digital Education Conference. Science Insights Education Frontiers, 20(2), 3283–3299. https://doi.org/10.15354/sief.24.re340
EF EPI. (2023). Retrieved March 30, 2024, from https://www.ef.com/ca/epi/regions/asia/china/.
Ellis, R., & Barkhuizen, G. P. (2005). Analysing Learner Language. Oxford University Press Oxford.
Geng, J.X, & Razali, A. B. (2020). Tapping the potential of Pigai automated writing evaluation (AWE) program to give feedback on EFL writing. Universal Journal of Educational Research, 8(12B), 8334-8343. https://doi.org/10.13189/ujer.2020.082638
Guo, L. (2020). A Study on the Application of Pigai. org Software in Teaching University-level English Writing-Taking a Freshman Class in Chongqing as an Example. Theory and Practice in Language Studies, 10(8), 952–958. https://doi.org/10.17507/tpls.1008.14
Hafizah Adnan, N., & Sayadi, S. S. (2022). ESL students' readiness for self-directed learning in improving English writing skills. Arab World English Journal (AWEJ), 12. https://doi.org/10.31235/osf.io/cswtz
Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable operations and computers, 3, 275-285. https://doi.org/10.1016/j.susoc.2022.05.004
Han, Y., & Hyland, F. (2015). Exploring learner engagement with written corrective feedback in a Chinese tertiary EFL classroom. Journal of Second Language Writing, 30, 31-44. https://doi.org/10.1016/j.jslw.2015.08.002
Han, Y., Zhao, S., & Ng, L. L. (2021). How technology tools impact writing performance, lexical complexity, and perceived self-regulated learning strategies in EFL academic writing: A comparative study. Frontiers in Psychology, 12, 752793. https://doi.org/10.3389/fpsyg.2021.752793
He, W., Zhang, Z. J. & Li, W. (2021). Information technology solutions, challenges, and suggestions for tackling the COVID-19 pandemic. International journal of information management, 57, 102287. https://doi.org/10.1016/j.ijinfomgt.2020.102287
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied linguistics, 30(4), 461-473. https://doi.org/10.1093/applin/amp048
IELTS TTPR Report. (2022). Overall Academic IELTS scores for 39 non-first language-speaking countries. Retrieved September 18, 2024, from https://ielts.org/researchers/our-research/test-statistics#Test_performance.
Li, Y., Teng, W., Tsai, L. & Lin, T. M. (2022). Does English proficiency support the economic development of non-English-speaking countries? The case of Asia. International Journal of Educational Development, 92, 102623. https://doi.org/10.1016/j.ijedudev.2022.102623
Li, Z., & Yan, D. (2020). Effect of pigai.org on English majors' writing self-efficacy and writing performance. In Journal of Physics: Conference Series (pp.042086). IOP Publishing. https://doi.org/10.1088/1742-6596/1533/4/042086
Liu, L. (2022). A Study on the English Writing Teaching of TEM-4 Based on Pigai Platform. Pacific International Journal, 5(4), 169–174. https://doi.org/10.55014/pij.v5i4.277
Lu, Z., & Li, Z. (2016). Exploring EFL learners' lexical application in AWE-based writing. Call communities and culture-short papers from EUROCALL (pp.295-301). https://doi.org/10.14705/rpnet.2016.eurocall2016.578
Luo, Y., & Liang, W. (2022). Application of POA in Teaching Mode of College English Writing Based on Artificial Intelligence. In 2022 IEEE 5th Eurasian Conference on Educational Innovation (ECEI). (pp. 105-109). https://doi.org/10.1109/ECEI53102.2022.9829466
National College English Testing Committee. (2024). National CET Test Specifications: Band 4 and 6 (2016 Revised ed). http://www.cet.edu.cn.
Pallotti, G. (2009). CAF: Defining, refining and differentiating constructs. Applied linguistics, 30(4), 590–601. https://doi.org/10.1093/applin/amp045
Roberts, H., Cowls, J., Morley, J., Taddeo, M., Wang, V., & Floridi, L. (2021). The Chinese approach to artificial intelligence: an analysis of policy, ethics, and regulation (pp. 47-79). Springer International Publishing. https://doi.org/10.1007/978-3-030-81907-1_5
Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press. https://doi.org/10.1177/003368829802900209
Storch, N., & Wigglesworth, G. (2007). Writing tasks: Comparing individual and collaborative writing. In M. P. Garcia-Mayo (Ed.), Investigating tasks in formal language learning (pp. 157–177). London: Multilingual Matters. https://doi.org/10.21832/9781853599286-011
Tahmouresi, S. (2021). On the Role of Individual Differences in the L2 Writing Achievement. The Florida State University. Journal of English Linguistics, 11(2), 68-84. https://doi.org/10.5539/ijel.v11n2p68
Tan, X. (2019). Research on college English writing teaching under the background of big data: taking Leshan Normal University as an example. Theory and Practice in Language Studies, 9(1), 60. https://doi.org/10.17507/tpls.0901.09
Tsai, S.-C. (2022). Chinese students’ perceptions of using Google Translate as a translingual CALL tool in EFL writing. Computer Assisted Language Learning, 35(5-6), 1250–1272. https://doi.org/10.1080/09588221.2020.1799412
Wang, J., & Bai, L. (2021). Unveiling the Scoring Validity of Two Chinese Automated Writing Evaluation Systems: A Quantitative Study. International Journal of English Linguistics, 2(2), 56-60. https://doi.org/10.5539/ijel.v11n2p68
Wigglesworth, G., & Storch, N. (2009). Pair versus individual writing: Effects on fluency, complexity and accuracy. Language Testing, 26(3), 445-466. http://doi.org/10.1177/0265532209104670
Wolfe-Quintero, K., Inagaki, S., & Kim, H. (1998). Second language development in writing: Measures of fluency accuracy and complexity. Honolulu, HI: University of Hawaii at Manoa.
Yan, W. (2019). Functions, Values & Inadequacies---An Evaluative Discussion of Pigai Intelligent Online English Writing Correction System in View of Second Language Acquisition. In Journal of Physics: Conference Series, 1237(4) (pp. 042002). IOP Publishing. https://doi.org/10.1088/1742-6596/1237/4/042002
Yang, F., Li, K., Zhu, Y., & Li, R. (2022). Educational Technology in Language Assessment: Enhancing Writing Assessment Literacy Through the Pigai AES System. In Proceedings of the 8th International Conference on Frontiers of Educational Technologies (pp. 41-45). https://doi.org/10.1145/3545862.3545869
Yao, D. (2021). Automated writing evaluation for ESL Learners: A case study of Pigai system. Journal of Asia TEFL, 18(3), 949. https://doi.org/10.18823/asiatefl.2021.18.3.14.949
Yu, S., Jiang, L., & Zhou, N. (2020). Investigating what feedback practices contribute to students' writing motivation and engagement in Chinese EFL context: A large scale study. Assessing Writing, 44, 100451. https://doi.org/10.1016/j.asw.2020.100451
Zhang, F. (2022). Research on the Application of Pigai AWES in College English Composition Writing. International Journal of Education and Humanities, 4(2), 92–95. https://doi.org/10.54097/ijeh.v4i2.1523
Zhang, Q. (2022). Impacts of world Englishes on local standardized language proficiency testing in the expanding circle: A study on the College English Test (CET) in China. English Today, 38(4), 254-270. https://doi.org/10.1017/S0266078421000158
Zhang, Z., & Hyland, K. (2023). The role of digital literacy in student engagement with automated writing evaluation (AWE) feedback on second language writing. Computer Assisted Language Learning, 1-26. https://doi.org/10.1080/09588221.2023.2256815
Zheng, Y. & Cheng, L. (2008). Test review: College English Test (CET) in China. Language Testing, 25(3), 408-417. https://doi.org/10.1177/0265532208092433
Zhu, W. (2019). A study on the application of automated essay scoring in college English writing based on Pigai. 5th International Conference on social science and higher education (ICSSHE 2019) (pp. 451–454). Atlantis Press. https://doi.org/10.2991/icsshe-19.2019.188
