An Accompaniment-Oriented Human–Machine Collaborative Model for EFL Writing Assessment
DOI:
https://doi.org/10.17507/tpls.1604.05Keywords:
accompaniment-oriented, human–machine collaborative model, EFL writing assessmentAbstract
This study constructs and implements an accompaniment-oriented human–machine collaborative model for EFL writing assessment, which integrates both process-oriented and product-oriented assessment through the use of technological tools. The model further clarifies the respective roles of teacher assessment, self-assessment, peer assessment, and machine assessment, thereby establishing a comprehensive and systematic framework for EFL writing evaluation. By incorporating the evaluation of EFL writing learning strategies, EFL writing strategies, and EFL writing outcomes, the model extends beyond existing studies in terms of scope, diversity of assessors, and richness of methods. Moreover, it combines multiple complementary approaches—including questionnaires, think-aloud protocols, keystroke logging, screen-recording software, corpus-based data analysis, and multi-faceted Rasch modeling—to provide triangulated evidence, thereby enhancing the overall reliability of the proposed assessment model.
References
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
Cheng, X., & Xie, S. (2023). The integration of teaching, learning, and assessment in English education: Concepts and practices. Foreign Language Teaching in Schools (Secondary Edition), 46(1), 1-8.
DeLuca, C., & Johnson, S. (2017). Developing assessment capable teachers in this age of accountability. Assessment in Education: Principles, Policy & Practice, 24(2), 121-126.
Deng, H., & Deng, J. (2022). Construct validity of the writing strategy scale in the China’s Standards of English Language Ability. Foreign Languages and Teaching, 14(6), 78–87. https://doi.org/10.13458/j.cnki.flatt.004903
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition & Communication, 32(4), 365-387.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132.
He, L. (2020). Promoting education evaluation reform through the professionalization of language assessment. China Examinations, 10(9), 5–9.
Li, F., & Wang, J. (2018). Online assessment for promoting learner development: An accompanying perspective. E-education Research, 6(5), 74–79.
Li, G. (2019). The effect of multiple feedback based on automated essay scoring systems on English composition revision. Foreign Language Teaching, 40(4), 72–76. https://doi.org/10.16362/j.cnki.cn61-1023/h.2019.04.014
Li, X., & Zhong, L. (2017). An empirical study on the application of automated essay scoring systems in college English writing instruction: A case study of Juku Correction Network. Teaching Research, 20(1), 57–61.
Lin, D., & Wu, Z. (2014). The latest progress in international research on language assessment literacy. Modern Foreign Languages, 37(5), 711–720.
Linacre, J. M. (2013). A user’s guide to FACETS (3.71.0). MESA Press.
Liu, J., & Li, X. (2020). Reform of teaching evaluation in English courses. China Examinations, 15(09), 27-31. https://doi.org/10.19360/j.cnki.11-3303/g4.2020.09.006
Liu, T. (2018). The application of portfolio-based formative assessment in English writing ability evaluation in higher vocational colleges. China Examinations, 10(9), 31–35. https://doi.org/10.19360/j.cnki.11-3303/g4.2018.09.005
Lu, L. (2016). A study on the process of second language writing based on automated essay scoring systems. Foreign Language World, 12(2), 88–96.
Lu, X., & Xu, Q. (2016). The L2 Syntactic Complexity Analyzer and its application in second language writing research. Foreign Language Teaching and Research, 48(3), 40–42.
The Central Committee of the Communist Party of China & The State Council. (2020, October 14). Overall plan for deepening the reform of education evaluation in the new era. People’s Daily, 001. https://doi.org/10.28655/n.cnki.nrmrb.2020.010185
Wang, X., & Shan, B. (2020). Designing a “companion-based assessment” framework based on dynamic learning data streams. E-educational Research, 41(2), 60–67. https://doi.org/10.13811/j.cnki.eer.2020.02.009
Xu, C. (2011). The cross-application of input logs and screen recording: A new perspective on computer-assisted second language writing process research. Foreign Language Education in China: Technology Enhanced Language Learning and Teaching, 15(5), 21–25.
Yang, X., Luo, J., Liu, Y., & Chen, S. (2017). Data-driven teaching: A new trend of teaching paradigm in the era of big data. Journal of Educational Technology and Research, 38(12), 13–20. https://doi.org/10.13811/j.cnki.eer.2017.12.002