Student Performance in Machine Translation Training: Assessment and Exploration
DOI:
https://doi.org/10.17507/tpls.1402.11Keywords:
MT, MTPE training, a mixed methods approach, assessment of student performance, student reception of MTAbstract
The present research aims to conduct a process-oriented analysis to measure whether a group of graduate students enrolled in a translation course made steady progress in their performance of identifying machine translation (MT) errors and post-editing MT drafts of company web texts and news texts. A mixed methods approach consisting of quantitative and qualitative analyses was used. The findings show that there was a steady decline in the average number of MT errors that students could not spot or correctly identify in their three assignments. However, there was no significant improvement in student MTPE performance, with only a slight decrease in errors in the final MTPE assignment, which still remained worse than the first one. Finally, student responses in their reflection essays indicated that their reception of MT and MTPE had shifted from negative denial to positive acceptance. Overall, the findings of the present study reveal the need to extend the period of MTPE training for students. Incorporating MT training into the translation course has proven to be worthwhile for students, as it helps to dispel students’ previous misconception about MT and MTPE.
References
Allen, J. (2003). Post-editing. Benjamins Translation Library, 35, 297-318.
Aranberri, N., Labaka, G., de Ilarraza, A. D., & Sarasola, K. (2014). Comparison of post-editing productivity between professional translators and lay users. In Proceedings of the 11th Conference of the Association for Machine Translation in the Americas (pp. 20-33). Association for Machine Translation in the Americas.
Depalma, D. (2013). Post-editing in practice. Retrieved October 23, 2022 from https://www.tcworld.info/e-magazine/translation-and-localization/post-editing-in-practice-459
Doherty, S., & Gaspari, F. (2013). Effective post-editing in human & machine translation workflows: Critical knowledge & techniques [PowerPoint slides]. Retrieved December 12, 2022 from http://www.qt21.eu/ downloads/QTLaunchPad-PostEditing-Webinar.pdf
Hu, K., & Cadwell, P. (2016). A comparative study of post-editing guidelines. In Proceedings of the 19th annual conference of the European association for machine translation (pp. 342-353). European Association for Machine Translation Conferences/Workshops.
Kliffer, M. D. (2008). Post-editing machine translation as an FSL exercise. Porta Linguarum: revista internacional de didáctica de las lenguas extranjeras, (9), 53-68.
Krings, H.P. (2007). Repairing texts: Empirical investigation of machine translation post-editing process (2nd ed.). The Kent Sate University Press.
Koehn, P. (2009). A process study of computer-aided translation. Machine Translation, 23(4), 241–63.
Loffler-Laurian, A. M. (1994). Réflexions sur la métaphore dans les discours scientifiques de vulgarization [Reflections on metaphor in the popular scientific discourse]. Langue française, 72-79.
Lommel, A. (2018). Where’s my translation jet pack? [PowerPoint slides]. In Proceedings of translating and the computer 40. Retrieved December 22, 2022 from https://www.asling.org/tc40/wp-content/uploads/L1-09.50-Lommel-wheres-my-translation-jetpack.pdf
Luo, J. M. (2014). Analyses of syntactic errors in machine translation. Journal of Tongji University (Social Science Section), 25(1), 111-118, 124.
Martìn-Mor, A., & Sánchez-Gijón, P. (2016). Machine translation and audiovisual products: a case study. JoSTrans, 26, 172-186.
Massardo, I., Meer, J. V.HuBrien, S., Hollowood, F., Aranberri, N., & Drescher, K. (2016). MT Post-editing Guidelines. TAUS Signature Editions.
Niño, A. (2008). Evaluating the use of machine translation post-editing in the foreign language class. Computer Assisted Language Learning, 21(1), 29-49.
O’Brien, S. (2002). Teaching post-editing: A proposal for course content. In The proceedings of the 6th EAMT workshop, teaching machine translation (pp. 99-106). Retrieved October 11, 2022 from http://www.mt-archive.info/00/EAMT-2002-OBrien.pdf
Ortiz-Martínez, D. et al. (2016). Integrating online and active learning in a computer-assisted translation workbench. In Michael Carl, Srinivas Bangalore and Moritz Schaeffer (Eds.), New directions in empirical translation process research (pp. 57-76). Springer International Publishing.
Reiss, K. (2000). Translation criticism - The potentials and limitations: Categories and criteria for translation quality assessment (E. F. Rhodes, Trans.). St. Jerome. (Original work published 1971)
Shih, C. L. (2006). Helpful assistance to translators: MT & TM. Bookman Books, Ltd.
Shih, C. L. (2021). Re-looking into machine translation errors and post-editing strategies in a changing high-tech context. Compilation and Translation Review, 14(2), 125-166.
Shofner, K. (2021). Post editing 101. Retrieved May 22, 2022 from https://unitedlanguagegroup.com/blog/post-editing-101/
Somers, H. (2003). Introduction. In H. Sommers (Ed.), Computers and translation: A translator’s guide (pp. 1-12). John Benjamins Publishing Company.
Vasconcellos, M. (1987). The contribution of machine translation: present status and future perspectives. In F. R. Ruskin, Bostid (Eds.), Microcomputer applications in education and training for developing countries (pp. 269-281). Westview Press.
Vasconcellos, M. (1986). Post-editing on-screen: machine translation from Spanish into English. In Proceedings of translating and the computer 8: A profession on the move (pp. 133-146). Aslib.
Veale, T., & Way, A. (1997). Gaijin: A bootstrapping, template-driven approach to example-based MT. Retrieved October 18, 2022 from https://aclanthology.org/www.mt-archive.info/RANLP-1997-Veale.pdf
Vilar, D., Xu, J., Luis Fernando, D. H., & Ney, H. (2006). Error analysis of statistical machine translation output. In Proceedings of the fifth international conference on language resources and evaluation (pp. 697-702). LREC’06. Retrieved October 15, 2022 from http://www.lrec-conf.org/proceedings/lrec2006/pdf/413_pdf.pdf
