Predictors of Learner Satisfaction in Video-Based ESP Assessment: A Factor-Analytic and Regression Study From Vietnam
DOI:
https://doi.org/10.17507/tpls.1608.27Keywords:
video-based assessment, ESP, learner satisfaction, skill developmentAbstract
This study employs exploratory factor analysis (EFA) and multiple regression analysis (MRA) to identify the key predictors of learner satisfaction with video-based assessment (VBA) in an English for Specific Purposes (ESP) context. Data were collected from 100 Public Relations students at a private university in Vietnam. Six constructs were examined: English skill gains, soft skill development, external motivation, internal motivation, perceived difficulties, and overall satisfaction. EFA confirmed the factorial validity of the instrument, while MRA revealed that only two factors exerted a statistically significant positive effect on satisfaction: soft skill improvement (β = 0.322, p < .05) and English language gains (β = 0.295, p < .05). Contrary to expectation, perceived difficulties and both motivational constructs showed no significant predictive effect. These findings suggest that skill acquisition — rather than motivational orientation or contextual challenge — is the primary driver of satisfaction in technology-mediated language assessment. Implications for ESP course design and digital assessment practice are discussed.
References
Abdulrahman, T., & Basalama, N. (2019). Promoting students' motivation in learning English vocabulary through a collaborative video project. CELT: A Journal of Culture, English Language Teaching & Literature, 19, 107–117. https://doi.org/10.24167/celt.v19i1.493
Abidi, S., Ramos, R., Chen, L., Kong, V., & Mcanena, A. (2022). WIP: Use of Student-Produced Educational Videos to Promote Learning and Technical Communication. In 2022 ASEE Annual Conference & Exposition Proceedings. https://doi.org/10.18260/1-2--41241
Aksel, A., & Gürman-Kahraman, F. (2014). Video project assignments and their effectiveness on foreign language learning. Procedia — Social and Behavioral Sciences, 141, 319–324. https://doi.org/10.1016/j.sbspro.2014.05.055
Al-Jarf, R. (2026). Online videos and podcasts for language learning in the Saudi context: A systematic review (2010–2025). Journal of English Language Teaching and Applied Linguistics, 8(5), 87–107. https://doi.org/10.32996/jeltal.2026.8.5.11
Aldukhayel, D. (2021). Vlogs in L2 listening: EFL learners' and teachers' perceptions. Computer Assisted Language Learning, 34(5–6), 598–618. https://doi.org/10.1080/09588221.2019.1658608
Anas, I. (2019). Behind the scene: Student-created video as a meaning-making process to promote student active learning. Teaching English with Technology, 19(4), 37–56. Retrieved April 19, 2025, from https://files.eric.ed.gov/fulltext/EJ1233488.pdf
Awang, Z. (2010). Research Methodology for Business and Social Sciences. Universiti Teknologi MARA.
Awang, Z. (2012). Structural equation modeling using AMOS graphic. Penerbit Universiti Teknologi MARA.
Bobkina, J., & Romero, E. (2020). Exploring the perceived benefits of self-produced videos for developing oracy skills in digital media environments. Computer Assisted Language Learning, 35(5–6), 1084–1106. https://doi.org/10.1080/09588221.2020.1802294
Brega, O. N., & Kruglyakova, G. V. (2025). Razvitie tsifrovoi kompetentsii studentov pri sozdanii videopodkastov na angliiskom yazyke dlya spetsialnykh tselei [Digital competence development while video podcast creation in ESP]. Perspektivy nauki i obrazovaniia (Perspectives of Science and Education), (2), 210–227. https://doi.org/10.32744/pse.2025.2.14
Broussard, S., & Garrison, M. (2004). The relationship between classroom motivation and academic achievement in elementary-school-aged children. Family and Consumer Sciences Research Journal, 33(2), 106–120. https://doi.org/10.1177/1077727X04269573
Cheng, F. W. (2025). Adapting to the digital era: ESP college students' challenges in composing video resumes. Ibérica, 49, 265–288. https://doi.org/10.17398/2340-2784.49.265
Christophel, D. M., & Gorham, J. (1995). A test-retest analysis of student motivation, teacher immediacy, and perceived sources of motivation and demotivation in college classes. Communication Education, 44(4), 292–306. https://doi.org/10.1080/03634529509379020
Dal, M. (2012). Digital video production and foreign language learning. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2012 (pp. 1927–1936).
Dörnyei, Z. (2001). Motivational Strategies in the Language Classroom. Cambridge University Press.
Dörnyei, Z. (2005). The Psychology of the Language Learner: Individual Differences in Second Language Acquisition. Lawrence Erlbaum Associates.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312
Gardner, R. C. (1985). Social psychology and second language learning: The role of attitudes and motivation. Edward Arnold.
Guay, F., Chanal, J., Ratelle, C., Marsh, H., Larose, S., & Boivin, M. (2010). Intrinsic, identified, and controlled types of motivation for school subjects in young elementary school children. British Journal of Educational Psychology, 80(4), 711–735. https://doi.org/10.1348/000709910X499084
Hafner, C. (2014). Embedding digital literacies in English language teaching: Students' digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655–685. https://doi.org/10.1002/tesq.138
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2014). Multivariate data analysis (7th ed.). Pearson Education.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) (2nd ed.). Sage Publications.
Johnson, R. L., & Morgan, G. (2016). Survey scales: A guide to development, analysis, and reporting (1st ed.). Guilford Press.
Kew, S., Tan, S.-M., Liew, T. W., & Tasir, Z. (2022). English Language Learner Pedagogical Performance and Experience Through Digital Video Production. In Emerging Trends in Pedagogical Practice and Learning Theory in K-12 Education (pp. 107–122). https://doi.org/10.4018/978-1-7998-8981-6.ch006
Kim, C., Park, S. W., Huynh, N., & Schuermann, R. (2017). University students' motivation, engagement, and performance in a large lecture-format general education course. Journal of Further and Higher Education, 41(2), 201–214. https://doi.org/10.1080/0309877X.2015.1070401
Kutner, M. H., Nachtsheim, C. J., & Neter, J. (2004). Applied linear regression models (4th ed.). McGraw-Hill.
Mahardika, G., Widiati, U., Basthomi, Y., & Suryati, N. (2021). Camera roll, action! Non-specialist undergraduate English learners' perceptions of using video production in learning English. Journal of University Teaching and Learning Practice, 18(3), 103–120. https://doi.org/10.53761/1.18.3.8
Maryani, M., & Aguskin, L. (2023). Collaborative video project in English online learning: Challenges and benefits. CELT: A Journal of Culture, English Language Teaching & Literature, 23(2), 296–311. https://doi.org/10.24167/celt.v23i2.10610
Naqvi, S., & Al-Mahrooqi, R. (2016). ICT and language learning: A case study on student-created digital video projects. Journal of Cases on Information Technology, 18(1), 49–64. https://doi.org/10.4018/JCIT.2016010104
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
Otodu, S., & Khoiriyah, K. (2023). Students' preference of speaking activities in online ESP classes. AL-ISHLAH: Jurnal Pendidikan, 15(2), 1310–1320. https://doi.org/10.35445/alishlah.v15i2.2644
Rodgers, O., & Ni Dhonnchadha, L. (2018). Digital video creation in the LSP classroom. The EUROCALL Review, 26(1), 43–58. https://doi.org/10.4995/eurocall.2018.9666
Sastre, M., Pifarre, M., Cujba, A., Cutillas i Alberich, L., & Falguera-Garcia, E. (2022). The role of digital technologies to promote collaborative creativity in language education. Frontiers in Psychology, 13, Article 828981. https://doi.org/10.3389/fpsyg.2022.828981
Tran, T. T. T., Nguyen, T. N. V., & Nguyen, T. T. H. (2023). Student-produced videos: Why not? In Proceedings of the 19th International Conference of the Asia Association of Computer-Assisted Language Learning (AsiaCALL 2022) (pp. 93–102). Atlantis Press. https://doi.org/10.2991/978-2-38476-042-8_9
Turner, P. (2019). Critical values for the Durbin-Watson test in large samples. Applied Economics Letters, 27(18), 1495–1499. https://doi.org/10.1080/13504851.2019.1691711
Yang, S. H., & Yeh, H. C. (2021). Enhancing EFL learners' intracultural development as cultural communicators through YouTube video-making. Technology, Pedagogy and Education, 30(4), 557–572. https://doi.org/10.1080/1475939X.2021.1925336
Yeh, H. C., Heng, L., & Tseng, S. S. (2020). Exploring the impact of video making on students' writing skills. Journal of Research on Technology in Education, 53(1), 1–11. https://doi.org/10.1080/15391523.2020.1795955