Investigating the Implementation of Multimodality and Spherical Video-Based Immersive Virtual Reality in the Indonesian Language for Foreign Speakers’ Learning Materials
DOI:
https://doi.org/10.17507/tpls.1307.20Keywords:
multimodality, Indonesian language for foreign speakers, SV-IVR, learning materialsAbstract
Experts have developed multimodality and spherical video-based immersive virtual reality (SV-IVR) for language learning to escalate learners’ cognition. However, neither experts nor teachers have explored and optimised the use of multimodality and SV-IVR in the Indonesian Language for Foreign Speakers (BIPA) learning materials. This study investigates foreign learners’ perception of multimodality and SV-IVR immersion in BIPA programme. The total sample involved in this study was 20 people from Europe, Asia, and the US. The results reveal that multimodality including utilisation of text, audio, video, and images contributed to the foreign learners’ motivation and eagerness to learn the Indonesian language. Although the foreign students argued that the combination of text, audio, video, and images elevates foreign learners’ eagerness to study the Indonesian language, the SV-IVR implementation indicated no significant effect on the foreign students’ eagerness. Regarding the combination of multimodality and SV-IVR, the students indicated that the simultaneous use of multimodality and SV-IVR could increase their motivation to learn the Indonesian language.
References
Amani, N., & Yuly, A. R. (2019). 3D modeling and animating of characters in educational game. Journal of Physics: Conference Series, 1193(1), 012025. https://doi.org/10.1088/1742-6596/1193/1/012025
Arvianto, F. (2020). Kaskus Smilies application as an alternative instructional media in BIPA (Indonesian language for foreign speakers) teaching. Journal of Physics: Conference Series, 1471(1), 012007. https://doi.org/10.1088/1742-6596/1471/1/012007
Astuti, W., & Bewe, N. (2020). Listening learning of Indonesian for speakers of other languages (BIPA) for academic purposes. Journal of Education, Teaching and Learning, 5(2), 401–408.
Bomer, R., Zoch, M. P., David, A. D., & Ok, H. (2010). New literacies in the material world. Language Arts, 88(1), 9–20.
Castaneda, L., Cechony, A., Bautista, A., & Pacampara, M. (2016). All-school aggregated findings 2016–2017 - VR. Foundry 10.http://fineduvr.fi/wp-content/uploads/2017/10/All-School-Aggregated-Findings-2016-2017.pdf
Chang, S. C., Hsu, T. C., Chen, Y. N., & Jong, M. S. (2020). The effects of spherical video-based virtual reality implementation on students’ natural science learning effectiveness. Interactive Learning Environments, 28(7), 915–929.
Chen, C., Hung, H., & Yeh, H. (2021). Virtual reality in problem‐based learning contexts: Effects on the problem‐solving performance, vocabulary acquisition and motivation of English language learners. Journal of Computer Assisted Learning, 37(3), 851–860.
Chen, M. R. A., & Hwang, G. J. (2020). Effects of experiencing authentic contexts on English speaking performances, anxiety and motivation of EFL students with different cognitive styles. Interactive Learning Environments, 30(9), 1619–1639.
Chien, S. Y., Hwang, G. J., & Jong, M. S. Y. (2020). Effects of peer assessment within the context of spherical video-based virtual reality on EFL students’ English-speaking performance and learning perceptions. Computers & Education, 146, 103751.
Choi, N., Kang, S., & Sheo, J. (2020). Children’s interest in learning English through picture books in an EFL context: The effects of parent–child interaction and digital pen use. Education Sciences, 10(2), 1-11.
Dickey, M. D. (2003). Teaching in 3D: Pedagogical affordances and constraints of 3D virtual worlds for synchronous distance learning. Distance Education, 24(1), 105–121.
Gerě, I., & Jaušcvec, N. (1999). Multimedia: Differences in cognitive processes observed with EEG. Educational Technology Research and Development, 47(3), 5–14.
Grapin, S. (2019). Multimodality in the new content standards era: Implications for English learners. TESOL Quarterly, 53(1), 30–55.
Gusnawaty, G., & Nurwati, A. (2019). A learning model of Bahasa Indonesia as a foreign language based on local intercultural politeness. Jurnal Cakrawala Pendidikan, 38(1), 141–155.
Han, I. S. & Kinzer, C. K. (2008). Examining the Effectiveness of a Multimedia Case-based Environment for Teaching Technology Integration to Korean Preservice Teachers. In Kanselaar, G., Jonker, V., Kirschner, P. A., & Prins, F. J. (Eds.), International Perspectives in the Learning Sciences: Cre8ing a learning world. Proceedings of the Eighth International Conference for the Learning Sciences – ICLS 2008, Volume 1 (pp. 319-326). Utrecht, The Netherlands: International Society of the Learning Sciences.
Hazari, S., North, A., & Moreland, D. (2009). Investigating pedagogical value of Wiki technology. Journal of Information Systems Education, 20(2), 187–198.
Huang, Y. P., Zheng, X. L., Chiu, C. K., Lei, J., Yang, G., Kim, H., & Wang, F. (2021). Towards figurative expression enhancement: Effects of the SVVR-supported worked example approach on the descriptive writing of highly engaged students. Sustainability, 13(21), 1-19.
Hung, S. T. A. (2016). Enhancing feedback provision through multimodal video technology. Computers & Education, 98, 90–101.
Jewitt, C., & Kress, G. (2010). Multimodality, literacy and school English. In D. Wyse, R. Andrews, and J. Hoffman (Eds.), The Routledge international handbook of English, language and literacy teaching (pp. 366–377). Routledge.
Junpaitoon, P. (2017). Enrichment of vocabulary in BIPA learning for beginner Thai students. ISCE: Journal of Innovative Studies on Character and Education, 1(1), 88–103.
Kaminski, A. (2019). Young learners’ engagement with multimodal texts. ELT Journal, 73(2), 175–185.
Kress, G., & Van Leeuwen, T. (1996). The grammar of visual design. Routledge.
Kress, G., & Van Leeuwen, T. (2020). Reading images: The grammar of visual design. Routledge.
Lan, Y. J., Hsiao, I. Y. T., & Shih, M. F. (2018). Effective learning design of game-based 3D virtual language learning environments for special education students. Journal of Educational Technology & Society, 21(3), 213–227.
Mayer, R. E. (2005). Principles of Multimedia Learning Based on Social Cues: Personalization, Voice, and Image Principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 201–212). Cambridge University Press.
Mills, K. A. (2009). Multiliteracies: Interrogating competing discourses. Language and Education, 23(2), 103–116.
Murtiani, A., Arifah, F. N., & Noviastuti, L. (2017). Tata bahasa Indonesia: Pedoman lengkap, mudah, dan praktis berbahasa Indonesia. Araska.
Nugroho, H. (2017). Pemertahanan bahasa sebagai strategi komunikasi pada kegiatan tutorial (pembelajar BIPA kelas pemula). Wacana: Jurnal Bahasa, Seni, Dan Pengajaran, 1(1), 23–31.
Philippe, S., Souchet, A. D., Lameras, P., Petridis, P., Caporal, J., Coldeboeuf, G., & Duzan, H. (2020). Multimodal teaching, learning and training in virtual reality: A review and case study. Virtual Reality & Intelligent Hardware, 2(5), 421–442.
Prisille, C., & Ellerbrake, M. (2020). Virtual reality (VR) and geography education: Potentials of 360° ‘experiences’ in secondary schools. In D. Edler, C. Jenal, and O. Kűhne (Eds.), Modern approaches to the visualization of landscapes (pp. 321–332). Springer.
Rahmanu, I. W. E. D., & Santosa, M. H. (2022). Exploring Polytechnic learners’ perception on multimodality in MALL in business administration instruction. Dinamika Pendidikan, 17(1), 12–24.
Rowsell, J., Kosnik, C., & Beck, C. (2008). Fostering multiliteracies pedagogy through preservice teacher education. Teaching Education, 19(2), 109–122.
Sahasti, J. P. (2019). Penggunaan media pembelajaran bahasa Indonesia bagi penutur asing: Studi kasus di BIPA universitas Negeri Semarang. Thesis. Unpublished. UNS (Sebelas Maret University).
Salazar, G., & Larenas, C. (2018). Using an audiovisual materials-based teaching strategy to improve EFL young learners’ understanding of instructions. How, 25(2), 91–112. https://doi.org/10.19183/how.25.2.419
Seni, S., Srinin, W., & Hum, N. M. (2019). Evaluation of Indonesian language teaching and learning for BIPA students in Thailand. Journal of International Studies, Prince of Songkla University, 9(2), 114–130.
Siroj, M. B. (2015). Pengembangan model integratif bahan ajar bahasa Indonesia ranah sosial budaya berbasis ICT bagi penutur asing tingkat menengah. Jurnal Pendidikan Bahasa Dan Sastra Indonesia, 4(2), 316133.
Sudini, L. P. (2008). Peranan visa on arrival (VOA) bagi orang asing yang datang ke Indonesia. Jurnal Hukum & Pembangunan, 38(3), 335–352.
Suh, A., & Prophet, J. (2018). The state of immersive technology research: A literature analysis. Computers in Human Behavior, 86, 77–90.
Symonenko, S., Zaitseva, N., Osadchyi, V., Osadcha, K., & Shmeltser, E. (2020). Virtual reality in foreign language training at higher educational institutions. Proceedings of the 2nd International Workshop (AREdu 2019), Kryvyi Rih, Ukraine, March 22, 2019. – P. 37-49
Tomlinson, B. (2011). Materials development in language teaching. Cambridge University Press.
Valero-Porras, M. J., & Cassany, D. (2015). Multimodality and language learning in a scanlation community. Procedia-Social and Behavioral Sciences, 212, 9–15.
Van Waes, L., Van Weijen, D., & Leijten, M. (2014). Learning to write in an online writing center: The effect of learning styles on the writing process. Computers & Education, 73, 60–71.
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2016). Unified theory of acceptance and use of technology: A synthesis and the road ahead. Journal of the Association for Information Systems, 17(5), 328–376.
Yaacob, A., & Lubis, A.H. (2022). The development of web-based teaching materials integrated with Indonesian folklore for Indonesian language for foreign speakers students. International Journal of Language Education, 6(1), 46-62
Yang, G., Chen, Y., Zheng, X., & Hwang, G. (2021). From experiencing to expressing: A virtual reality approach to facilitating pupils’ descriptive paper writing performance and learning behavior engagement. British Journal of Educational Technology, 52(2), 807–823.
Ye, X., Liu, P. F., Lee, X. Z., Zhang, Y. Q., & Chiu, C. K. (2021). Classroom misbehaviour management: An SVVR-based training system for preservice teachers. Interactive Learning Environments, 29(1), 112–129.
Zamzamy, D. A. (2021). Development of multimodal language teaching materials for Indonesian language for foreign speakers (BIPA) during pandemic time. English Language and Literature International Conference (ELLiC) Proceedings, 4, 21–31.
