Studying From Home During COVID-19: A Many-Facets Rasch Model (MFRM) Analysis
DOI:
https://doi.org/10.17507/tpls.1307.29Keywords:
distance education, E-learning, grammarAbstract
This study proposes to measure students’ grammar distancing while studying from home and explore their strengths and weaknesses with a grammar test. It is a descriptive quantitative study, the participants being 55 students in their fifth (5th) semester of the 2020/2021 academic year at a university in Tanjungpinang, Riau Islands, Indonesia. Data is retrieved from the grammar test and analyzed using the Many-Facet Rasch Measurement (MFRM) Model Software Version 3.83.3. This research highlights that studying from home, or distance learning, impacts grammar distancing as seen in the students’ varying achievements in grammar, the breakdown being 10.91% lower achievement, 5.45% low achievement, 27.27% high achievement, 43.64% higher achievement and 12.73% highest achievement. The results also indicate their strength in sentence translations and jumbled words; 83.64% of the students displayed good understanding. Their weakness lies in rearranging compound-complex sentences with phrasal verbs. The students’ different achievements in grammar demonstrate the need for improvement for future use and better student performance.
References
Abidah, A., Hidaayatullaah, H. N., Simamora, R. M., Fehabutar, D., & Mutakinati, L. (2020). The impact of COVID-19 to Indonesian education and its relation to the philosophy of “Merdeka Belajar.” Studies in Philosophy of Science and Education, 1(1), 38–49.
Abuhammad, S. (2020). Barriers to distance learning during the COVID-19 outbreak: A qualitative review from parents’ perspective. Heliyon, 6(e05482), 1–5.
Acheampong, E., & Agyemang, F. G. (2021). Enhancing academic library services provision in the distance learning environment with mobile technologies. Journal of Academic Librarianship, 47(102279), 1–7.
Agust, S., & Subroto, G. (2020). Coastal students’ tense on grammar tense(s): A Rasch model analysis. Universal Journal of Education Research, 8(3D), 26–38.
Angelelli, C. V., & Jacobson, H. E. (2009). Testing and assessment in translation and interpreting studies. John Benjamins Publishing Company.
Arikan, A. (2014). An examination of online grammar teaching materials available for young learners. Procedia - Social and Behavioral Sciences, 158, 18–22.
Ariyani, N. (2013). Developing a rubric for portfolio assessment in writing of grade VIII students at SMP Negeri 15 Yogyakarta. Yogyakarta State University.
Arulogun, O. T., Akande, O. N., Akindele, A. T., & Badmus, T. A. (2020). Survey dataset on open and distance learning students’ intention to use social media and emerging technologies for online facilitation. Data in Brief, 31(105929), 1–8.
Başöz, T. (2014). Through the eyes of prospective teachers of English: Explicit or implicit grammar instruction? Procedia - Social and Behavioral Sciences, 158, 377–382.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (Third Edit). Routledge, Taylor and Francis Group.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer Dordrecht Heidelberg.
Bradley, C. S., Johnson, B. K., & Dreifuerst, K. T. (2020). Debriefing: A place for enthusiastic teaching and learning at a distance. Clinical Simulation in Nursing, 49, 16–18.
Carter, C., Bishop, J., & Kravits, S. (2014). Keys to effective learning study skills and habits for success (Sixth Edit). Pearson Education Limited.
Castañeda, D. A., & Cho, M. H. (2016). Use of a game-like application on a mobile device to improve accuracy in conjugating Spanish verbs. Computer Assisted Language Learning, 29(7), 1195–1204.
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed method approaches (Fourth Edi). SAGE Publication, Inc.
Daher, A. M., Ahmad, S. H., Winn, T., & Selamat, M. I. (2015). Impact of rating scale categories on reliability and fit statistics of the Malay Spiritual well-being Scale using Rasch analysis. Malaysian Journal of Medical Sciences, 22(3), 48–55.
Davis, J. (2015). Rule, pattern, and meaning in the second-language teaching of grammar. Acta Linguistica Hafniensia, 47(1), 53–75.
Demirezen, M. (2015). Determining the intonation contours of cmpound-complex sentences uttered by Turkish prospective teachers of English. Procedia - Social and Behavioral Sciences, 186, 274–282.
Engelhard, G., & Wind, S. A. (2018). Invariant measurement with raters and rating scales: Rasch models for rater-mediated assessments. Routledge, Taylor and Francis Group.
Fauziati, E. (2017). Native and target language influence on the students’ interlanguage production: a case of Indonesian EFL compositions. Indonesian Journal of Applied Linguistics, 7(1), 54–63.
Favale, T., Soro, F., Trevisan, M., Drago, I., & Mellia, M. (2020). Campus traffic and e-Learning during COVID-19 pandemic. Computer Networks, 176(107290), 1–9.
Fisher, W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transaction, 21(1), 1095.
Gamoran, A., & Long, D. A. (2007). Equality of educational opportunity a 40 year retrospective. In International Studies in Educational Inequality, Theory and Policy (pp. 23–47). Springer.
Gascoigne, C. (2005). Toward an understanding of the relationship between L2 reading comprehension and graammatical competence. The Reading Matrix, 5(2), 1–14.
Hasan, S. M., Rehman, A., & Zhang, W. (2021). Who can work and study from home in Pakistan: Evidence from a 2018–19 nationwide household survey. World Development, 138(105197), 1–10.
Hong, F., Lim, W., & Zhao, X. (2017). The emergence of compositional grammars in artificial codes. Games and Economic Behavior, 102, 255–268.
Hung, H. T., Yang, J. C., Hwang, G. J., Chu, H. C., & Wang, C. C. (2018). A scoping review of research on digital game-based language learning. Computers and Education, 126, 89–104.
Kapasia, N., Paul, P., Roy, A., Saha, J., Zaveri, A., Mallick, R., Barman, B., Das, P., & Chouhan, P. (2020). Impact of lockdown on learning status of undergraduate and postgraduate students during COVID-19 pandemic in West Bengal, India. Children and Youth Services Review, 116(105194), 1–5.
Kumar, D. (2020). Impact of COVID-19 on higher education. Higher Education Digest: Independent Higher Education Portal & Magazine. https://www.highereducationdigest.com/impact-of-covid-19-on-higher-education
Lardiere, D. (2014). What is a rule of grammar? Second Language Research, 30(1), 41–46.
Lee, J., Schallert, D. L., & Kim, E. (2015). Effects of extensive reading and translation activities on grammar knowledge and attitudes for EFL adolescents. System, 52, 38–50.
Linacre, John M. (2017). Teaching Rasch measurement. Rasch Measurement Transactions, 31(2), 1630–1631.
Linacre, John M. (2020). A user’s guide to FACETS: Rasch-model computer programs (3.83.3.). Winsteps.
Liu, T. Y. (2009). A context-aware ubiquitous learning environment for language listening and speaking. Journal of Computer Assisted Learning, 25, 515–527.
Lou, S.-J., Lin, T.-C., Hsin, T.-H., Shih, R.-C., & Cheng, T.-F. (2013). Effects of Applying Blended Teaching Approach to English Sentence Translation for Vocational High School Students. Procedia - Social and Behavioral Sciences, 106, 997–1003. https://doi.org/10.1016/j.sbspro.2013.12.113
Lu, F.-C., & Chang, B. (2016). Role-play game-enhanced English for a specific-purpose vocabulary acquisition framework. Journal of Educational Technology & Society, 19(2), 367–377.
Maragakis, L. L. (2020). Coronavirus, social and physical distancing and self-quarantine. Johns Hopkins Medicine. Retrieved May 9th, 2022, from https://www.hopkinsmedicine.org/health/conditions-and-diseases/coronavirus/coronavirus-social-distancing-and-self-quarantine.
Markova, T., Glazkova, I., & Zaborova, E. (2017). Quality issues of online distance learning. Procedia - Social and Behavioral Sciences, 237, 685–691.
Marsden, H., & Slabakova, R. (2018). Grammatical meaning and the second language classroom: Introduction. Language Teaching Research, 00(0), 1–11.
Maryati, Prasetyo, Z. K., Wilujeng, I., & Sumintono, B. (2019). Measuring teachers’ pedagogical content knowledge using many-facet rasch model. Cakrawala Pendidikan, 38(3), 452–464.
Nishimuro, M., & Borg, S. (2013). Teacher cognition and grammar teaching in a Japanese high school. JALT Journal, 35(1), 29.
Özkan, Y., & Kesen, A. (2009). The third way in grammar instruction. Procedia - Social and Behavioral Sciences, 1(1), 1931–1935.
Perera, C. J., Sumintono, B., & Jiang, N. (2018). The psychometric validation of the principal practices questionnaire based on item response theory. International Online Journal of Educational Leadership, 2(1), 21–38.
Petraki, E., & Hill, D. (2011). Lessons from confident grammar. 21(2), 34–51.
Phoocharoensil, S. (2012). Language corpora for EFL teachers: An exploration of English grammar through concordance lines. Procedia - Social and Behavioral Sciences, 64, 507–514.
Połczyńska, M., Curtiss, S., Walshaw, P., Siddarth, P., Benjamin, C., Moseley, B. D., Vigil, C., Jones, M., Eliashiv, D., & Bookheimer, S. (2014). Grammar tests increase the ability to lateralize language function in the Wada test. Epilepsy Research, 108(10), 1864–1873.
Pozdnyakova, O., & Pozdnyakov, A. (2017). Adult students’ problems in the distance learning. Procedia Engineering, 178, 243–248.
Richards, J. C., & Reppen, R. (2014). Towards a pedagogy of grammar instruction. RELC Journal, 45(1), 5–25.
Shao, Y., & Liu, C. L. (2020). Teaching machines to write like humans using L-attributed grammar. Engineering Applications of Artificial Intelligence, 90(December 2019), 103489.
Sik, K. (2015). Tradition or modernism in grammar teaching: Deductive vs. inductive approaches. Procedia - Social and Behavioral Sciences, 197, 2141–2144.
Strielkowski, W. (2020). COVID-19 pandemic and the digital revolution in academia and higher education. Preprints, 1, 1–6.
Tammenga-Helmantel, M., & Maijala, M. (2019). The position of grammar in Finnish, Dutch, and global course books for German as a foreign language. Language Teaching Research, 23(5), 562–583.
Tran, T., Hoang, A., Nguyen, Y., Nguyen, L., & Ta, N. (2020). Toward sustainable learning during school suspension: Socioeconomic, occupational aspirations, and learning behavior of Vietnamese students during COVID-19. Sustainability, 12(4195), 1–19.
Trung, T., Hoang, A. D., Nguyen, T. T., Dinh, V. H., Nguyen, Y. C., & Pham, H. H. (2020). Dataset of Vietnamese student’s learning habits during COVID-19. Data in Brief, 30(105682), 1–7.
Turner, E. A., Chandler, M., & Heffer, R. W. (2009). The influence of parenting styles, achievement motivation, and self-efficacy on academic performance in college students. Journal of College Student Development, 50(3), 337–346.
Urh, M., & Jereb, E. (2014). Learning habits in higher education. Procedia - Social and Behavioral Sciences, 116, 350–355.
Uysal, N. D., & Yavuz, F. (2015). Pre-service teachers’ attitudes towards grammar teaching. Procedia - Social and Behavioral Sciences, 191, 1828–1832.
Vu, C. T., Hoang, A. D., Than, V. Q., Nguyen, M. T., Dinh, V. H., Le, Q. A. T., Le, T. T. T., Pham, H. H., & Nguyen, Y. C. (2020). Dataset of Vietnamese teachers’ perspectives and perceived support during the COVID-19 pandemic. Data in Brief, 31(105788), 1–9.
Wang, P., Coetzee, K., Strachan, A., Monteiro, S., & Cheng, L. (2020). Examining rater performance on the CELBAN speaking: A many-facets Rasch measurement analysis. Canadian Journal of Applied Linguistics, 23(2), 73–95.
Warner, S., Murray, G., & Meyer, D. (2008). Holiday and school-term sleep patterns of Australian adolescents. Journal of Adolescence, 31, 595–608.
Wind, S. A., Jr., G. E., & Wesolowski, B. (2016). Exploring the effects of rater linking designs and rater fit on achievement estimates within the context of music performance assessments. Educational Assessment, 21(4), 278–299.
