A Survey of the Issue of Generalizability in Task-based Language Assessment

Authors

  • Majeed Noroozi Florida International University

DOI:

https://doi.org/10.17507/tpls.1108.03

Keywords:

assessment task, generalizability, reliability, target language use, task-based language assessment

Abstract

The use of authentic tasks in Task-Based Language Assessment seems to facilitate the extrapolation of assessment performance to the real-life situation. The question arises as to how effective Task-Based Language Assessment is in predicting test-takers’ performance in the real-life situation based on their task performance in the assessment settings and what proposals there are to improve the generalizability of Task-Based Language Assessment. The study draws upon Bachman and Palmer (1996) and Douglas’s (2000) frameworks in order to identify the fixed and varied characteristics of assessment tasks and conditions in the Target Language Use (TLU) situation. These frameworks function as a template by presenting an organized list of the items to compare and contrast the assessment tasks with the real-life target tasks. The present study proposes standardizing the fixed conditions present in both the assessment and the TLU situation, such as setting and equipment. However, since the standardization of the varied conditions could undermine the extrapolation inferences at the cost of improving the reliability of assessment, the study concludes that the assessment procedure should standardize a set of short tasks or observation conditions that are representative of the TLU domain rather than just one specific type of task or condition.

References

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.

Bachman, L. F. (2002). Some reflections on task-based language performance assessment. Language Testing, 19, 453–476. https://doi.org/10.1191/0265532202lt240oa.

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University.

Brindley, G. (1998). Outcomes-based assessment and reporting in language learning programmes: A review of the issues. Language Testing, 15, 45–85. https://doi.org/10.1177/026553229801500103.

Brown, J. D., Hudson, T. D., Norris, J. M., & Bonk, W. (2002). Investigating task-based second language performance assessment. Honolulu: University of Hawai‘i Press.

Douglas, D. (2000). Assessing language for specific purposes. Cambridge: Cambridge University Press.

Ellis, R. (2003). Task-based language learning and teaching. Oxford: Oxford University Press.

Ellis, R. (2017). Position paper: moving task-based language teaching forward. Language Teaching, 50(4), 507-526. https://doi.org/10.1017/S0261444817000179.

Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational Measurement: Issues and Practice, 18(2), 5–17.

Long, M. (2014). Second language acquisition and task-based language teaching. Malden, MA: Wiley Blackwell.

Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241–56. https://doi.org/10.1177/026553229601300302.

Mislevy, R., Steinberg, L., & Almond, R. (2002). Design and analysis in task-based language assessment. Language Testing, 19(4), 477–496. https://doi.org/10.1191/0265532202lt241oa.

Norris, J. M. (2009). Task-based teaching and testing. In M. H. Long & C. J. Doughty (Eds.), The handbook of language teaching (pp. 578–94). Malden, MA: Wiley-Blackwell.

Norris, J. M. (2016). Current uses for task-based language assessment. Annual Review of Applied Linguistics, 36, 230–244. https://doi.org/10.1017/S0267190516000027.

Norris, J. M., Brown, J. D., Hudson, T. D., & Bonk, W. (2002). Examinee abilities and task difficulty in task-based second language performance assessment. Language Testing, 19(4), 395–418. https://doi.org/10.1191/0265532202lt237oa.

Norris, J., Brown, J., Hudson, T., & Yoshioka, J. (1998). Designing second language performance assessments. Honolulu, HI: University of Hawai‘i Press.

Robinson, P., & Ross, S. (1996). The development of task-based assessment in English for academic purposes programs. Applied Linguistics, 17(4), 455–476. https://doi.org/10.1093/applin/17.4.455.

Wigglesworth, G. (2008). Tasks and performance-Based assessment. In E. Shohamy & N. Hornberger (Eds.), Encyclopedia of language and education: Language testing and assessment (Vol. 7, 2nd ed., pp. 111–22). New York, NY: Springer.

Downloads

Published

2021-08-01

Issue

Section

Articles