Evaluating the Quality of a Teacher’s Made Test against Five Principles of Language Assessment

Authors

  • Dedi Sumarsono Universitas Pendidikan Mandalika, Indonesia
  • Moh. Arsyad Arrafii Universitas Pendidikan Mandalika, Indonesia
  • Imansyah Imansyah Universitas Pendidikan Mandalika, Indonesia

DOI:

https://doi.org/10.33394/jollt.v11i2.7481

Keywords:

Classroom Assessment, Test, Principles of Language Assessment, Assessment Literacy

Abstract

Classroom assessment serves both summative and formative functions to gauge evidence, evaluate and improve student learning. Assessment evidence is only meaningful when it reflects the true picture of student learning. In this sense, the role of effective assessment instrument, such as test, as crucial to obtain a valid and reliable evidence of student learning. However, we remain in caution about the ability of teachers in designing and developing assessment instruments which are underpinned by a sound theoretical understanding of language assessment principles.This research is set out to evaluate classroom-based assessment instrument (e.g., language test) against five principles of language assessment. To achieve the intended purposes, the research adopts an evaluative research approach by which assessment instrument developed by a teacher was evaluated and rated against the principles. Documentation was used as a method to collect data by which language tests developed by teachers were collected in person. The teachers’ made testscollected in this study were analysed deductively based on five principles of language assessment. The study indicates that the teacher-made test was in general meet all aspects ofthe principles. However, some aspects within principles are not adequately addressed. Some principal suggestions are provided.

Author Biographies

Dedi Sumarsono, Universitas Pendidikan Mandalika

A senior lecturer of English Language Education

Faculty of Culture, Management, and Business

Moh. Arsyad Arrafii, Universitas Pendidikan Mandalika

Pendidikan Bahasa Inggris, Universitas Pendidikan Mandalika

Imansyah Imansyah, Universitas Pendidikan Mandalika

Universitas Pendidikan Mandalika

References

Aprianoto, & Haerazi. (2019). Development and Assessment of an Interculture-based Instrument Model in the Teaching of Speaking Skills. Universal Journal of Educational Research, 7(12), 2796–2805. https://doi.org/10.13189/ujer.2019.071230

Arrafii, M. A. (2021). “We must assess all, even a student farting [is also assessed] for the behavioural aspect of learningâ€: Teachers' conceptions of assessment in the context of assessment reform in Indonesia. The Curriculum Journal, 00, 1–23. https://doi.org/10.1002/curj.130

Arrafii, M. A. (2021) Assessment reform in Indonesia: contextual barriers and opportunities for implementation, Asia Pacific Journal of Education, DOI: 10.1080/02188791.2021.1898931

Baars, M., Vink, S., van Gog, T., de Bruin, A. &Paas, F. (2014) Effects of training self- assessment and using assessment standards on retrospective and prospective monitoring of problem solving, Learning and Instruction, 33, 92-107

Bachman, L. F. (1990) Fundamental considerations in language testing. Oxford: Oxford University Press.

Baiutti, M. (2018). Fostering assessment of student mobility in secondary schools: Indicators of intercultural competence. Intercultural Education, 29(5–6), 549–570. https://doi.org/10.1080/14675986.2018.1495318

Black, P. & Wiliam, D. (2018) Classroom assessment and pedagogy, Assessment in Education: Principles, Policy & Practice, 25:6, 551-575

Brown, H. D. & Abeywickrama, P. (2018) Language assessment: Principles and classroom practices (3rded.). New York: Pearson Education Inc

Brown, H. D. (2004) Language assessment: Principles and classroom practices. New York: Pearson Education Inc.

Chapelle, C. A., Cotos, E., & Lee, J. (2015). Validity arguments for diagnostic assessment using automated writing evaluation. Language Testing, 32(3), 385–405. https://doi.org/10.1177/0265532214565386

Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (2002) Dictionary of language testing. Beijing: Foreign Language Teaching and Research Press.

Denscombe, M. (2007) The good research guide: For small-scale social research projects (3rd edition) Buckingham, UK: Open University Press.

Dolba, S., Gula, L., & Nunez, J. (2022). Reading Teachers: Reading Strategies Employed in Teaching Reading in Grade School. Journal of Language and Literature Studies, 2(2), 62–74. https://doi.org/10.36312/jolls.v2i2.874

Firman, E., Haerazi, H., & Dehghani, S. (2021). Students’ Abilities and Difficulties in Comprehending English Reading Texts at Secondary Schools; An Effect of Phonemic Awareness. Journal of Language and Literature Studies, 1(2), 57–65. https://doi.org/10.36312/jolls.v1i2.613

Follmer, D. J., & Sperling, R. A. (2019). Examining the Role of Self-Regulated Learning Microanalysis in the Assessment of Learners’ Regulation. The Journal of Experimental Education, 87(2), 269–287. https://doi.org/10.1080/00220973.2017.1409184

Fulcher, G. (2012) Assessment Literacy for the Language Classroom, Language Assessment Quarterly, 9, 2, 113-132,

Giraldo, F. (2018) Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20, 1, 179-195

Graves, K. (2000) Designing language courses: A guide for teachers. Boston: Heinle and Heinle.

Haerazi, H., & Kazemian, M. (2021). Self-Regulated Writing Strategy as a Moderator of Metacognitive Control in Improving Prospective Teachers’ Writing Skills. Journal of Language and Literature Studies, 1(1), 1–14. https://doi.org/10.36312/jolls.v1i1.498

Harding, L., Alderson, J. C., & Brunfaut, T. (2015). Diagnostic assessment of reading and listening in a second or foreign language: Elaborating on diagnostic principles. Language Testing, 32(3), 317–336. https://doi.org/10.1177/0265532214564505

Heaton, J. B. (2000) Writing English language tests (new ed.). Beijing: Foreign Language Teaching and Research Press.

Hughes, A. (2003) Testing for language teachers (2nd ed.). Cambridge: Cambridge University Press.

Kostons, D., van Gog, T. &Paas, F. (2012) Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning, Learning and Instruction 22, 121-132

Mahsun. (2017). Metode penelitianbahasa.Depok: PT Rajawali Pers.

McNamara, T. (2000) Language testing. Oxford: Oxford University Press.

Nunan, D. (1999) Second language teaching and learning. Boston: Heinle and Heinle.

Popham, W. J. (2011) Assessment literacy overlooked: A teacher educator’s confession, The Teacher Educator, 46, 4, 265-273.

Stiggins, R. J. (1995) Assessment Literacy for the 21st Century, The Phi Delta Kappan, 77, 3, 238-245

Su, H. (2020). Educational Assessment of the Postâ€Pandemic Age: Chinese Experiences and Trends Based on Largeâ€Scale Online Learning. Educational Measurement: Issues and Practice, 39(3), 37–40. https://doi.org/10.1111/emip.12369

Williams, T., Wiener, J., Lennox, C., & Kokai, M. (2022). Lessons Learned: Achieving Consensus About Learning Disability Assessment and Diagnosis. Canadian Journal of School Psychology, 37(3), 215–236. https://doi.org/10.1177/08295735221089457

Yin, R. K. (2009) Case Study Research: Design and Methods (4 ed.). London: SAGE Publications, Inc.

Downloads

Published

2023-04-25

How to Cite

Sumarsono, D., Arrafii, M. A., & Imansyah, I. (2023). Evaluating the Quality of a Teacher’s Made Test against Five Principles of Language Assessment. Journal of Languages and Language Teaching, 11(2), 225–237. https://doi.org/10.33394/jollt.v11i2.7481

Issue

Vol. 11 No. 2 (2023)

Section

Articles

Citation Check

License

License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:

  1. They are authorized by their co-authors to enter into these arrangements.
  2. The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  3. That it is not under consideration for publication elsewhere,
  4. That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
  5. They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  6. They agree to the following license and publishing agreement.

Copyright
Authors who publish with JOLLT Journal of Languages and Language Teaching agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Licensing for Data Publication

JOLLT Journal of Languages and Language Teaching uses a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data:
Other data publishing licenses may be allowed as exceptions (subject to approval by the editor on a case-by-case basis) and should be justified with a written statement from the author, which will be published with the article.

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.