Examining teacher-made English test in a language school

Taufiq Effendi; Ilza Mayuni

doi:10.56724/ladu.v2i2.109

Authors

Taufiq Effendi Universitas Gunadarma
Ilza Mayuni Universitas Negeri Jakarta

DOI:

https://doi.org/10.56724/ladu.v2i2.109

Keywords:

English classroom assessment, multiple-choice test, validity, reliability, item response analysis

Abstract

Background: Multiple-choice, teacher-made English tests have constantly been popular due to their immediate alignment to classroom instructions. However, ample studies have indicated the need for continuous evaluation of their quality to allow evidence-based feedbacks for sustained betterment of assessment practices.

Purpose: This study sought to examine the quality of a multiple-choice, teacher-made English formative informal assessment for four classes of high school students of an English course in Madura, Indonesia.
Design and methods: Data were collected from the test results of eighty students and put in an excel document. The data were then analysed with a computer application called Conquest to analyse the responses of each of the students on every item of the test. Based on this item response analysis, it turned out that the test could have achieved a higher credibility if necessary, moderations had been taken.

Results: The findings recommend that schools as well as teacher institutions need to provide necessary trainings to ensure in-service teachers and pre-service teachers possess adequate test development and test analysis expertise for continuous improvement of the learning, teaching and assessment practices.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

Alderson, J.C. (1991a). Dis-sporting Life. Response to Alistair Pollit’s paper. In Alderson and North (eds.), pp. 60-7.

Bachman, L. F., & Palmer, A. S. (1996). Designing Language Test. Oxford: Oxford University Press.

Brown, H. D. (2004). Language Assessment: Principles and Classroom Practices. New York: Pearson Education Inc.

Dardjowidjojo, S. (2000). English Teaching in Indonesia. EA Journal, 18(1), 22-30 DOI: https://doi.org/10.1111/1467-9639.00010

Effendi, T. (2021). Past learners’voices on EFL classroom management in Depok, Indonesia. Asian EFL Journal, 28(1.2), 220-240.

Effendi, T., & Suyudi, I. (2017). The Impacts of English National Examination in Indonesia. In Ninth International Conference on Applied Linguistics (CONAPLIN 9) (pp. 236-239). Atlantis Press. DOI: https://doi.org/10.2991/conaplin-16.2017.52

Effendi, T., & Suyudi, I. (2017). Investigating the Quality of a Popular Classroom Assessment Instrument in Indonesia. In Ninth International Conference on Applied Linguistics (CONAPLIN 9) (pp. 67-70). Atlantis Press. DOI: https://doi.org/10.2991/conaplin-16.2017.14

Frisbie, D. A. (1988). Reliability of scores from teacher‐made tests. Educational Measurement: Issues and Practice, 7(1), 25-35. DOI: https://doi.org/10.1111/j.1745-3992.1988.tb00422.x

Fulcher, G., & Davidson, F. (2007). Language, Testing, and Assessment. New York: Routledge.

Fulcher, G. (2010). Practical Language Testing. London: Hodder Education.

Hakim, L., & Irhamsyah, I. (2020). The analysis of the teacher-made test for senior high school at

State Senior High School 1 Kutacane, Aceh Tenggara. JURNAL ILMIAH DIDAKTIKA: Media Ilmiah Pendidikan dan Pengajaran, 21(1), 10-20.

Hughes, A. (2012). Testing for Language Teachers (2nd Ed.). Cambridge: Cambridge University Press.

Indrayani, M. S. D., Marhaeini, A. A. I. N., Paramartha, A. A. G. Y., & Wahyuni, L. G. E. (2020). The Analysis of the Teacher-Made Multiple-Choice Tests Quality for English Subject. Journal of Education Research and Evaluation, 4(3), 272-278. DOI: https://doi.org/10.23887/jere.v4i3.25814

Jannah, R., Hidayat, D. N., Husna, N., & Khasbani, I. (2021). An item analysis on multiple-choice questions: a case of a junior high school English try-out test in Indonesia. Leksika: Jurnal Bahasa, Sastra dan Pengajarannya, 15(1), 9-17. DOI: https://doi.org/10.30595/lks.v15i1.8768

Kholilah, N. (2016). The quality of english language testing implemented in kbri school, sekolah indonesia kuala lumpur, Malaysia. IJET (Indonesian Journal of English Teaching), 5(1), 149-172. DOI: https://doi.org/10.15642/ijet2.2016.5.1.149-172

Lebagi, D., Sumardi, S., & Sudjoko, S. (2017). The Quality of Teacher-made test in EFL Classroom at the Elementary School and Its Washback in the Learning. Journal of English Education, 2(2), 97-104. DOI: https://doi.org/10.31327/jee.v2i2.289

Messick, S. (1989). Validity. In R. Linn (ed.), Educational Measurement. New York: Macmillan, pp. 13-103.

Miller, M. D., Linn, L. R., & Gronlund, N. E. (2013). Measurement and assessment in teaching 10th Ed. New Jersey: Pearson Education.

Paramartha, A. G. Y. (2017). The Analysis Of Multiple-Choice Test Quality For Reading III Class In English Education Department, Universitas Pendidikan Ganesha Bali, Indonesia. Journal of Education Research and Evaluation, 1(1), 46-56. DOI: https://doi.org/10.23887/jere.v1i1.10060

Santy, N. P. L., Dewi, N. L. P. E. S., & Paramartha, A. A. G. Y. (2020). THE QUALITY OF TEACHER-MADE MULTIPLE-CHOICE TEST USED AS SUMMATIVE ASSESSMENT FOR ENGLISH SUBJECT. Prasi: Jurnal Bahasa, Seni, dan Pengajarannya, 15(02), 57-70. DOI: https://doi.org/10.23887/prasi.v15i02.25560

Septi, N. K. D. C., Paramartha, A. G. Y., & Wahyuni, L. G. E. (2020). AN ANALYSIS OF THE QUALITY OF TEACHER-MADE MULTIPLE-CHOICE TEST USED AS SUMMATIVE ASSESSMENT FOR ENGLISH SUBJECT. Jurnal Imiah Pendidikan dan Pembelajaran, 4(2), 356-368.

Sukyadi, D., & Mardiani, R. (2011). The washback effect of the English national examination (ENE) on English teachers’ classroom teaching and students’ learning. K@ ta, 13(1), 96-111. DOI: https://doi.org/10.9744/kata.13.1.96-111

Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment. 8, 350-353. DOI: https://doi.org/10.1037/1040-3590.8.4.350

Wu, M. & Adams, R. (2007). Applying the Rasch model to psycho-social measurement: A practical approach. Educational Measurement Solutions: Melbourne.

Weir, C. (1998). Communicative Language Testing. New York: Prentice Hall.

Weir, C. (2005). Language Testing and Validation: An Evidence-based Approach. New York: Palgrave Macmillan. DOI: https://doi.org/10.1057/9780230514577

Yulia, Y. (2014). An evaluation of English Language Teaching programs in Indonesian Junior High Schools in Yogyakarta province. Unpublished PhD thesis. Melbourne: RMIT University