nalysis of a Research Instrument to Map English Teachers’ Proficiency
Abstract
ABSTRACT
Teachers’ English proficiency can be measured by designing a research instrument in a form of test. The devised test must fulfill the requirement of a good test. This article is aimed at discussing item analysis centering on multiple choice questions used to measure the proficiency of Indonesian High School teachers involved in English instruction. The first set of syllabus oriented test is tried out to 20 subjects, and the second set – general English oriented – to 28 subjects. The test analysis indicates the item difficulty indices range from .20 to 1 for the first set and .07 to .89 for the second set. With regard to item discrimination analysis, the study finds the d values range from -0.33 to 1.0 for the first set, and -0.11 to .78 for the second set. It is found that the whole test has ‘average’ level of difficulty and is ‘good’ at discriminating between high and low achieving test takers; to be used for the actual research, a revision of the test is done to eliminate the ‘bad’ items.
ABSTRAK
Kecakapan bahasa Inggris guru dapat diukur dengan merancang instrumen penelitian dalam bentuk tes. Tes yang dirancang harus memenuhi persyaratan tes yang baik. Artikel ini bertujuan membahas analisis soal yang berpusat pada pertanyaan pilihan ganda yang digunakan untuk mengukur kemahiran guru-guru SMA Indonesia yang terlibat dalam pengajaran Bahasa Inggris. Tes set kesatu yang berorientasi silabus diujicobakan pada 20 subjek. Set kedua - berorientasi Bahasa Inggris umum - diujicobakan ke 28 subjek. Analisis tes menunjukkan bahwa indeks kesulitan soal berkisar dari .20 hingga 1 untuk set pertama dan .07 hingga .89 untuk set kedua. Terkait analisis diskriminasi item, studi ini menemukan bahwa nilai D berkisar dari -0,33 ke 1,0 untuk set pertama, dan -0,11 hingga 0,78 untuk set kedua. Ditemukan bahwa keseluruhan tes memiliki tingkat kesulitan 'rata-rata' dan 'baik' dalam membedakan antara peserta tes berprestasi tinggi dan rendah. Untuk digunakan dalam penelitian aktual, revisi tes dilakukan dengan menghilangkan soal 'buruk'.
How to Cite: Tamah, S. M., Lie, A. (2019). Analysis of a Research Instrument to Map English Teachers’ Proficiency. IJEE (Indonesian Journal of English Education), 6(1), 48-64. doi:10.15408/ijee.v6i1.11888
Keywords
References
Aniroh, K. (2009). From English as a general school subject onto English as a medium for learning specific subjects: The need to shift in the teaching orientation. TEFLIN Journal. 20(2), 169-179.
Anugerahwati, M. & Saukah, A. (2010). Professional Competence of English Teachers in Indonesia: A Profile of Exemplary Teachers. Indonesian Journal of English Language Teaching. 6(2), 47-59.
Barber, M. & Mourshed, M. (2007). How the World's Best Performing Schools Come Out on Top. London: McKinsey and Company.
Boopathiraj, C. & Chellamani, K. (2013). Analysis of test items on difficulty level and discrimination index in the test for research in education. International Journal of Social Science & Interdisciplinary Research. 2(2), 189-193.
Brown, D. H. (2004). Language Assessment: Principles and Classroom Practices. New York: Longman.
Brown, D. H., & Abeywickrama, P. (2010). Language Assessment: Principles and Classroom Practices. (2nd Edition). New York: Pearson Longman.
Brown, J. D. (1996). Testing in Language Program. New Jeersey: Prentice Hall Regents.
Caena, F. (2011). Teachers’ core competences: Requirements and development. European Commission. http://ec.europa.eu/dgs/education_culture/repository/ education/policy/strategic-framework/doc/teacher-competences_en.pdf
Eln. (2018). Fokus pada Perbaikan Standar Mutu Guru (Focus on Improvement of Teacher Quality Standards). Kompas, 10 August, p. 12.
Gronlund, N. E. (1982). Constructing Achievement Test (3rd edition). New York: Prentice Hall.
Chetty, R., Friedman, J. N. & Rockoff, J. E. (2011). The Long-term impacts of teachers: Teacher value-added and student outcomes in adulthood. Working Paper 17699 http://www.nber.org/papers/w17699 National Bureau of Economic Research.
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A Review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education. 15(3), 309–334.
Harjanto, I., Lie, A. Wihardini, D., Pryor, L., & Wilson, M. (2018). Community-based teacher professional development in remote areas in Indonesia. Journal of Education for Teaching. 44(2), 212-231. https://doi.org/10.1080/02607476.2017.1415515
Hughes, A. (1989). Testing for Language Teachers. Cambridge: Cambridge University press.
Kopriva, R. J. (2008). Improving Testing for English Language Learners. New York: Routledge.
Lee, K. S. (2004) Exploring the connection between the testing of reading and literacy: The case of the MUET. GEMA Online® Journal of Language Studies. 4(1).
Lengkanawati, N. (2005). EFL Teachers’ competence in the context of English curriculum 2004: Implications for EFL teacher education. TEFLIN Journal. 26(1), 79-92.
Nair, R. & Arshad, R. (2018). The discursive construction of teachers and implications for continuing professional development. Indonesian Journal of Applied Linguistics. 8(1), 131-138. doi: 10.17509/ijal.v8i1.11472
Newbold, D. (2012). Local institution, global examination: Working together for a ‘co-certification’. In Dina Tsagari / Ildikó Csépes (Eds.) Collaboration in Language Testing and Assessment (pp.127-142). Frankfurt: Peter Lang.
Othman, J. & Nordin, A. (2013) MUET as a predictor of academic achievement in ESL teacher education. GEMA Online® Journal of Language Studies. 13(1), 99-111.
Plakans, L. & Gebril, A. (2015) Assessment Myths. University of Michigan Press.
Prasetyo, S. (2017). Uji Kompetensi Guru, Tes Sesuaikan Kompetensi Guru. Jawa Pos. 2 July. Retrieved 9 August 2018 from https://www.jawapos.com/pendidikan/02/07/2017/uji-kompetensi-guru-tes-sesuaikan-kompetensi-guru
Putra, I. (2017). Pretest UKG (Ujian Kompetensi Guru) Ini Ujian Apa Ya? Kompasiana. Retrieved 9 August 2018 from https://www.kompasiana.com/indra-yahdi/59afb95aa32cdd1bae7721d3/pretest-ukg-ujian-kompetensi-guru-ini-ujian-apa-yaaa
Rasmussen, J. & Holm, C. (2012). In pursuit of good teacher education: How can research inform policy? Reflecting Education. 8(2), 62-71 http://reflectingeducation.net
Sharif, A. (2013) Limited proficiency English teachers’ language use in science classrooms. GEMA Online® Journal of Language Studies. 13(2), 65-80.
Sim, D. S. & Rasiah, R. I. (2006). Relationship between item difficulty and discrimination indices in true/false type multiple choice questions of a para-clinical multidisciplinary paper. Annals Academy of Medicine. 35(2), 67-71.
Soepriyatna. (2012). Investigating and assessing competence of high school teachers of English in Indonesia. Malaysian Journal of ELT Research. 8(2), 38-49.
Tsang, W. L. (2011) English metalanguage awareness among primary school teachers in Hong Kong. GEMA Online® Journal of Language Studies. 11(1), 1-16..
DOI: 10.15408/ijee.v6i1.11888
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
