VALIDITY, RELIABILITY, AND PRACTICALITY OF TEST ITEMS IN AN INTERNET-BASED ENGLISH PROFICIENCY TEST FOR ENGLISH LABORATORY

Nuri Emmiyati, Sardian Maharani Asnur, Ahmad Ahmad

Abstract


One way to evaluate English language skills is through the English Proficiency Test (EPT). This research aimed to develop the Internet-Based English Proficiency Test (IB-EPT) by evaluating its test items' validity, reliability, and practicality. The study followed a research and development approach incorporating qualitative and quantitative methods. The sample consisted of 24 students from UIN Alauddin Makassar. The developed English language test media received positive feedback from the expert validation and field trials. The results revealed that the validity of test items was confirmed, with a coefficient of 0.462 (r table = 0.44). Similarly, using Spearman-Brown product-moment correlation, the test items were reliable, with an index of 0.632, exceeding the critical value of the product-moment table (r table = 0.44). In addition, the students' evaluation of the product’s practicality yielded a score of 83.26%, categorized as “very good,” indicating the product was feasible. It is recommended that higher education policymakers should prioritize equipping campuses with comprehensive facilities, particularly information and communication technology, and provide specialized training for lecturers to develop effective computer-based and online assessments.


Keywords


English proficiency test; internet-based test; practicality; reliability; validity

References


Ananda, K. R. (2019). Developing English Proficiency Test Media in Junior High School [Institut Agama Islam Negeri Parepare]. http://repository.iainpare.ac.id/958/1/14.1300.010.pdf

Arikan, S., Kilmen, S., Abi, M., & Üstünel, E. (2019). An example of empirical and model based methods for performance descriptors: English proficiency test. Journal of Measurement and Evaluation in Education and Psychology, 10(3), 219–234. https://doi.org/10.21031/epod.477857

Azmi, U. (2020). Developing web-based reading tests for the students of English language education. Journal of Applied Linguistics, Translation, and Literature, 1(2), 92–104.

Brown, H. D. (2010). Language Assessment Principles and Classroom Practices. Pearson Longman.

Brown, H.D. (2001) Teaching by Principles: An Interactive Approach to Language Pedagogy. 2nd Edition. Pearson Longman

Brown, H. D., & Abeywickrama, P. (2004). Language assessment. Principles and Classroom Practices. White Plains, NY: Pearson Education.

Burhan, N. (2010). Penilaian Pembelajaran Bahasa Berbasis Kompetensi. Yogyakarta: BPFE-Yogyakarta.

Chapelle, C. A., & Lee, H. (2021). Conceptions of validity. In The Routledge handbook of language testing (pp. 17–31). Routledge.

Eldridge, H., De Donno, M., & Champod, C. (2021). Testing the accuracy and reliability of palmar friction ridge comparisons–a black box study. Forensic Science International, 318, 110457.

Endarto, I. T., & Subekti, A. S. (2020). Developing a Web-Based Vocabulary Size Test for Indonesian EFL Learners. Teknosastik, 18(2), 72. https://doi.org/10.33365/ts.v18i2.492

Grabe, W., & Kaplan, R. B. (2014). Theory and practice of writing: An applied linguistic perspective. Routledge.

Gultom, S., & Oktaviani, L. (2022). the Correlation Between Students’ Self-Esteem and Their English Proficiency Test Result. Journal of English Language Teaching and Learning, 3(2), 52–57. https://doi.org/10.33365/jeltl.v3i2.2211

Henning, G. (2001). A Guide to Language Testings: Development, Evaluation, and Research. Heinle & Heinle Publishers

Hesti, S. W. (2021). The Influence Of Using Problem Based Learning Towards Students Writing Ability On Analytical Exposition Text [UIN Raden Intan Lampung]. http://repository.radenintan.ac.id/id/eprint/16617

Korkmaz, S., & Öz, H. (2021). Using Kahoot to improve reading comprehension of English as a foreign language learners. International Online Journal of Education and Teaching, 8(2), 1138–1150.

Meadows, M., & Billington, L. (2005). A review of the literature on marking reliability. London: National Assessment Agency.

Parwanto, T. (2011). Perancangan Aplikasi Simulasi Toefl (Test of English As Foreign Language ). Program Studi Teknik Informatika Fakultas Sains Dan Teknologi Universitas Islam Negeri Syarif Hidayatullah, 100. https://repository.uinjkt.ac.id/dspace/handle/123456789/3767

Putria, A., & Lestari, W. (2021). Need Assessment For Developing An Online English Proficiency Test Instrument In Higher Education During Covid-19 Pandemic. JPP (Jurnal Pendidikan Dan Pembelajaran), 27(2), 78–82. https://doi.org/10.17977/um047v27i22020p078

Richards, J. C., & Pun, J. (2022). Teacher strategies in implementing English medium instruction. ELT Journal, 76(2), 227–237. https://doi.org/10.1093/elt/ccab081

Serevina, V., Astra, I., & Sari, I. J. (2018). Development of E-Module Based on Problem Based Learning (PBL) on Heat and Temperature to Improve Student’s Science Process Skill. Turkish Online Journal of Educational Technology-TOJET, 17(3), 26–36.

Sürücü, L., & Maslakci, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694–2726.

Tavakol, M., & Wetzel, A. (2020). Factor Analysis: a means for theory and instrument development in support of construct validity. International Journal of Medical Education, 11, 245.

Zboun, J., & Farrah, M. (2021). Students’ perspectives of online language learning during corona pandemic: Benefits and challenges.




DOI: 10.15408/ijee.v11i2.37276

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.