APPLICATION OF THE RASCH MODEL ON THE TEST INSTRUMENT TO ANALYZE THE PROBLEM-SOLVING ABILITY OF STUDENTS IN ACID-BASE SOLUTIONS MATERIALS
Abstract
APPLICATION OF THE RASCH MODEL ON THE TEST INSTRUMENT TO ANALYZE THE PROBLEM-SOLVING ABILITY OF STUDENTS IN ACID-BASE SOLUTIONS MATERIALS
Abstract
In 21st century education, students are required to have high problem-solving skills. This study aims to reveal the quality of the test instrument with the Rasch model. Descriptive quantitative research is used with total of 38 students of class XI SMAN 2 Semarang became the subjects in this study. The data obtained in this study is from a combination of student response patterns on the product development diagnostic test instrument. The data analysis used was IRT Rasch. Rasch model analysis for summary statistics, item-fit, wright-map, item-measure, person-measure, person-fit dan item-DIF. The value of person reliability is 0.78(sufficient), and item reliability value is 0.8(good). Cronbach's alpha value is 0.82 (very good). Based on the analysis Rasch model, it was found that there were two students (12P and 37P) whose response patterns were not ideal. The results showed problem-solving ability profile of students in the very high category of 26%, high of 29%, average of 16%, low of 13%, and very low of 16%. The results of this study indicate that the test instrument can be used for further research in measuring student problem solving and the Rasch model contributes to teachers and schools in identifying students' abilities in more detail.
Abstrak
Pada pendidikan abad-21, siswa dituntut harus memiliki keterampilan problem-solving yang tinggi. Penilaian keterampilan problem-solving dapat dilakukan secara online yang terintegrasi pada soal tes pengetahuan. Penelitian ini bertujuan untuk mengungkap kualitas instrumen tes dengan model Rasch. Penelitian kuantitatif deskriptif digunakan dalam penelitian ini. Total 38 siswa kelas XI SMAN 2 Semarang menjadi subjek dalam penelitian ini. Data yang diperoleh dalam penelitian ini adalah dari kombinasi pola respon jawaban siswa pada instrumen tes diagnostik produk pengembangan. Analisis data yang digunakan menggunakan Item Response Theory (IRT) model Rasch. Analisis model Rasch untuk summary statistics, item-fit, wright-map, item-measure, person-measure, person-fit dan item-DIF. Nilai person reliability didapatkan sebesar 0,78, kriteria cukup, dan nilai item reliability sebesar 0,85, kriteria bagus. Nilai alpha Cronbach sebesar 0,82, kriteria bagus sekali. Berdasarkan hasil analisis Rasch model ditemukan ada dua siswa yang pola responnya tidak ideal yaitu siswa 12P dan 37P. Hasil penelitian menunjukkan profil kemampuan problem-solving siswa dengan kategori sangat tinggi sebesar 26%, tinggi sebesar 29%, rata-rata sebesar 16%, rendah sebesar 13%, dan sangat rendah sebesar 16%. Hasil penelitian ini menunjukkan bahwa instrumen tes dapat digunakan untuk penelitian lanjutan dalam mengukur pemecahan masalah siswa dan model Rasch memberikan kontribusi kepada guru dan sekolah dalam mengidentifikasi kemampuan siswa lebih rinci
Keywords
Full Text:
PDFReferences
Afnia, P. N., & Istiyono, E. (2020). The Development of Two-Tier Multiple Choice Instruments to Measure Higher Order Thinking Skills Bloomian, 397, 1038–1045.
Aprilia, N., Susilaningsih, E., Priatmoko, S., & K. (2020). Desain Instrumen Tes Pemahaman Konsep Berbasis HOT dengan Analisis Model Rasch. Chemistry in Education, 9(2), 1–8.
Astuti, A. T., Supahar, Mundilarto, & Istiyono, E. (2020). Development of assessment instruments to measure problem solving skills in senior high school. Journal of Physics: Conference Series, 1440(012063), 1–8.
Bohori, M., & Winny, L. (2019). Analisis penguasaan konsep siswa menggunakan Rasch Model pada materi usaha dan energi. Prosiding Seminar Nasional Fisika, 5, 138–143.
Boone, W.J., Staver, J.R., & Yale, M.S. (2014). Rasch Analysis in the Human Sciences. Dordrecht: Springer.
Hamdu, G., Fuadi, F. N., Yulianto, A., & Akhirani, Y. S. (2020). Items Quality Analysis Using Rasch Model To Measure Elementary School Students’ Critical Thinking Skill On Stem Learning. JPI (Jurnal Pendidikan Indonesia), 9(1), 61–74.
Hilaliyah, H., Agustin, Y., Setiawati, S., Hapsari, S. N., Rangka, I. B., & Ratodi, M. (2019). Wright-Map to investigate the actual abilities on math test of elementary students. Journal of Physics: Conference Series, 1318(012067), 1–7.
Holster, T. A., & Lake, J. (2016). Guessing and the Rasch Model. Language Assessment Quarterly, 13(2), 124–141.
Lestari, W., Pratama, L. D., & Jailani, J. (2019). Metacognitive Skills in Mathematics Problem Solving. Jurnal Daya Matematis, 6(3), 286–295.
Lian, L.H., & Yew, W. . (2020). Development of an Assessment Literacy Super-item Test for Assessing Preservice Teachers’ Assessment Literacy. International Journal of Innovation, Creativity and Change. Www.Ijicc.Net, 13(7), 870–889.
Mariam, S., Saleh, M., Warsono, & Mujiyanto, J. (2018). Using the Rasch Model for the Affective Assessment of EFL Learners. Arab World English Journal, 9(2), 441–456.
Martinkova, P., Drabinová, A., Liaw, Y. L., Sanders, E. A., McFarland, J. L., & Price, R. M. (2017). Checking equity: Why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE Life Sciences Education, 16(2), 1–13.
Misbah, M., Mahtari, S., Wati, M., & Harto, M. (2018). Analysis of Students’ Critical Thinking Skills in Dynamic Electrical Material. Kasuari: Physics Education Journal, 1(2), 103–110.
Muller, M. (2020). Item fit statistics for Rasch analysis: can we trust them? Journal of Statistical Distributions and Applications, 7(5), 1–12.
Noben, I., Maulana, R., Deinum, J. F., & Hofman, W. H. A. (2021). Measuring university teachers’ teaching quality: a Rasch modelling approach. Learning Environments Research, 24, 87–107.
Nurwahidah, I., Widiyawati, Y., Sari, D. S., Masykuri, M., & Budiyanto, C. W. (2020). Development of Science Test To Measure Hots and Digital Literacy of Junior High School Students on the Topic of City Noise. Edusains, 12(2), 203–213.
Pratama, D., & Husnayaini, I. (2020). Applying Rasch Model To Measure Students` Reading Comprehension. JISAE: Journal of Indonesian Student Assessment and Evaluation, 6(2), 203–209.
Putri, F.S., Istiyono, E., & Nurcahyanto, E. (2016). Pengembangan Instrumen Tes Keterampilan Berpikir Kritis dalam Bentuk Pilihan Ganda Beralasan (Politomus) di DIY. Unnes Physics Education Journal, 5(2), 76–84.
Rachman, T., & Napitupulu, D. B. (2017). Rasch Model for Validation a User Acceptance Instrument for Evaluating E-learning System. CommIT (Communication and Information Technology) Journal, 11(1), 9–16.
Ringo, S. S., Samsudin, A., & Ramalis, T. R. (2020). Utilizing Rasch Model to Analyze A Gender Gap in Students’ Cognitive Ability on Simple Harmonic Motion. Journal of Physics: Conference Series, 1467(012054), 1–9.
Rusmansyah, & Almubarak. (2020). Students ’ Cognitive Analysis Using Rasch Modeling As an Assessment for Planning of Strategies in Chemistry Learning. JKPK (Jurnal Kimia Dan Pendidikan Kimia, 5(3), 222–235.
Sari, A. N., Rosidin, U., & Abdurrahman, A. (2020). Developing an Instrument of Performance Assessment to Measure Problem-Solving Skills of Senior High School Students in Physics Inquiry-Based Learning. Scientiae Educatia: Jurnal Pendidikan Sains, 9(1), 1–13.
Shuib, N. H., Amat, S., Kari, D. N. P. M., Ishak, N. M., & Ahmad, I. (2020). Validity and Reliability of MEQI-C Item Using Rasch Measurement Model. International Journal of Academic Research in Business and Social Sciences, 10(4), 468–481.
Sihombing, R.U., Naga, D.S., & Rahayu, W. (2019). A Rasch Model Measurement Analysis on Indonesian Science Literacy Test: Smart Way to Improve the Learning Assessment. Indonesian Journal of Educational Review, 6(2), 42–53.
Singaravelu, S. (2017). Problem Solving Ability of Higher Secondary Chemistry Students. IOSR Journal of Research & Method in Education (IOSR-JRME), 7(4), 19–22.
Stehle, S.M., & Peters-Burton, E. . (2019). Developing student 21 st Century skills in selected exemplary inclusive STEM high schools. International Journal of STEM Education, 6(39), 1–15.
Sudihartinih, E., & Prabawanto, S. (2020). Test Instrument Validation in Plane Geometry using Rasch Model. Mathematics Education Journals, 4(2), 102–115.
Sumintono, B., & Widhiarso, W. (2013). Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial. Cimahi: Trim Komunikata.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Permodelan Rasch Pada Assessment Pendidikan. Cimahi: Trim Komunikata.
Suryani, Y. E. (2018). Aplikasi Rasch Model dalam Mengevaluasi Intelligenz Structure Test (IST). Jurnal Penelitian Psikologi, 3(1), 73–100.
Susilaningsih, E., Nuswowati, M., Aprilia, N., & Luthfiyah, A. (2021). Dissemination of test instruments as product of the development research to measure the problem-solving ability of class X students by online in the pandemic period. Journal of Physics: Conference Series, 1918(032024), 1–8.
Treagust, D. F. (1988). Development and use of diagnostic tests to evaluate students’ misconceptions in science. International Journal of Science Education, 10(2), 159–169.
Treagust, D.F. (1995) Diagnostic assessment of students’ science concepts. In S. Glynn and R. Duit (Eds) Learning science in the schools: Research reforming practice. New Jersey: Lawrence Erlbaum Associates, 327–346.
Widiasih, Permanasari, A., Riandi, & Damayanti, T. (2018). The profile of problem-solving ability of students of distance education in science learning. Journal of Physics: Conference Series, 1013(012081), 1–6.
Wigati, I., & Aini, K. (2020). Biology Education Students’ Analysis of Reasoning on Plant Taxonomy Coursewhite Rasch Model. Edusains, 12(2), 145–153.
Winarti, A., & Mubarak, A. (2020). Rasch Modeling: A Multiple Choice Chemistry Test. Indonesian Journal on Learning and Advanced Education (IJOLAE), 2(1), 1–9.
Yasin, S. N. T. M., Yunus, M. F. M., & Ismail, I. (2018). The use of rasch measurement model for the validity and reliability. Journal of Counseling and Educational Technology, 1(2), 22–27.
Yazdani, K., Nedjat, S., Karimlou, M., Zeraati, H., Mohammad, K., & Fotouhi, A. (2015). Developing a shortened quality of life scale from Persian version of the WHOQOL-100 using the rasch analysis. Iranian Journal of Public Health, 44(4), 522–534.
DOI: https://doi.org/10.15408/es.v13i2.21375 Abstract - 0 PDF - 0
Refbacks
Copyright (c) 2023 Nurkintan Aprilia, Endang Susilaningsih, Sudarmin Sudarmin, Woro Sumarni, F. Widhi Mahatmanti, Naftalina Ulik Adhelia
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0).
EDUSAINS. P-ISSN:1979-7281;E-ISSN:2443-1281
Â
Â