Evaluating Psychometric Properties of Raven’s Coloured Progressive Matrices Test in Indonesian Sample using the Rasch Model
Abstract
Coloured Progressive Matrices (CPM) is a psychological test well known among Indonesian psychologists to measure intelligence. Some researchers who use CPM in their research reveal that CPM has weaknesses in the principle of measurement equivalence. Therefore, the focus of this research is to evaluate the details of the psychometric properties of CPM by using the Rasch model. This research used a secondary data analysis approach, where the primary data sets from a psychological service were collected into a single file for further analysis. Data of 371 boys and 377 girls with an age range of five to seven years old who took an intelligence test to assess their school readiness were collected. The Rasch model analysis showed that CPM showed unidimensionality and local independence, had a fairly good reliability value, and eight items were unsuitable for testing intelligence. Only twenty-eight items of CPM were suitable for measuring children’s intelligence in Indonesia
Keywords
References
Agnoli, S., Mancini, G., Pozzoli, T., Baldaro, B., Russo, P. M., & Surcinelli, P. (2012). The interaction between emotional intelligence and cognitive ability in predicting scholastic performance in school-aged children. Personality and Individual Differences, 53(5), 660–665. https://doi.org/10.1016/j.paid.2012.05.020
Antoniou, F., Alkhadim, G., Mouzaki, A., & Simos, P. (2022). A Psychometric Analysis of Raven’s Colored Progressive Matrices: Evaluating Guessing and Carelessness Using the 4PL Item Response Theory Model. Journal of Intelligence, 10(1), 6. https://doi.org/10.3390/jintelligence10010006
Ardini, P., & Handini, M. (2018). The Influence of Instructional Method, Visual Spatial Intelligence, and School Readiness on Early Reading Abilities. Journal of Scientific Research and Reports, 17(4), 1–22. https://doi.org/10.9734/jsrr/2017/38737
Balboni, G., Naglieri, J. A., & Cubelli, R. (2010). Concurrent and predictive validity of the Raven Progressive Matrices and the Naglieri Nonverbal Ability Test. Journal of Psychoeducational Assessment, 28(3), 222–235. https://doi.org/10.1177/0734282909343763
Bass, N. (2000). The Raven’ s Coloured Progressive Matrices Test: A pilot study for the establishment of normative data for Xhosa- speaking Primary School pupils in the Grahamstown region [Thesis, Rhodes University]. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.535.5516&rep=rep1&type=pdf
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model. In Applying the Rasch model: Fundamental Measurement in the Human Sciences (3rd Ed). Routledge.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer Science & Bussiness Media Dordrecht.
Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for Yen’s Q3: Identification of local dependence in the Rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178–194. https://doi.org/10.1177/0146621616677520
Clements, D. H., Sarama, J. H., & Liu, X. H. (2008). Development of a measure of early mathematics achievement using the Rasch model: The Research‐Based Early Maths Assessment. Educational Psychology, 28(4), 457–482. https://doi.org/10.1080/01443410701777272
Duncan, P. W., Bode, R. K., Min Lai, S., & Perera, S. (2003). Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950–963. https://doi.org/10.1016/S0003-9993(03)00035-2
Gorey, K. M. (2001). Early childhood education: A meta-analytic affirmation of the short- and long-term benefits of educational opportunity. School Psychology Quarterly, 16(1), 9–30. https://doi.org/10.1521/scpq.16.1.9.19163
Gusniarti, U., Rachmawati, M. A., Wibisono, S., Annatagia, L., Agustina, I., & Rumiani, R. (2021). Norming of Coloured Progressive Matrices test in elementary school children based on classical measurement theory and Rasch modeling. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia (JP3I), 10(2), 172–183. https://doi.org/10.15408/jp3i.v10i2.18155
Holster, T. A., & Lake, J. (2016). Guessing and the Rasch model. Language Assessment Quarterly, 13(2), 124–141. https://doi.org/10.1080/15434303.2016.1160096
Hülür, G., Wilhelm, O., & Robitzsch, A. (2011). Intelligence differentiation in early childhood. Journal of Individual Differences, 32(3), 170–179. https://doi.org/10.1027/1614-0001/a000049
Johnston, M. P. (2014). Secondary data analysis: A method of which the time has come. Qualitative and Quantitative Methods in Libraries, 3, 619–626. http://www.qqml-journal.net/index.php/qqml/article/download/169/170
Jong, C., Hodges, T. E., Royal, K. D., & Welder, R. M. (2015). Instruments to measure elementary preservice teachers concepetions: An application of the Rasch rating scale model. Educational Research Quarterly, 39(1), 21–48. https://files.eric.ed.gov/fulltext/EJ1166724.pdf
Khairani, A. Z. B., & Razak, N. B. A. (2015). Modeling a multiple choice mathematics test with the Rasch model. Indian Journal of Science and Technology, 8(12), 1–6. https://doi.org/10.17485/ijst/2015/v8i12/70650
Khan, S. A. (2015). Relationship between dental fluorosis and intelligence quotient of school going children in and around lucknow district: A cross-sectional study. Journal of Clinical and Diagnostic Research, 9(11), ZC10–ZC15. https://doi.org/10.7860/JCDR/2015/15518.6726
Kreiner, S. (2013). The Rasch model for dichotomous items. In K. B. Christensen, S. Kreiner, & M. Mesbah (Eds.), Rasch Models in Health (pp. 5–26). John Wiley & Sons, Inc. https://doi.org/10.1002/9781118574454.ch1
Lehmann, J., Quaiser-Pohl, C., & Jansen, P. (2014). Correlation of motor skill, mental rotation, and working memory in 3- to 6-year-old children. European Journal of Developmental Psychology, 11(5), 560–573. https://doi.org/10.1080/17405629.2014.888995
Lúcio, P. S., Cogo-Moreira, H., Puglisi, M., Polanczyk, G. V., & Little, T. D. (2019). Psychometric investigation of the Raven’s Colored Progressive Matrices test in a sample of preschool children. Assessment, 26(7), 1399–1408. https://doi.org/10.1177/1073191117740205
Lynn, R., & Irwing, P. (2004). Sex differences on the progressive matrices: A meta-analysis. 32(5), 481–498. https://doi.org/10.1016/j.intell.2004.06.008
Mair, P. (2018). Modern psychometrics with R. Springer International Publishing. https://doi.org/10.1007/978-3-319-93177-7
Mohd, R., Bakar, N. A., Hassan, S., & Hussain, A. H. (2017). Sustainable post-disaster recovery plan for flood victims in Gus Musang and Kuala Krai, Kelantan. Pertanika Journal of Social Sciences & Humanities, 25(S), 1–12. http://psasir.upm.edu.my/id/eprint/58310/1/JSSH Vol. 25 %28S%29 Jan. 2017 %28View Full Journal%29.pdf#page=17
Muniz, M., Gomes, C. M. A., & Pasian, S. R. (2016). Factor structure of Raven’s Coloured Progressive Matrices. Psico-USF, 21(2), 259–272. https://doi.org/10.1590/1413-82712016210204
Nicotra, E. F., Grassi, P., Masala, C., & Petretto, D. R. (2018). A Rasch analysis of Raven’s Colored Progressive Matrices to assess eductive intelligence: A study in a Sardinian sample. 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 1–6. https://doi.org/10.1109/MeMeA.2018.8438712
Othman, H., Ismail, N. A., Asshaari, I., Hamzah, F. M., & Nopiah, Z. M. (2015). Application Rasch measurement model for reliability measurement instrument in vector calculus course. Journal of Engineering Science and Technology, 10(2), 77–83. http://jestec.taylors.edu.my/Special Issue UKM TLC 2013_2/UKMTLC 2013_6_2015_2_077_083.pdf
Raven, J. (1983). Raven Coloured Progressive Matrices Intelligence test in Thailand and in Denmark: A response. School Psychology International, 4, 173–176. https://doi.org/10.1177/0143034383043007
Renny, Guritno, S., & Siringoringo, H. (2013). Perceived usefulness, ease of use, and attitude toward online shopping usefulness towards online airlines ticket purchase. Procedia - Social and Behavioral Sciences, 81, 212–216. https://doi.org/10.1016/j.sbspro.2013.06.415
Ridho, A. (2014). Differential item functioning pada tes multidimensi [Dissertation, Universitas Gajah Mada]. https://www.google.co.id/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwjQlrb7k_bvAhXafH0KHW_6C3wQFnoECAMQAA&url=http%3A%2F%2Frepository.uin-malang.ac.id%2F750%2F1%2FAli-Ridho.pdf&usg=AOvVaw0m21OYVtLMgiwu7rL4tuiJ
Rogers, H. J., & Swaminathan, H. (1990). A Comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning. Applied Psychological Measurement, 17(2), 105–116. https://doi.org/10.1177/014662169301700201
Sanz-Cervera, P., Pastor-Cerezuela, G., Fernández-Andrés, M. I., & Tárraga-Mínguez, R. (2015). Sensory processing in children with autism spectrum disorder: Relationship with non-verbal IQ, autism severity and attention deficit/hyperactivity disorder symptomatology. Research in Developmental Disabilities, 45–46, 188–201. https://doi.org/10.1016/j.ridd.2015.07.031
Sharma, B. (2016). A focus on reliability in developmental research through Cronbach Alpha among medical, dental and paramedical professional. Asian Pacific Journal of Health Sciences, 3(4), 271–278. https://doi.org/10.2466/pms.1983.56.2.484
Sigmon, S. B. (1983). Performance of American school children on Raven’s Colored Progressive Matrices scale. Perceptual and Motor Skills, 56(2), 484–486. https://doi.org/10.2466/pms.1983.56.2.484
van Schoor, N. M., Comijs, H. C., Llewellyn, D. J., & Lips, P. (2016). Cross-sectional and longitudinal associations between serum 25-hydroxyvitamin D and cognitive functioning. International Psychogeriatrics, 28(5), 759–768. https://doi.org/10.1017/S1041610215002252
Wicaksono, D. A., Roebianto, A., & Sumintono, B. (2021). Internal validation of the Warwick-Edinburgh Mental Wellbeing Scale: Rasch analysis in the Indonesian context. Journal of Educational, Health and Community Psychology, 10(2), 229–248. https://doi.org/10.12928/jehcp.v10i2.20260
Williams, P. G., & Lerner, M. A. (2019). School readiness. Pediatrics, 144(2), 54–66. https://doi.org/10.1542/peds.2019-1766
Wright, B. D., & Stone, M. H. (1979). Best test design. MESA PRESS.
Yoshizawa, K., Yasuda, N., Fukuda, M., Yukimoto, Y., Ogino, M., Hata, W., Ishizaka, I., & Higashikawa, M. (2014). Syntactic comprehension in patients with amyotrophic lateral sclerosis. Behavioural Neurology, 2014, 1–8. https://doi.org/10.1155/2014/230578
Ziol-Guest, K. M., & McKenna, C. C. (2014). Early childhood housing instability and school readiness. Child Development, 85(1), 103–113. https://doi.org/10.1111/cdev.12105
DOI: 10.15408/jp3i.v12i2.27838
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Yonathan Natanael
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
