Examining the psychometric properties of the Prosocial Behavior Scale Using Indonesian Pesantren (Islamic Boarding Education System) Sample

Wahyu Syahputra; Ika Widhiastuti; Baydhowi Baydhowi; Saiful Falah; Devie Yundianto; Moondore Madalina Ali

Examining the psychometric properties of the Prosocial Behavior Scale Using Indonesian Pesantren (Islamic Boarding Education System) Sample

Wahyu Syahputra, Ika Widhiastuti, Baydhowi Baydhowi, Saiful Falah, Devie Yundianto, Moondore Madalina Ali

Abstract

In the context of behavior, prosocial behavior is needed to maintain individual relationships with others. This behavior has existed among Islamic college students known as Santri. Santri, as an adolescent, has the concept of establishing relationships through prosocial behavior. Therefore, a measuring instrument is needed to determine Santri’s prosocial behavior. The Prosociality Scale is one of the popular instruments in measuring prosocial behavior, and it is essential to adapt and validate the instrument with the characteristics of the Indonesian sample, especially Santri. This study presents evidence of validity and reliability using the Rating Scale Rasch Measurement Model. With a sample of 742, 424 (57.1%) were female and 318 (42.9%) were male. This instrument has met the criteria of good psychometrics according to the Rasch model regarding reliability (0.82 - 0.99) and validity and fulfills the need for measurement invariance.

Keywords

Prosocial Behavior, Adolescents, Rasch Model, Validation

References

Abdel-Khalek, A. M. (2013). Personality dimensions and religiosity among Kuwaiti Muslim college students. Personality and Individual Differences, 54(2), 149–152. https://doi.org/https://doi.org/10.1016/j.paid.2012.08.004

AERA, APA, & NCME. (2014). Standards for educational and psychological testing. American Educational Research Association. https://cir.nii.ac.jp/crid/1130000794987222016.bib?lang=en

Akelaitis, A. V., & Lisinskiene, A. R. (2018). Social emotional skills and prosocial behaviour among 15-16-year-old adolescent. European Journal of Contemporary Education, 7(1), 21–28. https://doi.org/10.13187/EJCED.2018.1.21

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814

Andrich, D., & Marais, I. (2019). A Course in Rasch Measurement Theory. In Springer Nature. https://doi.org/10.1016/b978-008043348-6/50005-x

Anwar, C. (2018). Islam Dan Kebhinekaan di Indonesia: Peran Agama Dalam Merawat Perbedaan. Zawiyah: Jurnal Pemikiran Islam, 4(2), 1–18. https://doi.org/10.31332/ZJPI.V4I2.1074

Aryadoust, V., Ng, L. Y., & Sayama, H. (2020). A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research. Language Testing, 38(1), 6–40. https://doi.org/10.1177/0265532220927487

Badenes-Ribera, L., Duro-García, C., López-Ibáñez, C., Martí-Vilar, M., & Sánchez-Meca, J. (2022). The Adult Prosocialness Behavior Scale: A reliability generalization meta-analysis. International Journal of Behavioral Development, 47(1), 59–71. https://doi.org/10.1177/01650254221128280

Baldassarri, D., & Abascal, M. (2020). Diversity and prosocial behavior. Science, 369(6508), 1183–1187. https://doi.org/10.1126/science.abb2432

Barr, J. J., & Higgins-D’Alessandro, A. (2007). Adolescent Empathy and Prosocial Behavior in the Multidimensional Context of School Culture. The Journal of Genetic Psychology, 168(3), 231–250. https://doi.org/10.3200/GNTP.168.3.231-250

Baso, A. (2012). Pesantren Studies 2a. Pustaka Afid.

Blasi, A. (1980). Bridging moral cognition and moral action: A critical review of the literature. Psychological Bulletin, 88(1), 1.

Bond, T., & Fox, C. (2015). Applying the Rasch Model. In Applying the Rasch model: Fundamental Measurement in the Human Sciences. https://doi.org/10.1017/CBO9781107415324.004

Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. In Rasch Analysis in the Human Sciences. https://doi.org/10.1007/978-94-007-6857-4

Browne, M. W., & Cudeck, R. (1993). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230–258. https://econpapers.repec.org/RePEc:sae:somere:v:21:y:1992:i:2:p:230-258

Brownell, C. A. (2013). Early Development of Prosocial Behavior: Current Perspectives. Infancy, 18(1), 1–9. https://doi.org/https://doi.org/10.1111/infa.12004

Cai, L. (2010). High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm. Psychometrika, 75(1), 33–57. https://doi.org/10.1007/s11336-009-9136-x

Caprara, G. V., Steca, P., Zelli, A., & Capanna, C. (2005). A New Scale for Measuring Adults’ Prosocialness. European Journal of Psychological Assessment, 21(2), 77–89. https://doi.org/10.1027/1015-5759.21.2.77

Carlo, G., Padilla-Walker, L. M., & Nielson, M. G. (2015). Longitudinal bidirectional relations between adolescents’ sympathy and prosocial behavior. Developmental Psychology, 51(12), 1771.

Crocetti, E., & Rubini, M. (2017). Communicating Personal and Social Identity in Adolescence. Oxford Research Encyclopedia of Communication. https://doi.org/10.1093/acrefore/9780190228613.013.482

Davis, D. R., & Boone, W. (2021). Using Rasch analysis to evaluate the psychometric functioning of the other-directed, lighthearted, intellectual, and whimsical (OLIW) adult playfulness scale. International Journal of Educational Research Open, 2, 100054. https://doi.org/https://doi.org/10.1016/j.ijedro.2021.100054

de Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. In International Journal of Testing. https://doi.org/10.1080/15305058.2011.556771

Dhofier, Z. (2011). Tradisi Pesantren : Studi Pandangan Hidup Kyai dan Visinya Mengenai Masa Depan Indonesia (8th ed.). Pustaka LP3ES.

Dovidio, J. F., & Banfield, J. C. (2015). Prosocial Behavior and Empathy (J. D. B. T.-I. E. of the S. & B. S. (Second E. Wright (ed.); pp. 216–220). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-08-097086-8.24024-5

Eisenberg, N., Carlo, G., Murphy, B., & Van Court, P. (1995). Prosocial development in late adolescence: a longitudinal study. Child Development, 66(4), 1179–1197.

Eisenberg, N., Eggum, N. D., & Di Giunta, L. (2010). Empathy-related Responding: Associations with Prosocial Behavior, Aggression, and Intergroup Relations. Social Issues and Policy Review, 4(1), 143–180. https://doi.org/10.1111/j.1751-2409.2010.01020.x

Eisenberg, N., & Fabes, R. A. (1998). Prosocial Development. In Handbook of child psychology: Social, emotional, and personality development, Vol. 3, 5th ed. (pp. 701–778). John Wiley & Sons, Inc.

Eisenberg, N., Fabes, R. A., & Spinrad, T. L. (2006). Prosocial Development. In Handbook of child psychology: Social, emotional, and personality development, Vol. 3, 6th ed. (pp. 646–718). John Wiley & Sons, Inc.

Fabes, R. A., Carlo, G., Kupanoff, K., & Laible, D. (1999). Early adolescence and prosocial/moral behavior I: The role of individual processes. The Journal of Early Adolescence, 19(1), 5–16.

Fisher, W. P. J. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transaction, 21–1095. https://www.rasch.org/rmt/rmt211m.htm

Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 625–641. https://doi.org/10.1080/10705510903203573

Hanafi, H. (2001). Agama, Kekerasan dan Islam Kontemporer (1st ed.). Jendela.

Hayat, B., Hidayat, R., & Putra, M. D. K. (2021). Exploring the factor structure of environmental attitudes measure in a sample of Indonesian college students. Revista CES Psicologia, 14(1), 112–129. https://doi.org/10.21615/CESP.14.1.9

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Huda, M. N., Duwila, M., Nurul, S., Mojokerto, I., Gowa, D., Pungging, K., & Mojokerto, K. (2023). Menantang Disintegrasi Moral di Era Revolusi Industri 4.0 : Peran Revolusioner Pondok Pesantren. Journal of Islamic Education, 9(1), 1–13. https://doi.org/10.18860/JIE.V9I1.22805

Iffan, A. G. (2019). Santri dan Nasionalisme. Islamic Insights Journal, 1(1), 41–45. https://doi.org/10.21776/UB.IIJ.2019.001.01.4

Islam, M. H., & Aziz, A. (2020). Transformation of Pesantren in Maintaining Good Character. HUMANISTIKA : Jurnal Keislaman, 6(1), 35–48. https://doi.org/10.55210/humanistika.v6i1.307

Kaltwasser, L., Hildebrandt, A., Wilhelm, O., & Sommer, W. (2017). On the relationship of emotional abilities and prosocial behavior. Evolution and Human Behavior, 38(3), 298–308. https://doi.org/https://doi.org/10.1016/j.evolhumbehav.2016.10.011

Laible, D. J., Carlo, G., & Roesch, S. C. (2004). Pathways to self-esteem in late adolescence: the role of parent and peer attachment, empathy, and social behaviours. Journal of Adolescence, 27(6), 703–716. https://doi.org/10.1016/j.adolescence.2004.05.005

Lam, C. M. (2012). Prosocial involvement as a positive youth development construct: a conceptual review. TheScientificWorldJournal, 2012, 769158. https://doi.org/10.1100/2012/769158

Linacre, J. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Meas Trans, 16.

Linacre, J. (2006). A User’s Guide to WINSTEPS/MINISTEP Rasch-Model Computer Programs (3.91.0). In Chicago. http://www.winsteps.com/a/Winsteps-ManualPDF.zip

Luengo Kanacri, B. P., Eisenberg, N., Tramontano, C., Zuffiano, A., Caprara, M. G., Regner, E., Zhu, L., Pastorelli, C., & Caprara, G. V. (2021). Measuring Prosocial Behaviors: Psychometric Properties and Cross-National Validation of the Prosociality Scale in Five Countries. Frontiers in Psychology, 12, 693174. https://doi.org/10.3389/fpsyg.2021.693174

Luengo Kanacri, B. P., Pastorelli, C., Eisenberg, N., Zuffianò, A., & Caprara, G. V. (2013). The development of prosociality from adolescence to early adulthood: The role of effortful control. Journal of Personality, 81(3), 302–312.

Maate, S. (2017). Peran Islam dalam Dinamika Sosial, Budaya, dan Ekonomi di Indonesia. SOSIORELIGIUS: JURNAL ILMIAH SOSIOLOGI AGAMA, 2(1). https://doi.org/10.24252/SOSIORELIGIUS.V2I1.5999

Mair, P. (2018). Modern Psychometrics with R. Springer International. https://doi.org/https://doi.org/10.1007/978-3-319-93177-7

Malec, J. F., Torsher, L. C., Dunn, W. F., Wiegmann, D. A., Arnold, J. J., Brown, D. A., & Phatak, V. (2007). The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simulation in Healthcare : Journal of the Society for Simulation in Healthcare, 2(1), 4–10. https://doi.org/10.1097/SIH.0b013e31802b68ee

Malonda, E., Llorca, A., Mesurado, B., Samper, P., & Mestre, M. V. (2019). Parents or Peers? Predictors of Prosocial Behavior and Aggression: A Longitudinal Study. Frontiers in Psychology, 10, 2379. https://doi.org/10.3389/fpsyg.2019.02379

Martí-Vilar, M., Merino-Soto, C., & Rodriguez, L. M. (2020). Measurement Invariance of the Prosocial Behavior Scale in Three Hispanic Countries (Argentina, Spain, and Peru). Frontiers in Psychology, 11, 29. https://doi.org/10.3389/fpsyg.2020.00029

Martínez-Gregorio, S., Tomás, J. M., & Oliver, A. (2023). A Psychometric Study of the Prosocial Behavior Scale: Differential Item Functioning by Gender. In Behavioral Sciences (Vol. 13, Issue 3). https://doi.org/10.3390/bs13030259

Martínez-Pampliega, A., Cormenzana, S., Sanz, M., Barni, D., Simon, J., Alomar, E., & Pérez, C. (2018). Metric Goodness of the Adult Prosocialness Scale. Comparative Study of Italy and Spain. The Spanish Journal of Psychology, 21, E29. https://doi.org/10.1017/sjp.2018.26

Marzuki, M., Miftahuddin, M., & Murdiono, M. (2020). Multicultural Education in Salaf Pesantren and Prevention of Religious Radicalism in Indonesia. Jurnal Cakrawala Pendidikan, 39(1), 12–25. https://doi.org/10.21831/cp.v39i1.22900

Mastuki. (2020). Menjadi Muslim, Menjadi Indonesia (Kilas Balik Indonesia Menjadi Bangsa Muslim Terbesar). https://kemenag.go.id/opini/menjadi-muslim-menjadi-indonesia-kilas-balik-indonesia-menjadi-bangsa-muslim-terbesar-03w0yt

Messick, S. (1989). Validity. In Educational measurement, 3rd ed. (pp. 13–103). American Council on Education.

Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741

Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006

Muthen, L. K., & Muthen, B. (2017). MPlus, Statistical Analysis With Latent Variables user’s guide. In Muthén & Muthén (8th ed.). http://www.ncbi.nlm.nih.gov/pubmed/22210541

Nahdiyah, H. (2018). Menggugah Keberadaan Pesantren Untuk Membangun Nalar Pendidikan Berbasis Local Wisdom: Suatu Tela’ah Eksploratif dalam Perspektif Budaya. At-Turas, 4(2), 208–226. https://doi.org/10.33650/at-turas.v4i2.333

Nashori, F. (2011). Kekuatan Karakter Santri. Millah: Journal of Religious Studies, 11(1 SE-Articles), 203–219. https://doi.org/10.20885/millah.vol11.iss1.art10

Nielson, M. G., Padilla-Walker, L., & Holmes, E. K. (2017). How do men and women help? Validation of a multidimensional measure of prosocial behavior. Journal of Adolescence, 56, 91–106. https://doi.org/10.1016/j.adolescence.2017.02.006

Orcan, F. (2018). Exploratory and Confirmatory Factor analysis: Which one to use first? Egit. Psikol. Olcme Deger. Derg., 9(4), 414–421. https://doi.org/10.21031/epod.394323

Padilla-Walker, L. M., & Carlo, G. (2014). The study of prosocial behavior. Prosocial Development: A Multidimensional Approach, 3.

Paek, I., & Wilson, M. (2011). Formulating the Rasch Differential Item Functioning Model Under the Marginal Maximum Likelihood Estimation Context and Its Comparison With Mantel–Haenszel Procedure in Short Test and Small Sample Conditions. Educational and Psychological Measurement, 71(6), 1023–1046. https://doi.org/10.1177/0013164411400734

Rasch, G. (Georg). (1960). Probabilistic models for some intelligence and attainment tests. 199.

Rosset, D. (2016). Perbedaan Perilaku Prososial Santriwati Antara Pesantren Modern Dan Tradisional [Muhammadiyah Malang University]. https://eprints.umm.ac.id/34407/1/jiptummpp-gdl-debrinaros-44062-1-debrina-t.pdf

Sabiq, Z. (2012). Kecerderdasan Emosi, Kecerdasan Spiritual dan Perilaku Prososial Santri Pondok Pesantren Nasyrul Ulum Pamekasan. Persona:Jurnal Psikologi Indonesia, 1(2). https://doi.org/10.30996/PERSONA.V1I2.21

Sefianmi, D., Purnama, C. Y., & Setyadiredja, A. N. (2023). Adaptasi Skala Prosocialness for Adult Versi Bahasa Indonesia. Jurnal Psikologi. https://doi.org/http://dx.doi.org/10.35760/psi.2023.v16i1.7284

Song, H.-D., Hong, A. J., & Jo, Y. (2020). Psychometric Investigation of the Utrecht Work Engagement Scale-17 Using the Rasch Measurement Model. Psychological Reports, 124(3), 1384–1411. https://doi.org/10.1177/0033294120922494

Steinberg, L., & Morris, A. S. (2001). Adolescent Development. Journal of Cognitive Education and Psychology, 2(1), 55–87. https://doi.org/10.1891/194589501787383444

Van der Graaff, J., Branje, S., De Wied, M., Hawk, S., Van Lier, P., & Meeus, W. (2014). Perspective taking and empathic concern in adolescence: gender differences in developmental changes. Developmental Psychology, 50(3), 881.

Wentzel, K. R. (1993). Does being good make the grade? Social behavior and academic competence in middle school. Journal of Educational Psychology, 85(2), 357.

Wittek, R., & Bekkers, R. (2015). Altruism and Prosocial Behavior, Sociology of (J. D. B. T.-I. E. of the S. & B. S. (Second E. Wright (ed.); pp. 579–583). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-08-097086-8.32158-4

Wolfe, E. W., & Smith, E. V. J. (2007). Instrument development tools and activities for measure validation using Rasch models: part II--validation activities. Journal of Applied Measurement, 8(2), 204–234.

Wright, B. (2006). Local Dependency, Correlations and Principal Components. Rasch Measurement Transactions, 509–511. https://www.rasch.org/rmt/rmt103b.htm

Wright, B., & Masters, G. (1982). Rating Scale Analysis. MESA Press.

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017

Zhan, Q., Wang, S., Li, C., Li, M., Liu, D., Peng, W., Song, F., Shi, T., & Li, Y. (2023). Revision and validation of the prosocialness scale for adults (PSA) among chinese college students. BMC Psychology, 11(1), 124. https://doi.org/10.1186/s40359-023-01124-3

Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In Differential item functioning. (pp. 337–347). Lawrence Erlbaum Associates, Inc. https://doi.org/10.1075/z.62.13kok

Zuhri, S. (2013). Berangkat dari Pesantren (1st ed.). LKiS Yogyakarta.

Full Text: PDF

DOI: 10.15408/jp3i.v13i2.39054