Development and Validation of the Online Victimization Scale: Confirmatory Factor Analysis and Composite Reliability

Muhammad Dzuhri Muzayyin; Abdullah Azzam Al Afghani; Mela Minkhatul Maula

Development and Validation of the Online Victimization Scale: Confirmatory Factor Analysis and Composite Reliability

Muhammad Dzuhri Muzayyin, Abdullah Azzam Al Afghani, Mela Minkhatul Maula

Abstract

Online victimization is harmful actions directed at individuals or institutions through digital technology. This study aims to develop, validate, and examine the psychometric properties of the Online Victimization Scale (OVS). The researchers constructed and adapted several items from the Online Victimization Scale (OVS) by Tynes et al. (2014) and the Perceived Online Racism Scale (PORS) by Keum (2021), resulting in 54 items that were translated into Indonesian. A quantitative research method was employed using an accidental sampling technique. Data were collected from 204 individuals aged 14-23 years who were active social media users. Data analysis was conducted using Confirmatory Factor Analysis (CFA)to evaluate the factor structure. Score reliability was assessed by calculating composite omega and stratified alpha values using the lavaan package in R. The results indicated high inter-factor correlations, prompting a second-order factor analysis. The first-order and second-order models demonstrated good model fit indices with no significant differences, resulting in a final scale of 16 items. Measurement invariance testing using multi-group CFA confirmed that the scale met the criteria for scalar invariance, as indicated by minimal changes in ΔCFI and ΔTLI (<0.01). These findings validate the equivalence of the factor structure, factor loadings, and item intercepts between male and female participants, ensuring that score differences reflect actual differences in the online victimization construct rather than measurement bias.

Keywords

Confirmatory Factor Analysis, composite reliability, online victimization, adolescents and early adulthood

References

Al-Mujtahid, N. M., Khairiah, N., Simbolon, A. B., & Joharis, M. (2023). Komunikasi lintas budaya: menilik iklim neo-rasisme di indonesia pada era media baru nazil. Hikmah, 17(2), 239–254. https://doi.org/10.30872/jmmn.v13i4.9872

Álvarez-García, D., Núñez, J. C., Barreiro-Collazo, A., & García, T. (2017). Validation of the Cybervictimization Questionnaire (CYVIC) for adolescents. Computers in Human Behavior, 70, 270–281. https://doi.org/10.1016/j.chb.2017.01.007

Amin, N. F., Garancang, S., & Abunawas, K. (2023). Konsep umum populasi dan sampel dalam penelitian. Jurnal Pilar: Jurnal Kajian Islam Kontemporer, 14(1), 103–116.

Ampuni, S., & Buwono, S. B. S. (2022). Pengembangan dan identifikasi properti psikometris kuesioner intensi prososial berbasis skenario untuk anak dan remaja. Jurnal Psikologi Sosial, 20(2), 154–172. https://doi.org/10.7454/jps.2022.18

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/https://doi.org/10.1097/00007632-200012150-00014

Brown, T. A. (2015). Statistical power and sample size. In T. D. Little (Ed.), Guilford Publications (second). Little The Guilford Press. https://doi.org/10.1201/9781315383286-21

Byrne, B. M. (2012). Testing the factorial validity of scores from a measuring instrument: First-order confirmatory factor analysis model. In Taylor & Francis Group. Taylor & Francis Group. http://www.psypress.com/structural-equation-modeling-with-mplus-9781848728394

Byrne, B. M. (2024). Structural equation modeling with EQS and EQS/Windows (Issue 024). Sage Publications.

Çavuş, S. (2023). Negative impacts of technology and digital diseases. In Handbook of Research on Perspectives on Society and Technology Addiction. https://doi.org/10.4018/978-1-6684-8397-8.ch029

Chen, F. . (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Cheung, G. ., & Rensvold, R. . (2002). Evaluating goodness of fit indexes for testing measurement invariance. structural equation modeling. A Multidisciplinary Journal, 9(2), 233–255.

Data, R. (2019). KPAI sebut anak korban kejahatan dunia maya capai 679 kasus. KPAI.

dos Santos, P. M., & Cirillo, M. Â. (2023). Construction of the average variance extracted index for construct validation in structural equation models with adaptive regressions. Communications in Statistics: Simulation and Computation, 52(4), 1639–1650. https://doi.org/10.1080/03610918.2021.1888122

Elipe, P., Mora-Merchán, J. A., & Nacimiento, L. (2017). Development and validation of an instrument to assess the impact of cyberbullying: The cybervictimization emotional impact scale. Cyberpsychology, Behavior, and Social Networking 20(8), 479–485. https://doi.org/10.1089/cyber.2017.0069

Fornell, C., & Larcker, D. F. (1981). Structural equation models with unobservable variables and measurement error: algebra and statistics. Journal of Marketing Research, 18(3), 382. https://doi.org/10.2307/3150980

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Pearson.

Hapsari, R., Kesumayadi, I., Sari, D., Anjarwati, D. U., Alfiyuliani, N. H., Mujahidah, M., Sari, I. P., & Hadi, P. (2023). Comparison of SARS-CoV-2 variant screening and whole genome sequencing at an Indonesian Tertiary Hospital. Journal of Biomedicine and Translational Research, 9(3), 111–115. https://doi.org/10.14710/jbtr.v9i3.19147

Henson, B. (2012). Bullying beyond the schoolyard: Preventing and responding to cyberbullying. Security Journal, 25(1), 88–89. https://doi.org/10.1057/sj.2011.25

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/http://dx.doi.org/10.1080/10705519909540118

Iacobucci, D. (2010). Structural equations modeling: Fit Indices, sample size, and advanced topics. Journal of Consumer Psychology, 20(1), 90–98. https://doi.org/10.1016/j.jcps.2009.09.003

Jamaludin. (2019). Uji validitas, struktur internal, dan measurement invariance pada alat ukur achievement goal orientation. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 8(2), 140–155. https://doi.org/10.15408/jp3i.v8i2.13331

Keum, B. T. (2021). Computers in human behavior reports development and validation of the perceived online racism scale short form ( 15 items ) and very brief ( six items ). Computers in Human Behavior Reports, 3. https://doi.org/10.1016/j.chbr.2021.100082

Kline, R. B. (2015). Principles and Practice of Structural Equation Modeling (4th ed.). Guilford Press.

Kristiansen, S., & Jensen, A. V. (2023). Victimization in online gaming-related trade scams: A study among young Danes. Nordic Journal of Criminology, 24(2), 1–17. https://doi.org/10.18261/njc.24.2.6

Lee, Y., & Lai, C. (2021). The pet affection scale development , validation and influence on consumers ’ behavior of pet hotels. Mathematics, 9(15), 1–14. https://doi.org/https://doi.org/10.3390/math9151772

Malaki, Z. (2020). E-victims: Explaining online victimization for the cases of cyberbullying and cyberstalking. Malmö University.

Maulida, G., & Romdoni, M. (2024). Perlindungan hukum terhadap korban pelecehan seksual yang mengalami viktimisasi sekunder di media sosial. Southeast Asian Journal of Victimology, 2(1), 59–78. https://doi.org/10.51825/sajv.v2i1.25445

Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychomertika, 58(4), 525–543.

Montiel, I., Carbonell, E., & Pereda, N. (2016). Multiple online victimization of Spanish adolescents: Results from a community sample. Child Abuse and Neglect, 52, 123–134. https://doi.org/10.1016/j.chiabu.2015.12.005

Nedelec, M., Aloulou, A., Duforez, F., Meyer, T., & Dupont, G. (2018). The variability of sleep among elite athletes. In Sports Medicine - Open (Vol. 4, Issue 1). Springer. https://doi.org/10.1186/s40798-018-0151-2

Permatasari, A. A. (2022). Cyberbullying sebagai kekerasan berbasis gender online: Dampak terhadap remaja serta peran keluarga. Jurnal Wanita Dan Keluarga, 3(1), 1–15. https://doi.org/10.22146/jwk.5201

Peterson, R. A., & Kim, Y. (2013). On the relationship between coefficient alpha and composite reliability. Journal of Applied Psychology, 98(1), 194–198. https://doi.org/10.1037/a0030767

Putnick, D. ., & Bornstein, M. . (2016). Measurement invariance conventions and reporting: the state of the art and future directions for psychological research. Developmental Review, 41, 71–90.

Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477

Retnawati, H. (2017). Validitas dan reliabilitas konstruk skor tes kemampuan calon mahasiswa. Jurnal Ilmu Pendidikan, 23(2), 126–135.

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2015). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 1–16. https://doi.org/10.1080/00223891.2015.1089249

Schoot, V. ., & Lugtig, P. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492.

Setia Wati, S., Aldi, S., Islamia Az-Zahra, S., & Ramdan Yulia Saputra, M. (2023). Telaah kritis terhadap pemenuhan hak-hak korban penipuan jual beli online. In Jurnal Sosio-Komunika (Vol. 2, Issue 1). https://bit.ly/SurveyPenipuanOnline

Sumter, S. R., Valkenburg, P. M., Baumgartner, S. E., Peter, J., & Van Der Hof, S. (2015). Development and validation of the multidimensional offline and online peer victimization scale. Computers in Human Behavior, 46, 114–122. https://doi.org/10.1016/j.chb.2014.12.042

Topcu, Ç., & Erdur-Baker, Ö. (2010). The Revised Cyber Bullying Inventory (RCBI): Validity and reliability studies. Procedia Social and Behavioral Sciences, 5, 660–664. https://doi.org/10.1016/j.sbspro.2010.07.161

Tynes, B., & Giang, M. (2009). Online victimization, depression and anxiety among adolescents in the us. European Psychiatry, 24(S1). https://doi.org/10.1016/s0924-9338(09)70919-8

Tynes, B. M., Rose, C. A., & Williams, D. R. (2014). The development and validation of the online victimization scale for adolescents. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 4(June), 1–17.

Umar, J., & Nisa, Y. F. (2020). Uji validitas konstruk dengan CFA dan pelaporannya. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 9(2), 1–11. https://doi.org/10.15408/jp3i.v9i2.16964

van den Eijnden, R., Vermulst, A., van Rooij, A. J., Scholte, R., & van de Mheen, D. (2014). The bidirectional relationships between online victimization and psychosocial problems in adolescents: a comparison with real-life victimization. Journal of Youth and Adolescence, 43(5), 790–802. https://doi.org/10.1007/s10964-013-0003-9

Wang, C. (2022). Online dating scam victims psychological impact analysis. Journal of Education, Humanities and Social Sciences, 4, 149–154. https://doi.org/10.54097/ehss.v4i.2740

Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73(6), 913–934. https://doi.org/10.1177/0013164413495237

Yusuf, I., & Sartika, D. (2021). Pengaruh store image dan private label image serta perceived quality terhadap purchase intention produk private label alfamidi di kota samarinda. Borneo Student Research, 3(1), 847–886.

Zhu, C., Huang, S., Evans, R., & Zhang, W. (2021). Cyberbullying among adolescents and children: A comprehensive review of the global situation, risk factors, and preventive measures. Frontiers in Public Health, 9(March), 1–12. https://doi.org/10.3389/fpubh.2021.634909

Full Text: PDF

DOI: 10.15408/jp3i.v14i1.40554