Development and Validation of the Online Victimization Scale: Confirmatory Factor Analysis and Composite Reliability
DOI:
https://doi.org/10.15408/jp3i.v14i1.40554Keywords:
Confirmatory Factor Analysis, composite reliability, online victimization, adolescents and early adulthoodAbstract
Online victimization is harmful actions directed at individuals or institutions through digital technology. This study aims to develop, validate, and examine the psychometric properties of the Online Victimization Scale (OVS). The researchers constructed and adapted several items from the Online Victimization Scale (OVS) by Tynes et al. (2014) and the Perceived Online Racism Scale (PORS) by Keum (2021), resulting in 54 items that were translated into Indonesian. A quantitative research method was employed using an accidental sampling technique. Data were collected from 204 individuals aged 14-23 years who were active social media users. Data analysis was conducted using Confirmatory Factor Analysis (CFA)to evaluate the factor structure. Score reliability was assessed by calculating composite omega and stratified alpha values using the lavaan package in R. The results indicated high inter-factor correlations, prompting a second-order factor analysis. The first-order and second-order models demonstrated good model fit indices with no significant differences, resulting in a final scale of 16 items. Measurement invariance testing using multi-group CFA confirmed that the scale met the criteria for scalar invariance, as indicated by minimal changes in ΔCFI and ΔTLI (<0.01). These findings validate the equivalence of the factor structure, factor loadings, and item intercepts between male and female participants, ensuring that score differences reflect actual differences in the online victimization construct rather than measurement bias.
References
Álvarez-García, D., Núñez, J. C., Barreiro-Collazo, A., & García, T. (2017). Validation of the Cybervictimization Questionnaire (CYVIC) for adolescents. Computers in Human Behavior, 70, 270–281. https://doi.org/10.1016/j.chb.2017.01.007
Amin, N. F., Garancang, S., & Abunawas, K. (2023). Konsep Umum Populasi dan Sampel dalam Penelitian. Jurnal Pilar: Jurnal Kajian Islam Kontemporer, 14(1), 103–116.
Ampuni, S., & Buwono, S. B. S. (2022). Pengembangan dan Identifikasi Properti Psikometris Kuesioner Intensi Prososial Berbasis Skenario Untuk Anak dan Remaja. Jurnal Psikologi Sosial, 20(2), 154–172. https://doi.org/10.7454/jps.2022.18
Brown, T. A. (2015). Statistical Power and Sample Size. In T. D. Little (Ed.), Guilford Publications (second). Little The Guilford Press. https://doi.org/10.1201/9781315383286-21
Byrne, B. M. (2012). Testing the Factorial Validity of Scores From a Measuring Instrument First-Order Confirmatory Factor Analysis Model. In Taylor & Francis Group. Taylor & Francis Group.
Byrne, B. M. (2024). Structural Equation Modeling with EQS and EQS/Windows (Issue 024). Sage Publications, Inc. https://us.sagepub.com/en-us/nam/structural-equation-modeling-with-eqs-and-eqswindows/book4319
Çavuş, S. (2023). Negative Impacts of Technology and Digital Diseases. Handbook of Research on Perspectives on Society and Technology Addiction, 468–478. https://doi.org/10.4018/978-1-6684-8397-8.ch029
dos Santos, P. M., & Cirillo, M. Â. (2023). Construction of the Average Variance Extracted Index for Construct Validation in Structural Equation Models with Adaptive Regressions. Communications in Statistics: Simulation and Computation, 52(4), 1639–1650. https://doi.org/10.1080/03610918.2021.1888122
Elipe, P., Mora-Merchán, J. A., & Nacimiento, L. (2017). Development and Validation of an Instrument to Assess the Impact of Cyberbullying: The Cybervictimization Emotional Impact Scale. Cyberpsychology, Behavior, and Social Networking, 20(8), 479–485. https://doi.org/10.1089/cyber.2017.0069
Hapsari, R., Kesumayadi, I., Sari, D., Anjarwati, D. U., Alfiyuliani, N. H., Mujahidah, M., Sari, I. P., & Hadi, P. (2023). Comparison of SARS-CoV-2 Variant Screening and Whole Genome Sequencing at an Indonesian Tertiary Hospital. https://doi.org/10.14710/jbtr.v9i3.19147
Hu, L., & Bentler, P. M. (1999). Structural Equation Modeling : A Multidisciplinary Journal Cutoff Criteria for Fit Indexes in Covariance Structure Analysis : Conventional Criteria Versus New Alternatives. A Multidisciplinary Journal, July 2012, 1–55. https://doi.org/http://dx.doi.org/10.1080/10705519909540118
Iacobucci, D. (2010). Structural Equations Modeling: Fit Indices, Sample Size, and Advanced Topics. Journal of Consumer Psychology, 20(1), 90–98. https://doi.org/10.1016/j.jcps.2009.09.003
Keum, B. T. (2021). Computers in Human Behavior Reports Development and Validation of the Perceived Online Racism Scale short form ( 15 items ) and very brief ( six items ). Computers in Human Behavior Reports, 3. https://doi.org/10.1016/j.chbr.2021.100082
Kristiansen, S., & Jensen, A. V. (2023). Victimization in Online Gaming-Related Trade Scams: A Study Among Young Danes. Nordic Journal of Criminology, 24(2), 1–17. https://doi.org/10.18261/njc.24.2.6
Lam, L. W. (2012). Impact of Competitiveness on Salespeople ’s Commitment And Performance ☆. Journal of Business Research, 65(9), 1328–1334. https://doi.org/10.1016/j.jbusres.2011.10.026
Lee, Y., & Lai, C. (2021). The Pet Affection Scale Development , Validation and Influence on Consumers ’ Behavior of Pet Hotels. Mathematics, 9(15), 1–14. https://doi.org/https://doi.org/10.3390/math9151772
Montiel, I., Carbonell, E., & Pereda, N. (2016). Multiple online victimization of Spanish adolescents: Results from a community sample. Child Abuse and Neglect, 52, 123–134. https://doi.org/10.1016/j.chiabu.2015.12.005
Nedelec, M., Aloulou, A., Duforez, F., Meyer, T., & Dupont, G. (2018). The Variability of Sleep Among Elite Athletes. In Sports Medicine - Open (Vol. 4, Issue 1). Springer. https://doi.org/10.1186/s40798-018-0151-2
Permatasari, A. A. (2022). Cyberbullying sebagai Kekerasan Berbasis Gender Online: Dampak terhadap Remaja serta Peran Keluarga. Jurnal Wanita dan Keluarga, 3(1), 1–15. https://doi.org/10.22146/jwk.5201
Peterson, R. A., & Kim, Y. (2013). On The Relationship between Coefficient Alpha and Composite Reliability. Journal of Applied Psychology, 98(1), 194–198. https://doi.org/10.1037/a0030767
Retnawati, H. (2017). Validitas dan Reliabilitas Konstruk Skor Tes Kemampuan Calon Mahasiswa. Jurnal Ilmu Pendidikan, 23(2), 126–135.
San Miguel, C., Morales, K., & Antonius Ynalvez, M. (2020). Online Victimization, Social Media Utilization, and Cyber Crime Prevention Measures. In Asia-Pacific Social Science Review (Vol. 20).
Setia Wati, S., Aldi, S., Islamia Az-Zahra, S., & Ramdan Yulia Saputra, M. (2023). Telaah Kritis terhadap Pemenuhan Hak-Hak Korban Penipuan Jual Beli Online. In Jurnal Sosio-Komunika (Vol. 2, Issue 1).
Sumter, S. R., Valkenburg, P. M., Baumgartner, S. E., Peter, J., & Van Der Hof, S. (2015). Development and validation of the Multidimensional Offline and Online Peer Victimization Scale. Computers in Human Behavior, 46, 114–122. https://doi.org/10.1016/j.chb.2014.12.042
Topcu, Ç., & Erdur-Baker, Ö. (2010). The Revised Cyber Bullying Inventory (RCBI): Validity and reliability studies. Procedia - Social and Behavioral Sciences, 5, 660–664. https://doi.org/10.1016/j.sbspro.2010.07.161
Tynes, B., & Giang, M. (2009). Online Victimization, Depression and Anxiety Among Adolescents in the us. European Psychiatry, 24(S1). https://doi.org/10.1016/s0924-9338(09)70919-8
Tynes, B. M., Rose, C. A., & Williams, D. R. (2014). The Development and Validation of the Online Victimization Scale for Adolescents. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 4(June), 1–17. http://cyberpsychology.eu/view.php?cisloclanku=2010112901&article=1
van den Eijnden, R., Vermulst, A., van Rooij, A. J., Scholte, R., & van de Mheen, D. (2014). The Bidirectional Relationships Between Online Victimization and Psychosocial Problems in Adolescents: A Comparison with Real-Life Victimization. Journal of Youth and Adolescence, 43(5), 790–802. https://doi.org/10.1007/s10964-013-0003-9
Wang, C. (2022). Online Dating Scam Victims Psychological Impact Analysis. Journal of Education, Humanities and Social Sciences, 4, 149–154. https://doi.org/10.54097/ehss.v4i.2740
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educational and Psychological Measurement, 73(6), 913–934. https://doi.org/10.1177/0013164413495237
Yusuf, I., & Sartika, D. (2021). Pengaruh Store Image dan Private Label Image serta Perceived Quality Terhadap Purchase Intention Produk Private Label Alfamidi di Kota Samarinda. Borneo Student Research, 3(1), 847–886.
Zhu, C., Huang, S., Evans, R., & Zhang, W. (2021). Cyberbullying Among Adolescents and Children: A Comprehensive Review of the Global Situation, Risk Factors, and Preventive Measures. Frontiers in Public Health, 9(March), 1–12. https://doi.org/10.3389/fpubh.2021.634909
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Muhammad Dzuhri Muzayyin, Abdullah Azzam Al Afghani, Mela Minkhatul Maula
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
