Evaluating Psychometric Properties of the Stress Measurement Instrument  (the Operational and Organizational Police Stress Questionnaires) with the Application of Rasch Model in the Indonesian Nasional Police (INP)

Abi Risa Bayu Argo; Heri Yulianto; Dwi Nuryanto

Evaluating Psychometric Properties of the Stress Measurement Instrument (the Operational and Organizational Police Stress Questionnaires) with the Application of Rasch Model in the Indonesian Nasional Police (INP)

Abi Risa Bayu Argo, Heri Yulianto, Dwi Nuryanto

Abstract

Police Stress Questionnaire (PSQ) is a questionnaire developed by McCreary and Thompson (2006) to measure stress exercised by the police. The development of this questionnaire is based on the reason that the previous stress measuring instruments only measure general stressors and can’t describe specific stressors, especially in types of work that exert high level of stress. This study aims to evaluate the Police Stress Questionnaire (PSQ) instrument consists of two instruments, namely the Operational Police Stress Questionnaire (PSQ-Op) and the Organizational Police Stress Questionnaire (PSQ-Org), each containing 20 items with seven-point Likert scale for police officers in Indonesia. Respondents in this study were 313 police officers who served in the National Police Headquarters work unit (32.9%), Regional Police (38.3%), Resort Police (19.5%) and Sector Police (9.3%). The data collection technique used non-probability sampling with the help of the google form application. The method used is the Rating Scale Model (RSM). The results show that the Indonesian version of the Police Stressor Questionnaire (PSQ) is proven to meet unidimensional assumptions and the reliability analysis for person and items shows a strong level of reliability. However, the Rasch RSM analysis found violations of the assumption of local independence and problematic discrimination at specific thresholds (threshold disorder) in the seven response categories used. Furthermore, the results of the application of the Rasch Model Rating Scale model show that the psychometric facts of the two research instruments are very good and precise, as well as the suitability of the items to the model. Implications and suggestions for future research are also presented in the discussion.

Keywords

Rasch models; rating scale model; police stress questionnaire

References

Abidin, Z., Shahrul, A., & Isha, N. (2014). A psychometric properties of the Malay-version Police stress questionnaire. 42–50.

Adams, R. J., Wu, M. L., & Wilson, M. (2012). The Rasch rating model and the disordered threshold controversy. Educational and Psychological Measurement, 72(4), 547–573.

Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory: measuring in the educational, social and health sciences. Springer Singapore

Aulya, D. (2013). Faktor-faktor yang berhubungan dengan stres kerja pada polisi lalu lintas di Polres Metro Jakarta Pusat Bulan April – Agustus 2013. Skripsi. Jakarta: FKM UIN.

Aziz, M. A. (2020). Uji klinis tingkat stres personil Polri: pengaruh hormon stres terhadap halitosis yang disebabkan bakteri patogen periodontal pada anggota Korps Brimob Polri. Jurnal Litbang Polri, 23(1), 1–20.

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. 3186–3191.

Bond, T., & Fox, C. (2015). Applying the Rasch model: fundamental measurement in the human sciences (3rd ed.). Mahwah, NJ: Lawrence Erblaum & Associates.

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: fundamental measurement in the human sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum

Cheung, K. C., & Mooi, L. C. (1994). A comparison between the rating scale model and dual scaling for likert scales. Applied Psychological Measurement, 18(1), 1–13.

DeMars, C. E. (2003). Detecting multidimensionality due to curricular differences. Journal of Educational Measurement, 40(1), 29–51.

DiStefano, C., Greer, F. W., Kamphaus, R. W., & Brown, W. H. (2014). Using Rasch rating scale methodology to examine a behavioral screener for preschoolers at risk. Journal of Early Intervention, 36(3), 192–211.

DiStefano, C., & Morgan, G. B. (2010). Evaluation of the BESS TRS-CA using the Rasch rating scale model. School Psychology Quarterly, 25(4), 202–212.

Deviana, T., Hayat, B., & Suryadi, B. (2020). Validasi instrumen social provision scale pada siswa Sekolah Menengah Atas: studi dengan penerapan Rasch model. Indonesian Journal of Educational Assessment,3(1), 1-15.

Duncan, P. W., Bode, R. K., Min Lai, S., Perera, S. (2003). Rasch analysis of a new stroke-specific outcome scale: the stroke impact scale. Archives of Physical Medicine and Rehabilitation, 84 (7), 950-963.

Eckes, T. (2011). Item banking for C-tests: A polytomous Rasch modeling approach. Psychological Test and Assessment Modeling, 53, 414–439.

Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. L. Erlbaum Associates.

Geldenhuys, M., & Bosch, A. (2019). A Rasch adapted version of the 30-item bem sex role inventory (BSRI). Journal of Personality Assessment, 1–12. https://doi.org/10.1080/00223891.2018.1527343

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. SAGE.

Hayati, U. (2019). Pengaruh stres kerja terhadap kesejahteraan subjektif yang dimediasi oleh resiliensi pada polisi reserse kriminal di kepolisian daerah Jawa Barat (Doctoral Dissertation, Universitas Pendidikan Indonesia).

Hellman, C. M. (1997). Job satisfaction and intent to leave. Journal of Social Psychology, 137, 677– 689.

Hidayati, R., Purwanto, Y., & Yuwono, S. (2011). Kecerdasan emosi, stres kerja dan kinerja karyawan. Jurnal Psikologi, 2(1).

Holt, R. R. (1993). Occupational stress. In L. Goldberger & S. Breznitz (Eds.), Handbook of stress: Theoretical and clinical aspects (2nd ed.) (pp. 342–367). New York: Free Press.

Houghton, S., Wood, L., Marais, I., Rosenberg, M., Ferguson, R., & Pettigrew, S. (2017). Positive mental well-being: a validation of a Rasch-derived version of the warwick-edinburgh mental well-being scale. Assessment, 24(3), 371–386. https://doi.org/10.1177/1073191115609995

Jayanegara. (2007). Stres kerja dan coping pada Polisi Indonesia. Jakarta: Fakultas Psikologi Universitas Indonesia.

Kunz, S., Fellinghauer, C., & Peter, C. (2019). Measuring posttraumatic growth and depreciation after spinal cord injury: A Rasch analysis. Rehabilitation Psychology, 64(4), 407–424. https://doi.org/10.1037/rep0000288

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping (11. [print.]). Springer.

Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3(2), 103–122.

Linacre, J. M. (2004). Rasch model estimation: further topics. Journal of Applied Measurement, 5 (1), 95–110.

Linacre, John M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3 (1), 85–106.

Linacre, John M. (2010). Predicting responses from Rasch measures. 11 (1), 1–10.

Linacre, John M, & Wright, B. D. (2019). A user’s guide to BIGSTEPS: Rasch-model computer program. Mesa Press.

McCreary, D. R., & Thompson, M. M. (2006). Development of two reliable and valid measures of stressors in policing: The operational and organizational police stress questionnaires. International Journal of Stress Management, 13(4), 494–518. https://doi.org/10.1037/1072-5245.13.4.494

Meijer, R. R., Sijtsma, K., & Smid, N. G. (1990). Theoretical and empirical comparison of the mokken and the Rasch approach to IRT. Applied Psychological Measurement, 14(3), 283–298. https://doi.org/10.1177/014662169001400306

Muhammad, A.N. (2004). Gambaran hubungan faktor-faktor dengan stres kerja pada polisi lalu lintas di kawasan terminal Kampung Melayu Jakarta 2004. Skripsi. Jakarta: FKM UI.

Muraki, E. (1990). Fitting a polytomous item response model to likert-type data. Applied Psychological Measurement, 14(1), 59–71. https://doi.org/10.1177/014662169001400106

Nikam, P.K. & Shaikh, M. (2014). Occupational stress, burnout and coping in police personel: finding from a systematic review. American InternationalJournal of Research in Humanities, Arts and Social Scienes. ISSN (Print): 2328-3734

Pichardo, M. C., Cano, F., Garzón-Umerenkova, A., de la Fuente, J., Peralta-Sánchez, F. J., & Amate-Romera, J. (2018). Self-regulation questionnaire (SRQ) in Spanish adolescents: factor structure and Rasch analysis. Frontiers in Psychology, 9, 1370. https://doi.org/10.3389/fpsyg.2018.01370

Purda, Valeria, N., Liliana, & Amelia. (2012). Burnout – an effect of professional stress in the police environment. International Conference on Economics, Trade and Development IPEDR, vol.36.

Queiros, C., Kaiseller, M & Da Silva, A.N. (2013). Burnout as predictor of aggressivity among police officer. European Journal of Policing Studis, 1 (2), 110-135. ISSN 2034-760

Rahayu, W., Putra, M. D. K., Iriyadi, D., Rahmawati, Y., & Koul, R.K. (2020). A Rasch and factor analysis of an Indonesia version of the student perception of opportunity competence development (SPOCD) questionnaire. Cogent Education, 7

Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: results and implications. Journal of Educational Statistics, 4(3), 207–230.

Retnawati, H. (2017). Validitas reliabilitas & karakteristik butir. Yogyakarta: Parama Publishing.

Robbins, S. P. (2004). Teori organisasi, struktur, desain, dan aplikasi. (Alih bahasa: tim indeks). New Jersey: Prentice Hall.

Rost, J. (2001). The growing family of Rasch models. In essays on item response theory. Springer - Verlag New York.

Spector, P. E. (1997). Job satisfaction: Application, assessment, causes, and consequences. Thousand Oaks, CA: Sage.

Tennant, A., & Conaghan, P. G. (2007). The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis & Rheumatism, 57(8), 1358–1362. https://doi.org/10.1002/art.23108

Tett, R. P. & Meyer, J. P. (1993). Job satisfaction, organizational commitment, turnover intention, and turnover: Path analyses based on meta-analytic findings. Personnel Psychology, 46, 259 –293.

Wakita, T., Ueshima, N., & Noguchi, H. (2012). Psychological distance between categories in the likert scale: comparing different numbers of options. Educational and Psychological Measurement, 72(4), 533–546. https://doi.org/10.1177/0013164411431162

Wright, B. D., & Mok, M. M. C. (2004). An overview of the family of Rasch measurement models. Introduction to Rasch Measurement, 1–24.

Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: MESA Press.

Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8(2), 125–145

Yulianto, H. (2020). Maslach burnout inventory-human services survey (MBI-HSS) versi bahasa Indonesia: studi validasi konstruk pada anggota Polisi. JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia), 9(1), 19-29.

Full Text: PDF

DOI: 10.15408/jp3i.v10i1.17557