UWES-17 in the Indonesian context: Rasch analysis

Abdul Rahman Shaleh; Bahrul Hayat; Arung Samudera

UWES-17 in the Indonesian context: Rasch analysis

Abdul Rahman Shaleh, Bahrul Hayat, Arung Samudera

Abstract

Work engagement is a positive psychology construct widely sought after and developed in various countries. Psychometric validation requires statistical analysis to measure and differentiate individuals across different cultures. This study aims to validate the Utrecht Work Engagement Scale-17 (UWES-17) instrument on hospitality workers in state-owned companies in Indonesia. The study sample comprised 1,638 individuals, representing various positions and types of hospitality service jobs within the land transportation sector of a state-owned enterprise. A non-probability sampling approach, specifically convenience sampling, was employed, selecting participants based on their accessibility and willingness to participate. The participants, aged between 18 and 62, came from diverse fields and work areas. Analysis of item responses in the test was the Rasch Model with a study focus on item fit and person fit from the UWES-17 Scale. In addition, assumption tests of unidimensionality and local independence were performed to ensure the validity of the measurement model. The scale’s reliability was also assessed to evaluate the instrument’s consistency. The results showed that the items were overall fit, but the criteria for person fit were unmet. This is due to the tendency for uniformity and too many diverse positions and cultural tendencies of state-owned companies. The implication is that further item development and confirmation are needed on the constituent aspects, especially the absorption constituent items. Additionally, developing a more consistent shorter version or discovering other dimensions of work engagement that are specific to collectivist societies may be possible.

Keywords

Rasch Model, Work Engagement, UWES, Indonesian Context

References

Abun, D., Menor, R. I., Catabagan, N. C., Magallanes, T., & Ranay, F. B. (2021). Organizational climate and work engagement of employees of divine word colleges in Ilocos Region, Philippines. International Journal of Research in Business and Social Science (2147- 4478), 10(1), 107–121. https://doi.org/10.20525/ijrbs.v10i1.1017

Adams, E. S. (2005). Bayesian analysis of linear dominance hierarchies. Animal Behaviour, 69(5), 1191–1201. https://doi.org/10.1016/j.anbehav.2004.08.011

Adanaqué-Bravo, I., Escobar-Segovia, K., Gómez-Salgado, J., García-Iglesias, J. J., Fagundo-Rivera, J., & Ruiz-Frutos, C. (2023). Relationship Between Psychological Distress, Burnout and Work Engagement in Workers During the COVID-19 Pandemic: A Systematic Review. International Journal of Public Health, 67(January), 1–11. https://doi.org/10.3389/ijph.2022.1605605

Albrecht, S. L., Bakker, A. B., Gruman, J. A., Macey, W. H., & Saks, A. M. (2015). Employee engagement, human resource management practices and competitive advantage: An integrated approach. Journal of Organizational Effectiveness, 2(1), 7–35. https://doi.org/10.1108/JOEPP-08-2014-0042

Aman, A., Rafiq, M., & Dastane, O. (2023). A cross-cultural comparison of work engagement in the relationships between trust climate – Job performance and turnover intention: Focusing China and Pakistan. Heliyon, 9(9), e19534. https://doi.org/10.1016/j.heliyon.2023.e19534

Anasori, E., Soliman, M., & Costa, C. (2023). Workplace bullying, psychological distress, and work engagement in the hospitality industry: The moderating effect of self-compassion. European Journal of Tourism Research, 35, 1–18. https://doi.org/10.54055/ejtr.v35i.3056

Andrich, D. (2018). Controlling response dependence in the measurement of change using the Rasch model. Statistical Methods in Medical Research, 27(12), 3709–3725. https://doi.org/10.1177/0962280217710834

Asparouhov, T., & Muthén, B. (2021). Bayesian analysis of latent variable models using Mplus. 1–5. https://www.statmodel.com/download/BayesAdvantages18.pdf

Ayala, R. J. de. (2009). Reviewed Work(s): Handbook of Statistics , Volume 26 : Psychometrics by C . R . Rao and Sandip Sinharay. Journal of the American Statistical Association, 104(487), https://www.jstor.org/stable/40592308

Bakker, A. B., & Schaufeli, W. B. (2008). Positive organizational behavior: Engaged employees in flourishing organizations. Journal of Organizational Behavior, 29(2), 147–154. https://doi.org/10.1002/job.515

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine, 25(24), 3186–3191. https://doi.org/10.1080/000163599428823

Cameron, K. S. (2003). Organizational virtuousness and performance. In Positive organizational scholarship. precisionmi.com. http://precisionmi.com/Materials/UniveralVirtuesMat/org_virtuousness_and_performance.pdf

Cameron, K. S., Dutton, J. E., & Quinn, R. E. (2003). An introduction to positive organizational scholarship. In Positive Organizational Scholarship. https://arwana007.wordpress.com/wp-content/uploads/2013/11/positive-organizational-scholarship.pdf

Choi, M., Suh, C., Choi, S. P., Lee, C. K., & Son, B. C. (2020). Validation of the work engagement scale-3, used in the 5th Korean working conditions survey. Annals of Occupational and Environmental Medicine, 32(1), 1–10. https://doi.org/10.35371/AOEM.2020.32.E27

Chou, Y. T., & Wang, W. C. (2010). Checking dimensionality in item response models with principal component analysis on standardized residuals. Educational and Psychological Measurement, 70(5), 717–731. https://doi.org/10.1177/0013164410379322

Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations. Applied Psychological Measurement, 41(3), 178–194. https://doi.org/10.1177/0146621616677520

Courville, T. G. (2004). An empirical comparison of item response theory and classical test theory item/person statistics. Dissertation, August.

de Bruin, G. P., Hill, C., Henn, C. M., & Muller, K. P. (2013). Dimensionality of the UWES-17: An item response modelling analysis. SA Journal of Industrial Psychology, 39(2 SPL), 1–8. https://doi.org/10.4102/sajip.v39i2.1148

Distefano, C., Liu, J., & Greer, F. (2017). Theory Methods : Examinations With a Teacher-Rating Scale.

Elghadi, A. M. O., Kassim, M. S., & Jusoh, A. (2024). Employee Engagement in the Malaysian Public Sector: the Moderating Effect of Job Demands on the Relationship Between Employee Participation, Employee Motivation, and Self-Efficacy. International Journal of Business and Society, 25(1), 180–200. https://doi.org/10.33736/ijbs.6906.2024

Erguven, M. (2013). Two approaches in psychometric process: Classical test theory & item response theory. Journal of Education, 2(2), 23–30.

Fahrizal, I., Santoso, B., & Budiono, A. (2023). Unlocking Work Engagement: How Leadership and Total Rewards Impact Employee Work Engagement Through the Mediating Role of Service Climate in Supply Chain and Logistic Company in Indonesia. Jurnal Pamator : Jurnal Ilmiah Universitas Trunojoyo, 16(2), 328–349. https://doi.org/10.21107/pamator.v16i2.19791

Farajat, J., & Salah, A. A. (2023). Effect of positive organizational behavior on subjective well-being in the workplace in the tourism sector of Jordan. Problems and Perspectives in Management, 21(3), 736–752. https://doi.org/10.21511/ppm.21(3).2023.57

Gleeson, J., Cutler, B., Rickinson, M., Walsh, L., Ehrich, J., Cirkony, C., & Salisbury, M. (2023). School educators’ engagement with research: an Australian Rasch validation study. Educational Assessment, Evaluation and Accountability, 35(2), 281–307. https://doi.org/10.1007/s11092-023-09404-7

Guest, D. (2014). Employee engagement: a sceptical analysis. Journal of Organizational Effectiveness, 1(2), 141–156. https://doi.org/10.1108/JOEPP-04-2014-0017

Gwamanda, N., Mahembe, B., & Jano, R. (2024). The psychometric properties of the Utrecht Work Engagement Scale on a Zimbabwean population. SA Journal of Human Resource Management/SA Tydskrif Vir Menslikehulpbronbestuur, 22(0), a2492. https://doi.org/10.1002/joe.22295

Helmi, A. F., Widhiarso, W., Marvianto, R. D., Priwati, A. R., Mustari, M. A., & Artikasari, Y. V. (2020). The Fourth Dimensions of the Job Demands-Resources (JD-R) Model of Work Engagement in Indonesian Context. Jurnal Psikologi, 47(3), 206. https://doi.org/10.22146/jpsi.56682

Holster, T. A., & Lake, J. (2016). Guessing and the Rasch Model. Language Assessment Quarterly, 13(2), 124–141. https://doi.org/10.1080/15434303.2016.1160096

Imanina, A. S., Rafiqana, N. M., & Hariani, M. (2024). Analysing the influence of work-life balance on work with a qualitative approach PT Kereta Api Indonesia. 2(2006), 55–58.

Jafari, F., Salari, N., Hosseinian-Far, A., Abdi, A., & Ezatizadeh, N. (2021). Predicting positive organizational behavior based on structural and psychological empowerment among nurses. Cost Effectiveness and Resource Allocation, 19(1), 1–9. https://doi.org/10.1186/s12962-021-00289-1

Kanjanakan, P., Zhu, D., Doan, T., & Kim, P. B. (2023). Taking Stock: A Meta-Analysis of Work Engagement in the Hospitality and Tourism Context. Journal of Hospitality and Tourism Research, 47(5), 851–876. https://doi.org/10.1177/10963480211066958

Kristiana, I. F., Fajrianthi, F., & Purwono, U. (2019). Analisis Rasch Dalam Utrecht Work Engagement Scale-9 (Uwes-9) Versi Bahasa Indonesia. Jurnal Psikologi, 17(2), 204. https://doi.org/10.14710/jp.17.2.204-217

Kulikowski, K. (2017). Do we all agree on how to measure work engagement? Factorial validity of Utrecht Work Engagement Scale as a standard measurement tool - A literature review. International Journal of Occupational Medicine and Environmental Health, 30(2), 161–175. https://doi.org/10.13075/ijomeh.1896.00947

Lee, Y., Song, J. H., & Kim, S. J. (2021). Validation study of the Korean version of decent work scale. European Journal of Training and Development, 47(1), 43–57. https://doi.org/10.1108/EJTD-03-2021-0040

Leiter, M. P., & Maslach, C. (2003). Areas of Worklife: a Structured Approach To Organizational Predictors of Job Burnout. Research in Occupational Stress and Well Being, 3(03), 91–134. https://doi.org/10.1016/S1479-3555(03)03003-8

Linacre, J. M. (2002). Understanding Rasch measurement: Optimizing Rating Scale Category Effectiveness. Journal of Applied Measurement, 3(1), 85–106. https://pubmed.ncbi.nlm.nih.gov/11997586/

Linacre, J. M. (2011). Winsteps Help for Rasch Analysis. http://homes.jcu.edu.au/~edtgb/%5Cnpapers3://publication/uuid/D56B724A-62FF-4D00-84E1-ECC888298B70

Linley, A. P., Joseph, S., Harrington, S., & Wood, A. M. (2006). Positive psychology: Past, present, and (possible) future. Journal of Positive Psychology, 1(1), 3–16. https://doi.org/10.1080/17439760500372796

Luthans, F. (2002). The need for and meaning of positive organizational behavior. Journal of Organizational Behavior, 23(6), 695–706. https://doi.org/10.1002/job.165

Luthans, F., & Avolio, B. J. (2009). The “point” of positive organizational behavior. Journal of Organizational Behavior: The …. https://doi.org/10.1002/job.589

Macey, W. H., & Schneider, B. (2008). Engaged in Engagement: We Are Delighted We Did It. Industrial and Organizational Psychology, 1(1), 76–83. https://doi.org/10.1111/j.1754-9434.2007.00016.x

Maslach, C. (2003). Job Burnout: New Directions in Research and Intervention. Current Directions in Psychological Science, 12(5), 189–192. https://doi.org/10.1111/1467-8721.01258

Maslach, C. (2016). Understanding the burnout experience: Recent research and its implications for psychiatry. World Psychiatry, 15(2), 103–111. https://doi.org/10.1002/wps.20311

Mead, R. (2008). A Rasch Primer: The Measurement Theory of Georg Rasch. Psychometric Services Research Memorandum, March. http://www.edmeasurement.net/8226/Mead-2008-Rasch-primer.pdf

Meena, A. R., & Batra, G. (2022). Impact of Positive Organizational Behaviour on Job Satisfaction. Editorial Board, July. https://fimt-ggsipu.org/pdf/Educator-Multidiscilinary-Journal.pdf#page=18

Mundy, M. E. (2003). Faculty engagement in service-learning: individual & organizational factors at distinct institutional types. Graduate School of Vanderbilt University.

Oliveira, S., Carvalho, C., Pinto, A., de Moura, R. C., & Santos-Costa, P. (2023). Emotional labor, occupational identity and work engagement in Portuguese police officers. International Journal of Human Resource Management, 34(4), 768–804. https://doi.org/10.1080/09585192.2022.2162345

Rahman, R. A., Pasaribu, F., Khair, H., & Tirtayasa, S. (2023). The Influence Of Talent Management And Knowledge Management On Employee Performance With Employee Engagement As The Intervening Variable On Pt Kereta Api Indonesia (Persero) Division Regional I Sumut. Jurnal Ekonomi, 12(04), 1–11. http://ejournal.seaninstitute.or.id/index.php/Ekonomi

Rahman, U. U., Rehman, C. A., Imran, M. K., & Aslam, U. (2017). Does team orientation matter? Linking work engagement and relational psychological contract with performance. Journal of Management Development, 36(9), 1102–1113. https://doi.org/10.1108/jmd-10-2016-0204

Reeves, T. D., & Marbach-Ad, G. (2016). Contemporary test validity in theory and practice: A primer for discipline-based education researchers. CBE Life Sciences Education, 15(1), 1–9. https://doi.org/10.1187/cbe.15-08-0183

Rothmann, S. (2017). Employee Engagement. In The Wiley Blackwell Handbook of the Psychology of Positivity and Strengths-Based Approaches at Work, First Edition. Edited Employee Engagement. https://doi.org/10.1002/9781118977620.ch1

Saks, A. M. (2006). Antecedents and consequences of employee engagement. Journal of Managerial Psychology, 21(7), 600–619. https://doi.org/10.1108/02683940610690169

Saks, A. M., Gruman, J. A., & Zhang, Q. (2022). Organization engagement: a review and comparison to job engagement. Journal of Organizational Effectiveness, 9(1), 20–49. https://doi.org/10.1108/JOEPP-12-2020-0253

Sasmoko, Abbas, B. S., Indrianti, Y., & Widhoyoko, S. A. (2018). Indonesian teacher engagement index: A rasch model analysis. IOP Conference Series: Materials Science and Engineering, 296(1), 1–8. https://doi.org/10.1088/1757-899X/296/1/012027

Schaufeli, W. B. (2019). An ultra-short measure for work engagement: The UWES-3 validation across five countries. European Journal of Psychological Assessment, 35(4), 577–591. https://doi.org/10.1027/1015-5759/a000430

Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006). The measurement of work engagement with a short questionnaire: A cross-national study. Educational and Psychological Measurement, 66(4), 701–716. https://doi.org/10.1177/0013164405282471

Schaufeli, W. B., & Salanova, M. (2010). How to improve work engagement? In Handbook of Employee Engagement: Perspectives, Issues, Research and Practice (pp. 399–415). https://doi.org/10.4337/9781849806374.00044

Schaufeli, W., & Salanova, M. (2011). Work engagement: On how to better catch a slippery concept. European Journal of Work and Organizational Psychology, 20(1), 39–46. https://doi.org/10.1080/1359432X.2010.515981

Seppälä, P., Mauno, S., Feldt, T., Hakanen, J., Kinnunen, U., Tolvanen, A., & Schaufeli, W. (2009). The construct validity of the Utrecht Work Engagement Scale: Multisample and longitudinal evidence. Journal of Happiness Studies, 10(4), 459–481. https://doi.org/10.1007/s10902-008-9100-y

Shaleh, A. R. (2016). Analisis Faktor Skala Totalitas Kerja (Work Engagement). Seminar Asean 2nd Psychology & Humanity, 12–17.

Shimazu, A., Schaufeli, W. B., Kosugi, S., Suzuki, A., Nashiwa, H., Kato, A., Sakamoto, M., Irimajiri, H., Amano, S., Hirohata, K., Goto, R., & Kitaoka-Higashiguchi, K. (2008). Work engagement in Japan: Validation of the Japanese version of the utrecht work engagement scale. Applied Psychology, 57(3), 510–523. https://doi.org/10.1111/j.1464-0597.2008.00333.x

Sidharta, I. (2018). Validation on Utrecht Work Engagement Scale: Multisample and Multi Sectors Analysis. Kontigensi : Jurnal Ilmiah Manajemen, 6(2), 49–58. https://doi.org/10.56457/jimk.v6i2.53

Snyder, C. R., & Lopez, S. J. (2023). The Future of Positive Psychology; A Declaration of Independence. Handbook of Positive Psychology, 751–767. https://doi.org/10.1093/oso/9780195135336.003.0055

Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274. https://doi.org/10.1111/j.1365-2753.2010.01434.x

Tatha, O., Shimazu, A., Watanabe, K., Kawakami, N., & Schaufeli, W. B. (2024). Measuring work engagement in Thailand: development and validation testing of the Utrecht Work Engagement Scale-Thai version (UWES-TH). Industrial Health, 62(3), 182–194. https://doi.org/10.2486/indhealth.2023-0017

Umar, J., & Nisa, Y. F. (2020). Uji Validitas Konstruk dengan CFA dan Pelaporannya. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 9(2), 1–11. https://doi.org/10.15408/jp3i.v9i2.16964

van de Vijver, F. J. R., & Leung, K. (2021). Methods and Data Analysis for Cross-Cultural Research. Methods and Data Analysis for Cross-Cultural Research. https://doi.org/10.1017/9781107415188

Van der Colff, J. J., & Rothmann, S. (2009). Occupational stress, sense of coherence, coping, burnout and work engagement of registered nurses in South Africa. SA Journal of Industrial Psychology, 35(1), 1–10. https://doi.org/10.4102/sajip.v35i1.423

Walker, C. M. (2011). What’s the DIF? why differential item functioning analyses are an important part of instrument development and validation. Journal of Psychoeducational Assessment, 29(4), 364–376. https://doi.org/10.1177/0734282911406666

Wang, W. C., & Willson, M. (2005). Exploring local item dependence using a random-effects facet model. Applied Psychological Measurement, 29(4), 296–318. https://doi.org/10.1177/0146621605276281

Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: Mesa Press.

Yaz, A. H., & Cemaloğlu, N. (2024). Tendencies of the doctoral theses on work engagement in Türkiye: a content analysis study. Eximia Journal, 13, 510–525. https://doi.org/10.47577/eximia.v13i1.481

Yen, W. M. (1984). Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model. Applied Psychological Measurement, 8(2), 125–145. https://doi.org/10.1177/014662168400800201

Yen, W. M. (1993). Scaling Performance Assessments: Strategies for Managing Local Item Dependence. Journal of Educational Measurement, 30(3), 187–213. https://doi.org/10.1111/j.1745-3984.1993.tb00423.x

Zahari, N., & Kaliannan, M. (2023). Antecedents of Work Engagement in the Public Sector: A Systematic Literature Review. Review of Public Personnel Administration, 43(3), 557–582. https://doi.org/10.1177/0734371X221106792

Full Text: PDF

DOI: 10.15408/jp3i.v14i1.46003