Psychometric Properties of Indonesian Job-related Affective Well-being Scale: Examining Factor Structure Through CFA and ESEM
DOI:
https://doi.org/10.15408/jp3i.v15i1.47083Keywords:
exploratory structural equation modelling, job-related affective well-being scale, psychometric validation, Indonesian workersAbstract
Job Affective Well-Being Scale (JAWS) is a psychological instrument used to measure emotional conditions in the context of work. However, research on the psychometric properties of JAWS in the Indonesian context remains limited. This study aims to test the construct validity of JAWS among 410 Indonesian workers (mean = 34.98; SD = 9.51) using a competing models strategy. This study compares three approaches: Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modelling (ESEM), and Set-ESEM. The results of the model comparison analysis indicated that the Modified 4-Factor Set-ESEM model was the best, balancing statistical accuracy and parsimony and accommodating natural cross-loadings among items within the same valence. The evaluation of measurement invariance across genders confirmed the instrument's stability at the configurational and metric levels, as well as partial scalar invariance. The final JAWS Indonesian version model with the Set-ESEM model shows that this instrument is valid, reliable, and fair in measuring affective well-being at work, and supports its use for research and organisational intervention purposes in Indonesia.
References
Alamer, A. (2022). Exploratory structural equation modeling (ESEM) and bifactor ESEM for construct validation purposes: Guidelines and applied example. Research Methods in Applied Linguistics, 1(1). https://doi.org/10.1016/j.rmal.2022.100005
Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural equation modeling: a multidisciplinary journal, 16(3), 397-438.https://doi.org/10.1080/10705510903008204
Barrett, L. F. (2006). Are Emotions Natural Kinds? Perspectives on Psychological Science, 1(1), 28–58. https://doi.org/10.1111/j.1745-6916.2006.00003.x
Barrett, L. F. (2017). How emotions are made: The secret life of the brain. In How emotions are made: The secret life of the brain. https://jyotsnabooks.files.wordpress.com/2017/12/how-emotions-are-made-the-secret-life-of-the-brain.pdf
Basińska, B. A., Gruszczyńska, E. W. A., & Schaufeli, W. B. (2014). Psychometric properties of the polish version of the job-related affective well-being scale. International Journal of Occupational Medicine and Environmental Health, 27(6), 993–1004.https://doi.org/10.2478/s13382-014-0329-x
Bentler, P. M., & Chou, C.-P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16(1), 78–117.https://doi.org/10.1177/0049124187016001004
Biggs, A., Brough, P., & Drummond, S. (2017). Lazarus and Folkman’s Psychological Stress and Coping Theory. In Cary L. Cooper & James Campbell Quick (Eds.), The Handbook of Stress and Health: A Guide to Research and Practice, First Edition. Wiley Online Library. https://doi.org/https://doi.org/10.1002/9781118993811.ch21
Blais, A. R., Gillet, N., Houle, S. A., Comeau, C. A., & Morin, A. J. (2020). Work fatigue profiles: Nature, implications, and associations with psychological empowerment. Frontiers in Psychology, 11, 596206. https://doi.org/10.3389/fpsyg.2020.596206
Brief, A. P., Burke, M. J., George, J. M., Robinson, B. S., & Webster, J. (1988). Should negative affectivity remain an unmeasured variable in the study of job stress?. Journal of applied psychology, 73(2), 193. DOI : 10.1037/0021-9010.73.2.193
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). Guilford Press.
Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
Byrne, B.M. (2016). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming (3rd ed.). New York: Routledge.
Caldwell, J. A., Caldwell, J. L., Thompson, L. A., & Lieberman, H. R. (2019). Fatigue and its management in the workplace. Neuroscience & Biobehavioral Reviews, 96, 272-289. https://doi.org/10.1016/j.neubiorev.2018.10.024
Carneiro, L. L., & Bastos, A. V. B. (2023). Well-being at work scale (WBWS): Gathering empirical evidence from different interpretation strategies. Quaderns de Psicologia, 25(1), 3. https://doi.org/10.5565/rev/qpsicologia.1729
Chaplin, T. M. (2015). Gender and emotion expression: A developmental contextual perspective. Emotion Review, 7(1), 14–21. https://doi.org/10.1177/1754073914544408.Gender
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783. https://doi.org/10.1007/s10490-023-09871-y
Datar, R. S. (2022). A Study of the Impact of Positive and Negative Emotions at Work Place. International Journal of Innovative Science and Research Technology, 7(4), 1025–1028. https://doi.org/https://doi.org/10.5281/zenodo.6558690
Deng, Y., Chang, L., Yang, M., Huo, M., & Zhou, R. (2016). Gender differences in emotional response: Inconsistency between experience and expressivity. PLoS ONE, 11(6), 1–12. https://doi.org/10.1371/journal.pone.0158666
Ding, L., Velicer, W. F., & Harlow, L. L. (1995). Effects of Estimation Methods, Number of Indicators per Factor, and Improper Solutions on Structural Equation Modeling Fit Indices. Structural Equation Modeling: A Multidisciplinary Journal, 2(2), 119–143. https://doi.org/10.1080/10705519509540000
Epstein, J., Osborne, R. H., Elsworth, G. R., Beaton, D. E., & Guillemin, F. (2015). Cross-cultural adaptation of the Health Education Impact Questionnaire: Experimental study showed expert committee, not back-translation, added value. Journal of Clinical Epidemiology, 68(4), 360–369. https://doi.org/10.1016/j.jclinepi.2013.07.013
Fox, S., Spector, P. E., Goh, A., Bruursema, K., & Kessler, S. R. (2012). The deviant citizen: Measuring potential positive relations between counterproductive work behaviour and organisational citizenship behaviour. Journal of Occupational and Organizational Psychology, 85(1), 199–220. https://doi.org/10.1111/j.2044-8325.2011.02032.x
Frone, M. R., & Tidwell, M.-C. O. (2015). The meaning and measurement of work fatigue: Development and evaluation of the Three-Dimensional Work Fatigue Inventory (3D-WFI). Journal of Occupational Health Psychology, 20(3), 273–288. https://doi.org/10.1037/a0038700
Gong, X., Wong, N., & Wang, D. (2018). Are Gender Differences in Emotion Culturally Universal? Comparison of Emotional Intensity Between Chinese and German Samples. Journal of Cross-Cultural Psychology, 49(6), 993–1005. https://doi.org/10.1177/0022022118768434
Hadadian, Z., & Sayadpour, Z. (2018). Relationship between Toxic Leadership and Job Related Affective Well-Being: The Mediating Role of Job Stress. European Online Journal of Natural and Social Sciences, 7(1). https://doi.org/https://european-science.com/eojnss_proc/article/view/5398
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2020). Multivariate Data Analysis (8th Edition).
Hamzah, H., & Nordin, N. S. (2022). Perceived Supervisor Support and Work Engagement: Mediating Role of Job-Related Affective Well-Being. Pakistan Journal of Psychological Research, 37(2), 149–164. https://doi.org/10.33824/PJPR.2022.37.2.10
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment a functional approach to concepts and methods. Psychological Assesment, 7(3), 238–247. https://doi.org/10.1037/1040-3590.7.3.238
Heuvel, M. van den, Demerouti, E., & Peeters, M. C. W. (2015). The job crafting intervention: Effects on job resources, self-efficacy, and affective well-being. Journal of Occupational and Organisational Psychology, 88(3), 511–532. https://doi.org/10.1111/joop.12128
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
International Test Commission. (2017). ITC Guidelines for Translating and Adapting Tests (Second Edition). https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdf
Jabid, A., Fahri, J., Buamonabot, I., & Arilaha, M. (2019, June 5). Relationship Between Job Satisfaction and Positive Affect on Turnover Intention (Study in Non-Bank Financing Institutions in Ternate City, Indonesia. 4th International Conference on Accounting, Management, and Economics. https://doi.org/10.4108/eai.25-10-2019.2295316
Jo, D., & Koh, C. K. (2023). Perceived hazardous physical work environments and job-related affective well-being of navy officers aboard the Republic of Korea Navy ships and submarines in South Korea. BMJ Military Health, 169(1 e), E29–E33. https://doi.org/10.1136/bmjmilitary-2020-001702
Kacimi, Y., & Adda, M. (2024). From signals to emotion: affective state classification through Valence and arousal. Procedia Computer Science, 251, 358-365. https://doi.org/10.1016/j.procs.2024.11.121
Khairana, S., Priatna, S. F., & Emilisa, N. (2024). Employee Engagement Sebagai Mediator Positive Emotions dan Exhaustion Terhadap Intention To Stay. Solusi, 22(4), 480–498. https://doi.org/10.26623/slsi.v22i4.9581
Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford publications.
Krasikova, D. V., Green, S. G., & LeBreton, J. M. (2013). Destructive Leadership: A Theoretical Review, Integration, and Future Research Agenda: A Theoretical Review, Integration, and Future Research Agenda. Journal of Management, 39(5), 1308-1338. https://doi.org/10.1177/0149206312471388
Kunze, F., & Menges, J. I. (2017). Younger supervisors, older subordinates: An organizational-level study of age differences, emotions, and performance. Journal of Organizational Behavior, 38(4), 461–486. https://doi.org/10.1002/job.2129
Lim, N. (2016). Cultural differences in emotion: differences in emotional arousal level between the East and the West. Integrative Medicine Research, 5(2), 105–109. https://doi.org/10.1016/j.imr.2016.03.004
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037/1082-989X.1.2.130
Malik, S., & Noreen, S. (2015). Perceived Organizational Support as a Moderator of Affective Well-being and Occupational Stress among Teachers. Soc Sci Pakistan Journal of Commerce and Social Sciences, 9(3), 865–874. https://doi.org/https://hdl.handle.net/10419/188227
Marsh, H. W., Guo, J., Dicke, T., Parker, P. D., & Craven, R. G. (2020). Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance Between Goodness of Fit and Parsimony. Multivariate Behavioral Research, 55(1), 102–119. https://doi.org/10.1080/00273171.2019.1602503
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(Mimic), 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. In Structural Equation Modeling (Vol. 16, Issue 3). https://doi.org/10.1080/10705510903008220
Maulida, D., & Shaleh, A. R. (2018). Pengaruh Modal Psikologis dan Totalitas Kerja terhadap Kesejahteraan Subjektif. Psikohumaniora: Jurnal Penelitian Psikologi, 2(2), 107–124. https://doi.org/10.21580/pjpp.v2i2.2461
Menghini, L., Balducci, C., & Toderi, S. (2022). Italian adaptation of Warr’s Job-related Affective Well-being Scale: Factorial structure and relationships with the HSE Management Standards Indicator Tool. TPM-Testing, Psychometrics, Methodology in Applied Psychology, 29(3), 309–325. doi:10.4473/TPM29.3.3
Mihalache, M., & Mihalache, O. R. (2022). How workplace support for the COVID-19 pandemic and personality traits affect changes in employees’ affective commitment to the organisation and job-related well-being. Human Resource Management, 61(3), 295–314. https://doi.org/10.1002/hrm.22082
Morin, A., Myers, N., & Lee, S. (2020). Bifactor Models, Exploratory Structural Equation Modeling (ESEM), and Bifactor‐ESEM. In Handbook of Sport Psychology (Vol. 2, pp. 1044–1073).https://doi.org/10.1002/9781119568124.ch51
Morrissy, L., Boman, P., & Mergler, A. (2013). Nursing a case of the blues: An examination of the role of depression in predicting job-related affective well-being in nurses. Issues in Mental Health Nursing, 34(3), 158–168. https://doi.org/10.3109/01612840.2012.740767
Muthén, L. K., & Muthén, B. O. (2015). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
Ogunola, A. A. (2022). Quality of Work-Life and Work-Life Balance as Predictors of Employee Job Satisfaction. TAZKIYA: Journal of Psychology, 10(1), 74–84. https://doi.org/https://doi.org/10.15408/tazkiya.v10i1.22499
Polit, D. F., & Beck, C. T. (2006). The Content Validity Index : Are You Sure You Know What ’ s Being Reported ? Critique and Recommendations. Research in Nursing & Health Health, 29, 489–497. https://doi.org/10.1002/nur
Polit, D. F., Beck, T., & Owen, S. V. (2007). Focus on Research Methods Is the CVI an Acceptable Indicator of Content Validity ? Appraisal and Recommendations. Research in Nursing & Health, 30, 459–467. https://doi.org/10.1002/nur
Rahardjo, L., & Fitness, J. (2013). Indonesian and Australian Employee Responses to Interactional Injustice: The Roles of Negative Affect and Power Distance. Anima Indonesian Psychological Journal, 29(1), 1–14. https://doi.org/https://journal.ubaya.ac.id/index.php/jpa/article/view/4123
Ramdhani, N., Ancok, D., & Adrianson, L. (2017). The Importance of Positive Affect: The Role of Affective Personality in Predicting Organisational Citizenship Behavior. Makara Human Behavior Studies in Asia, 21(2), 62. https://doi.org/10.7454/mssh.v21i2.3501
Rubio, D. M., Weger, M. B., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifyng content validity : Conducting a content validity study in social work research. Social Work Research, 27(2), 94–104. https://doi.org/10.1093/swr/27.2.94
Russell, J. A. (2003). Core Affect and the Psychological Construction of Emotion. Psychological Review, 110(1), 145–172. https://doi.org/10.1037/0033-295X.110.1.145
Şahin M. D. (2021). Effect of Item Order on Certain Psychometric Properties: A Demonstration on a Cyberloafing Scale. Frontiers in psychology, 12, 590545. https://doi.org/10.3389/fpsyg.2021.590545
Sari, E. Y., Widyowati, A., & Arendse, N. (2025). The relationship between work-life conflict, workforce agility, and subjective well-being among remote employees: The underlying mechanism of job stress. Psikohumaniora: Jurnal Penelitian Psikologi, 10(1), 21–42. https://doi.org/10.21580/pjpp.v10i1.23281
Schumacker, R. E., & Lomax, R. G. (2004). A beginner's guide to structural equation modeling (2nd Edition). psychology press.
Spector, P. E., & Goh, A. (2001). The role of emotions in the occupational stress process. In ( (Vol. 1, pp. 195–232). https://doi.org/10.1016/S1479-3555(01)01013-7
Sperber, A. D. (2004). Translation and Validation of Study Instruments for Cross-Cultural Research. Gastroenterology, 126, 124–128. https://doi.org/10.1053/j.gastro.2003.10.016
Stan, R. (2022). Personality Traits, Technology-Related Teaching Skills, and Coping Mechanisms as Antecedents of Teachers’ Job-Related Affective Well-Being and Burnout in Compulsory and Higher Education Online Teaching Settings. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.792642
Totterdell, P., & Niven, K. (2014). Workplace moods and emotions: A review of research. Charleston, SC: Createspace Independent Publishing.
Uncu, Y., Bayram, N., & Bilgel, N. (2007). Job related affective well-being among primary health care physicians. European Journal of Public Health, 17(5), 514–519. https://doi.org/10.1093/eurpub/ckl264
Van Katwyk, P. T., Fox, S., Spector, P. E., & Kelloway, E. K. (2000). Using the Job-Related Affective Well-Being Scale (JAWS) to investigate affective responses to work stressors. Journal of Occupational Health Psychology, 5(2), 219–230. https://doi.org/10.1037/1076-8998.5.2.219
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organisational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
Walsh, L. M., Wolk, C. B., Haimes, E. M. B., Jensen-Doss, A., & Beidas, R. S. (2018). The Relationship Between Anger and Anxiety Symptoms in Youth with Anxiety Disorders. Journal of child and adolescent counseling, 4(2), 117–133. https://doi.org/10.1080/23727810.2017.1381930
Wang, J., & Wang, X. (2019). Structural equation modeling: Applications using Mplus. John Wiley & Sons.
Warr, P. (1990). Affective well being measures. Journal Pf Occupational Psychology, 63, 193–210. https://doi.org/https://doi.org/10.1111/j.2044-8325.1990.tb00521.x
Watson, D., & Clark, L. A. (1992). On Traits and Temperament: General and Specific Factors of Emotional Experience and Their Relation to the Five‐Factor Model. Journal of Personality, 60(2), 441–476. https://doi.org/10.1111/j.1467-6494.1992.tb00980.x
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037//0022-3514.54.6.1063
Weiss, H. M., & Cropanzo, R. (1996). Affective Events Theory A theoretical discussion of the structure causes and consequences of affective experiences at work. Research in Osrganizational Behavior, 18(1), 1–74.https://web.mit.edu/curhan/www/docs/Articles/15341_Readings/Affect/AffectiveEventsTheory_WeissCropanzano.pdf
Yik, M., Russell, J. A., & Steiger, J. H. (2011). A 12-Point Circumplex Structure of Core Affect. Emotion, 11(4), 705–731. https://doi.org/10.1037/a0023980
Zhang, Y., Zhang, J., Forest, J., & Chen, C. (2018). The negative and positive aspects of employees’ innovative behavior: Role of goals of employees and supervisors. Frontiers in Psychology, 9. https://doi.org/10.3389/fpsyg.2018.01871
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Silvia Kristanti Tri Febriana, Muhammad Abdan Shadiqi, Ahmad Helmi Nugraha, Meydisa Utami Tanau, Rusdi Rusli, Rahmiyati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
