JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia)
<p style="box-sizing: border-box; margin: 0px 0px 10px; color: #333333; font-family: latoregular; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: #ffffff; text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) is a peer-reviewed scientific journal in psychology and education published by the Faculty of Psychology, Syarif Hidayatullah State Islamic University of Jakarta, Indonesia, in cooperation with the Indonesian Educational Evaluation Association (HEPI). <p style="box-sizing: border-box; margin: 0px 0px 10px; color: #333333; font-family: latoregular; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: #ffffff; text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) focus and scope: Psychological and educational measurement, application and development of psychometric methods, instrument development, and research on quantitative psychology.
FAKULTAS PSIKOLOGI UIN SYARIF HIDAYATULLAH JAKARTA
Adaptation and Validation of the Indonesian Version of Behavioral Activation for Depression Scale – Short Form (BADS-SF) Using Confirmatory Factor Analysis and Rasch Modeling
The Behavioral Activation for Depression Scale – Short Form (BADS-SF) is a brief instrument designed to measure activation levels in individuals undergoing behavioral activation (BA) therapy for depression. With the broad potential for implementing BA therapy, including in Indonesia, the BADS-SF needs to be cross-culturally adapted. While the original validation study supported a two-factor model, subsequent adaptations, particularly in non-Western settings, have yielded inconsistent results. In addition, given the practical application of the BADS-SF total score as an overall indicator of behavioral activation, it is essential to evaluate its psychometric properties as a unidimensional measure. The objectives of this study are: (1) to culturally adapt the BADS-SF into the Indonesian language (Bahasa Indonesia); (2) to examine its underlying factor structure and convergent validity; and (3) to evaluate its psychometric properties using item response theory (IRT), specifically Rasch modeling. The cultural adaptation process demonstrated good content validity based on Aiken’s V (.75 to 1 for all items) and confirmed the scale readability. The confrmatory factor analysis (CFA) results revealed a different factor structure than the original, with a 6-item one-factor model providing the best fit and confirmed convergent validity. Rasch analysis further showed that the Indonesian version of BADS-SF had good psychometric properties, including excellent item reliability, acceptable person reliability, and supported unidimensionality following the exclusion of a misfitting item (Item 8). Based on the overall results, the 6-item version of BADS-SF Bahasa Indonesia is recommended to be used for both research and clinical practice. Further implications of the findings are discussed.
Copyright (c) 2026 Salma Salma, Restu Tri Handoyo, Ajeng J. Puspitasari, Rahmat Hidayat, Rachel Leonard, Jonathan Kanter https://creativecommons.org/licenses/by-sa/4.0
A Rasch Analysis of The Indonesian Version of Proactive Personality Scale
Proactive personality reflects an individual’s tendency to initiate change and influence the environment, particularly in organizational contexts. This study aimed to examine the psychometric properties of the Indonesian version of the Proactive Personality Scale (PPS) using Rasch measurement modeling. A cross-sectional survey design was employed involving 307 employees from various organizations in Indonesia (40.4% male, 59.6% female; Mage = 32.46, SD = 8.38), recruited through convenience sampling. The instrument was translated and culturally adapted in accordance with International Test Commission (ITC) guidelines. Data were analyzed using the Rasch Rating Scale Model with Winsteps, applying Joint Maximum Likelihood Estimation to evaluate dimensionality, item fit, reliability and rating scale functioning. The Rasch model explained 44.1% of the variance, supporting the unidimensional assumption. The results suggest adequate person separation and stable item calibration and indicate good internal consistency (Cronbach’s α = 0.81), acceptable person reliability (0.77), also excellent item reliability (0.98), However, rating scale analysis revealed suboptimal functioning in lower response categories, indicating that collapsing categories may improve measurement precision. Overall, the Indonesian PPS demonstrates acceptable psychometric properties for research and organizational assessment purposes. Nevertheless, refinement of the response format and further validation using more diverse samples are recommended to enhance measurement precision and generalizability.
Copyright (c) 2026 Unika Prihatsanti, Dito Aryo Prabowo, Anggun Resdasari Prasetyo, Kartika Sari Dewi https://creativecommons.org/licenses/by-sa/4.0
Applying the Rasch Model as a Diagnostic Tool for Rating Scale Refinement
The Rasch model has been widely used in educational, psychological, and health research to evaluate the measurement quality of instruments. In many applications, however, Rasch analysis is primarily reported to support validation or confirm the adequacy of a scale. Although diagnostic analyses may be conducted during instrument development, their role in informing substantive instrument refinement is less explicitly documented and therefore less visible in the literature. This study aims to demonstrate how the Rasch model can be applied as a diagnostic tool to support the refinement of rating scales. Using empirical data from an attitude scale, the study illustrates how detailed Rasch outputs—such as item fit, response category functioning, and threshold ordering—can be interpreted to identify specific sources of measurement problems. These insights provide a basis for targeted revisions, demonstrating how Rasch analysis can contribute not only to validation but also to iterative instrument refinement. This study contributes to the methodological literature by highlighting a more comprehensive use of the Rasch model that integrates validation and diagnostic purposes. It also provides practical guidance for researchers, particularly those less familiar with Rasch analysis, on how to use model outputs to improve measurement instruments, especially rating scales.
Copyright (c) 2026 Asrijanty https://creativecommons.org/licenses/by-sa/4.0
Psychometric Properties of Indonesian Job-related Affective Well-being Scale: Examining Factor Structure Through CFA and ESEM
Job Affective Well-Being Scale (JAWS) is a psychological instrument used to measure emotional conditions in the context of work. However, research on the psychometric properties of JAWS in the Indonesian context remains limited. This study aims to test the construct validity of JAWS among 410 Indonesian workers (mean = 34.98; SD = 9.51) using a competing models strategy. This study compares three approaches: Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modelling (ESEM), and Set-ESEM. The results of the model comparison analysis indicated that the Modified 4-Factor Set-ESEM model was the best, balancing statistical accuracy and parsimony and accommodating natural cross-loadings among items within the same valence. The evaluation of measurement invariance across genders confirmed the instrument's stability at the configurational and metric levels, as well as partial scalar invariance. The final JAWS Indonesian version model with the Set-ESEM model shows that this instrument is valid, reliable, and fair in measuring affective well-being at work, and supports its use for research and organisational intervention purposes in Indonesia.
exploratory structural equation modelling
Copyright (c) 2026 Silvia Kristanti Tri Febriana, Muhammad Abdan Shadiqi, Ahmad Helmi Nugraha, Meydisa Utami Tanau, Rusdi Rusli, Rahmiyati https://creativecommons.org/licenses/by-sa/4.0
PHQ-9: Validation and Investigation Response Format using Nominal Response Model
The Patient Health Questionnaire 9 (PHQ-9) is a widely used tool for depression screening, but its internal structure varies across different contexts and potentially leads to misinterpretations of the depression construct it measures. This study aims to investigate the internal structure and response format effectiveness of the Indonesian version of the PHQ-9. Data were collected from 1,310 participants who completed the PHQ-9 questionnaire, sourced from the Faculty of Psychology of the Universitas Gadjah Mada (UGM)’s database. Data analysis included confirmatory factor analysis (CFA), item factor analysis (IFA), and item response theory (IRT) using a nominal response model (NRM). Results indicated that a two-factor model demonstrated a better fit than a single-factor model, which was categorised as a marginal fit. Furthermore, nearly all items functioned effectively in their response format, except for items 5 (poor appetite) and 9 (suicidal thoughts), which showed suboptimal functioning in the highest categories. These findings support the practical use of the PHQ-9 and underscore the value of collapsing categories when extreme responses are rarely endorsed to improve measurement precision.
Copyright (c) 2025 Ramadhan Dwi Marvianto, S.Psi., M.A., Dra. Sri Kusrohmaniah, M.Si., Ph.D., Psikolog https://creativecommons.org/licenses/by-sa/4.0
Development and Validation of the Online Victimization Scale: Confirmatory Factor Analysis and Composite Reliability
Online victimization is harmful actions directed at individuals or institutions through digital technology. This study aims to develop, validate, and examine the psychometric properties of the Online Victimization Scale (OVS). The researchers constructed and adapted several items from the Online Victimization Scale (OVS) by Tynes et al. (2014) and the Perceived Online Racism Scale (PORS) by Keum (2021), resulting in 54 items that were translated into Indonesian. A quantitative research method was employed using an accidental sampling technique. Data were collected from 204 individuals aged 14-23 years who were active social media users. Data analysis was conducted using Confirmatory Factor Analysis (CFA)to evaluate the factor structure. Score reliability was assessed by calculating composite omega and stratified alpha values using the lavaan package in R. The results indicated high inter-factor correlations, prompting a second-order factor analysis. The first-order and second-order models demonstrated good model fit indices with no significant differences, resulting in a final scale of 16 items. Measurement invariance testing using multi-group CFA confirmed that the scale met the criteria for scalar invariance, as indicated by minimal changes in ΔCFI and ΔTLI (<0.01). These findings validate the equivalence of the factor structure, factor loadings, and item intercepts between male and female participants, ensuring that score differences reflect actual differences in the online victimization construct rather than measurement bias.
Copyright (c) 2025 Muhammad Dzuhri Muzayyin, Abdullah Azzam Al Afghani, Mela Minkhatul Maula https://creativecommons.org/licenses/by-sa/4.0
Validating the Indonesian Version of UWES-17: A Rasch Model Analysis of Work Engagement
Work engagement is a positive psychology construct widely sought after and developed in various countries. Psychometric validation requires statistical analysis to measure and differentiate individuals across different cultures. This study aims to validate the Utrecht Work Engagement Scale-17 (UWES-17) instrument on hospitality workers in state-owned companies in Indonesia. The study population comprised 3185 individuals, representing various positions and types of hospitality service jobs within the land transportation sector of a state-owned enterprise. A non-probability sampling approach, specifically convenience sampling, was employed, selecting participants based on their accessibility and willingness to participate. The participants, aged between 18 and 62, came from diverse fields and work areas. Analysis of item responses in the test was the Rasch Model with a study focus on item fit and person fit from the UWES-17 Scale. In addition, assumption tests of unidimensionality and local independence were performed to ensure the validity of the measurement model. The scale’s reliability was also assessed to evaluate the instrument’s consistency. The results showed that the items were overall fit, but the criteria for person fit were unmet. This is due to the tendency for uniformity and too many diverse positions and cultural tendencies of state-owned companies. The implication is that further item development and confirmation are needed on the constituent aspects, especially the absorption constituent items. Additionally, developing a more consistent shorter version or discovering other dimensions of work engagement that are specific to collectivist societies may be possible.
Copyright (c) 2025 Abdul Rahman Shaleh, Bahrul Hayat, Arung Samudera https://creativecommons.org/licenses/by-sa/4.0
Comparing IRT Models: Summated Scaling Effects on Critical Thinking in Vocational Students
This study investigates the comparative efficacy of Summated Rating Scales (SRS) and traditional ordinal scales (raw Likert-type responses) in measuring critical thinking skills among vocational students, employing Item Response Theory (IRT) to evaluate their psychometric properties. Addressing the limitations of ordinal scales notably inconsistent intervals between response categories the research adopts a descriptive quantitative methodology involving 269 students from state vocational high schools in Yogyakarta, Indonesia. Data were collected using a five-point Likert scale instrument, validated for content (Aiken’s V = 0.94), and analyzed through two IRT frameworks: Polytomous IRT for unscaled ordinal data and Continuous Response Model (CRM) IRT for SRS-transformed interval data. Key findings reveal that SRS enhances measurement precision by normalizing response distributions into proportional intervals (e.g., recalibrated scores: 0.00, 0.73, 1.46, 2.07, 2.84), thereby resolving issues of unequal category spacing inherent to ordinal scales. Polytomous IRT demonstrated robust item fit (e.g., Partial Credit Model fit for 5/6 items) and strong difficulty parameter invariance (r = 0.84), yet exhibited instability in ability estimates (r = 0.37) due to extreme response patterns. Conversely, CRM IRT applied to scaled data produced stable ability estimates (r = 0.46) and eliminated infinite values in Maximum Likelihood Estimation, underscoring its superiority in handling continuous metrics. However, ordinal scales retained higher consistency in difficulty calibration across subgroups. The study concludes that integrating SRS with CRM IRT offers a refined approach for critical thinking assessments, balancing precision and fairness, while ordinal scales remain pragmatic for contexts prioritizing simplicity. These insights advocate for the adoption of advanced scaling techniques in vocational education to improve the validity of competency evaluations, with recommendations for future research to explore hybrid models and longitudinal applications.
Copyright (c) 2025 Andi Abdurrahman Manggaberani, Abrar Syahrul Fajri, Heri Retnawati https://creativecommons.org/licenses/by-sa/4.0
Psychometric Properties of the Resistance to Framing Scale: Evidence from Indonesia
This paper reports the validation of the Indonesian version of the resistance to framing effects scale, which is part of the Adult Decision-Making Competence Index (A-DMC). Framing refers to an individual’s tendency to be influenced by how information is structured. The resistance to framing effects scale is a measurement tool designed to assess an individual’s susceptibility to framing. This scale comprises two dimensions: attribute framing and risky-choice framing. A total of 217 participants (60 men and 157 women) completed the 14-item scale. Item Response Theory and the Multidimensional Graded Response Model (MGRM) were used to evaluate the psychometric properties of the scale. The MGRM analysis results indicated that the data fit the model, as evidenced by global fit statistics. Additionally, all items showed a good fit with the MGRM model. The reliability of this scale was 0.697 for the attribute dimension and 0.722 for the risky-choice dimension. However, we found that one item had low discrimination (ATT5 with a = 0.638), while the remining 13 items had optimal discrimination. Based on these results, we conclude that the 14-item Indonesian version of the resistance to framing effects scale is a reliable measurement tool that can be used for future research in behavioral economics or economic psychology in Indonesia. There are limitations of this study: the relatively small sample size and the lack of convergent validity testing with other instruments. However, the strong psychometric properties observed in this study suggest that this instrument is suitable for use in future research and may also be applied for practical measurement purposes.
Copyright (c) 2025 Rahmat Hidayat, Ajeng Putri Pertiwi https://creativecommons.org/licenses/by-sa/4.0
Measuring the Intention for Innovative Work Behavior: Scale Development for Indonesian Employees
The current business era is dynamic and filled with uncertainty, and innovating is no longer an option but a solution to survive and compete. Innovation in the organisational context is displayed by employees in their work, known as Innovative Work Behaviour (IWB). However, the measurement tool for innovative work behavior focuses on past behavior, whereas innovative behavior is characterized by uncertainty. Previous behavior may not necessarily predict future behavior. Meanwhile, intention is the closest factor to predicting future behavior. Some researchers have adjusted the measurement of innovative work behavior into the intention for innovative work behavior. But its reliability and validity have not been tested, and it has not been adapted to the Indonesian language. Therefore, this quantitative study aims to develop a measurement tool of intention for innovative work behavior in Indonesia based on the Su et al. Scale (2019). Using the convenience sampling method, 1,071 participants who had worked for at least 1 (one) year in their organisation participated in this study. The results show that the I-IWB Scales had good reliability (α = 0.840). Confirmatory factor analysis also revealed that the scale fit the one-factor model (RMSEA = 0.054 < 0.070; 90% CI 0.044, 0.066), (CFI = 0.970 > 0.950), (TLI = 0.955 > 0.900). Construct validity shows the model fit as a unidimensional scale. Thus, based on the analysis results, it can be said that the I-IWB Scale is still reliable and valid for measuring the construct of intention for innovative work behaviour for Indonesian employees.
Copyright (c) 2025 Arum Etikariena, Aflaha Hadini Kusuma, Anak Agung Istri Ratna Kumala Dewi, Devika Nur Shabrina, Rana Hafizhah, Zidan Raleto Seno https://creativecommons.org/licenses/by-sa/4.0
A New Unidimensional Family Resilience Scale in an Indonesian Context: Development and Psychometric Properties
This study aims to develop a psychological instrument of family resilience using data derived from Indonesian samples based on a five-dimensional resilience scale: physical resilience, psychological resilience, economic resilience, social resilience, and religiosity resilience. Each dimension was measured with five items (25 items in total) on a 4-point Likert scale. A total of 841 subjects (n = 841) were gathered through purposive sampling and were required to complete the questionnaire. Data were analysed using confirmatory factor analysis (CFA) and Rasch analysis, aimed at generating each item’s validity based on the formulated constructs. Results indicated that all item t-values exceeded 1.96 (t > 1.96), and the model’s statistical indices satisfied the criteria for unidimensionality and goodness of fit. According to the Rasch analysis, all items demonstrated good fit and a high Cronbach’s alpha reliability index. A newly developed family resilience measure for Indonesian populations demonstrates strong construct validity across all dimensions and items, including a unique dimension that recognises the role of religion in family coping. While promising for clinical and research use, further validation and cross-cultural studies are needed to address limitations related to purposive sampling and cultural specificity. These studies should employ longitudinal and cross-cultural designs to enhance generalizability. This will ensure that the instrument provides a robust measure of family resilience for diverse applications. Meanwhile, the limitation of the study is the need to conduct a standardised norming of the instrument.
Copyright (c) 2025 Muhammad Iqbal, Adiyo Roebianto, Laila Meiliyandrie Indah Wardani https://creativecommons.org/licenses/by-sa/4.0
Investigating Differential Item Functioning (DIF) in Geometry Test Scores: Holistic vs. Analytical Scoring Rubrics
The use of polytomous data in test instruments enables more detailed assessment of test-takers' abilities, but group differences, such as gender, class, and ethnicity, are often overlooked. Differential Item Functioning (DIF) analysis helps determine whether these identities influence test performance. This descriptive quantitative study examines DIF in geometry tests using Holistic and Analytical Scoring Rubrics across gender, class, and ethnic groups. The study involved 102 undergraduate students from Cenderawasih University, Papua, who completed a geometry test with 10 descriptive questions. Two scoring rubrics were used: the Holistic Scoring Rubric with three categories and the Analytical Scoring Rubric with five. Results were analyzed with the difR package in the R Program. The criterion for detecting DIF is a p-value less than 0.05. Findings show that some test items exhibit DIF concerning gender, class, and ethnicity. The DIF detected for the holistic scoring rubric is items 1, 6, 7, and 10 for the gender group; items 1, 4, 5, and 8 for the class group; and items 1, 2, and 6 for the ethnic group. Meanwhile, the DIF detected for the analytic scoring rubric is item 10 for the gender group; items 9 and 10 for the class group; and item 10 for the ethnic group. However, not all DIF items are flawed; some assess fundamental skills. The Analytical Rubric demonstrated slightly higher reliability (alpha 0.903) than the Holistic Rubric (alpha 0.804). These insights support the development of more equitable and sustainable assessment practices, ensuring fairness and inclusivity in educational evaluations.
Copyright (c) 2026 Okky Riswandha Imawan, Heri Retnawati, Haryanto Haryanto, Raoda Ismail https://creativecommons.org/licenses/by-sa/4.0
Development of irtawsi: A User-Friendly R Package for IRT Analysis
The complexity of the IRT analysis makes it difficult to perform manually, therefore requiring easy-to-use software. While many software options exist for IRT analysis, the high cost of paid software can make it inaccessible for many students and lecturers in Indonesia. While the mirt package provides a complete, free option for IRT analysis, proficiency in the R programming language is required. This study aims to develop an R package for IRT analysis, equipped with a user-friendly interface based on the mirt package, designed to be easy to use for beginners in IRT analysis. The System Development Life Cycle (SDLC) model is used for development and includes five stages: Planning, Analysis, Design, Implementation, and System. The resulting package is named irtawsi and includes functionality comparable to paid software. This package can calibrate both test and non-test instruments using various IRT models, such as the Rasch, 2PL, 3PL, 4PL, GRM, PCM, and GPCM models. The irtawsi package functionality includes: (1) an easy-to-use user interface, (2) automatic interpretation of analysis results, (3) a guide for IRT analysis, (4) recommendations when assumptions are not met, (5) an HTML report format for analysis results,(6) support for two languages (Indonesian and English), (7) it is free, and (8) can be installed on Windows, macOS, and Linux operating systems. The results of this development contribute to the calibration process, making it easier for practitioners and researchers to calibrate the instruments being developed, especially for beginners who are learning IRT.
Copyright (c) 2025 Hari Purnomo Susanto https://creativecommons.org/licenses/by-sa/4.0
The Development of The Situational Judgement Test (SJT) for Workforce Agility
This research aimed to develop workforce agility measuring tool with the situational judgment test (SJT) format and evaluate its psychometric properties. This research included 886 respondents with higher education. The data were analyzed using confirmatory factor analysis (CFA) and multigroup confirmatory factor analysis (MGCFA). The CFA results showed that 18 items have satisfactory psychometric properties, thus forming a fit factor structure and providing valid evidence based on internal structure. Besides, the MGCFA results showed that this measuring instrument has measurement invariance at the strict invariance level to be used as validity evidence based on test consequences. The Omega reliability of this instrument was estimated, and the required criteria were met. The implication is that this measuring instrument has at least three of the five sources of validity to allow solid interpretations of the measuring results.
Copyright (c) 2025 Avin Fadilla Helmi, Ramadhan Dwi Marvianto, Arif Budiman Al Fariz, Indahinsani Purnasari Anggoro, Wahyu Jati Anggoro https://creativecommons.org/licenses/by-sa/4.0
The Indonesian version of the Short Grit Scale (Indonesian Grit-S): Psychometric Properties Based on the Multidimensional Rasch Model
“Grit” refers to persistence in trying and consistent interest in achieving long-term goals. The Short Grit Scale (Grit-S) is one of the measures used to assess grit. Given that previous research on the Grit-S scale was reported with a CFA approach, this study aims to examine the psychometric properties of the Indonesian Grit-S using Rasch model analysis. Rasch model shows a more detailed analysis than CFA by explaining item difficulty, item fit statistics, reliability, and wright map. Participants in the study were 480 students (male: 86 and female: 394) with an age range of 17-25 years (mean age: 20.05, SD age: 1.32). The sampling method used was non-probability sampling with a convenience sampling technique. The research analysis results show that the Indonesian Grit-S has a good reliability. In addition, all Indonesian Grit-S scale items fit using the Rasch model. Overall, the results showed that the Indonesian Grit-S scale has valid and reliable psychometric properties and can be used to measure grit.
Copyright (c) 2025 Nursalam Nursalam, Rahmat S. Bintang, Kurniati Zainuddin, Diana Mutiah https://creativecommons.org/licenses/by-sa/4.0
Investigating the Factor Structure of the Myers-Briggs Type Indicator (MBTI): Case of Indonesian Students
Psychological tests require continuous refinement and evaluation to ensure their effectiveness. This study aimed to evaluate the factor structure, invariance, item quality, and differential item functioning (DIF) of the 60-item Myers–Briggs Type Indicator (MBTI) among Indonesian students using modern psychometric methods. Involving 7,526 participants, the results of the item factor analysis (IFA) indicated that a single-factor model for each MBTI dimension adequately fit the data, supporting satisfactory construct validity. The Infit and Outfit MNSQ values ranged between 0.5 and 1.5, demonstrating good item quality. Moreover, no gender bias was detected based on the DIF Contrast effect size, indicating that MBTI items function equivalently for male and female students. These findings provide strong empirical evidence for the psychometric validity and reliability of the MBTI in the Indonesian context and represent the first large-scale study contributing to the refinement and modernization of the instrument in alignment with national legislative standards for psychological test use.
Copyright (c) 2025 Dwi Yan Nugraha, Widyastuti Widyastuti, Ahmad Ridfah https://creativecommons.org/licenses/by-sa/4.0
A Meta-analysis of Coefficient Alpha for the Revised Life Orientation Test (LOT-R)
The Revised Life Orientation Test (LOT-R) is one of the most popular instruments for measuring optimism. The authors conducted a meta-analysis, also known as a reliability Generalization study, to estimate the population Cronbach's Alpha for the LOT-R. This study also examined Alpha heterogeneity and identified factors that might influence it. Using a Random Effects Model, the estimated population Cronbach's Alpha based on 211 studies was found to be 0.768 (95% CI: 0.757, 0.778), indicating a good level of reliability. The heterogeneity analysis revealed an I² value of 95.84%, suggesting significant differences among the studies. These differences may stem from factors beyond just methodological variations or population samples. To understand the possible causes for this heterogeneity, a meta-regression analysis was performed, focusing on moderator variables including gender, age, study setting, study type, citation, and language. Among these moderator variables, only the language variable showed a significant impact on the variation in Cronbach's Alpha. In conclusion, the findings suggest that the LOT-R is a reliable instrument for measuring optimism. However, the study also reveals that linguistic factors may influence its reliability, potentially limiting the generalizability of findings across different language groups and in cross-cultural contexts. Therefore, researchers should consider language-related variations when interpreting LOT-R results. Future studies are encouraged to examine further how linguistic differences may affect the instrument's validity and to explore ways to optimize its use across diverse cultural settings.
meta-analysis of reliability coefficient
Copyright (c) 2026 Wahyu Syahputra, Bahrul Hayat https://creativecommons.org/licenses/by-sa/4.0
Exploring Gender Bias in the Dual Continua of Mental Health Measurement: Differential Item Functioning Analysis
Gender differences in mental health are widely reported, yet few studies have examined whether commonly used assessment instruments function equivalently across gender at the item level, particularly within the Dual Continua Model of Mental Health. The present study addresses this gap by evaluating gender-related measurement bias using regression-based Differential Item Functioning (DIF) analysis. A total of 1,674 university students from 32 Indonesian institutions completed the Azira Mental Health Scale (AMHS-24), which measures psychological well-being and psychological distress. DIF was assessed by controlling for latent trait levels to determine whether males and females respond differently to items at equivalent levels of psychological functioning. Results indicate that most well-being items exhibited no DIF, suggesting structural stability across gender for positive emotion, social relationship, and life satisfaction domains. In contrast, several distress items demonstrated uniform and nonuniform DIF, with one item showing strong magnitude. These findings suggest that the distress dimension may be more sensitive to gender-related response tendencies than the well-being dimension. By integrating the dual-continua framework with item-level psychometric analysis, this study clarifies whether observed gender differences reflect construct-relevant variance or differential item functioning, thereby contributing to the theoretical refinement and measurement fairness of mental health assessment.
Copyright (c) 2026 Retno Mangestuti, Rahmat Aziz, Nada Ibrahim Alribdi, Maqdisi Firdaus Ali https://creativecommons.org/licenses/by-sa/4.0
Construct Validity and Reliability: Perception of Teacher Competency Scale
Early childhood teacher competency ensures high-quality programs and fosters student development. This competency comprises four key aspects: pedagogical, personality, social, and professional skills. However, Indonesia still lacks a psychometrically validated, perception-based competency scale that fully aligns with both national policy standards and internationally recognised frameworks. To address this gap, this research aimed to develop a self-inventory model of teacher competency. A 60-item questionnaire was sent to 249 early childhood teachers. Construct validity was examined using Exploratory and Confirmatory Factor Analyses. Convergent validity was confirmed by significant factor loadings, Composite Reliability, and Average Variance Extracted values. Criterion-related validity was supported by positive correlations with established measures of creative adaptability, perceived social support, teacher efficacy, and work engagement scale. The final analysis identified seven teacher competency dimensions. This scale also correlates with the other four measuring instruments. Analysis of Cronbach's Alpha Coefficient, Composit Reliability Value, and Average Variance Extract assessed reliability. The scale was refined to 45 valid items. This was followed by Measurement Invariance with Multigroup Confirmatory Factor Analysis, to evaluate potential differences in perceptions among groups categorised by educational background and teaching experience in their comprehension of the item questionnaire. The results revealed no significant differences in perceptions across either group type regarding the measuring instrument. This new scale is expected to enhance future research, educator training, and the quality of early childhood education.
Copyright (c) 2025 Raisa Rakhmania, Benedicta Prihatin Dwi Riyanti, Margaretha Purwanti https://creativecommons.org/licenses/by-sa/4.0
Psychometric Properties Of The Perceived Stress Scale (PSS-10) In Indonesian Version
The Perceived Stress Scale (PSS-10) by Cohen is a popular tool for measuring stress from a psychological perspective. The PSS-10 measures the extent to which situations in a person's life are perceived as stressful. This study aims to evaluate the psychometric properties of the Perceived Stress Scale adapted into Indonesian. The PSS-10 has been translated into various languages, but no previous studies have specifically explored the psychometric properties of the PSS-10 in Indonesian. Additionally, this study seeks to test the construct invariance of the PSS-10 among students and workers. The respondents of this study were employees working in several regions in Indonesia (N=259) and college students (N=244). Data analysis was conducted using Confirmatory Factor Analysis (CFA) and Measurement Invariance (MI). After testing for validity based on internal structure, the Indonesian version of the PSS-10 fit the two-factor model (perceived helplessness and perceived self-efficacy). The AVE value of 0.38 for student participants was considered low, with a CR value of 0.81, which is quite good. For employee participants, the AVE value was 0.58 and the CR value was 0.93, both of which were good. Based on the multigroup CFA analysis test, there are differences in the factor structure of the PSS-10 between students and employees, where these differences lie in how the two groups respond to and interpret the items of the PSS-10.
Investigation of Content Validity and Exploratory Factor Analysis of Students’ Economic Behavior Measure
Economic behavior has attracted scholars in the last decade, and past studies measured this construct partially from consumptive perspectives or entrepreneurial behavior (Mulyani et al., 2018). Therefore, this study aims to develop a new and valid measurement of students’ economic behavior and investigate its content validity using an exploratory factor analysis (EFA). The content validity is provided using an experts’ assessment method with a 4-point evaluation form. At the same time, the exploratory factor analysis is performed using SPSS. This study involved content validity assessment for each item (I-CVI) for the entire scale (S-CVI/Ave). Based on the analysis of the questionnaire scale, it can be concluded that the content validity check using I-CVI, S-CVI/Ave, and S-CVI/UA is all satisfactory except for item SEB20, which was subsequently dropped. On the other hand, the results of EFA indicated that two more items did not meet the thresholds and, thus, were excluded. Therefore, developing instruments to measure students’ economic behavior is prominent in dealing with digital changes, preventing consumptive behavior, and enhancing economic well-being.
Copyright (c) 2024 Bagus Shandy Narmaditya, Sheerad Sahid, Muhammad Hussin
Comparison of KMO Results, Eigen Value, Reliability, and Standard Error of Measurement: Original & Rescaling Through Summated Rating Scaling
This study aims to compare the results of KMO MSA analysis, Eigen Value, reliability, and Standard Error Measurement (SEm) between raw scores (original) and standardized scores (rescaling) through the summated rating scaling method on critical reasoning attitudes of vocational students in Yogyakarta City. This study used a quantitative descriptive approach involving 204 private vocational students as subjects. The instrument used to measure critical reasoning attitudes has gone through thorough validity and reliability testing before the research was carried out. The analysis process was carried out by calculating the KMO MSA, Eigen Value, reliability, and SEm values on both raw and standardized scores. The results of the two types of scores were then compared to identify any differences. Based on the results of the analysis, it was found that the raw score had a KMO MSA of 0.87, reliability of 0.823, and SEm of 0.337. After rescaling, the KMO MSA value decreased slightly to 0.86, the reliability also decreased slightly to 0.821, while the SEm increased to 0.406. Eigenvalue analysis showed that both the raw and standardized scores yielded seven factors with Eigenvalues greater than 1. The differences found between these two types of scores, namely 0.01 for KMO MSA, 0.002 for reliability, and -0.069 for SEm, indicate small but significant changes, especially in terms of the increase in SEm after rescaling, which impacts the level of measurement accuracy.
Copyright (c) 2024 Nuryani Dwi Astuti, Farida Agus Setiawati, Heri Retnawati, Yuli Prihatni, Ari Setiawan
Examining the psychometric properties of the Prosocial Behavior Scale Using Indonesian Pesantren (Islamic Boarding Education System) Sample
In the context of behavior, prosocial behavior is needed to maintain individual relationships with others. This behavior has existed among Islamic college students known as Santri. Santri, as an adolescent, has the concept of establishing relationships through prosocial behavior. Therefore, a measuring instrument is needed to determine Santri’s prosocial behavior. The Prosociality Scale is one of the popular instruments in measuring prosocial behavior, and it is essential to adapt and validate the instrument with the characteristics of the Indonesian sample, especially Santri. This study presents evidence of validity and reliability using the Rating Scale Rasch Measurement Model. With a sample of 742, 424 (57.1%) were female and 318 (42.9%) were male. This instrument has met the criteria of good psychometrics according to the Rasch model regarding reliability (0.82 - 0.99) and validity and fulfills the need for measurement invariance.
Copyright (c) 2024 wahyu syahputra, Ika Widhiastuti, Baydhowi Baydhowi, saiful falah, Devie Yundianto, Moondore Madalina Ali
Mplus and the R mirt Package: A Comparison of Model Parameter Estimation for Generalized Partial Credit Model (GPCM)
This article aims to carry out an empirical demonstration to calibrate data using the generalized partial credit model (GPCM) and compare the results of GPCM analysis on paid software, namely Mplus, and open-source software, namely R Package Mirt. The data used in this study used secondary data in the form of item scores from the future orientation scale or Skala orientasi masa depan (S-OMD) with a total of 326 participants using a Likert scale with 4 response options. The results of this study show that GPCM is fit for OMD scale data. Comparison of analysis results using Mplus and R Package mirt shows the same output, such as discrimination parameters and item difficulty levels. The resulting factor score correlation also has a perfect correlation or one. In conclusion, open-source software is capable of having the same computing performance as paid software, and even has several additional features that are not found in paid software.
Copyright (c) 2024 Arif Budiman Al Fariz
Investigation of Construct Validity of The Indonesian Version of The Financial Wellness Questionnaire
Developing a financial wellness questionnaire in Indonesia is necessary to evaluate household financial situation. However, there has been a scarcity of research that adapts and tests the psychometric properties of the financial wellness questionnaire in Indonesia. The purpose of the current study was to evaluate the psychometric properties of the Indonesian version of Joo’s Financial Wellness Questionnaire. Data was collected using an online survey consisting of 388 participants (25-60 years). The results provided two evidences of the validity of the Indonesian version of the Financial Wellness Questionnaire based on the scale’s internal structure. Firstly, the structure of relationships between items in the questionnaire fits the theoretical model of financial wellness, which includes objective and subjective measurements. Furthermore, the structure of relationships between items in the subjective measure fits the theoretical model of the subjective measure of financial wellness, which comprises aspects of subjective perception, financial behavior, and financial satisfaction. Based on the evaluation of the Multiple Indicator Multiple Cause (MIMIC) model fitted, we also identified the effects of gender, education, and socio-economic status (SES) on some of the subjective financial wellness indicators. Therefore, the questionnaire should consider the aforementioned variables in interpreting the questionnaire scores.
Copyright (c) 2024 Theda Renanita, Rahmat Hidayat, Agung Santoso
Evaluation of Different Person-Fit Measures in Cognitive Tests with Different Test Lengths
Test takers’ characteristic is an exciting topic to discuss in psychometric research. In this study, person-fit is a part of the person characteristics applied in the context of cognitive tests. Given the importance of accurately estimating item and person parameters, person-fit is a statistical technique that can detect aberrant responses. Aberrance adversely affects the estimation process at the level of items and persons. The purpose of this study was to introduce and apply two popular person-fit statistics called and . These two statistics were applied in two studies, in study 1 using N = 317 and item = 16, and in study 2 using N = 331 and item = 49. The results showed that in studies 1 and 2, detected more aberrant responses compared to . Significant differences in estimated results from both techniques were also shown in Study 2. The outcomes of this study are valuable for researchers and practitioners in the field of psychometrics who rely on , as a foundation for identifying aberrant responses.
Copyright (c) 2024 Sukaesi Marianti, Herdin Natalius Manao, Arij Faiha
Measuring the Teacher's Sense of Efficacy Scale for Teachers of Children with Special Needs in Indonesia
This research aims to test the validity and analysis of the Teacher's Sense of Efficacy Scale (short form) measurement tool for teachers of children with special needs in Indonesia. In this study, researchers tested three dimensions developed by Tschannen-Moran and Hoy (2001) for measuring teaching efficacy: Efficacy in Classroom Management, Efficacy in Student Engagement, and Efficacy in Instructional Strategies, with 12 items. The research subjects were 301 teachers of children with special needs. Among the subjects are 225 female and 76 male teachers, with a median age of 26-35. The sampling method utilised in this study is purposive sampling. The data analysis method used in this research is confirmatory factor analysis (CFA). The analysis results show a GFI value of 0.9 97; CFI 0.930; TLI 0.907; RNI 0.930; SRMR 0.044; and RMSEA 0.082. Further, Rasch analysis found that all 12 items of the scale were valid and used in the study. This model allows stakeholders to gain more insights into teachers’ self-efficacy, especially regarding children with special needs.
Copyright (c) 2025 Ratna Syifa'a Rachmahana https://creativecommons.org/licenses/by-sa/4.0
Technostress Construct Validity Test with Confirmatory Factor Analysis (CFA) Method
This study aims to test the construct validity of the technostress instrument using an instrument developed by Ragu-Nathan et al. (2008) contained 20 modified items using the Indonesian language. The research data was obtained from middle adult teaching staff, namely teachers and lecturers aged 35-60 who taught online learning during Covid-19. 212 respondents participated in this study. The test used confirmatory factor analysis (CFA) with first-order per-dimensional, first-order unidimensional, and second-order models. The analysis was done in MPLUS. Based on CFA first-order unidimensional results, the model fits the data with one item discarded (Item 17). The CFA second-order model is also fit according to the goodness criteria with all items being valid except item 6. According to CFA first-order per-dimensional testing, results show that items for three dimensions (techno-overload, techno-complexity, and techno-insecurity) are valid, while the other two dimensions (techno-uncertainty and techno-invasion) are not fit because the number of items is too small. The instrument can be used to measure technostress and is considered to be unidimensional measuring technostress.
Modeling of Colorado Learning Attitude Science Survey in Indonesian Version: A Study with Applying Item Response Theory
Colorado Learning Attitudes about Science Survey (CLASS) is an instrument designed to explore students' perceptions of physics and assess how closely their beliefs correspond with those of professional physicists. Before the development of CLASS, several similar instruments were developed in the field of Physics Education such as the Maryland Physics Expectation (MPEX), Views About Science Survey (VASS), and Epistemological Beliefs Assessment for Physical Science (EBAPS). Adams et al. developed CLASS in 2006 by evaluating these three instruments. Since then, CLASS has been extensively studied for its use in research, especially in the field of Physics Education, and has also been applied in other fields and translated into several languages. As a form of community strengthening, this article attempts to report the research findings related to the use of the CLASS instrument that has been translated into Indonesian. A total of 292 undergraduate students were sampled in this study, who are students from four universities. The respondents in this study were students who had enrolled in the Fundamental of Physics course. The data obtained were analysed with Item Response Theory (IRT) for the polytomous scale. There are Grade Response Model (GRM), Partial Credit Model (PCM), Rating Scale Model (RSM), and Generalized Partial Credit Model (GPCM). The research results show that among the four models of approach and based on the criteria used, the model considered most suitable is GRM. The research also shows that the number of items declared consistent with the model does not cover all CLASS items but rather some items. This finding indicates that further exploration is needed regarding the CLASS instrument items, especially in the Indonesian version. The findings of this study also add to the wealth of knowledge related to the quality assessment of the CLASS instrument through the modern test theory approach (IRT). Thus, the CLASS instrument can be regarded as a standard instrument and can be used globally across various populations.
Copyright (c) 2024 Mutmainna Mutmainna, Farida Agus Setiawati
The Impact of Sample Size, Test Length, and Person-Item Targeting on the Separation Reliability in Rasch Model: A Simulation Study
This research is a simulation study using resampling methods to see the effect of sample size, test length, and person-item targeting on separation reliability in the Rasch Model. Simulation conditions were created with several predetermined factors, namely sample size with five conditions (200, 500, 1000, 2000, and 4000 person), test length with three conditions (20, 40, and 60 items), and person-item targeting with five conditions (-2, -1, 0, 1, and 2 logit). The total number of conditions is 75 conditions where each condition is replicated 50 times so that a total of 3.750 data are generated. The data is generated using WinGen software. The results of the separation reliability analysis were analyzed using Winsteps software. The separation reliability criteria set are for Person Separation Reliability (PSR) > 0.80 and for Item Separation Reliability (ISR) > 0.90. The results showed that 75 conditions (100%) resulted in ISR estimates that met the criteria (> 0.90). For PSR estimation, 37 conditions (49%) resulted in PSR estimates that met the criteria (> 0.80) and 38 conditions (51%) resulted in PSR estimates that did not meet the criteria (< 0.80). In addition, PSR estimation is influenced by test length and person-item targeting.