Evaluation of E-Learning Usability Based on ISO 25010 with Hofstede's Cultural Dimensions as Moderation: A PLS-SEM Study in Higher Education
Abstract
Although e-learning has rapidly advanced in higher education, many platforms still fall short of meeting user needs due to a lack of integration between usability and cultural dimensions. This study explores how usability influences user satisfaction with e-learning platforms, with cultural dimensions based on Hofstede’s model examined as moderating variables. Usability Quality (QiU) is assessed using the ISO/IEC 25010 framework, which includes five key elements: effectiveness, efficiency, user satisfaction, risk avoidance, and contextual relevance. A total of 384 students from private universities in Bali participated in the study, representing a diverse range of academic disciplines. Using SmartPLS and Partial Least Squares Structural Equation Modeling (PLS-SEM), the analysis revealed that usability has a significant effect on user satisfaction (T=7.528, β=0.270), and cultural variables also play a substantial role (T=21.094, β=0.704). Although the moderating effect of culture was statistically significant (T=2.379, β=0.042), its impact was relatively modest compared to the direct effect of usability. Among the usability components, efficiency emerged as the most influential factor. Regarding cultural dimensions, individualism versus collectivism was found to have the strongest effect. These findings emphasize the importance of designing e-learning systems that are both usability-driven and culturally sensitive, ensuring alignment with user expectations and the educational context.
Keywords
Full Text:
PDFReferences
A. R. Alenezi, “An empirical study into the role of quality factors in influencing the effectiveness of the e-learning system: An academic staff perspective,” International Journal of Education and Information Technologies, vol. 16, pp. 62–71, Jan. 2022, doi: 10.46300/9109.2022.16.7.
J. Alqurni, “Assessing the usability of e-learning software among university students: A study on student satisfaction and performance,” International Journal of Information Technology and Web Engineering, vol. 18, no. 1, pp. 1–26, 2023, doi: 10.4018/IJITWE.329198.
H. Heryanto, S. Tambun, R. Pramono, D. Priyanti, and I. C. Siregar, “E-Learning quality: The role of learning technology utilization effectiveness teacher leadership and curriculum during the pandemic season in Indonesia,” International Journal of Data and Network Science, vol. 7, no. 4, pp. 1451–1462, Sep. 2023, doi: 10.5267/j.ijdns.2023.8.017.
M. Sheikh, A. H. Muhammad, and Q. N. H. Naveed, “Enhancing usability of e-learning platform: A case study of khan academy,” sjesr, vol. 4, no. 2, pp. 40–50, May 2021, doi: 10.36902/sjesr-vol4-iss2-2021(40-50).
S. A. El-Aasar and G. F. Farghali, “Predictive study of the factors and challenges affecting the usability of e-learning platforms in the light of COVID-19,” International Journal of Education in Mathematics, Science and Technology, vol. 10, no. 3, pp. 568–589, 2022, doi: 10.46328/ijemst.2428.
R. Setyadi, A. A. Rahman, and T. Anwar, “Evaluation of the orthopedic hospital website’s performance using user acceptance testing,” Applied Information System and Management (AISM), vol. 8, no. 1, pp. 65–70, May 2025, doi: 10.15408/aism.v8i1.42951.
M. W. Wijaya and B. Waspodo, “Usability analysis of trello using the system usability scale (SUS) at the UIN jakarta career development center,” Applied Information System and Management (AISM), vol. 7, no. 2, Sep. 2024, doi: 10.15408/aism.v7i2.38220.
L. Souza-Pereira, N. Pombo, and S. Ouhbi, “Software quality: Application of a process model for quality-in-use assessment,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 7, pp. 4626–4634, Jul. 2022, doi: 10.1016/j.jksuci.2022.03.031.
L. Souza-Pereira, S. Ouhbi, and N. Pombo, “A process model for quality in use evaluation of clinical decision support systems,” J Biomed Inform, vol. 123, Art. no. 103917, Sep. 2021, doi: 10.1016/j.jbi.2021.103917.
N. Ngadiman, S. Sulaiman, N. Idris, M. R. Samingan, and H. Mohamed, “Systematic review on software quality in educational applications,” IEEE Access, vol. 9, pp. 60187–60200, Jan. 2021, doi: 10.1109/access.2021.3072223.
A. Alsswey and H. Al-Samarraie, “The role of hofstede’s cultural dimensions in the design of user interface: The case of Arabic,” Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM, vol. 35, no. 1, pp. 116–127, Feb. 2021, doi: 10.1017/S0890060421000019.
J. Siebert et al., “Construction of a quality model for machine learning systems,” Software Quality Journal, vol. 30, no. 2, pp. 307–335, Jun. 2022, doi: 10.1007/s11219-021-09557-y.
A. Jabborov, A. Kharlamova, Z. Kholmatova, A. Kruglov, V. Kruglov, and G. Succi, “Taxonomy of quality assessment for intelligent software systems: A systematic literature review,” IEEE Access, vol. 11, pp. 130491–130507, 2023, doi: 10.1109/ACCESS.2023.3333920.
M. A. Mannan and A. Ansari, “SPMM: A model taxonomy for designing and managing quality system,” IEEE Access, vol. 10, pp. 76720–76730, 2022, doi: 10.1109/ACCESS.2022.3190081.
E. Jharko, “Ensuring the software quality for critical infrastructure objects,” IFAC-PapersOnLine, vol. 54, no. 13, pp. 499–504, Jan. 2021, doi: 10.1016/j.ifacol.2021.10.498.
J. Jan, K. A. Alshare, and P. L. Lane, “Hofstede’s cultural dimensions in technology acceptance models: a meta-analysis,” Univers Access Inf Soc, vol. 23, no. 2, pp. 717–741, Jun. 2024, doi: 10.1007/s10209-022-00930-7.
N. Barz, M. Benick, L. Dörrenbächer-Ulrich, and F. Perels, “Students’ acceptance of e-learning: extending the technology acceptance model with self-regulated learning and affinity for technology,” Discover Education, vol. 3, no. 1, Jul. 2024, doi: 10.1007/s44217-024-00195-7.
R. Wandira, A. Fauzi, and F. Nurahim, “Analysis of factors influencing behavioral intention to use cloud-based academic information system using extended technology acceptance model (TAM) and expectation-confirmation model (ECM),” Journal of Information Systems Engineering and Business Intelligence, vol. 10, no. 2, pp. 179–190, Jun. 2024, doi: 10.20473/jisebi.10.2.179-190.
J. F. Hair Jr, G. T. M. Hult, C. Ringle, and M. Sarstedt, A primer on Partial Least squares Structural Equation Modeling (PLS-SEM). SAGE Publications, 2016.
G. S. Nadella, K. Meduri, S. Satish, M. H. Maturi, and H. Gonaygunta, “Examining E-learning tools impact using IS-impact model: A comparative PLS-SEM and IPMA case study,” Journal of Open Innovation: Technology, Market, and Complexity, vol. 10, no. 3, Sep. 2024, doi: 10.1016/j.joitmc.2024.100351.
H. Nordin, D. Singh, Z. Mansor, and E. Yadegaridehkordi, “Impact of power distance cultural dimension in e-learning interface design among malaysian generation z students,” IEEE Access, vol. 10, pp. 64199–64208, 2022, doi: 10.1109/ACCESS.2022.3183117.
Y. Li, J. Karreman, and M. De Jong, “Cultural Differences in web design on chinese and western websites: A literature review,” in IEEE International Professional Communication Conference, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 105–111. doi: 10.1109/ProComm53155.2022.00023.
T. Ariel Tandra and L. E. F. Rofil, “Cultural dimensions and intercultural user interface design (IUID) in a learning management system: Indonesian and International Student Perspectives,” in E3S Web of Conferences, EDP Sciences, Sep. 2023. doi: 10.1051/e3sconf/202342601100.
A. K. Alhazmi, A. Imtiaz, F. Al-Hammadi, and E. Kaed, “Success and failure aspects of LMS in e-learning systems,” International Journal of Interactive Mobile Technologies, vol. 15, no. 11, pp. 133–147, 2021, doi: 10.3991/ijim.v15i11.20805.
A. Nuryatin, H. Mukhibad, and T. Tusyanah, “Effectiveness of online learning at universities: do sociocultural differences matter?,” European Journal of Educational Research, vol. 11, no. 4, pp. 2153–2166, Oct. 2022, doi: 10.12973/eu-jer.11.4.2153.
N. Gurjar and H. Bai, “Assessing culturally inclusive instructional design in online learning,” Educational Technology Research and Development, vol. 71, no. 3, pp. 1253–1274, Jun. 2023, doi: 10.1007/s11423-023-10226-z.
S. Jorgji et al., “A cross-cultural study of university students’ e-learning adoption,” Emerging Science Journal, vol. 8, no. 3, pp. 1060–1074, Jun. 2024, doi: 10.28991/ESJ-2024-08-03-015.
O. I. B. Hariyanto and D. P. Alamsyah, “Student individual performance in online learning: Technology adoption and culture,” in 2023 4th International Conference on Big Data Analytics and Practices, IBDAP 2023, Institute of Electrical and Electronics Engineers Inc., 2023. doi: 10.1109/IBDAP58581.2023.10271998.
M. Mulyanto and A. H. Sujiatmoko, “EFL learners’ cultural perspectives towards online learning through flipped classrooms in indonesia for facing 4.0 industry era,” Journal of Social Science, vol. 3, no. 5, pp. 918–928, Aug. 2022, doi: 10.46799/jss.v3i5.396.
S. Bak, “Understanding an Importance of interculturalism in the learning process,” International Journal of Social Science and Human Research, vol. 04, no. 08, Aug. 2021, doi: 10.47191/ijsshr/v4-i8-07.
R. Luppicini and E. Walabe, “Exploring the socio-cultural aspects of e-learning delivery in saudi arabia,” Journal of Information, Communication and Ethics in Society, vol. 19, no. 4, pp. 560–579, 2021, doi: 10.1108/JICES-03-2021-0034.
L. K. Yuki, N. Anoegrajekti, N. Lustyantie, and K. H. Abdullah, “Mapping the intersection of e-learning, culture, and tradition: A bibliometric analysis,” Journal of Education and Learning, vol. 19, no. 2, pp. 1083–1094, May 2025, doi: 10.11591/edulearn.v19i2.21199.
A. Tlili et al., “Impact of cultural diversity on students’ learning behavioral patterns in open and online courses: A lag sequential analysis approach,” Interactive Learning Environments, vol. 31, no. 6, pp. 3951–3970, 2023, doi: 10.1080/10494820.2021.1946565.
D. Galin, Software Quality: Concepts and Practice. New Jersey: John Wiley & Sons, 2018.
P. Gerlach and K. Eriksson, “Measuring cultural dimensions: external validity and internal consistency of hofstede’s VSM 2013 scales,” Front Psychol, vol. 12, Apr. 2021, doi: 10.3389/fpsyg.2021.662604.
M. Sarstedt, J. F. Hair, M. Pick, B. D. Liengaard, L. Radomir, and C. M. Ringle, “Progress in partial least squares structural equation modeling use in marketing research in the last decade,” Psychol Mark, vol. 39, no. 5, pp. 1035–1064, May 2022, doi: 10.1002/mar.21640.
H. Panduwiyasa, M. Saputra, Z. F. Azzahra, and A. R. Aniko, “Accounting and smart system: functional evaluation of ISO/IEC 25010:2011 quality model (a case study),” IOP Conf Ser Mater Sci Eng, vol. 1092, no. 1, Art. no. 012065, Mar. 2021, doi: 10.1088/1757-899x/1092/1/012065.
J. Henseler, C. M. Ringle, and M. Sarstedt, “A new criterion for assessing discriminant validity in variance-based structural equation modeling,” J Acad Mark Sci, vol. 43, no. 1, pp. 115–135, Jan. 2015, doi: 10.1007/s11747-014-0403-8.
A. S. M. Yusoff, F. S. Peng, F. Z. A. Razak, and W. A. Mustafa, “Discriminant validity assessment of religious teacher acceptance: The use of HTMT criterion,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Jun. 2020. doi: 10.1088/1742-6596/1529/4/042045.
F. H. M. Asri, D. Singh, Z. Mansor, and H. Norman, “A review of cross-cultural design to improve user engagement for learning management system,” KSII Transactions on Internet and Information Systems, vol. 18, no. 2, pp. 397–419, Feb. 2024, doi: 10.3837/tiis.2024.02.007.
J. W. A. Witsenboer, K. Sijtsma, and F. Scheele, “Measuring cyber secure behavior of elementary and high school students in the Netherlands,” Computers & Education, vol. 186, Art. no. 104536, May 2022, doi: 10.1016/j.compedu.2022.104536.
DOI: https://doi.org/10.15408/aism.v8i1.45738
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
EDITORIAL ADDRESS:
Department of Information Systems, Faculty of Science and Technology,
Universitas Islam Negeri (UIN) Syarif Hidayatullah Jakarta
Faculty of Science and Technology Building, 3rd Floor, 1st Campus, Universitas Islam Negeri (UIN) Syarif Hidayatullah Jakarta
Jl. Ir. H. Juanda No. 95, Ciputat Timur, Kota Tangerang Selatan, Banten 15412, Indonesia.
Tlp/Fax: +622174019 25/+62217493315.
E-mail: aism.journal@apps.uinjkt.ac.id, Website: https://journal.uinjkt.ac.id/index.php/aism
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Applied Information System and Management (AISM) | E-ISSN: 2621-254 | P-ISSN: 2621-2536
https://journal.uinjkt.ac.id/index.php/aism