Development of Edusmart as an AI-Based Adaptive Learning Application for Needs Analysis Among Indonesian Primary School Students
DOI:
https://doi.org/10.15408/tjems.v12i2.46582Keywords:
EduSmart, artificial intelligence, adaptive learning, AI-based formative assessment, primary education, pembelajaran adaptif, asesmen formatif berbasis AIAbstract
Abstract
Digital transformation in primary education requires learning tools that can support competency-based assessment and respond to students’ diverse learning needs. However, conventional evaluation practices often provide limited diagnostic information for teachers when planning differentiated instruction. This study aimed to develop and conduct an initial classroom trial of EduSmart, an AI-supported adaptive learning application designed to classify students’ competency levels and provide learning recommendations based on quiz performance. The study employed a Research and Development (R&D) approach using the ADDIE model. Participants consisted of 66 fifth-grade students from three public elementary schools in Bekasi Regency. Data were collected through observations, interviews, expert validation, user response questionnaires, and learning outcome tests using a one-group pretest–posttest design. Quantitative data were analyzed using descriptive statistics, paired-sample t-test, and N-Gain analysis, while qualitative data were analyzed thematically with NVivo support. The results showed that EduSmart was rated very feasible by experts, with an average score of 4.5 out of 5. The paired-sample t-test indicated a significant difference between pretest and posttest scores (p < .001), with a mean improvement of 15.68 points. The average N-Gain score was 0.42, indicating moderate improvement. Qualitative findings showed that students responded positively to EduSmart, particularly in terms of ease of use, learning relevance, and motivation. Since the study did not involve a control group, these findings should be interpreted as preliminary evidence of EduSmart’s potential to support adaptive and data-informed learning in primary education.
Abstrak
Transformasi digital dalam pendidikan dasar membutuhkan perangkat pembelajaran yang mampu mendukung asesmen berbasis kompetensi dan merespons kebutuhan belajar siswa yang beragam. Namun, praktik evaluasi konvensional sering kali belum memberikan informasi diagnostik yang cukup bagi guru dalam merancang pembelajaran terdiferensiasi. Penelitian ini bertujuan mengembangkan dan melakukan uji coba awal aplikasi EduSmart, yaitu aplikasi pembelajaran adaptif berbasis AI yang dirancang untuk mengklasifikasikan tingkat kompetensi siswa dan memberikan rekomendasi belajar berdasarkan hasil kuis. Penelitian ini menggunakan pendekatan Research and Development (R&D) dengan model ADDIE. Partisipan penelitian terdiri atas 66 siswa kelas V dari tiga sekolah dasar negeri di Kabupaten Bekasi. Data dikumpulkan melalui observasi, wawancara, validasi ahli, angket respons pengguna, serta tes hasil belajar dengan desain one-group pretest–posttest. Data kuantitatif dianalisis menggunakan statistik deskriptif, paired-sample t-test, dan N-Gain, sedangkan data kualitatif dianalisis secara tematik dengan bantuan NVivo. Hasil penelitian menunjukkan bahwa EduSmart dinilai sangat layak oleh ahli dengan skor rata-rata 4,5 dari 5. Hasil paired-sample t-test menunjukkan perbedaan yang signifikan antara skor pretest dan posttest (p < .001), dengan peningkatan rata-rata sebesar 15,68 poin. Nilai rata-rata N-Gain sebesar 0,42 menunjukkan peningkatan pada kategori sedang. Temuan kualitatif menunjukkan bahwa siswa merespons EduSmart secara positif, terutama pada aspek kemudahan penggunaan, relevansi pembelajaran, dan motivasi belajar. Karena penelitian ini tidak menggunakan kelompok kontrol, temuan tersebut perlu dipahami sebagai bukti awal mengenai potensi EduSmart dalam mendukung pembelajaran adaptif dan berbasis data di pendidikan dasar.
References
Açıkgöz, T., & Babadoğan, M. C. (2021). Competency-based education: Theory and practice. Psycho-Educational Research Reviews, 10(3), 67–95. https://doi.org/10.52963/PERR_Biruni_V10.N3.06
Alamri, H. A. (2021). Learning technology models that support personalization within blended learning environments in higher education. TechTrends, 65(1), 62–78. https://doi.org/10.1007/s11528-020-00530-3
Bhutoria, A. (2022). Personalized education and artificial intelligence in the United States, China, and India: A systematic review using a human-in-the-loop model. Computers and Education: Artificial Intelligence, 3, 100068. https://doi.org/10.1016/j.caeai.2022.100068
Bimpeh, Y. (2024). AI-powered adaptive formative assessment: Validity and reliability evaluation. In P. Ilic & R. Casebourne (Eds.), Artificial intelligence in education: The intersection of technology and pedagogy (pp. 127–144). Springer. https://doi.org/10.1007/978-3-031-71232-6_8
Bosch, E., Seifried, E., & Spinath, B. (2021). What successful students do: Evidence-based learning activities matter for students’ performance in higher education beyond prior knowledge, motivation, and prior achievement. Learning and Individual Differences, 91, 102056. https://doi.org/10.1016/j.lindif.2021.102056
Branch, R. M. (2009). Instructional design: The ADDIE approach. Springer. https://doi.org/10.1007/978-0-387-09506-6
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Cantú-Ortiz, F. J., Galeano Sánchez, N., Garrido, L., Terashima-Marin, H., & Brena, R. F. (2020). An artificial intelligence educational strategy for the digital transformation. International Journal on Interactive Design and Manufacturing, 14(4), 1195–1209. https://doi.org/10.1007/s12008-020-00702-8
Choi, Y., & McClenen, C. (2020). Development of adaptive formative assessment system using computerized adaptive testing and dynamic Bayesian networks. Applied Sciences, 10(22), 8196. https://doi.org/10.3390/app10228196
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE Publications.
de Hoyos, R., Estrada, R., & Vargas, M. J. (2021). What do test scores really capture? Evidence from a large-scale student assessment in Mexico. World Development, 146, 105524. https://doi.org/10.1016/j.worlddev.2021.105524
Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74. https://doi.org/10.1119/1.18809
Huang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023). Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers & Education, 194, 104684. https://doi.org/10.1016/j.compedu.2022.104684
Jebb, A. T., Ng, V., & Tay, L. (2021). A review of key Likert scale development advances: 1995–2019. Frontiers in Psychology, 12, Article 637547. https://doi.org/10.3389/fpsyg.2021.637547
Kabudi, T., Pappas, I., & Olsen, D. H. (2021). AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and Education: Artificial Intelligence, 2, 100017. https://doi.org/10.1016/j.caeai.2021.100017
Ministry of Education and Culture. (2020). Regulation of the Minister of Education and Culture of the Republic of Indonesia Number 22 of 2020 concerning the Strategic Plan of the Ministry of Education and Culture 2020–2024.
Ministry of Education, Culture, Research, and Technology. (2024). Regulation of the Minister of Education, Culture, Research, and Technology Number 12 of 2024 concerning curriculum at the levels of early childhood education, basic education, and secondary education. https://peraturan.bpk.go.id/Details/281847/permendikbudriset-no-12-tahun-2024
Minn, S. (2022). AI-assisted knowledge assessment techniques for adaptive learning environments. Computers and Education: Artificial Intelligence, 3, 100050. https://doi.org/10.1016/j.caeai.2022.100050
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y
Parkavi, R., Karthikeyan, P., & Sheik Abdullah, A. (2024). Enhancing personalized learning with explainable AI: A chaotic particle swarm optimization-based decision support system. Applied Soft Computing, 156, 111451. https://doi.org/10.1016/j.asoc.2024.111451
Rich, J. V., Fostaty Young, S., Donnelly, C., Hall, A. K., Dagnone, J. D., Weersink, K., Caudle, J., Van Melle, E., & Klinger, D. A. (2020). Competency-based education calls for programmatic assessment: But what does this look like in practice? Journal of Evaluation in Clinical Practice, 26(4), 1087–1095. https://doi.org/10.1111/jep.13328
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18, Article 54. https://doi.org/10.1186/s41239-021-00292-9
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
Stefanov, K. (2022). Software systems and frameworks for competency-based learning. Computer, 55(8), 82–88. https://doi.org/10.1109/MC.2022.3148811
Tandika, P. B., & Ndijuye, L. G. (2020). Pre-primary teachers’ preparedness in integrating information and communication technology in teaching and learning in Tanzania. Information and Learning Sciences, 121(1/2), 79–94. https://doi.org/10.1108/ILS-01-2019-0009
UNESCO. (2023). Guidance for generative AI in education and research. UNESCO.
Waheed, H., Hassan, S.-U., Aljohani, N. R., Hardman, J., Alelyani, S., & Nawaz, R. (2020). Predicting academic performance of students from VLE big data using deep learning models. Computers in Human Behavior, 104, 106189. https://doi.org/10.1016/j.chb.2019.106189
Yanes, N., Mostafa, A. M., Ezz, M., & Almuayqil, S. N. (2020). A machine learning-based recommender system for improving students’ learning experiences. IEEE Access, 8, 201218–201235. https://doi.org/10.1109/ACCESS.2020.3036336
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Titin Sunaryati sunaryati, Edi Widodo, Ahmad Firdaus, Muhamad Sudharsono, Muhammad Faiz Rayyan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
