Evaluation of An Existing System Using The System Usability Scale (SUS) as A Guideline for System Improvement
Abstract
The e-Polvot system at the University of Science and Technology Indonesia (USTI) is a digital platform used for student elections, replacing traditional paper-based voting to enhance efficiency and minimize election fraud. This study evaluates the system using the System Usability Scale (SUS) to assess its usability, including efficiency, effectiveness, and user satisfaction. However, SUS alone does not determine failure points but provides a usability score that reflects user perception. A survey was conducted with 88 respondents from three different academic programs, which showed that while the system generally received a "Good" usability rating, certain areas require enhancement to improve user engagement and satisfaction. Based on the findings, this study recommends enhancing the user interface, providing targeted user training, and introducing additional features to broaden the system’s application across academic units. Additionally, the study highlights the potential for expanding the system's functionality beyond student elections, supporting activities such as departmental voting and organizational decision-making processes. These improvements aim to increase user satisfaction and usability, making the system a more effective tool for various academic and institutional contexts.
Full Text:
PDFReferences
.
CONCLUSION
The evaluation of the e-Polvot system using the System Usability Scale (SUS) revealed that while the system effectively supports student elections at USTI, there are opportunities for improvement to enhance user experience and engagement. The analysis showed that although the system was rated as "Good" and "Acceptable," many users remained passive in their support, indicating room for increased satisfaction and adoption. By addressing the identified usability issues and expanding the system's capabilities to include additional features for academic and organizational voting, e-Polvot can become a more versatile and widely-used tool. Key recommendations include improving user interface design, providing comprehensive training for new users, and integrating features that allow the system to be utilized for various academic purposes beyond student elections. Implementing these changes will likely lead to higher user satisfaction and broaden the system's applicability, reinforcing its role as an essential platform within the academic community.
REFERENCES
M. K. Anam, F. Zoromi, Soni, T. Nasution, and K. Andesa, “Penerapan Model Technology Readiness Index Untuk Mengukur Tingkat Kesiapan Mahasiswa dalam Penerimaan Sistem E-POLVOT,” Jurnal Teknologi Informasi dan Ilmu Komputer (JTIIK), vol. 10, no. 6, pp. 1401–1408, 2023, doi: 10.25126/jtiik.2023107368.
D. Daryanto, M. K. Anam, Y. Efendi, and R. Rahmaddeni, “Pengujian ISO 25010 Pada Smart Chair Akupresure Berbasis Internet Of Things (IoT),” JURNAL MEDIA INFORMATIKA BUDIDARMA, vol. 6, no. 3, pp. 1476–1483, 2022, doi: 10.30865/mib.v6i3.4134.
M. K. Anam, S. D. Putri, D. Yuliana, E. Yumami, and T. P. Lestari, “Application Of the Cobit 2019 Framework to Analyse the Security Of Academic Information Systems,” Decode: Jurnal Pendidikan Teknologi Informasi, vol. 3, no. 2, pp. 296–309, Jul. 2023, doi: 10.51454/decode.v3i2.192.
C. Putri and R. Sutomo, “Evaluation of Ultima InfoSys Site Usability Using Usability Test & System Usability Scale Method,” Ultima Infosys : Jurnal Ilmu Sistem Informasi, vol. 13, no. 2, pp. 85–93, 2022, doi: 10.31937/si.v13i2.2812.
T. S. Syamfithriani, N. Mirantika, Daswa, F. Yusuf, and E. Kurniadi, “M-Commerce application acceptance analysis using Technology Readiness Index (TRI) model in Kuningan Regency,” in Journal of Physics: Conference Series, IOP Publishing Ltd, Jun. 2021. doi: 10.1088/1742-6596/1933/1/012012.
S. Husein and A. N. Fajar, “Design of a Cloud Based Information System for Education Institution using TOGAF ADM,” International Journal of Recent Technology and Engineering, vol. 8, no. 6, pp. 279–285, 2020, doi: 10.35940/ijrte.f7184.038620.
R. Y. Manurung, D. Krisbiantoro, and D. A. B. Utami, “Usability Evaluation of Tokopedia Application Version 3.242 Using System Usability Scale (SUS) Method,” Sinkron, vol. 9, no. 1, pp. 366–374, Jan. 2024, doi: 10.33395/sinkron.v9i1.13191.
F. F. Adelia, M. K. Anam, T. A. Fitri, and F. Zoromi, “Analisis Perspektif Pada Penerapan E-Money Menggunakan Delone And Mclean Is Success Model Di Bandara Sultan Syarif Kasim II Pekanbaru,” Jurnal Informatika & Rekayasa Elektronika, vol. 3, no. 2, pp. 100–110, 2020, doi: https://doi.org/10.36595/jire.v3i2.256.
M. K. Anam, M. Fuad, H. Yenni, S. E. Fatda, H. Asnal, and H. Hamdani, “Application of usability testing for analyzing the quality of ‘Keluarga’ pharmacy system in Pekanbaru,” ILKOM Jurnal Ilmiah, vol. 13, no. 3, pp. 244–251, 2021, doi: 10.33096/ilkom.v13i3.870.244-251.
A. R. E. Najaf, R. Permatasari, and C. S. Sakti, “Evaluating the Usability of a Book Stock and Sales Recording Android App: System Usability Scale (SUS), Heuristic Evaluation, and Maze Tool Insights,” Journal of Information Systems and Informatics, vol. 6, no. 3, pp. 1774–1789, Sep. 2024, doi: 10.51519/journalisi.v6i3.829.
A. E. Maulana, A. K. Rivai, and S. Sarwani, “Analisis Kualitas Sistem Layanan Penilaian Buku Pendidikan Agama (Silpbpa) Menggunakan Metode System Usability Scale (SUS) dan Pengembangannya Menggunakan Scrum Berbasis Web,” Jurnal Teknik Informatika, vol. 13, no. 2, pp. 103–122, 2020, doi: 10.15408/jti.v13i2.17778.
F. G. Sembodo, G. F. Fitriana, and N. A. Prasetyo, “Evaluasi Usability Website Shopee Menggunakan System Usability Scale (SUS),” Journal of Applied Informatics and Computing (JAIC), vol. 5, no. 2, pp. 146–150, 2021, doi: 10.30871/jaic.v5i2.3293.
F. Purwaningtias and U. Ependi, “Pengujian Usability Website Pondok Pesantren Qodratullah Menggunakan System Usability Scale,” Jurnal Sains dan Informatika, vol. 6, no. 1, pp. 34–43, Jun. 2020, doi: 10.34128/jsi.v6i1.220.
M. Hyzy et al., “System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis,” JMIR Mhealth Uhealth, vol. 10, no. 8, pp. 1–11, Aug. 2022, doi: 10.2196/37290.
Y. Natrio, R. A. Malik, and R. Kasrin, “Uncovering User Experience Evaluation in Nursing-English Several platforms Through SUS and PSSUQ,” JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), vol. 9, no. 4, pp. 2403–2417, Nov. 2024, doi: 10.29100/jipi.v9i4.6780.
I. Rachmawati and R. Setyadi, “Evaluasi Usability Pada Sistem Website Absensi Menggunakan Metode SUS,” Journal of Information System Research (JOSH), vol. 4, no. 2, pp. 551–561, Jan. 2023, doi: 10.47065/josh.v4i2.2868.
S. R. Arifin, “System Usability Scale (SUS) implementation in Ruang Baca Virtual – UT Library,” MATRIX: Jurnal Manajemen Teknologi dan Informatika, vol. 14, no. 1, pp. 1–8, Mar. 2024, doi: 10.31940/matrix.v14i1.1-8.
D. Menon and K. Shilpa, “‘Chatting with ChatGPT’: Analyzing the factors influencing users’ intention to Use the Open AI’s ChatGPT using the UTAUT model,” Heliyon, vol. 9, no. 11, Nov. 2023, doi: 10.1016/j.heliyon.2023.e20962.
S. Erlinda, M. K. Anam, T. Nasution, Ambiyar, and D. Irfan, “Analisis Tingkat Objektifitas Pengisian Edom Untuk Meningkatkan Kualitas Pembelajaran Dosen,” JURTEKSI (Jurnal Teknologi dan Sistem Informasi), vol. VII, no. 1, pp. 105–114, 2020, doi: https://doi.org/10.33330/jurteksi.v7i1.881.
D. K. Rinjany, “Does Technology Readiness and Acceptance Induce more Adoption of E-Government? Applying the UTAUT and TRI on an Indonesian Complaint-Based Application,” Policy & Governance Review, vol. 4, no. 1, p. 68, 2020, doi: 10.30589/pgr.v4i1.157.
T. A. Puspito, “Evaluation of Website Performance and Usability Using GTMetrix, Usability Testing, and System Usability Scale (SUS) Methods,” JURNAL TEKNIK INFORMATIKA, vol. 17, no. 2, pp. 162–170, Oct. 2024, doi: 10.15408/jti.v17i2.38530.
E. Rahmawati and I. Hasan Basri, “Perancangan Sistem Informasi Pengelolaan Arsip Berbasis Web Dengan Metode Prototype,” Indonesian Journal on Software Engineering (IJSE), vol. 10, no. 1, pp. 52–62, 2024, doi: 10.31294/ijse.v10i1.21170.
Ahmad Fauzi Sarumpaet and Rayyan Firdaus, “Implementasi Sistem Informasi Manajemen pada Lembaga Pendidikan atau Sosial Formal,” Merkurius : Jurnal Riset Sistem Informasi dan Teknik Informatika, vol. 2, no. 4, pp. 194–207, Jun. 2024, doi: 10.61132/merkurius.v2i4.163.
S. Dika Pratama and M. Noviarsyah Dadaprawira, “Pengujian Black Box Testing Pada Aplikasi Edu Digital Berbasis Website Menggunakan Metode Equivalence Dan Boundary Value,” Jurnal Teknologi Sistem Informasi dan Sistem Komputer TGD, vol. 6, no. 2, pp. 560–569, 2023, doi: 10.53513/jsk.v6i2.8166.
Y. Margaretta, T. Andistika Despayani, Y. Amri, D. Natasia Watunglawar, and A. Taryana, “Implementasi Design Thinking Pada Prototype Konten Media Sosial Produk AC Ramah Lingkungan,” Jurnal Ilmiah MEA, vol. 8, no. 2, pp. 1904–1923, 2024, doi: 10.31955/mea.v8i2.4260.
M. T. Abdillah et al., “Implementasi Black box Testing dan Usability Testing pada Website Sekolah MI Miftahul Ulum Warugunung Surabaya,” Jurnal Ilmu Komputer dan Desain Komunikasi Visual, vol. 8, no. 1, pp. 234–242, 2023, doi: 10.55732/jikdiskomvis.v8i1.897.
A. Ilman Dinan Tandra et al., “Perancangan User Interface dan User Experience Aplikasi Produk Digital Menggunakan Metode Lean Ux,” Jurnal Nasional Komputasi dan Teknologi Informasi (JNKTI), vol. 7, no. 6, pp. 1879–1886, 2024, doi: 10.32672/jnkti.v7i6.8323.
A. Ruangkanjanases, O. Sivarak, C. T. Chen, A. Khan, and S. C. Chen, “Evaluating the influence of characteristics on the acceptance of artificial intelligence application: An empirical study,” Heliyon, vol. 10, no. 21, Nov. 2024, doi: 10.1016/j.heliyon.2024.e39460.
S. Subhan, “Analisis penerapan UI/UX dalam aplikasi media sosial: Dampaknya terhadap keterlibatan pengguna dan loyalitas platform,” Jurnal Teknik Industri Terintegrasi, vol. 7, no. 4, pp. 2128–2137, Oct. 2024, doi: 10.31004/jutin.v7i4.36161.
A. Dwinggo Samala et al., “Rancang Bangun Aplikasi E-Sertifikat Berbasis Web Menggunakan Metode Pengembangan Waterfall,” Jurnal Teknik Informatika, vol. 13, no. 2, pp. 147–156, 2020, doi: 10.15408/jti.v13i2.16470.
DOI: https://doi.org/10.15408/jti.v18i1.40766
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 M. Khairul anam, Susanti Susanti, Nurjayadi Nurjayadi, Fransiskus Zoromi, Atalya Kurnia Sari
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
3rd Floor, Dept. of Informatics, Faculty of Science and Technology, UIN Syarif Hidayatullah Jakarta
Jl. Ir. H. Juanda No.95, Cempaka Putih, Ciputat Timur.
Kota Tangerang Selatan, Banten 15412
Tlp/Fax: +62 21 74019 25/ +62 749 3315
Handphone: +62 8128947537
E-mail: jurnal-ti@apps.uinjkt.ac.id
Jurnal Teknik Informatika by Prodi Teknik Informatika Universitas Islam Negeri Syarif Hidayatullah Jakarta is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://journal.uinjkt.ac.id/index.php/ti.
JTI Visitor Counter: View JTI Stats