Sentiment Analysis of COVID-19 Booster Vaccines on Twitter Using Multi-Class Support Vector Machine

Andi Nurkholis; Styawati Styawati; Syahirul Alim; Hendi Saputra; Andrey Ferriyan

doi:10.15408/aism.v8i1.42911

Sentiment Analysis of COVID-19 Booster Vaccines on Twitter Using Multi-Class Support Vector Machine

Andi Nurkholis, Styawati Styawati, Syahirul Alim, Hendi Saputra, Andrey Ferriyan

Abstract

As part of its response to combat COVID-19, the Indonesian government has implemented a booster vaccination program. This policy has sparked various public responses, particularly across the Twitter platform. This research examines public sentiment regarding booster vaccines by analysing Twitter data through the Support Vector Machine (SVM) algorithm. The research utilises sentiment analysis, a text mining and processing technique, to represent and interpret text-based data. By examining the sentiment expressed in tweets, the study seeks better to understand the public discourse on booster shots on Twitter. The study also conducts a multi-class parameter assessment of SVM, combining One-against-one and One-against-rest approaches with various kernels (Sigmoid, Polynomial, and RBF) to obtain optimal results. The highest accuracy rate of 96% is achieved using the One Against One method combined with the RBF kernel. This is closely followed by implementations using the Polynomial kernel at 95.2% and the Sigmoid kernel at 93.7%. When employing the One Against Rest method, the RBF kernel demonstrates superior performance with 95.5% accuracy compared to both Polynomial and Sigmoid kernels. Based on these evaluation results, it is evident that integrating the One Against One approach with the RBF kernel delivers the most optimal accuracy among all tested combinations. The sentiment class distribution in the optimal model classifies 49 tweets as positive, 927 as neutral, and 24 as negative.

Keywords

Booster vaccine, COVID-19, sentiment analysis, support vector machine.

Full Text:

PDF

References

N. W. P. Y. Praditya, A. K. Syaka, and R. Anggraini, “Correlation Analysis and Prediction of Confirmed Cases of Covid 19 and Meteorological Factor,” Applied Information System and Management (AISM), vol. 7, no. 1, pp. 9–16, 2024.

H. Harapan et al., “Drivers of and Barriers to COVID-19 Vaccine Booster Dose Acceptance in Indonesia,” Vaccines (Basel), vol. 10, no. 12 (1981), pp. 1–20, 2022.

R. Rahmadyanti and M. Masruloh, “Community Knowledge and Attitude to Conduct Covid-19 Booster Vaccination,” Jurnal Keperawatan Komprehensif (Comprehensive Nursing Journal), vol. 8, no. 3, pp. 362–367, 2022.

H. Harapan et al., “Willingness to Pay (WTP) for COVID-19 Vaccine Booster Dose and Its Determinants in Indonesia,” Infect Dis Rep, vol. 14, no. 6, pp. 1017–1032, 2022.

S. Styawati, A. Nurkholis, E. Winarko, Y. Rahmanto, M. A. Reza, and I. Ismail, “Sentiment Analysis of Indonesian Government Policy using Support Vector Machine-Word2Vec,” in 2022 International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), Dec. 2022.

T. Aichner, M. Grünfelder, O. Maurer, and D. Jegeni, “Twenty-five years of social media: a review of social media applications and definitions from 1994 to 2019,” Cyberpsychol Behav Soc Netw, vol. 24, no. 4, pp. 215–222, 2021.

E. Chen, K. Lerman, and E. Ferrara, “Tracking social media discourse about the covid-19 pandemic: Development of a public coronavirus twitter data set,” JMIR Public Health Surveill, vol. 6, no. 2, Art.. no. e19273, 2020.

S. Styawati, A. Nurkholis, A. A. Aldino, S. Samsugi, E. Suryati, and R. P. Cahyono, “Sentiment Analysis on Online Transportation Reviews Using Word2Vec Text Embedding Model Feature Extraction and Support Vector Machine (SVM) Algorithm,” in 2021 International Seminar on Machine Learning, Optimization, and Data Science, ISMODE 2021, 2022. doi: 10.1109/ISMODE53584.2022.9742906.

A. Kumar and G. Garg, “Systematic literature review on context-based sentiment analysis in social multimedia,” Multimed Tools Appl, vol. 79, pp. 15349–15380, 2020.

P. Nandwani and R. Verma, “A review on sentiment analysis and emotion detection from text,” Soc Netw Anal Min, vol. 11, Art. No. 81, 2021, doi: 10.1007/s13278-021-00776-6.

A. Budianto, R. Ariyuana, and D. Maryono, “Comparison of K-Nearest Neighbor (Knn) and Support Vector Machine (Svm) in the Recognition of Motor Vehicle Plate Characters,” Jurnal Ilmiah Pendidikan Teknik dan Kejuruan, vol. 11, no. 1, pp. 27–35, 2019.

F. Fitriana, E. Utami, and H. Al Fatta, “Opinion Sentiment Analysis of the Covid-19 Vaccine on Twitter Social Media Using Support Vector Machine and Naive Bayes,” Jurnal Komtika (Komputasi Dan Informatika), vol. 5, no. 1, pp. 19–25, 2021.

M. Azhari, Z. Situmorang, and R. Rosnelly, “Comparison of Accuracy, Recall, and Classification Precision on C4.5 Algorithm, Random Forest, SVM and Naive Bayes,” Jurnal Media Informatika Budidarma, vol. 5, no. 2, pp. 640–651, 2021.

R. R. N. Bhactiar and D. Hartanti, “Hybrid Decision Tree Method and C4. 5 Algorithm for a Recommendation System in Determining Recipients of Direct Cash Assistance (BLT),” Journal of Computer Networks, Architecture and High Performance Computing, vol. 5, no. 2, pp. 368–377, 2023.

A. A. A. Mas’amah, F. E. Jelahut, and A. Mallongi, “The Influence of Mass Media Content on the Effectiveness of Covid-19 Vaccination Achievements in East Nusa Tenggara, Indonesia,” Journal of Namibian Studies: History Politics Culture, vol. 34, pp. 2594–2608, 2023.

A. Nurkholis, D. Alita, and A. Munandar, “Comparison of Kernel Support Vector Machine Multi-Class in PPKM Sentiment Analysis on Twitter,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 6, no. 2, pp. 227–233, Apr. 2022.

A. Nurkholis and I. S. Sitanggang, “A spatial analysis of soybean land suitability using spatial decision tree algorithm,” in Proceedings of SPIE - The International Society for Optical Engineering, 2019. doi: 10.1117/12.2541555.

A. Nurkholis, Styawati, D. Alita, A. Sucipto, M. Chanafy, and Z. Amalia, “Hotspot Classification for Forest Fire Prediction using C5.0 Algorithm,” in 2021 International Conference on Intelligent Cybernetics Technology and Applications (ICICyTA), 2021, doi: 10.1109/ICICyTA53712.2021.9689085.

Q.-T. Phan, Y.-K. Wu, and Q.-D. Phan, “An overview of data preprocessing for short-term wind power forecasting,” in 2021 7th International Conference on Applied System Innovation (ICASI), 2021, pp. 121–125.

A. Nurkholis, I. S. Sitanggang, Annisa, and Sobir, “Spatial decision tree model for garlic land suitability evaluation,” IAES International Journal of Artificial Intelligence, vol. 10, no. 3, pp. 666–675, 2021, doi: 10.11591/ijai.v10.i3.pp666-675.

M. I. Alfarizi, L. Syafaah, and M. Lestandy, “Emotional Text Classification Using TF-IDF (Term Frequency-Inverse Document Frequency) And LSTM (Long Short-Term Memory),” JUITA: Jurnal Informatika, vol. 10, no. 2, pp. 225–232, 2022.

D. A. Otchere, T. O. A. Ganat, R. Gholami, and S. Ridha, “Application of supervised machine learning paradigms in the prediction of petroleum reservoir properties: Comparative analysis of ANN and SVM models,” J Pet Sci Eng, vol. 200, pp. 1–20, 2021.

A. A. Ajhari, “The Comparison of Sentiment Analysis of Moon Knight Movie Reviews between Multinomial Naive Bayes and Support Vector Machine,” Applied Information System and Management (AISM), vol. 6, no. 1, pp. 13–20, 2023, doi: 10.15408/aism.v6i1.26045.

S. Styawati and K. Mustofa, “A Support Vector Machine-Firefly Algorithm for Movie Opinion Data Classification,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 13, no. 3, pp. 219–230, 2019.

A. Nurkholis, Styawati, I. S. Sitanggang, Jupriyadi, A. Matin, and P. Maulana, “SVM Multi-Class Algorithm for Soybean Land Suitability Evaluation,” in 2022 International Conference on Information Technology Research and Innovation, ICITRI 2022, 2022. doi: 10.1109/ICITRI56423.2022.9970216.

X. He, Z. Wang, C. Jin, Y. Zheng, and X. Xue, “A simplified multi-class support vector machine with reduced dual optimization,” Pattern Recognit Lett, vol. 33, no. 1, pp. 71–82, 2012.

DOI: https://doi.org/10.15408/aism.v8i1.42911

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

EDITORIAL ADDRESS:

Department of Information Systems, Faculty of Science and Technology,
Universitas Islam Negeri (UIN) Syarif Hidayatullah Jakarta
Faculty of Science and Technology Building, 3rd Floor, 1st Campus, Universitas Islam Negeri (UIN) Syarif Hidayatullah Jakarta
Jl. Ir. H. Juanda No. 95, Ciputat Timur, Kota Tangerang Selatan, Banten 15412, Indonesia.
Tlp/Fax: +622174019 25/+62217493315.
E-mail: aism.journal@apps.uinjkt.ac.id, Website: https://journal.uinjkt.ac.id/index.php/aism

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.