Klasifikasi Ujaran Kebencian Teks Bahasa Gaul Terkait Isu Israel Menggunakan Support Vector Machine

Kamila Insani P; Mahardika Abdi Prawira Tanjung

doi:10.33151/ijomss.v4i5.1116

Kamila Insani P Universitas Muhammadiyah Sumatera Utara
Mahardika Abdi Prawira Tanjung Universitas Muhammadiyah Sumatera Utara

DOI: https://doi.org/10.33151/ijomss.v4i5.1116

Keywords: Ujaran Kebencian, Bahasa Gaul, Support Vector Machine, TF-IDF, YouTube

Abstract

Penelitian ini bertujuan mengembangkan sistem klasifikasi ujaran kebencian berbahasa Indonesia pada teks bahasa gaul yang berkaitan dengan isu Israel di platform YouTube. Tingginya potensi polarisasi opini pada kolom komentar terkait isu geopolitik tersebut, serta terbatasnya penelitian yang menyasar variasi bahasa informal, menjadi latar belakang utama penelitian ini. Pendekatan kuantitatif dengan desain penelitian eksperimen digunakan, berbasis metode Support Vector Machine (SVM). Data dikumpulkan melalui teknik web scraping menggunakan YouTube Data API v3 terhadap 79 video, menghasilkan 15.096 komentar mentah yang kemudian melalui tahap praproses berupa case folding, normalisasi bahasa gaul, tokenizing, stopword removal, dan stemming sehingga menghasilkan 13.314 data bersih. Data dilabeli secara otomatis berbasis leksikon, kemudian diekstraksi fiturnya menggunakan TF-IDF sebanyak 5.000 fitur sebelum dilatih dengan model SVM berkernel linear. Hasil pengujian terhadap 2.663 data uji menunjukkan performa model yang sangat baik, dengan akurasi 99,10%, presisi 97,28%, recall 93,63%, dan F1-Score 95,42% pada kelas ujaran kebencian. Ujaran kebencian yang ditemukan didominasi kata kasar dan kata bermuatan hasutan, dengan proporsi 10,02% dari keseluruhan data. Model selanjutnya diimplementasikan pada sistem web SIKUK berbasis PHP native untuk mendukung moderasi konten secara cepat dan objektif.

Author Biographies

Kamila Insani P, Universitas Muhammadiyah Sumatera Utara

Program Studi Sistem Informasi, Fakultas Ilmu Komputer dan Teknologi Informasi

Mahardika Abdi Prawira Tanjung, Universitas Muhammadiyah Sumatera Utara

Program Studi Sistem Informasi, Fakultas Ilmu Komputer dan Teknologi Informasi

References

Allahyari, M., Pouriyeh, S., Assefi, M., Safaei, S., Trippe, E. D., Gutierrez, J. B., & Kochut, K. (2017). A brief survey of text mining: Classification, clustering and extraction techniques. arXiv preprint. https://doi.org/10.48550/arXiv.1707.02919

Chakravarthi, B. R. (2024). Detection of homophobia and transphobia in YouTube comments. International Journal of Data Science and Analytics, 18(1), 49–68. https://doi.org/10.1007/s41060-023-00400-0

Chicco, D., & Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics, 21(1), 6. https://doi.org/10.1186/s12864-019-6413-7

Chimkhlai, P., & Panyametheekul, S. (2023). Hate speech in YouTube comments on Rohingya refugees in Thailand and Syrian refugees in Europe. LEARN Journal: Language Education and Acquisition Research Network, 17(1), 133–161.

Hofmann, S., Sommermann, C., Kraus, M., Zschech, P., & Rosenberger, J. (2025). Hate speech and sentiment of YouTube video comments from public and private sources covering the Israel-Palestine conflict. arXiv. https://doi.org/10.48550/arXiv.2503.10648

Jefriyanto Saud, & Ratna Dewanti. (2025). Hate speech communication patterns in social media: A case study on Instagram during the 2024 political year. International Journal of Integrative Sciences, 4(7), 1533–1548. https://doi.org/10.55927/ijis.v4i7.408

Kamalia, H. (2021). Sentiment analysis of hate speech using SVM method. Khatulistiwa Smart: Journal of Artificial Intelligence, 35(1).

Kartika, S., & Nurhayati, N. (2023). Ujaran kebencian (hate speech) di media sosial dalam konteks hukum dan perubahan sosial (Studi kasus pada masyarakat kota Medan). JURNAL MERCATORIA, 16(1), 99–106. https://doi.org/10.31289/mercatoria.v16i1.7668

Khatib Sulaiman, J., Ariska, A., Kamayani, M., & Muhammadiyah DrHamka, U. (2024). Deteksi hate speech pada kolom komentar TikTok dengan menggunakan SVM. Indonesian Journal of Computer Science, 13(1). https://doi.org/10.33022/ijcs.v13i1.3791

Kowsari, K., Meimandi, K. J., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019). Text classification algorithms: A survey. Information, 10(4), 150. https://doi.org/10.3390/info10040150

Kurniawan, S., Gata, W., Puspitawati, D. A., Parthama, I. K. S., Setiawan, H., & Hartini, S. (2020). Text mining pre-processing using Gata framework and RapidMiner for Indonesian sentiment analysis. IOP Conference Series: Materials Science and Engineering, 835(1). https://doi.org/10.1088/1757-899X/835/1/012057

Mustofa, B. A., Laksito, W., & Saptomo, Y. (2025). Use of natural language processing in social media text analysis. Journal of Artificial Intelligence and Engineering Applications, 4(2). https://doi.org/10.59934/jaiea.v4i2.755

Poletto, F., Basile, V., Sanguinetti, M., Bosco, C., & Patti, V. (2021). Resources and benchmark corpora for hate speech detection: A systematic review. Language Resources and Evaluation, 55(2), 477–523. https://doi.org/10.1007/s10579-020-09502-8

Powers, D. M. W. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv preprint. https://doi.org/10.48550/arXiv.2010.16061

Purnama Sari, I., Krianto Sulaiman, O., Apdilah, D., & Simanjuntak, P. (2025). Analisis komparatif Support Vector Machine dan Random Forest untuk deteksi email phishing. AICOMS, 4(2), 18–27. https://doi.org/10.58466/aicoms.v4i1.1806

Rahman, O. H., Abdillah, G., & Komarudin, A. (2021). Klasifikasi ujaran kebencian pada media sosial Twitter menggunakan Support Vector Machine. Jurnal RESTI, 5(1), 17–23. https://doi.org/10.29207/resti.v5i1.2700

Rianto, Mutiara, A. B., Wibowo, E. P., & Santosa, P. I. (2021). Improving the accuracy of text classification using stemming method, a case of non-formal Indonesian conversation. Journal of Big Data, 8(1), 48. https://doi.org/10.1186/s40537-021-00413-1

Saifullah, S., Dreżewski, R., Dwiyanto, F. A., Aribowo, A. S., Fauziah, Y., & Cahyana, N. H. (2024). Automated text annotation using a semi-supervised approach with meta vectorizer and machine learning algorithms for hate speech detection. Applied Sciences, 14(3), 1078. https://doi.org/10.3390/app14031078

Salsabila, U. N., Winatmoko, Y. A., Septiandri, A. A., & Jamal, A. (2018). Colloquial Indonesian lexicon. 2018 International Conference on Asian Language Processing (IALP). https://doi.org/10.1109/IALP.2018.8629151

Santos-Ríos, R., Vilares, J., & Alonso, M. A. (2023). Some experiments on the use of natural language processing for sexism detection and classification in social media. Kalpa Publications in Computing, 14. https://easychair.org/publications/paper/Hqwq

Sari, H., Leonarde Ginting, G., & Zebua, T. (2021). Penerapan algoritma text mining dan TF-IDF untuk pengelompokan topik skripsi pada aplikasi repository STMIK Budi Darma. Jurnal Informatika, 2(7), 414–432.

Septiani, D., & Isabela, I. (2022). Analisis term frequency inverse document frequency (TF-IDF) dalam temu kembali informasi pada dokumen teks. SINTESIA: Jurnal Sistem dan Teknologi Informasi Indonesia, 1(2), 14–19.

Susanto, L., Wijanarko, M. I., Pratama, P. A., Hong, T., Idris, I., Aji, A. F., & Wijaya, D. (2025). IndoToxic2024: A demographically-enriched dataset of hate speech and toxicity types for Indonesian language. arXiv preprint. https://doi.org/10.48550/arXiv.2406.19349

Suwarno, & Kusnadi, R. (2021). Comparative analysis of SVM, XGBoost and neural network on hate speech classification. Jurnal RESTI, 5(5), 896–903. https://doi.org/10.29207/resti.v5i5.3506

Tahir, I., & Ramadhan, M. G. F. (2024). Hate speech on social media: Indonesian netizens' hate comments of presidential talk shows on YouTube. LLT Journal: Journal on Language and Language Teaching, 27(1), 230–251. https://doi.org/10.24071/llt.v27i1.8180

Valencia Suci Handayani, M. (2026). Arsitektur hibrida IndoBERTweet-CNN untuk klasifikasi ujaran kebencian berbahasa gaul di media sosial. Infotekmesin, 17(01). https://doi.org/10.35970/infotekmesin.v17i1.3026

Venkata Mahesh Babu Batta. (2024). Text classification in natural language processing. International Journal of Advanced Research in Science, Communication and Technology, 282–290. https://doi.org/10.48175/ijarsct-17645

Vidgen, B., & Derczynski, L. (2021). Directions in abusive language training data, a systematic review: Garbage in, garbage out. PLoS ONE, 15(12), e0243300. https://doi.org/10.1371/journal.pone.0243300