Analisis Sentimen E-Commerce dengan Optimasi IndoBERT Menggunakan Bayesian Optuna
DOI:
https://doi.org/10.52436/1.jpti.1208Keywords:
Analisis sentimen, Bayesian Optimization, IndoBERT, Optuna, E-commerceAbstract
Pertumbuhan e-commerce di Indonesia memicu peningkatan signifikan jumlah ulasan pengguna terhadap aplikasi Shopee di Google Play, sehingga analisis manual menjadi tidak lagi efisien. Penelitian ini bertujuan untuk meningkatkan performa analisis sentimen pada ulasan pengguna e-commerce berbahasa Indonesia dengan mengoptimalkan model IndoBERT menggunakan teknik Bayesian Optimization melalui framework Optuna. Latar belakang penelitian ini berfokus pada pentingnya pengolahan opini konsumen di platform Shopee, yang semakin tidak dapat ditangani secara manual karena volume data yang besar dan keberagaman gaya bahasa. Metode yang digunakan meliputi pengumpulan data melalui web scraping, praproses teks, pembagian data, pemodelan dengan IndoBERT, serta penalaan hiperparameter menggunakan Optuna. Hasil eksperimen menunjukkan bahwa optimasi Bayesian mampu meningkatkan akurasi klasifikasi dari 89,30% menjadi 96,10% dan macro-F1 dari 85,83% menjadi 94,82%. Selain itu, false-positive dan false-negative masing-masing turun sebesar 60% dan 67%, serta nilai ROC-AUC meningkat signifikan dari 0,9028 menjadi 0,9903. Temuan ini menegaskan efektivitas Optuna dalam meningkatkan performa dan efisiensi sistem klasifikasi sentimen berbasis IndoBERT, yang dapat diintegrasikan dalam pemantauan opini secara real-time di ranah e-commerce.
Downloads
References
S. Aras, R. Ruimassa, E. Agustinus, B. Wambrauw, and E. B. Palalangan, “Sentiment Analysis on Shopee Product Reviews Using IndoBERT,” vol. 6, no. 3, pp. 1616–1627, 2024, doi: 10.51519/journalisi.v6i3.814.
J. Qu, P. Zhang, and B. Zhou, “Sentiment Analysis in Social Media?: Leveraging BERT for Enhanced Accuracy,” vol. 2, no. 4, 2024.
Anugerah Simanjuntak et al., “Research and Analysis of IndoBERT Hyperparameter Tuning in Fake News Detection,” J. Nas. Tek. Elektro dan Teknol. Inf., vol. 13, no. 1, pp. 60–67, 2024, doi: 10.22146/jnteti.v13i1.8532.
G. Onorato, “Bayesian Optimization for Hyperparameters Tuning in Neural Networks,” no. 1979543, 2024, [Online]. Available: http://arxiv.org/abs/2410.21886
S. Hanifi, A. Cammarono, and H. Zare-Behtash, “Advanced hyperparameter optimization of deep learning models for wind power prediction,” Renew. Energy, vol. 221, no. November 2023, p. 119700, 2024, doi: 10.1016/j.renene.2023.119700.
A. Daza, N. D. González Rueda, M. S. Aguilar Sánchez, W. F. Robles Espíritu, and M. E. Chauca Quiñones, “Sentiment Analysis on E-Commerce Product Reviews Using Machine Learning and Deep Learning Algorithms: A Bibliometric Analysisand Systematic Literature Review, Challenges and Future Works,” Int. J. Inf. Manag. Data Insights, vol. 4, no. 2, 2024, doi: 10.1016/j.jjimei.2024.100267.
E. D. Madyatmadja, H. Candra, J. Nathaniel, M. R. Jonathan, and Rudy, “Sentiment Analysis on User Reviews of Threads Applications in Indonesia,” J. Eur. des Syst. Autom., vol. 57, no. 4, pp. 1165–1171, 2024, doi: 10.18280/jesa.570423.
G. Z. Nabiilah, S. Y. Prasetyo, Z. N. Izdihar, and A. S. Girsang, “BERT base model for toxic comment analysis on Indonesian social media,” Procedia Comput. Sci., vol. 216, no. 2022, pp. 714–721, 2022, doi: 10.1016/j.procs.2022.12.188.
X. Xiao et al., “An interpretable model for landslide susceptibility assessment based on Optuna hyperparameter optimization and Random Forest,” Geomatics, Nat. Hazards Risk, vol. 15, no. 1, p., 2024, doi: 10.1080/19475705.2024.2347421.
M. A. K. Raiaan et al., “A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks,” Decis. Anal. J., vol. 11, no. September 2023, p. 100470, 2024, doi: 10.1016/j.dajour.2024.100470.
“EMOTION DETECTION VIA BERT-BASED DEEP LEARNING 2 . LITERATURE REVIEW,” vol. 9, no. 2, pp. 103–114, 2024.
S. Uyun, R. P. Rosalin, L. V. Sari, and H. H. Sucinta, “A Hybrid Classification Model Based on BERT for Multi-Class Sentiment Analysis on Twitter,” vol. 11, no. 2, pp. 194–205, 2025, doi: 10.26555/jiteki.v11i2.30665.
L. Khan, A. Qazi, H. T. Chang, M. Alhajlah, and A. Mahmood, “Empowering Urdu sentiment analysis: an attention-based stacked CNN-Bi-LSTM DNN with multilingual BERT,” Complex Intell. Syst., vol. 11, no. 1, pp. 1–14, 2025, doi: 10.1007/s40747-024-01631-9.
N. P. I. Maharani, A. Purwarianti, Y. Yustiawan, and F. C. Rochim, “Domain-Specific Language Model Post-Training for Indonesian Financial NLP,” Proc. Int. Conf. Electr. Eng. Informatics, 2023, doi: 10.1109/ICEEI59426.2023.10346625.
Wily Mohammad, Hanif Saifurrahman, Riska Nabila, and Besar Agung Martono, “Sentiment Analysis and Word Cloud Insights of Freelance Illustrators in the Dynamics of the AI Art Era using Atlas-ti,” Econ. Financ. Enthusiastic, vol. 1, no. 2, pp. 87–94, 2023, doi: 10.59535/efe.v1i2.106.
