Discovering disease risk trends by applying Latent Dirichlet Allocation sentiment analysis to social media health discussions

DOI: https://doi.org/10.3846/ntcs.2026.25980

Abstract

Social media platforms generate large volumes of health-related content that can provide valuable insights into emerging disease concerns and public perceptions. This study explores disease-risk trends through topic modeling and sentiment analysis of social media discussions. We used Latent Dirichlet Allocation (LDA) to extract topics and VADER sentiments from 50,000 statements related to diseases. The model performance was evaluated in terms of coherence, topic diversity, and stability metrics. The comparison was made with NMF and BERTopic. Three main topics were identified: COVID-19 symptoms and diagnosis; chronic disease management; and disease risk factors. The LDA model obtained coherence and topic diversity scores of 0.402 and 0.77, respectively. The sentiment analysis shows that the discussions are overall neutral, with some sentiments related to negative concerns. The results indicate that the use of topic modeling along with sentiment analysis is a useful approach to extract major disease-related topics from social media data. Future studies using transformer-based models, multilingual data, and longitudinal studies may improve digital disease surveillance and enable proactive public health monitoring. 

Keywords:

disease risk surveillance, social media analytics, Latent Dirichlet Allocation, sentiment analysis, topic modeling, public health informatics, health intelligence

How to Cite

Bhattacharjee, S. (2026). Discovering disease risk trends by applying Latent Dirichlet Allocation sentiment analysis to social media health discussions. New Trends in Computer Sciences, 4(1), 111–130. https://doi.org/10.3846/ntcs.2026.25980

Share

Published in Issue
September 4, 2026
Abstract Views
36

References

Akila, V., & Bhushanm, K. (2026, May). A systematic review of machine learning and deep learning techniques for brain tumor detection and classification in MRI images (2020–2026). In 2026 International Conference on Signal, Systems, and Computing for Next-Gen Automation (ICSSCNA) (pp. 1–9). IEEE. https://doi.org/10.1109/ICSSCNA68616.2026.11546721

Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022. https://www.jmlr.org/papers/volume3/blei03a/blei03a.pdf

Broniatowski, D. A., Paul, M. J., & Dredze, M. (2013). National and local influenza surveillance through Twitter: An analysis of the 2012–2013 influenza epidemic. PLoS ONE, 8(12), Article e83672. https://doi.org/10.1371/journal.pone.0083672

Charles-Smith, L. E., Reynolds, T. L., Cameron, M. A., Conway, M., Lau, E. H., Olsen, J. M., Robinson, S. J., & Corley, C. D. (2015). Using social media for actionable disease surveillance and outbreak management: A systematic literature review. PLoS ONE, 10(10), Article e0139701. https://doi.org/10.1371/journal.pone.0139701

Chen, J., Wei, W., Guo, C., Tang, L., & Sun, L. (2017). Textual analysis and visualization of research trends in data mining for electronic health records. Health Policy and Technology, 6(4), 389¬–400. https://doi.org/10.1016/j.hlpt.2017.10.003

Chen, N., Chen, X., Zhong, Z., & Pang, J. (2025). “Double vaccinated, 5G boosted!”: Learning attitudes towards COVID-19 vaccination from social media. ACM Transactions on the Web, 19(1), 1–24. https://doi.org/10.1145/3731205

De Choudhury, M., Gamon, M., Counts, S., & Horvitz, E. (2013). Predicting depression via social media. Proceedings of the International AAAI Conference on Web and Social Media, 7(1), 128–137. https://doi.org/10.1609/icwsm.v7i1.14432

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 4171–4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423

French, M., & Monahan, T. (2020). Disease surveillance: How might surveillance studies address COVID-19? Surveillance & Society, 18(1), 1–11. https://doi.org/10.24908/ss.v18i1.13985

Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv. https://doi.org/10.48550/arXiv.2203.05794

Hassija, V., Chakrabarti, A., Singh, A., Chamola, V., & Sikdar, B. (2023). Unleashing the potential of conversational AI: Amplifying ChatGPT’s capabilities and tackling technical hurdles. IEEE Access, 11, 143657–143682. https://doi.org/10.1109/ACCESS.2023.3339553

Herland, M., Khoshgoftaar, T. M., & Wald, R. (2014). A review of data mining using big data in health informatics. Journal of Big Data, 1(1), Article 2. https://doi.org/10.1186/2196-1115-1-2

Holzinger, A. (2016). Machine learning for health informatics. In A. Holzinger (Ed.), Machine learning for health informatics: State-of-the-art and future challenges (pp. 1–24). Springer. https://doi.org/10.1007/978-3-319-50478-0_1

Hutto, C. J., & Gilbert, E. (2014). VADER: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media (pp. 216–225). https://doi.org/10.1609/icwsm.v8i1.14550

Ibrahim, N. K. (2020). Epidemiologic surveillance for controlling the COVID-19 pandemic: Types, challenges and implications. Journal of Infection and Public Health, 13(11), 1630–1638. https://doi.org/10.1016/j.jiph.2020.07.019

Imhoff, M., Webb, A., & Goldschmidt, A. (2001). Health informatics. Intensive Care Medicine, 27(1), 179–186. https://doi.org/10.1007/PL00020869

Iroju, O. G., & Olaleke, J. O. (2015). A systematic review of natural language processing in healthcare. International Journal of Information Technology and Computer Science, 8(8), 44–50. https://doi.org/10.5815/ijitcs.2015.08.07

Kherwa, P., & Bansal, P. (2019). Topic modeling: A comprehensive review. EAI Endorsed Transactions on Scalable Information Systems, 7(24), Article e2. https://doi.org/10.4108/eai.13-7-2018.159623

Kumari, K., Pahuja, S. K., & Kumar, S. (2024). A comprehensive examination of ChatGPT’s contribution to the healthcare sector and hepatology. Digestive Diseases and Sciences, 69(11), 4027–4043. https://doi.org/10.1007/s10620-024-08659-4

Lee, K., Agrawal, A., & Choudhary, A. (2013). Real-time disease surveillance using Twitter data: Demonstration on flu and cancer. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1474–1477). Association for Computing Machinery. https://doi.org/10.1145/2487575.2487709

Lee, K., Chung, Y., & Kim, J. S. (2024). Research trends on metabolic syndrome in digital healthcare using topic modeling: Systematic search of abstracts. Journal of Medical Internet Research, 26, Article e53873. https://doi.org/10.2196/53873

Li, C., & Hu, X. (2025). Medical artificial intelligence in scholarly and public perspective: A BERTopic-based analysis of topic-sentiment collaborative mining. Data Science and Informetrics, 5(1), 33–42. https://doi.org/10.1016/j.dsim.2025.05.001

Liu, A. T., Li, S. W., & Lee, H. Y. (2021). TERA: Self-supervised learning of transformer encoder representation for speech. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 29, 2351–2366. https://doi.org/10.1109/TASLP.2021.3095662

Liu, B. (2012). Sentiment analysis and opinion mining. Springer. https://doi.org/10.2200/S00416ED1V01Y201204HLT016

Ma, L., Chen, R., Ge, W., Rogers, P., Lyn-Cook, B., Hong, H., & Zou, W. (2025). AI-powered topic modeling: Comparing LDA and BERTopic in analyzing opioid-related cardiovascular risks in women. Experimental Biology and Medicine, 250, Article 10389. https://doi.org/10.3389/ebm.2025.10389

Mersha, M. A., & Kalita, J. (2024). Semantic-driven topic modeling using transformer-based embeddings and clustering algorithms. Procedia Computer Science, 244, 121–132. https://doi.org/10.1016/j.procs.2024.10.185

Priya, B., & Malhotra, J. (2023). 5GhNet: An intelligent QoE-aware RAT selection framework for 5G-enabled healthcare networks. Journal of Ambient Intelligence and Humanized Computing, 14(7), 8387–8408. https://doi.org/10.1007/s12652-021-03606-x

Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G. Z. (2017). Deep learning for health informatics. IEEE Journal of Biomedical and Health Informatics, 21(1), 4–21. https://doi.org/10.1109/JBHI.2016.2636665

Reuter, A., Thielmann, A., Weisser, C., Säfken, B., & Kneib, T. (2025). Probabilistic topic modeling with transformer representations. IEEE Transactions on Neural Networks and Learning Systems, 36(8), 14551–14565. https://doi.org/10.1109/TNNLS.2025.3538262

Robishaw, J. D., Alter, S. M., Solano, J. J., Shih, R. D., DeMets, D. L., Maki, D. G., & Hennekens, C. H. (2021). Genomic surveillance to combat COVID-19: Challenges and opportunities. The Lancet Microbe, 2(9), e481–e484. https://doi.org/10.1016/S2666-5247(21)00121-X

Sandeepbitmba. (2026). Disease statements dataset [Data set]. GitHub. https://github.com/sandeepbitmba/socialmediastatements/blob/main/Disease%20statements.docx

Velupillai, S., Suominen, H., Liakata, M., Roberts, A., Shah, A. D., Morley, K., Osborn, D., Hayes, R. D., Stewart, R., & Dutta, R. (2018). Using clinical natural language processing for health outcomes research: Overview and actionable suggestions for future advances. Journal of Biomedical Informatics, 88, 11–19. https://doi.org/10.1016/j.jbi.2018.10.005

Yu, Y., Yao, S., Zhou, T., Fu, Y., Yu, J., Wang, D., & Lin, Y. (2024, June). Data on the move: Traffic-oriented data trading platform powered by AI agents with common sense. In 2024 IEEE Intelligent Vehicles Symposium (IV) (pp. 521–526). IEEE. https://doi.org/10.1109/IV55156.2024.10588800

Zhou, B., Yang, G., Shi, Z., & Ma, S. (2022). Natural language processing for smart healthcare. IEEE Reviews in Biomedical Engineering, 17, 4–18. https://doi.org/10.1109/RBME.2022.3210270

View article in other formats

CrossMark check

CrossMark logo

Published

2026-09-04

Issue

Section

Articles

How to Cite

Bhattacharjee, S. (2026). Discovering disease risk trends by applying Latent Dirichlet Allocation sentiment analysis to social media health discussions. New Trends in Computer Sciences, 4(1), 111–130. https://doi.org/10.3846/ntcs.2026.25980

Share