ISSN: 3107-4553
JANOLI International Journal of
Big Data ( JIJBD )
Login/Register
For Reference
About Journal Aim and Scope Editorial Board Publication Ethics Indexing And Abstracting Peer Review Process About Journal Aim and Scope Editorial Board Publication Ethics Indexing And Abstracting Peer Review Process

Multimodal Text-Emoji Fusion for Enhanced Emotion Detection in Online Communication

Authors: Vishwash Singh

Published: 2025/3/6

Download PDF

Abstract

This paper explores the integration of emoji analysis into text-based emotion detection, emphasizing the significance of multimodal fusion in online communication. With the increasing use of emojis as emotional cues, understanding their impact on sentiment classification is crucial. The study investigates five key areas: the effect of emoji usage on emotion detection accuracy, the role of emojis in differentiating supportive and contrastive sentiments, the impact of emoji context on sarcasm interpretation, the integration of emojis in hybrid deep learning frameworks, and the effectiveness of multimodal fusion techniques in enhancing emotion classification. Using a quantitative research approach, this study leverages the GoEmotions dataset to analyze the relationship between emoji usage and emotion detection performance. Findings demonstrate that incorporating emojis significantly improves classification accuracy, sentiment differentiation, and sarcasm interpretation. Additionally, hybrid frameworks integrating emojis enhance emotion detection capabilities, and multimodal fusion techniques improve classification performance. The research contributes to the growing field of emotion detection by highlighting the essential role of emojis in enriching sentiment analysis models. Future work should address dataset diversity and cultural factors to refine emotion detection frameworks further.

Keywords

Emotion detection, multimodal fusion, emojis, sentiment analysis, sarcasm detection, hybrid deep learning, text classification, machine learning, online communication, computational linguistics

References

  1. Felbo, B., Mislove, A., Søgaard, A., Rahwan, I., & Lehmann, S. (2017). "Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm." Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
  2. Barbieri, F., Camacho-Collados, J., Ronzano, F., & Espinosa-Anke, L. (2018). "Interpretable emoji prediction via label-wise attention LSTMs." Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
  3. Eisner, B., Rocktäschel, T., Augenstein, I., Bošnjak, M., & Riedel, S. (2016). "emoji2vec: Learning emoji representations from their description." arXiv preprint arXiv:1609.08359
  4. Liu, P., Li, W., Zou, L., & Song, Y. (2022). "Multimodal sentiment analysis with hierarchical fusion of text and emoji embeddings." IEEE Transactions on Affective Computing
  5. Cohn, N., Roijackers, T., & Schaap, R. (2019). "The impact of emoji on sentiment classification in online communication." Computers in Human Behavior, 96, 181-191
  6. Poria, S., Cambria, E., & Gelbukh, A. (2015). "Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis." Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing
  7. Xing, F., Li, C., & Lu, S. (2020). "Sentiment-aware emoji recommendation via deep multimodal learning." ACM Transactions on Information Systems (TOIS), 38(4), 1-22
  8. Sharma, T., Singh, K., & Bajaj, S. (2021). "Enhancing sarcasm detection using emoji-based features in deep learning models." International Journal of Machine Learning and Cybernetics, 12(5), 1195-1210
  9. Chen, S., Huang, Y., Tian, Y., & Yang, L. (2022). "Contextual emoji analysis for sarcasm detection in social media text." Expert Systems with Applications, 190, 116-142
  10. Zhang, Y., Zhang, X., & Yu, H. (2020). "A hybrid deep learning framework for emotion detection using textual and visual features." Neurocomputing, 402, 161-172
Download PDF

How to Cite

Vishwash Singh, (2025/3/6). Multimodal Text-Emoji Fusion for Enhanced Emotion Detection in Online Communication. JANOLI International Journal of Big Data , Volume ALIHWmliJRGzmKonHyii, Issue 1.

Follow Us
Get In Touch

Vitthal Namdev Nagar, Opp Jain Temple Sanganer Sanganer Bazar Jaipur 302029 Rajasthan (India)

mail@janolijournals.org

© JANOLI International Journal. All Rights Reserved.