Authors :
A. Ajith Kumar; P. Madhu Charan Reddy; Nikhil Gunnam
Volume/Issue :
Volume 9 - 2024, Issue 8 - August
Google Scholar :
https://tinyurl.com/3eed3x68
Scribd :
https://tinyurl.com/uc7nnsk9
DOI :
https://doi.org/10.38124/ijisrt/IJISRT24AUG345
Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.
Abstract :
Sentiment analysis, an automated method for
detecting emotions and opinions in text, has become a
versatile tool applied across various domains, from
assessing online customer feedback to monitoring
sentiment trends on social media. While Bag of Words
(BoW) has been the traditional method, more advanced
techniques like Bidirectional Encoder Representations
from Transformers (BERT) and Long Short-Term
Memory (LSTM) have revolutionized sentiment analysis
by elevating accuracy and context comprehension. This
study conducts an extensive comparison between BERT,
a hybrid model that combines CNN and LSTM in the
realm of sentiment analysis within movie reviews.
Through meticulous experimentation, the study strongly
proves that both the hybrid model of CNN and LSTM
models significantly outshine the techniques like BERT
and BoW with noticeably higher accuracy in precisely
categorizing sentiments expressed in movie reviews.
These results highlight how deep learning methodologies
remarkably refine the precision and effectiveness of
sentiment analysis, allowing for more nuanced and
context-aware sentiment classification. The study's
significance goes beyond performance contrasts; it
demonstrates the exceptional capacity of BERT along
with the hybrid model of CNN and LSTM to
comprehend the complexities of language and contextual
nuances within movie reviews. This heightened
contextual understanding is particularly crucial in
sentiment analysis, enabling the models to discern subtle
shifts in sentiment that simpler methods like BoW might
overlook. By showcasing the supremacy of hybrid model
that combines CNN and LSTM in movie review
sentiment analysis, this research opens new avenues for
the field's advancement. It emphasizes the potential of
deep learning techniques in revolutionizing sentiment
analysis across diverse domains, offering more accurate
and contextually attuned sentiment classification for
deeper insights and well-informed decision-making. This
study stands as a valuable asset for researchers and
practitioners aiming to leverage deep learning for
sentiment analysis applications
References :
- Maas, Andrew L., et al. ”Learning word vectors for sentiment analysis.” Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1. Association for Computational Linguistics, 2011.
- Pang, Bo, and Lillian Lee. ”Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales.” Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, 2005.
- Socher, Richard, et al. ”Parsing natural scenes and natural language with recursive neural networks.” Proceedings of the 28th international conference on machine learning (ICML-11). 201.
- Socher, Richard, et al. ”Semi-supervised recursive autoencoders for predicting sentiment distributions.” Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2011.
- Socher, Richard, et al. ”Semantic compositionality through recursive matrix-vector spaces.” Proceedings of the 2012 Joint Conference on Empirical Methods in Natural
- Language Processing and Computational Natural Language Learning. Association for Computational Linguistics, 2012. APA
- Socher, Richard, et al. ”Recursive deep models for semantic compositionally over a sentiment treebank.” Proceedings of the conference on empirical methods in natural language processing (EMNLP). Vol. 1631. 2013.
- Mikolov, Tomas, et al. ”Distributed representations of words and phrases and their compositionality.” Advances in Neural Information Processing Systems. 2013.
- Zou, Hui, and Trevor Hastie. ”Regularization and variable selection via the elastic net.” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67, no. 2 (2005): 301-320.
- Pang, Bo, and Lillian Lee. ”Opinion mining and sentiment analysis.” Foundations and trends in information retrieval 2, no. 1-2 (2008): 1-135.
- Pang, Bo, and Lillian Lee. ”A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts.” In Proceedings of the 42nd annual meeting on Association for Computational Linguistics, p. 271. Association for Computational Linguistics, 2004.
- Beylkin, Gregory, Jochen Garcke, and Martin J. Mohlenkamp. ”Multivariate regression and machine learning with sums of separable functions.” SIAM Journal on Scientific Computing 31, no. 3 (2009): 1840-1857.
- Abid, F., M. Alam, M. Yasir, and C. Li, “Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter,” Future Generation Computer Systems, Vol.95(2019), 292~308.
- Appel, O., F. Chiclana and J. Carter, “Main concepts, state of the art and future research questions in sentiment analysis,” Acta Polytechnica Hungarica, Vol.12, No.3(2015), 87~108.
- Baydogan, M. G., G. Runger, and E. Tuv, “A bag-of-features framework to classify time series,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.35, No.11(2013), 2796~2802.
- Bengio, Y., P. Simard, and P. Frasconi, “Learning long-term dependencies with gradient descent is difficult,” IEEE Transactions on Neural Networks, Vol.5, No.2(1994), 157~166.
- Ferguson, P., N. O’Hare, M. Davy, A. Bermingham, P. Sheridan, C. Gurrin and A. F. Smeaton, “Exploring the use of paragraph-level annotations for sentiment analysis of financial blogs,” Proceedings of WOMAS 2009-Workshop on Opinion Mining and Sentiment Analysis, (2009).
- Kim, Y., and M. Song, “A study on analysing sentiments on movie reviews by multi-level sentiment classifier,” Journal of Intelligence and Information Systems, Vol.22, No.3(2016), 71~89.
- Lee, S.-H., J. Cui, and J.-W. Kim, “Sentiment analysis on movie review through building modified sentiment dictionary by movie genre,” Journal of Intelligence and Information Systems, Vol.22, No.2(2016), 97~113.
- Liu, P., X. Qiu, and X. Huang, “Recurrent neural network for text classification with multi-task learning,” arXiv 1605.05101, 2016.
- Liu, S., and J.-H. Chen, “A multi-label classification based approach for sentiment classification,” Expert Systems with Applications, Vol.42, No.3(2015), 1083~1093. Lochter, J. V., R. F.Zanetti, D. Reller, and T. A. Almeida, “Short text opinion detection using ensemble of classifiers and semantic indexing,” Expert Systems with Applications, Vol.62, (2016), 243~249.
- Nguyen, H., and N. M. Le, “An ensemble method with sentiment features and clustering support,” Neurocomputing, Vol.370(2019), 155~165.
- Pak, A. and P. Paroubek, “Twitter as a corpus for sentiment analysis and opinion mining,” Proceedings of the Seventh International Conference on Language Resources and Evaluation, (2010), 1320~1326.
- Pang, B., L. Lee, and S. Vaithyanathan, “Thumbs up?: sentiment classification using machine learning techniques,” Proceedings of the ACL-02 conference on Empirical methods in Natural Language Processing, 2002.
- Rao, G., W. Huang, Z. Feng, and Q. Cong, “LSTM with sentence representations for document level sentiment classification,” Neurocomputing, Vol.308(2018), 49~57.
- Sailunaz, K., and R. Alhajj, “Emotion and sentiment analysis from Twitter text,” Journal of Computational Science, Vol.36(2019), 101003.
- Shuang K., Z. Zhang, H. Guo, and J. Loo, “A sentiment information Collector–Extractor architecture based neural network for sentiment analysis,” Information Sciences, Vol.467 (2018), 549~558.
- Tang, F., L. Fu, B. Yao, and W. Xu, “Aspect based fine-grained sentiment analysis for online reviews,” Information Sciences, Vol.488(2019), 190~204.
- Xu, J., D. Chen, X. Qiu, and X. Huang, “Cached long short-term memory neural networks for document-level sentiment classification,” arXiv preprint arXiv:1610.04989, 2016.
Sentiment analysis, an automated method for
detecting emotions and opinions in text, has become a
versatile tool applied across various domains, from
assessing online customer feedback to monitoring
sentiment trends on social media. While Bag of Words
(BoW) has been the traditional method, more advanced
techniques like Bidirectional Encoder Representations
from Transformers (BERT) and Long Short-Term
Memory (LSTM) have revolutionized sentiment analysis
by elevating accuracy and context comprehension. This
study conducts an extensive comparison between BERT,
a hybrid model that combines CNN and LSTM in the
realm of sentiment analysis within movie reviews.
Through meticulous experimentation, the study strongly
proves that both the hybrid model of CNN and LSTM
models significantly outshine the techniques like BERT
and BoW with noticeably higher accuracy in precisely
categorizing sentiments expressed in movie reviews.
These results highlight how deep learning methodologies
remarkably refine the precision and effectiveness of
sentiment analysis, allowing for more nuanced and
context-aware sentiment classification. The study's
significance goes beyond performance contrasts; it
demonstrates the exceptional capacity of BERT along
with the hybrid model of CNN and LSTM to
comprehend the complexities of language and contextual
nuances within movie reviews. This heightened
contextual understanding is particularly crucial in
sentiment analysis, enabling the models to discern subtle
shifts in sentiment that simpler methods like BoW might
overlook. By showcasing the supremacy of hybrid model
that combines CNN and LSTM in movie review
sentiment analysis, this research opens new avenues for
the field's advancement. It emphasizes the potential of
deep learning techniques in revolutionizing sentiment
analysis across diverse domains, offering more accurate
and contextually attuned sentiment classification for
deeper insights and well-informed decision-making. This
study stands as a valuable asset for researchers and
practitioners aiming to leverage deep learning for
sentiment analysis applications