The impact of BERT-infused deep learning models on sentiment analysis accuracy in financial news

Oussama Ndama, Ismail Bensassi, El Mokhtar En-Naimi

Abstract


This study delves into the enhancement of sentiment analysis accuracy within the financial news domain through the integration of bidirectional encoder representations from transformers (BERT) with traditional deep learning models, including artificial neural networks (ANN), long short-term memory (LSTM) networks, gated recurrent units (GRU), and convolutional neural networks (CNN). By employing a comprehensive method encompassing data preprocessing, polarity analysis, and the application of advanced neural network architectures, we investigate the impact of incorporating BERT’s contextual embeddings on the models’ sentiment classification performance. The findings reveal significant improvements in model accuracy, precision, recall, and F1 scores when BERT is integrated, surpassing both traditional sentiment analysis models and contemporary natural language processing (NLP) transformers. This research contributes to the body of knowledge in financial sentiment analysis by demonstrating the potential of combining deep learning and NLP technologies to achieve a more nuanced understanding of financial news sentiment. The study’s insights advocate for a shift towards sophisticated, context-aware models, highlighting the pivotal role of transformer-based techniques in advancing the field.

Keywords


Bidirectional encoder representations from transformers; Deep learning models; Financial news; Natural language processing; Sentiment analysis

Full Text:

PDF


DOI: https://doi.org/10.11591/eei.v14i2.8469

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Bulletin of EEI Stats

Bulletin of Electrical Engineering and Informatics (BEEI)
ISSN: 2089-3191, e-ISSN: 2302-9285
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).