Hybrid RNNs and USE for enhanced sequential sentence classification in biomedical paper abstracts

Oussama Ndama, Ismail Bensassi, El Mokhtar En-Naimi

Abstract


This research evaluates a number of hybrid recurrent neural network (RNN) architectures for classifying sequential sentences in biomedical abstracts. The architectures include long short-term memory (LSTM), bidirectional LSTM (BI-LSTM), gated recurrent unit (GRU), and bidirectional GRU (BI-GRU) models, all of which are combined with the universal sentence encoder (USE). The investigation assesses their efficacy in categorizing sentences into predefined classes: background, objective, method, result, and conclusion. Each RNN variant is used with the pre-trained USE as word embeddings to find complex sequential relationships in biomedical text. Results demonstrate the adaptability and effectiveness of these hybrid architectures in discerning diverse sentence functions. This research addresses the need for improved literature comprehension in biomedicine by employing automated sentence classification techniques, highlighting the significance of advanced hybrid algorithms in enhancing text classification methodologies within biomedical research.

Keywords


Hybrid models; Information extraction; Recurrent neural networks; Sentence classification; Universal sentence encoder

Full Text:

PDF


DOI: https://doi.org/10.11591/eei.v13i5.8240

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Bulletin of EEI Stats

Bulletin of Electrical Engineering and Informatics (BEEI)
ISSN: 2089-3191, e-ISSN: 2302-9285
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).