Transformers-Text-Classification

Suggesting a neural network architecture for analyzing and recognizing texts, where transformers were used through a pre-trained BERT model, in addition to its integration with the LSTM layer with the Global Pooling layers, in order to reach a model capable of analyzing texts.

Result:

Neural Network Architecture:

Metrics:

Accuracy, Recall, Precision:

Loss While Training:

Evaluate with Validation Data: