Details

Autor(en) / Beteiligte

• Roshan, Megha
• Rawat, Mukul
• Aryan, Karan
• Lyakso, Elena
• Mekala, A Mary
• Ruban, Nersisson

Titel

Linguistic based emotion analysis using softmax over time attention mechanism

Ist Teil von

• PloS one, 2024-04, Vol.19 (4), p.e0301336-e0301336

Ort / Verlag

United States: Public Library of Science

Erscheinungsjahr

2024

Link zum Volltext

Quelle

Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals

Beschreibungen/Notizen

• Recognizing the real emotion of humans is considered the most essential task for any customer feedback or medical applications. There are many methods available to recognize the type of emotion from speech signal by extracting frequency, pitch, and other dominant features. These features are used to train various models to auto-detect various human emotions. We cannot completely rely on the features of speech signals to detect the emotion, for instance, a customer is angry but still, he is speaking at a low voice (frequency components) which will eventually lead to wrong predictions. Even a video-based emotion detection system can be fooled by false facial expressions for various emotions. To rectify this issue, we need to make a parallel model that will train on textual data and make predictions based on the words present in the text. The model will then classify the type of emotions using more comprehensive information, thus making it a more robust model. To address this issue, we have tested four text-based classification models to classify the emotions of a customer. We examined the text-based models and compared their results which showed that the modified Encoder decoder model with attention mechanism trained on textual data achieved an accuracy of 93.5%. This research highlights the pressing need for more robust emotion recognition systems and underscores the potential of transfer models with attention mechanisms to significantly improve feedback management processes and the medical applications.