Cracking Emotions in Amharic
Emotion detection on social media is a game-changer for understanding human feelings. But, for languages like Amharic, it's tough to make sense of emotions because there's not enough labeled data. Most current models are like black boxes - you can't see how they make predictions. A new approach tries to fix this by fine-tuning a model called AfroXLMR for Amharic. This model is special because it's designed to be transparent, so you can see how it makes predictions.
The team behind this created a dataset of 22,000 social media comments in Amharic, labeled with eight different emotions. They used 80% of the data for training, 10% for validation, and 10% for testing. The model achieved a recall of 87% and a Hamming loss of 0.08. To understand how it made predictions, they used a technique called Local Interpretable Model-agnostic Explanations (LIME).
Compared to other top models, this approach did really well. It outperformed XLM-R base, mBART, BiLSTM, LSTM, CNN, and AfriBERTa, with F1-score improvements of 5%, 3%, 5%, 7%, 9%, and 2% respectively. Statistical tests showed that these improvements weren't just luck - they were significant.
The fine-tuned AfroXLMR model shows promise for emotion classification in Amharic. To take it to the next level, researchers could try more advanced fine-tuning strategies and expand the dataset to make the model even better at generalizing to different contexts in Amharic.