Enhanced Aspect-Based Sentiment Analysis with Integrated Category Extraction for Instruct-DeBERTa

Dineth Jayakody, Koshila Isuranda, A V A Malkith, Nisansa de Silva, Sachintha Rajith Ponnamperuma, G G N Sandamali, K L K Sudheera, Kashnika Gimhani Sarathchandra
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation

Aspect-Based Sentiment Analysis (ABSA) has seen significant advancements with the introduction of Transformer-based models, which have reshaped the landscape of Natural Language Processing (NLP) tasks. This paper introduces enhancements to the Instruct-DeBERTa model which is one of the leading ABSA models for ABSA. It takes a hybrid approach combining the strengths of InstructABSA for Aspect Term Extraction (ATE) and DeBERTa-V3-baseabsa-V1 for Aspect Sentiment classification (ASC). In this work, we enhance Instruct-DeBERTa by introducing category classification through a cosine similarity-based method, comparing aspect embeddings with predefined categories. Also for InstructABSA and DeBERTa-V3-baseabsa-V1, we investigate different configurations by adding a linear layer followed by ReLU activation, incorporation of regularization and optimization of attention heads. These modifications were tailored specifically for the data sets in the hospitality domain. Our empirical evaluations, run on diverse datasets, have shown that these enhancements significantly raise the performance of Instruct-DeBERTa for hospitality domain datasets.

Keywords: Natural Language Processing |