Volume 10, Number 14, November 2020

Multi-Layer Attention Approach for Aspect based Sentiment Analysis

  Authors

Xinzhi Ai¹, Xiaoge Li¹, Feixiong Hu², Shuting Zhi¹ and Likun Hu², ¹Xi’an University of Posts and Telecommunications, China, ²Tencent Technology (Shenzhen) Co., Ltd, China

  Abstract

Based on the aspect-level sentiment analysis is typical of fine-grained emotional classification that assigns sentiment polarity for each of the aspects in a review. For better handle the emotion classification task, this paper put forward a new model which apply Long Short-Term Memory network combine multiple attention with aspect context. Where multiple attention mechanism (i.e., location attention, content attention and class attention) refers to takes the factors of context location, content semantics and class balancing into consideration. Therefore, the proposed model can adaptively integrate location and semantic information between the aspect targets and their contexts into sentimental features, and overcome the model data variance introduced by the imbalanced training dataset. In addition, the aspect context is encoded on both sides of the aspect target, so as to enhance the ability of the model to capture semantic information. The Multi-Attention mechanism (MATT) and Aspect Context (AC) allow our model to perform better when facing reviews with more complicated structures. The result of this experiment indicate that the accuracy of the new model is up to 80.6% and 75.1% for two datasets in SemEval-2014 Task 4 respectively, While the accuracy of the data set on twitter 71.1%, and 81.6% for the Chinese automotive-domain dataset. Compared with some previous models for sentiment analysis, our model shows a higher accuracy.

  Keywords

Aspect-level sentiment analysis, Multiple attention mechanism, LSTM neural network.