An SNN-Based Semantic Role Labeling Model with Its Network Parameters Optimized Using an Improved PSO Algorithm

Abstract

Semantic role labeling (SRL) is a fundamental task in natural language processing to find a sentence-level semantic representation. The semantic role labeling procedure can be viewed as a process of competition between many order parameters, in which the strongest order parameter will win by competition and the desired pattern will be recognized. To realize the above-mentioned integrative SRL, we use synergetic neural network (SNN). Since the network parameters of SNN directly influence the synergetic recognition performance, it is important to optimize the parameters. In this paper, we propose an improved particle swarm optimization (PSO) algorithm based on log-linear model and use it to effectively determine the network parameters. Our contributions are two-folds: firstly, a log-linear model is introduced to PSO algorithm which can effectively make use of the advantages of a variety of different knowledge sources, and enhance the decision making ability of the model. Secondly, we propose an improved SNN model based on the improved PSO and show its effectiveness in the SRL task. The experimental results show that the proposed model has a higher performance for semantic role labeling with more powerful global exploration ability and faster convergence speed, and indicate that the proposed model has a promising future for other natural language processing tasks.

Cloud Synergetic Recommendation Model for Overseas Chinese Education by Modeling Multi-Source User Metaphor Information

“…Synergetics is a comprehensive discipline which studies the evolution of synergetic system from disorder to order. Synergetic pattern recognition has been successfully used in semantic annotation [9], automatic control [10] and semantic role labeling [11]. One of the advantages of synergetic processing method is its strong anti-defect ability.…”

Transition-based Parsing with Context Enhancement and Future Reward Reranking

“…Recently, deep learning has attracted significant attention in the community and achieved extraordinary results in natural language processing, such as Partof-Speech Tagging [27], Semantic Role Labeling [4,21], Sentiment Parsing [6], Parsing [7,10,26], etc. In dependency parsing, neural networks automatically extract the features without manually feature engineering, and then they evaluate the score of a span (sub-tree) in graph-based model [17,18] or an action in transition-based model [3,11] to build the best tree of a sentence.…”