Graph Neural Network Enhanced Language Models for Efficient Multilingual Text Classification

Abstract

Online social media works as a source of various valuable and actionable information during disasters. These information might be available in multiple languages due to the nature of user generated content. An effective system to automatically identify and categorize these actionable information should be capable to handle multiple languages and under limited supervision. However, existing works mostly focus on English language only with the assumption that sufficient labeled data is available. To overcome these challenges, we propose a multilingual disaster related text classification system which is capable to work undervmonolingual, cross-lingual and multilingual lingual scenarios and under limited supervision. Our end-to-end trainable framework combines the versatility of graph neural networks, by applying over the corpus, with the power of transformer based large language models, over examples, with the help of cross-attention between the two. We evaluate our framework over total nine English, Non-English and monolingual datasets invmonolingual, cross-lingual and multilingual lingual classification scenarios. Our framework outperforms state-of-the-art models in disaster domain and multilingual BERT baseline in terms of Weighted F 1 score. We also show the generalizability of the proposed model under limited supervision.

Local search five‐element cycle optimized reLU‐BiLSTM for multilingual aspect‐based text classification

“…The time complexity of different techniques in classifying the aspects present in the embedded documents is presented in Table 6. We compared the efficiency of our proposed methodology with different techniques such as support vector machine (SVM)-genetic algorithm(GA), 28 bidirectional encoder representations from transformers (BERT) ensemble model, 29 graph neural network based multilingual text classification framework (GNoM), 30 and Bert-based mental approach. 31 The results show that the proposed model consumes less time when compared to the SVM-GA and…”

Multilingual Information Retrieval Using Graph Neural Networks: Practical Applications in English Translation

“…Multilingual information retrieval (MIR) employing graph neural networks (GNNs) has emerged as a promising approach with practical applications in English translation [8]. GNNs, which model data as graphs and operate directly on graph structures, offer several advantages for MIR tasks.…”