Social Media Multi-modal Processing Mode for Emergency

Lin, Jing

doi:10.1007/978-3-031-05237-8_7

Cited by 1 publication

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Social media platforms involving Weibo, WeChat, Facebook, Instagram, and Twitter have evolved into (1) key real-time information acquisition channels in disaster management and (2) information communication tools in physical and virtual contexts following the advent of the mobile Internet [1][2][3]. A vast amount of rescue and assistance information is promptly shared on digital platforms.…”

Section: Introductionmentioning

confidence: 99%

Social Media Multimodal Information Analysis based on the BiLSTM-Attention-CNN-XGBoost Ensemble Neural Network

Jixian¹,

An²,

Su³

et al. 2022

IJACSA

View full text Add to dashboard Cite

Social media users internalise information in a multimodal context. Social media functions as a primary information source for disaster situational awareness encompassing texts, photographs, videos, and other multimodal information widely used in emergency management. Applying ensemble learning to social media sentiment analysis has garnered much scholarly attention, albeit with limited research on rescue and its sub-domain, which is characterised as a major complexity. A multimodal information categorisation model based on hierarchical feature extraction was proposed in this study. The information of multiple modes is first mapped to a unified text vector space in modelling the semantic content at the sentence and multimodal information levels in the multimodal information. Multiple deep learning (DL) models were subsequently applied to model the semantic content at the aforementioned levels. This study offers a BiLSTM-Attention-CNN-XGBOOST ensemble neural network model to acquire extensive multimodal information characteristics. Based on the empirical outcomes, this method precisely extracted multimodal information features with an accuracy exceeding 85% and 95% for Chinese-and English-language datasets, respectively.

show abstract

Section: Introductionmentioning

confidence: 99%