2021
DOI: 10.1109/access.2021.3099021
|View full text |Cite
|
Sign up to set email alerts
|

Biomedical Text Similarity Evaluation Using Attention Mechanism and Siamese Neural Network

Abstract: It is a crucial component to estimate the similarity of biomedical sentence pair. Siamese neural network (SNN) can achieve better performance for non-biomedical corpora. However, SNN alone cannot obtain satisfactory biomedical text similarity evaluation results due to syntactic complexity and long sentences. In this paper, a cross self-attention (CSA) is proposed to design a new attention mechanism, namely self2self-attention(S2SA). Then the S2SA is introduced into SNN to construct a novel self2selfattentive s… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1

Citation Types

0
3
0

Year Published

2022
2022
2024
2024

Publication Types

Select...
5
1
1

Relationship

0
7

Authors

Journals

citations
Cited by 7 publications
(3 citation statements)
references
References 29 publications
0
3
0
Order By: Relevance
“…For the determination of similarity in Chinese short texts, methods have always been improved, from SOW/BOW statistical frequency [40] to n-gram sliding windows [41], from topic models [42] to deep learning [43]. The evolution of methods is to meet the similarity situation in different situations.…”
Section: Filling Methods Based On Ocr and Text Similaritymentioning
confidence: 99%
“…For the determination of similarity in Chinese short texts, methods have always been improved, from SOW/BOW statistical frequency [40] to n-gram sliding windows [41], from topic models [42] to deep learning [43]. The evolution of methods is to meet the similarity situation in different situations.…”
Section: Filling Methods Based On Ocr and Text Similaritymentioning
confidence: 99%
“…In the experiment dataset, eight baseline methods were employed, including representation-based text classification (Cao and Zhao, 2018); interactive-based text classification models such as ESIM (Chen et al, 2016), Siamese Bi-LSTM (Li et al, 2021), Attention-Bi-LSTM (Xie et al, 2019); and pre-trained based text classification models such as BERT.…”
Section: Baseline Methodsmentioning
confidence: 99%
“…Using the Siamese neural network in that study, satisfactory results for biomedical text similarity evaluation could not be obtained. Li et al [9] designed a self2self-attention model to solve syntactic complexity and long-sentence problems. In [10], the semantic representation of each sentence was used to generate its embedding.…”
Section: Introductionmentioning
confidence: 99%