A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts

Shakeel, Muhammad Haroon; Karim, Asim; Khan, Imdadullah

doi:10.1016/j.ipm.2020.102204

Cited by 35 publications

(17 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It has applications in different domains such as graphs [36], [37], nodes in graphs [38], [39], and electricity consumption [33], [40]. This vector-based representation also achieves significant success in sequence analysis, such as texts [41]- [43], electroencephalography and electromyography sequences [44], [45], networks [46], and biological sequences [32], [47]. However, most of the existing sequence classification methods require the input sequences to be aligned.…”

Section: Literature Reviewmentioning

confidence: 99%

Spike2Vec: An Efficient and Scalable Embedding Approach for COVID-19 Spike Sequences

Ali

2021

2021 IEEE International Conference on Big Data (Big Data)

View full text Add to dashboard Cite

With the rapid global spread of COVID-19, more and more data related to this virus is becoming available, including genomic sequence data. The total number of genomic sequences that are publicly available on platforms such as GISAID is currently several million, and is increasing with every day. The availability of such Big Data creates a new opportunity for researchers to study this virus in detail. This is particularly important with all of the dynamics of the COVID-19 variants which emerge and circulate. This rich data source will give us insights on the best ways to perform genomic surveillance for this and future pandemic threats, with the ultimate goal of mitigating or eliminating such threats. Analyzing and processing the several million genomic sequences is a challenging task. Although traditional methods for sequence classification are proven to be effective, they are not designed to deal with these specific types of genomic sequences. Moreover, most of the existing methods also face the issue of scalability. Previous studies which were tailored to coronavirus genomic data proposed to use spike sequences (corresponding to a subsequence of the genome), rather than using the complete genomic sequence, to perform different machine learning (ML) tasks such as classification and clustering. However, those methods suffer from scalability issues.In this paper, we propose an approach called Spike2Vec, an efficient and scalable feature vector representation for each spike sequence that can be used for downstream ML tasks. Through experiments, we show that Spike2Vec is not only scalable on several million spike sequences, but also outperforms the baseline models in terms of prediction accuracy, F1 score, etc. Since this type of study on such huge numbers of spike sequences has not been done before (to the best of our knowledge), we believe that it will open new doors for researchers to use this data and perform different tasks to unfold new information that was not available before. We also use information gain (IG) to compute the importance of each amino acid in the spike sequence. The amino acids with higher IG values tend to be the same as many reported by the USA based Centers for Disease Control and Prevention (CDC) for different variants.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Spike2Vec: An Efficient and Scalable Embedding Approach for COVID-19 Spike Sequences

Ali

2021

2021 IEEE International Conference on Big Data (Big Data)

View full text Add to dashboard Cite

show abstract

“…Since the dimensionality of data are another problem while dealing with larger sized sequences, using approximate methods to compute the similarity between two sequences is a popular approach [21,27,28]. The fixed-length numerical embedding methods have been successfully used in literature for other applications such as predicting missing values in graphs [29], text analytics [30][31][32], biology [21,27,33], graph analytics [34,35], classification of electroencephalography and electromyography sequences [36,37], detecting security attacks in networks [38], and electricity consumption in smart grids [39]. The conditional dependencies between variables is also important to study so that their importance can be analyzed in detail [40].…”

Section: Literature Reviewmentioning

confidence: 99%

Robust Representation and Efficient Feature Selection Allows for Effective Clustering of SARS-CoV-2 Variants

2021

View full text Add to dashboard Cite

The widespread availability of large amounts of genomic data on the SARS-CoV-2 virus, as a result of the COVID-19 pandemic, has created an opportunity for researchers to analyze the disease at a level of detail, unlike any virus before it. On the one hand, this will help biologists, policymakers, and other authorities to make timely and appropriate decisions to control the spread of the coronavirus. On the other hand, such studies will help to more effectively deal with any possible future pandemic. Since the SARS-CoV-2 virus contains different variants, each of them having different mutations, performing any analysis on such data becomes a difficult task, given the size of the data. It is well known that much of the variation in the SARS-CoV-2 genome happens disproportionately in the spike region of the genome sequence—the relatively short region which codes for the spike protein(s). In this paper, we propose a robust feature-vector representation of biological sequences that, when combined with the appropriate feature selection method, allows different downstream clustering approaches to perform well on a variety of different measures. We use such proposed approach with an array of clustering techniques to cluster spike protein sequences in order to study the behavior of different known variants that are increasing at a very high rate throughout the world. We use a k-mers based approach first to generate a fixed-length feature vector representation of the spike sequences. We then show that we can efficiently and effectively cluster the spike sequences based on the different variants with the appropriate feature selection. Using a publicly available set of SARS-CoV-2 spike sequences, we perform clustering of these sequences using both hard and soft clustering methods and show that, with our feature selection methods, we can achieve higher F1 scores for the clusters and also better clustering quality metrics compared to baselines.

show abstract

“…It has applications in different domains such as graphs [19,20], nodes in graphs [8,18], and electricity consumption [5,6]. This vector-based representation also achieve significant success in sequence analysis, such as texts [38][39][40], electroencephalography and electromyography sequences [12,42], Networks [4], and biological sequences [10]. However, most of the existing sequence classification methods require the input sequences to be aligned.…”

Section: Related Workmentioning

confidence: 99%

Classifying COVID-19 Spike Sequences from Geographic Location Using Deep Learning

Ali¹,

Bello²,

Patterson³

2021

Preprint

View full text Add to dashboard Cite

With the rapid spread of COVID-19 worldwide, viral genomic data is available in the order of millions of sequences on public databases such as GISAID. This Big Data creates a unique opportunity for analysis towards the research of effective vaccine development for current pandemics, and avoiding or mitigating future pandemics. One piece of information that comes with every such viral sequence is the geographical location where it was collected -the patterns found between viral variants and geographic location surely being an important part of this analysis. One major challenge that researchers face is processing such huge, highly dimensional data to get useful insights as quickly as possible. Most of the existing methods face scalability issues when dealing with the magnitude of such data. In this paper, we propose an algorithm that first computes a numerical representation of the spike protein sequence of SARS-CoV-2 using k-mers (substrings) and then uses a deep learning-based model to classify the sequences in terms of geographical location. We show that our proposed model significantly outperforms the baselines. We also show the importance of different amino acids in the spike sequences by computing the information gain corresponding to the true class labels.

show abstract

A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts

Cited by 35 publications

References 31 publications

Spike2Vec: An Efficient and Scalable Embedding Approach for COVID-19 Spike Sequences

Spike2Vec: An Efficient and Scalable Embedding Approach for COVID-19 Spike Sequences

Robust Representation and Efficient Feature Selection Allows for Effective Clustering of SARS-CoV-2 Variants

Classifying COVID-19 Spike Sequences from Geographic Location Using Deep Learning

Contact Info

Product

Resources

About