A Two-stage Chinese text summarization algorithm using keyword information and adversarial learning

Deng, Zhenrong; Fuxin, Ma; Lan, Rushi; Huang, Wenming; Luo, Xiangfeng

doi:10.1016/j.neucom.2020.02.102

Cited by 29 publications

(26 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Limited analysis of unstructured text document because of some predefined criteria. It is also not capable for every sort of text corpus Worked over incomplete words and sentences by abstractive & extractive summarization [8] ! X !…”

Section: Concept-based Abstractive and Extractive Text Mining Implementmentioning

confidence: 99%

“…Therefore, the optimal use of time and cost for corpus processing is crucial in the information retrieval system. To resolve this issue, metadata analysis and relevant text extraction have a significant role in optimizing the processing effort, cost, and time [6], [8], [17].…”

Section: Introductionmentioning

confidence: 99%

“…This extraction process attempts to extract important sentences or those sentences carrying salient words. In the text extraction process, we refer these sentences as key-sentences [2], [4], [8], [59], [61]. The reason to select abstractive & extractive summarization is to overcome sentence structures, active or passive voice, etc.…”

Section: Introductionmentioning

confidence: 99%

“…Collective metadata of similar documents leads to a relevant set of documents rather than processing documents with individual metadata. The process of keywords-based Clustering generates groups of the metadata in the form of a dictionary [8], [9]. This process faces challenges like semantic-restrictions language-dependency.…”

Section: Introductionmentioning

confidence: 99%

“…In literature, researchers mostly apply either syntactic and semantic approaches for deciding sentence scores. We implement the predetermined features during the syntactic approach, which are usually hand-crafted for those sentences that we consider for scoring the sentences [8], [13], [22], [39]. Semantic approaches involve the word's meaning and various types of text phrases to create a semantic relation [9], [17], [28], [41].…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Unstructured Text Documents Summarization With Multi-Stage Clustering

et al. 2020

View full text Add to dashboard Cite

In natural language processing, text summarization is an important application used to extract desired information by reducing large text. Existing studies use keyword-based algorithms for grouping text, which do not give the documents' actual theme. Our proposed dynamic corpus creation mechanism combines metadata with summarized extracted text. The proposed approach analyzes the mesh of multiple unstructured documents and generates a linked set of multiple weighted nodes by applying multistage Clustering. We have generated adjacency graphs to link the clusters of various collections of documents. This approach comprises of ten steps: pre-processing, making multiple corpuses, first stage clustering, creating sub-corpuses, interlinking sub-corpuses, creating page rank keyword dictionary of each sub-corpus, second stage clustering, path creation among clusters of sub-corpuses, text processing by forward and backward propagation for results generation. The outcome of this technique consists of interlinked subcorpuses through clusters. We have applied our approach to a News dataset, and this interlinked corpus processing follows step by step clustering to search the most relevant parts of the corpus with less cost, time, and improve content detection. We have applied six different metadata processing combinations over multiple text queries to compare results during our experimentation. The comparison results of text satisfaction show that Page-Rank keywords give 38% related text, single-stage Clustering gives 46%, twostage Clustering gives 54%, and the proposed technique gives 67% associated text. Furthermore, this approach covers/searches the relevant data with a range of most to less relevant content. It provides the systematic query-relevant corpus processing mechanism, which automatically selects the most relevant subcorpus through dynamic path selection. We used the SHAP model to evaluate the proposed technique, and our evaluation results proved that the proposed mechanism improved text processing. Moreover, combining text summarization features, shown satisfactory results compared to the summaries generated by general models of abstractive & extractive summarization.

show abstract

Section: Concept-based Abstractive and Extractive Text Mining Implementmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Unstructured Text Documents Summarization With Multi-Stage Clustering

et al. 2020

View full text Add to dashboard Cite

show abstract

Intelligent deep learning‐based hierarchical clustering for unstructured text data

Jyothi

Lingamgunta

Eluri

2022

Concurrency and Computation

View full text Add to dashboard Cite

Document clustering is a technique used to split the collection of textual content into clusters or groups. In modern days, generally, the spectral clustering is utilized in machine learning domain. By using a selection of text mining algorithms, the diverse features of unstructured content is captured for ensuing in rich descriptions. The main aim of this article is to enhance a novel unstructured text data clustering by a developed natural language processing technique. The proposed model will undergo three stages, namely, preprocessing, features extraction, and clustering. Initially, the unstructured data is preprocessed by the techniques such as punctuation and stop word removal, stemming, and tokenization. Then, the features are extracted by the word2vector using continuous Bag of Words model and term frequency-inverse document frequency. Then, unstructured features are performed by the hierarchical clustering using the optimizing the cut-off distance by the improved sensing area-based electric fish optimization (FISA-EFO). Tuned deep neural network is used for improving the clustering model, which is proposed by same algorithm. Thus, the results reveal that the model provides better clustering accuracy than other clustering techniques while handling the unstructured text data. K E Y W O R D S fitness improved sensing area-based electric fish optimization, hierarchical clustering, tuned deep neural network, unstructured text data clustering INTRODUCTIONGenerally, speech and text data are read by humans easily, but the machine learning and statistical modeling applications have some unstructured data and so, it is necessary to do some alterations in the coded input feature sets. 1 Data clustering is a technique used for splitting the data elements into many groups so that the elements in the same group have the highest similarity. Though, based on the cluster's attributes, there are diverse elements in other groups. The major aim of clustering techniques is to get centroids or cluster centers for characterizing the entire cluster. Few of the clustering techniques were performed and classified from different scenarios such as "density-based methods, grid-based methods, partitioning methods, and hierarchical methods." 2,3 Moreover, the data set is defined as categorical or numerical. The primary statistical features of numeric data are utilized for describing the distance function between data elements. The categorical data is imitated from the qualitative and quantitative data, and then the descriptions are attained from the counts. 4 By using a "textual virtual schematic model" (TVSM), the textual data are assigned in clusters and it follows three steps. Initially, the extraction of unstructured data is carried out from the data source, and then, it is changed into structured data. 5 After that, clustering is implemented on structured data. Finally, the comparison of documents is done for enhancing the performance of the query based on accuracy.The day today's life generates a huge amount of unstructured text...

show abstract