An novel cluster based feature selection and document classification model on high dimension trec data

Abstract

TREC text documents are complex to analyze the features its relevant similar documents using the traditional document similarity measures. As the size of the TREC repository is increasing, finding relevant clustered documents from a large collection of unstructured documents is a challenging task. Traditional document similarity and classification models are implemented on homogeneous TREC data to find essential features for document entities that are similar to the TREC documents. Also, most of the traditional models are applicable to limited text document sets for text analysis. The main issues in the traditional text mining models in TREC repository include :1) Each document is represented in vector form with many sparsity values 2) Failed to find the document semantic similarity between the intra and inter clusters 3) High mean squared error rate. In this paper, novel feature selection based clustered and classification model is proposed on large number of different TREC repositories. Traditional latent Semantic Indexing and document clustering models are failed to find the topic relevance on large number of TREC clinical text document sets due to computational memory and time. Proposed document feature selection and clustered based classification model is applied on TREC clinical benchmark datasets. From the experimental results, it is proved that the proposed model is efficient than the existing models in terms of computational memory, accuracy and error rate are concerned.

Deep embedding for mental health content on social media using vector space model with feature clusters

“…The document clustering process organizes similar documents into clusters using statistical measures on frequencies of words, phrases, or sentences. 1 Based on some feature matrix, the document clustering methods group the documents to ensure that the documents within a cluster are close than those from other clusters. 2,3 In order to cluster textual data, the data must first be properly mapped to a vector space, that is, it is important to vectorize each text document and then cluster the vectors using clustering algorithms such as K-means.…”

KNN classifier based approach for multi-class sentiment analysis of twitter data

“…Through hash-tags, it is possible for larger number of audience to view the tweets. All these properties of tweets are taken into consideration along with the regular textual features during feature selection [12][13][14][15] [16][17]. Twitter is the most popular microblogging site and hence generates enormous amounts of data suitable for opinion mining as compared to any other social media.…”