Classification of Full Text Biomedical Documents: Sections Importance Assessment

Abstract

The exponential growth of documents in the web makes it very hard for researchers to be aware of the relevant work being done within the scientific community. The task of efficiently retrieving information has therefore become an important research topic. The objective of this study is to test how the efficiency of the text classification changes if different weights are previously assigned to the sections that compose the documents. The proposal takes into account the place (section) where terms are located in the document, and each section has a weight that can be modified depending on the corpus. To carry out the study, an extended version of the OHSUMED corpus with full documents have been created. Through the use of WEKA, we compared the use of abstracts only with that of full texts, as well as the use of section weighing combinations to assess their significance in the scientific article classification process using the SMO (Sequential Minimal Optimization), the WEKA Support Vector Machine (SVM) algorithm implementation. The experimental results show that the proposed combinations of the preprocessing techniques and feature selection achieve promising results for the task of full text scientific document classification. We also have evidence to conclude that enriched datasets with text from certain sections achieve better results than using only titles and abstracts.

Text mining for contexts and relationships in cancer genomics literature

“…Firstly, it would be of high value to adapt our machine-learning models to work on full article texts, thereby providing access to a much greater volume of relevant information and context for extraction. Full-text classifier adaptation is possible and has been demonstrated in similar work ( Oliveira Gonçalves et al 2021 , Gonçalves et al 2022 ). Secondly, our methodology would benefit from linking the identified phenotypes to the recently available HPO ( Groza et al 2015 ).…”

Last Teen Pixels for Arabic Font Size and Style Recognition

“…The character and word recognition error could be reduced by over 70% when using font recognition first, followed by word recognition [8], [9]. Arabic font recognition based on a priori approach using steerable pyramid with 6 orientations give high recognition rates than Gray Level Co-occurrence Matrix, Gabor Filter and Wavelets evaluated using the Arabic printed text image dataset multi-font of APTID/MF database and Bp ANN for classification [10], [11].…”