Using wavelet analysis for text categorization in digital libraries: a first experiment with Strathprints

Abstract

Digital libraries increasingly benefit from research on automated text categorization for improved access. Such research is typically carried out by using standard test collections. In this paper we present a pilot experiment of replacing such test collections by a set of 6000 objects from a real-world digital repository, indexed by Library of Congress Subject Headings, and test support vector machines in a supervised learning setting for their ability to reproduce the existing classification. To augment the standard approach, we introduce a combination of two novel elements: using functions for document content representation in Hilbert space, and adding extra semantics from lexical resources to the representation. Results suggest that wavelet-based kernels slightly outperformed traditional kernels on classification reconstruction from abstracts and vice versa from full-text documents, the latter outcome due to word sense ambiguity. The practical implementation of our methodological framework enhances the analysis and representation of specific knowledge relevant to large-scale digital collections, in this case the thematic coverage of the collections. Representation of specific knowledge about digital collections is one of the basic elements of the persistent archives and the less studied one (compared to representations of digital objects and collections). Our research is an initial step in this direction developing further the methodological approach and demonstrating that text categorisation can be applied to analyse the thematic coverage in digital repositories.

Digital Preservation in Grids and Clouds: A Middleware Approach

“…Especially if considering their extreme usefulness, with a few notable exceptions [19,11], taking advantage of these general techniques within digital library services does not appear to be widespread. The situation is similar in text mining processes within digital libraries, with very few examples of fully integrated services and workflows [48].…”

Leveraging on High-Performance Computing and Cloud Technologies in Digital Libraries: A Case Study

“…Especially if considering their extreme usefulness, with a few notable exceptions [5], [2], taking advantage of the general techniques within digital library services does not appear to be widespread. The situation is similar in text mining processes within digital libraries, with very few examples of fully integrated services and workflows [21].…”