Using NLP to Generate MARC Summary Fields for Notre Dame ’s Catholic Pamphlets

Abstract

Three NLP (Natural Language Processing) automated summarization techniques were tested on a special collection of Catholic Pamphlets acquired by Hesburgh Libraries. The automated summaries were generated after feeding the pamphlets as .pdf files into an OCR pipeline. Extensive data cleaning and text preprocessing were necessary before the computer summarization algorithms could be launched. Using the standard ROUGE F1 scoring technique, the Bert Extractive Summarizer technique had the best summarization score. It most closely matched the human reference summaries. The BERT Extractive technique yielded an average Rouge F1 score of 0.239. The Gensim python package implementation of TextRank scored at .151. A hand-implemented TextRank algorithm created summaries that scored at 0.144. This article covers the implementation of automated pipelines to read PDF text, the strengths and weakness of automated summarization techniques, and what the successes and failures of these summaries mean for their potential to be used in Hesburgh Libraries.

Using Machine Learning and Natural Language Processing to Analyze Library Chat Reference Transcripts

“…This project tried to automatically generate a summary for each digitized pamphlet by using NLP's BERT Extractive technique and Gensim python package. 10 Other applications of ML techniques in the academic library include analyzing library operations such as acquisition. In 2019, Kevin W. Walker and Zhehan Jiang from the University of Alabama used a machine learning method called adaptive boosting (AdaBoost) to predict demand-driven acquisition (DDA).…”

Automating intellectual freedom: Artificial intelligence, bias, and the information landscape

“…Additionally, Zeng et al (2014) have experimented with using OpenCalais, a semantic analysis tool, to automatically extract and create access points for archival records as a response to the inability of traditional resource description methods to catch up with the growing body of information resources. Other experiments with AI-generated metadata have gone beyond either extraction or the assignment of keywords, and have used AI to craft entire descriptive summaries for digitized items (Flannery, 2020).…”