Question answering with deep neural networks for semi-structured heterogeneous genealogical knowledge graphs

Abstract

With the rising popularity of user-generated genealogical family trees, new genealogical information systems have been developed. State-of-the-art natural question answering algorithms use deep neural network (DNN) architecture based on self-attention networks. However, some of these models use sequence-based inputs and are not suitable to work with graph-based structure, while graph-based DNN models rely on high levels of comprehensiveness of knowledge graphs that is nonexistent in the genealogical domain. Moreover, these supervised DNN models require training datasets that are absent in the genealogical domain. This study proposes an end-to-end approach for question answering using genealogical family trees by: (1) representing genealogical data as knowledge graphs, (2) converting them to texts, (3) combining them with unstructured texts, and (4) training a transformer-based question answering model. To evaluate the need for a dedicated approach, a comparison between the fine-tuned model (Uncle-BERT) trained on the auto-generated genealogical dataset and state-of-the-art question-answering models was performed. The findings indicate that there are significant differences between answering genealogical questions and open-domain questions. Moreover, the proposed methodology reduces complexity while increasing accuracy and may have practical implications for genealogical research and real-world projects, making genealogical data accessible to experts as well as the general public.

CR-COPEC: Causal Rationale of Corporate Performance Changes to learn from Financial Reports

“…Pre-trained NLMs have been state-of-thearts for many Natural Language Processing (NLP) tasks. For example, NLMs such as BERT (Devlin et al, 2018) and ALBERT (Lan et al, 2019) demonstrate outstanding performance in some tasks such as answering questions (Clark et al, 2020;Suissa et al, 2023) and computing conditional probabilities of masked words in a sentence (Kwon et al, 2022). Nonetheless, recent research indicates that the size of human-annotated data continues to be a significant factor influencing the performance of models (Gu et al, 2022;Mehrafarin et al, 2022).…”

AI‐Based Research Tool for Large Genealogical Corpora: The Case of Jewish Communities Worldwide

“…One of the key AI‐based techniques for textual corpora exploration is natural language question‐answering (QA). Unlike keyword‐based search engines, QA algorithms receive and process natural language questions and produce precise answers rather than long lists of documents that need to be manually scanned (Suissa et al, 2021). While factual question‐answering models aim to answer a question about one (or few) piece(s) of information (e.g., about a specific individual), quantitative question‐answering models aim to answer quantitative questions about a substantial subset of the dataset (e.g., a community or a country) (Suissa et al, 2023).…”

CIDOC-CRM and Machine Learning: A Survey and Future Research

“…Indicatively, they managed to predict, with an accuracy of over 92%, the class labels of previously unseen images. [47]. In particular, ti generates text passages from knowledge sub-graphs that contain genealogical data for creating questions and answers and for building a Question Answering system by exploiting deep neural network techniques with the Uncle-BERT model.…”