Veracity Roadmap: Is Big Data Objective, Truthful and Credible?

Abstract

This paper argues that big data can possess different characteristics, which affect its quality. Depending on its origin, data processing technologies, and methodologies used for data collection and scientific discoveries, big data can have biases, ambiguities, and inaccuracies which need to be identified and accounted for to reduce inference errors and improve the accuracy of generated insights. Big data veracity is now being recognized as a necessary property for its utilization, complementing the three previously established quality dimensions (volume, variety, and velocity), But there has been little discussion of the concept of veracity thus far. This paper provides a roadmap for theoretical and empirical definitions of veracity along with its practical implications. We explore veracity across three main dimensions: 1) objectivity/subjectivity, 2) truthfulness/deception, 3) credibility/implausibility -and propose to operationalize each of these dimensions with either existing computational tools or potential ones, relevant particularly to textual data analytics. We combine the measures of veracity dimensions into one composite index -the big data veracity index. This newly developed veracity index provides a useful way of assessing systematic variations in big data quality across datasets with textual information. The paper contributes to the big data research by categorizing the range of existing tools to measure the suggested dimensions, and to Library and Information Science (LIS) by proposing to account for heterogeneity of diverse big data, and to identify information quality dimensions important for each big data type.

Toward better data veracity in mobile cloud computing: A context-aware and incentive-based reputation mechanism

“…Data veracity is becoming a research hotspot of big data and there have been many related studies in the literature [2,4,10,16,20,15]. For example, Kepner et al [10] introduced a new technique called Computing on Masked Data (CMD) to improve data veracity while allowing a wide range of computations and queries to be performed with low overhead by combining efficient cryptographic encryption methods with an associative array representation of big data.…”

Deception Detection and Rumor Debunking for Social Media

“…Passing the deception detection test in Social Media can verify the source's intention to create a truthful impression in the readers' mind, supporting sources trustworthiness and credibility. On the other hand, failing the test immediately alerts the user to potential alternative motives and intentions and necessitates further fact verification (Lukoianova and Rubin, 2014). th V in addition to Volume, Velocity and Variety -portrayed across three primary orthogonal dimensions in the conceptual space -objectivity, truthfulness, credibility.…”

“…Prior to this work on subjectivity, Rubin (2006b) continues, an NLP system needed to determine the structure of a text -normally at least enough to answer "Who did what to whom?" (Manning and Schütze, 1999 (Lukoianova and Rubin, 2014).…”

A Conceptual Framework and a Suite of Tools to Support Crisis Management

“…Similarly, variety can be managed thanks to the existence of metadata, which allow the identification of the data content [15]. However, there is no single solution that takes into account veracity [20]: Consequently, objectivity, truthfulness and credibility of data need to be controlled, especially in a crisis context.…”