Multimodal Deception Detection

Abstract

This work proposes a new approach to deception detection, based on finding significant differences between liars and truth tellers through the analysis of their behavior, verbal and non-verbal. This is based on the combination of two factors: multimodal data collection, and t-pattern analysis. Multimodal approach has been acknowledged in literature about deception detection and on several studies concerning the understanding of any communicative phenomenon. We believe a methodology such as T-pattern analysis could be able to get the best advantages from an approach that combines data coming from multiple signaling systems. In fact, T-pattern analysis is a recent methodology for the analysis of behavior that unveil the complex structure at the basis of the organization of human behavior. For this work, we conducted an experimental study and analyzed data related to a single subject. Results showed how T-pattern analysis allowed to find differences between truth telling and lying. This work aims at making progress in the state of knowledge about deception detection, with the final goal to propose a useful tool for the improvement of public security and well-being

Pathways to truth: using criteria-based content analysis in missing person cases

“…This was expected, as innocent individuals should obtain more criteria than guilty individuals. Individual cues, or tells, and clusters of tells have been the focus of some forensic linguistic literature (Burgoon and Qin, 2006; Fitzpatrick et al , 2015; Zhou et al , 2004); however, in recent deception detection studies, researchers have shifted their focus to sequential indicators of deception, though currently only in nonverbal communication literature (Burgoon et al , 2014, 2015; Diana et al , 2015; Keatley et al , 2018; Lansley, 2017; Marono et al , 2017, 2018; Zurloni et al , 2015). The current research has made a significant contribution to the forensic linguistics literature, by demonstrating how temporal approaches can be used to analyse linguistic cues in missing persons cases.…”

“…The way in which nonverbal deception detection research examines sequential patterns has progressed, and this seems to also be effective in linguistic research. As deception is complex and in order to help researchers and practitioners understand this complexity, dynamic systems modelling, like BSA, may be useful (Burgoon et al , 2014, 2015; Diana et al , 2015; Zurloni et al , 2015).…”

How Game Location Affects Soccer Performance: T-Pattern Analysis of Attack Actions in Home and Away Matches

“…Temporal pattern analysis (Magnusson, 2000 ) has been applied to a great number of research experiments in very different fields. Patterns have been used to describe, interpret and understand phenomena such as deceptive communication (Anolli and Zurloni, 2009 ; Zurloni et al, 2013 , 2016 ; Diana et al, 2015 ), animal and human behavior (Casarrubea et al, 2015a , b ) a wide variety of observational and sports studies, such as analysis of soccer team play (Camerino et al, 2012 ; Castañer et al, 2016 ), deception detection in doping cases (Zurloni et al, 2014b ), motor skill responses in body movement and dance (Castañer et al, 2009 ), effectiveness of offensive plays in basketball (Remmert, 2003 ; Fernández et al, 2009 ) and futsal (Sarmento et al, 2015 ) or tactics employed by runners (Aragón et al, 2015 ).…”

T-Pattern Analysis and Cognitive Load Manipulation to Detect Low-Stake Lies: An Exploratory Study

“…Basing on the literature discussed above and results from previous studies ( Vrij, 2008 ; Zurloni et al, 2013 , 2016 ; Burgoon et al, 2014 , 2015 ; Diana et al, 2015 ), this work proposes an approach to deception detection combining cognitive load manipulation and T-pattern methodology with three objectives: (a) testing the efficacy of dual task-procedure in enhancing differences between truth tellers and liars in a low-stakes situation; (b) exploring the efficacy of T-pattern methodology in discriminating truthful reports from deceitful ones in a low-stakes context; (c) setting the experimental design and procedure for future and follow-up research.…”

“…Temporal pattern analysis and its related software THEME ( Magnusson, 2000 ) have been applied to a great number of research experiments in very different fields. Patterns have been used to describe, interpret and understand phenomena such as deceptive communication ( Anolli and Zurloni, 2009 ; Zurloni et al, 2013 , 2016 ; Diana et al, 2015 ), animal and human behavior ( Kerepesi et al, 2005 ; Casarrubea et al, 2015 ), patient–therapist communication in computer assisted environments ( Riva et al, 2005 ), a wide variety of observational and sports studies, such as analysis of soccer team play ( Camerino et al, 2012 ; Cavalera et al, 2015 ; Diana et al, 2017 ), motor skill responses in body movement and dance ( Castañer et al, 2009 ) and deception detection in doping cases ( Zurloni et al, 2015 ).…”