Audio Transformer for Synthetic Speech Detection via Formant Magnitude and Phase Analysis

Abstract

This paper introduces a novel multi-task transformer for synthetic speech detection. The network encodes magnitude and phase of the input speech with a feature bottleneck, used to autoencode the input magnitude, to predict the trajectory of the fundamental frequency (f0), and to discern if the input speech is synthetic or natural. The approach achieves state-ofthe-art performance on the ASVspoof 2019 LA dataset while still retaining interpretability, with an AUC score of 0.910.