The proliferation of deepfake generation has become increasingly widespread. Current solutions for automatically detecting and classifying generated content require substantial computational resources, making them impractical for use by the average non-expert individual particularly from edge computing applications. In this paper, we propose a series of techniques to accelerate the inference speed of deepfake detection on video data. We also draw inspiration from steganalysis approaches to expose deepfakes as any secret payloads encoded in the image. Furthermore, some key considerations were identified to significantly reduce the size of the core convolutional neural network. The experiment yielded competitive results when evaluated on two second-generation deepfake datasets, namely Celeb-DFv2 and DFDC, while requiring only a fraction of the typical computational cost and resources.