Distributed acoustic sensing (DAS) is an optoelectronic technology that utilises fibre optic cables to detect disturbances caused by seismic waves. Using DAS, seismologists can monitor geophysical phenomena at high spatial and temporal resolutions over long distances in inhospitable environments. Field experiments using DAS, are typically associated with large volumes of observations, requiring algorithms for efficient processing and monitoring capabilities. In this study, we present a supervised classifier trained to recognise seismic activity from other sources of hydroacoustic energy. Our classifier is based on a 2D convolutional neural network architecture. The 55km-long ocean-bottom fibre optic cable, located off Cape Muroto in south-west of Japan, was interrogated using DAS. Data were collected during two different monitoring time-periods. Optimisation of the model’s hyperparameters using Gaussian Processes Regression was necessary to prevent issues associated with small sizes of training data. Using a test set of 100 annotated images, we have shown that the top performing model is around $92\%$ accurate in classifying geophysical data from other sources of hydroacoustic energy and ambient noise.