While mathematical models, in particular self-propelled particle models, capture many properties of large fish schools, they do not always capture the interactions of smaller shoals. Nor do these models tend to account for the use of intermittent locomotion, often referred to as burst-and-glide, by many species. In this paper, we propose a model of social burst-and-glide motion by combining a well-studied model of neuronal dynamics, the FitzHugh–Nagumo model, with a model of fish motion. We first show that our model can capture the motion of a single fish swimming down a channel. Extending to a two-fish model, where visual stimulus of a neighbour affects the internal burst or glide state of the fish, we observe a rich set of dynamics found in many species. These include: leader–follower behaviour; periodic changes in leadership; apparently random (i.e. chaotic) leadership change; and tit-for-tat turn taking. Moreover, unlike previous studies where a randomness is required for leadership switching to occur, we show that this can instead be the result of deterministic interactions. We give several empirically testable predictions for how bursting fish interact and discuss our results in light of recently established correlations between fish locomotion and brain activity.