Total lengths (LT) of 50 free‐swimming fish in a tank, silver carp Hypophthalmichthys molitrix and rainbow trout Oncorhynchus mykiss, were measured using a DIDSON (Dual‐frequency IDentification SONar) camera. Using Sound Metrics software, multiple measurements of each fish (LT, side aspect angle and distance from the camera) at different times were analysed by two experienced operators while a subset of data was analysed by two inexperienced operators. The main result showed high variability in intra‐fish LT measurements. The number of measurements required to minimise errors and to obtain robust fish measurements (true LT ± 3 cm) was estimated by a bootstrap method. Three to five measurements per fish were recommended for fish surveys in rivers. In this experimental study, aiming to reproduce river conditions, no evidence of fish position (side aspect angle and distance from the camera) effect was detected, but an operator effect (partially explained by training) was observed. General linear mixed models also showed that lengths of the smallest fish (LT < 57 cm) were overestimated and lengths of the largest fish (LT > 57 cm) were underestimated in comparison with their true lengths. In conclusion, we highlight that this technology, like any monitoring methods, returns imperfect observations. We advise DIDSON users to ensure that measurements are carried out correctly in order to draw accurate conclusion from this new technology.