Recent advances in autonomous underwater vehicle (AUV) technology have led to their widespread acceptance and adoption for use in scientific, commercial, and defence applications in the underwater domain. At the same time, research progress in swarm robotics has seen swarm intelligence algorithms in use with greater effect on real-world robots in the field. A group of AUVs utilizing swarm intelligence concepts has the potential to address issues more effectively than a single AUV, and such a group can potentially open up new areas of application. Examples include the monitoring and tracking of highly dynamic oceanographic phenomena such as phytoplankton blooms and the use of an AUV swarm as a virtual acoustic receiver for sea-bottom seismic surveying or the monitoring of naturally occurring acoustic radiation from cracking ice. However, the limitations of the undersea environment places unique constraints on the use of existing swarm robotics approaches with AUVs. In particular, algorithms must be distributed and robust in the face of localization error and degraded communications.This work presents an investigation into one particular swarm strategy for a group of AUVs, termed formation control, with consideration to the constraints of the underwater domain. Four formation control algorithms, each developed and tested within the MOOS-IvP framework, are presented. In addition, a 'formation quality' metric is introduced. This metric is used in conjunction with a measure of formation energy expenditure to compare the efficacy of each behaviour during construction of a desired formation, and formation maintenance while it drifts in ocean currents. This metric is also used to compare robustness of each algorithm in the presence of vehicle failure and changing communication rate.