This thesis examines two aspects of the non-equilibrium dynamics of Bose-Einstein condensates (BECs). Our particular interests are the relaxation of near-integrable systems, and the inter-particle correlations present in BECs, both in equilibrium and following an abrupt change in the Hamiltonian.In the first part of this thesis we investigate the stability of solitary wave solutions to a system of two coupled one-dimensional non-linear Schrödinger equations (CNLSE). This system has an integrable point known as the Manakov [1] model which has analytic dark-bright soliton solutions [2] . We break the integrability of this model by varying the inter-species interaction strength, and employ variational and numerical methods in order to find dark-bright solitary wave solutions, away from the integrable point.The time evolution of these states is calculated via numerical integration of the CNLSE, which allows us to assess the stability of these solutions in isolation and to quantify their robustness against collisions with a dark soliton. We find that there is a broad region of the parameter space in which solutions for black-bright (stationary) solitary waves can be found. In this domain, the integrability breaking is revealed only during collisions. Prior to a collision, the numerical solutions are indistinguishable from true solitons, however, the collisional stability of these solitary waves is significantly affected by the extent to which integrability is broken. We find that there is a smooth transition between the non-dispersive particle-like nature of soliton interactions for integrable systems, and the destructive collisions which take place when the system is perturbed far from the integrable point.In the case of moving (grey-bright) solitary waves, we find a more restricted region of the parameter space which admits solitary wave solutions. In this domain we are able to find approximately stable solitary wave solutions using a variational ansatz. The collisional stability of these grey-bright solitary waves is also found to depend upon the extent to which integrability is broken.We conclude that the observation of stable, long-lived dark-bright solitary waves is not sufficient to indicate near-integrability of the two-component system. However, near-integrability may inferred if dark-bright solitary waves are observed to survive multiple collisions. These results are not only of theoretical interest, but may also inform future experiments which explore the behaviour of solitary waves in two-component Bose-Einstein condensates.Following this we investigate the properties of magnetic solitary wave solutions to the CNLSE. We find that the analytic 'magnetic soliton' solutions derived in reference [3] are dynamically unstable and relax to non-stationary magnetic solitary wave states over a short timescale. We investigate the collisional dynamics of these magnetic solitary waves and find that these excitations are remarkably robust.In the second part of this thesis we calculate the fluctuations in the nu...