In this paper, we prove that any solution of the energy-critical wave equation in space dimensions 3, 4 or 5, which is bounded in the energy space decouples asymptotically, for a sequence of times going to its maximal time of existence, as a finite sum of modulated solitons and a dispersive term. This is an important step towards the full soliton resolution in the nonradial case and without any size restrictions. The proof uses a Morawetz estimate very similar to the one known for energy-critical wave maps, a virial type identity and a new channels of energy argument based on a lower bound of the exterior energy for well-prepared initial data.