The intermediate Jacobian map, which associates to a smooth cubic threefold its intermediate Jacobian, does not extend to the GIT compactification of the space of cubic threefolds, not even as a map to the Satake compactification of the moduli space of principally polarized abelian fivefolds. A better ‘wonderful’ compactification trueM∼ of the space of cubic threefolds was constructed by the first and fourth authors — it has a modular interpretation, and divisorial normal crossing boundary. We prove that the intermediate Jacobian map extends to a morphism from trueM∼ to the second Voronoi toroidal compactification of A5 — the first and fourth author previously showed that it extends to the Satake compactification. Since the second Voronoi compactification has a modular interpretation, our extended intermediate Jacobian map encodes all of the geometric information about the degenerations of intermediate Jacobians, and allows for the study of the geometry of cubic threefolds via degeneration techniques. As one application, we give a complete classification of all degenerations of intermediate Jacobians of cubic threefolds of torus rank 1 and 2.