This study explores the interactions underlying the IR spectra of the ionic liquid [NC4111][NTf2] and its deuterated isotopomer [d9-NC4111][NTf2] by first isolating the spectra of charged ionic building blocks using mass-selective CIVP spectroscopy and then following the evolution of these bands upon sequential assembly of the ionic constituents. The spectra of the (1,1) and (2,2) neutral ion pairs are recorded using superfluid helium droplets as well as a solid neon matrix, while those of the larger charged aggregates are again obtained with CIVP. In general, the cluster spectra are similar to that of the bulk, with the (2,2) system displaying the closest resemblance. Analysis of the polarization-dependent band intensities of the neutral ion pairs in liquid droplets as a function of external electric field yields dipole moments of the neutral aggregates. This information allows a coarse assessment of the packing structure of the neutral pairs to be antiparallel at 0.37 K, in contrast to the parallel arrangement found for the assembly of small, high-dipole neutral molecules with large rotational constants (e.g., HCN). The role of an extra anion or cation attached to both the (1,1) and the (2,2) ion pairs to form the charged clusters is discussed in the context of an additional remote, more unfavorable binding site intrinsic to the nature of the charged IL clusters and as such not anticipated in the bulk phase. Whereas for the anion itself only the lowest energy trans conformer was observed, the higher clusters showed an additional population of the cis conformer. The interactions are found to be consistent with a minimal role of hydrogen bonding.