We investigate the influence of low-dimensionality and disorder in phonon transport in ultra-narrow armchair graphene nanoribbons (GNRs) using non-equilibrium Green's function (NEGF) simulation techniques. We specifically focus on how different parts of the phonon spectrum are influenced by geometrical confinement and line edge roughness. Under ballistic conditions, phonons throughout the entire phonon energy spectrum contribute to thermal transport. With the introduction of line edge roughness, the phonon transmission is reduced, but in a manner which is significantly non-uniform throughout the spectrum. We identify four distinct behaviors within the phonon spectrum in the presence of disorder: i) the low-energy, low-wavevector acoustic branches have very long mean-free-paths and are affected the least by edge disorder, even in the case of ultra-narrow W=1nm wide GNRs; ii) energy regions that consist of a dense population of relatively 'flat' phonon modes (including the optical branches) are also not significantly affected, except in the case of the ultra-narrow W=1nm GNRs, in which case the transmission is reduced because of band mismatch along the phonon transport path; iii) 'quasi-acoustic' bands that lie within the intermediate region of the spectrum are strongly affected by disorder as this part of the spectrum is depleted of propagating phonon modes upon both confinement and disorder (resulting in sparse E(q) phononic bandstructure), especially as the channel length increases; iv) the strongest reduction in phonon transmission is observed in energy regions that are composed of a small density of phonon modes, in which case roughness can introduce transport gaps that greatly increase with channel length. We show that in GNRs of widths as small as W=3nm, under moderate roughness, both the low-energy acoustic modes and dense regions of optical modes can retain semi-ballistic transport properties, even for channel lengths up to 2 L=1μm. These modes tend to completely dominate thermal transport. Modes in the sparse regions of the spectrum, however, tend to fall into the localization regime, even for channel lengths as short as 10s of nanometers, despite their relatively high phonon group velocities.