Ubiquitin and its polymeric forms are conjugated to intracellular proteins to regulate diverse intracellular processes. Intriguingly, polyubiquitin has also been identified as a component of pathological protein aggregates associated with Alzheimer’s disease and other neurodegenerative disorders. We recently found that polyubiquitin can form amyloid-like fibrils, and that these fibrillar aggregates can be degraded by macroautophagy. Although the structural properties appear to function in recognition of the fibrils, no structural information on polyubiquitin fibrils has been reported so far. Here, we identify the core of M1-linked diubiquitin fibrils from hydrogen-deuterium exchange experiments using solution nuclear magnetic resonance (NMR) spectroscopy. Intriguingly, intrinsically flexible regions became highly solvent-protected in the fibril structure. These results indicate that polyubiquitin fibrils are formed by inter-molecular interactions between relatively flexible structural components, including the loops and edges of secondary structure elements.