Narrow‐bandgap n‐type polymers with high electron mobility are urgently demanded for the development of all‐polymer solar cells (all‐PSCs). Here, two regioregular narrow‐bandgap polymer acceptors, L15 and MBTI, with two electron‐deficient segments are synthesized by copolymerizing two dibrominated fused‐ring electron acceptors (FREA) with distannylated aromatic imide, respectively. Taking full advantage of the FREA and the imide, both polymer acceptors show narrow bandgap and high electron mobility. Benefiting from the more extended absorption, better backbone ordering, and higher electron mobility than those of its regiorandom analog, the L15‐based all‐PSC yields a high power conversion efficiency (PCE) of 15.2% when blended with the polymer donor PM6. More importantly, MBTI incorporating a benzothiophene‐core FREA segment shows relatively higher frontier molecular orbital levels than L15, forming a cascade‐like energy level alignment with L15 and PM6. Based on this, ternary all‐PSCs are designed where MBTI is introduced as a guest into the PM6:L15 host system. Thanks to further optimal blend morphology and more balanced charge transport, the PCE is improved up to 16.2%, which is among the highest values for all‐PSCs. The results demonstrate that combining an FREA and an aromatic imide to construct regioregular narrow‐bandgap polymer acceptors provides an effective approach to fabricate highly efficient all‐PSCs.