Cell-penetrating peptides are an important class of molecules with promising applications in bioactive cargo delivery. A diverse series of guanidinium-containing polymeric cell-penetrating peptide mimics (CPPMs) with varying backbone chemistries was synthesized and assessed for delivery of both GFP and fluorescently tagged siRNA. Specifically, we examined CPPMs based on norbornene, methacrylate, and styrene backbones to determine how backbone structure impacted internalization of these two cargoes. Either charge content or degree of polymerization was held constant at 20, with di-guanidinium norbornene molecules being polymerized to both 10 and 20 repeat units. Generally, homopolymer CPPMs delivered low amounts of siRNA into Jurkat T cells, with no apparent backbone dependence; however, by adding a short hydrophobic methyl methacrylate block to the guanidinium-rich methacrylate polymer, siRNA delivery to nearly the entire cell population was achieved. Protein internalization yielded similar results for most of the CPPMs, though the block polymer was unable to deliver proteins. In contrast, the styrene-based CPPM yielded the highest internalization for GFP (~40% of cells affected), showing that indeed backbone chemistry impacts protein delivery, specifically through the incorporation of an aromatic group. These results demonstrate that an understanding of how polymer structure affects cargo-dependent internalization is critical to designing new, more effective CPPMs.