The secondary structure of poly(amino acids) is an excellent tool for controlling and understanding the functionality and properties of proteins. In this perspective article the secondary structures of the homopolymers of oligo‐ and poly‐glutamic acid (Glu), aspartic acid (Asp), and α‐aminoisobutyric acid (Aib) are discussed. Information on external and internal factors, such as the nature of side groups, interactions with solvents and interactions between chains is reviewed. A special focus is directed on the folding in hybrid‐polymers consisting of oligo(amino acids) and synthetic polymers. Being part of the SFB TRR 102 “Polymers under multiple constraints: restricted and controlled molecular order and mobility” this overview is embedded into the cross section of protein fibrillation and supramolecular polymers. As polymer‐ and amino acid folding is an important step for the utilization and design of future biomolecules these principles guide to a deeper understanding of amyloid fibrillation.