Almost all modern proteins possess well-defined, relatively rigid scaffolds that provide structural preorganization for desired functions. Such scaffolds require the sufficient length of a polypeptide chain and extensive evolutionary optimization. How ancestral proteins attained functionality, even though they were most likely markedly smaller than their contemporary descendants, remains a major, unresolved question in the origin of life. On the basis of evidence from experiments and computer simulations, we argue that at least some of the earliest water-soluble and membrane proteins were markedly more flexible than their modern counterparts. As an example, we consider a small, evolved in vitro ligase, based on a novel architecture that may be the archetype of primordial enzymes. The protein does not contain a hydrophobic core or conventional elements of the secondary structure characteristic of modern water-soluble proteins, but instead is built of a flexible, catalytic loop supported by a small hydrophilic core containing zinc atoms. It appears that disorder in the polypeptide chain imparts robustness to mutations in the protein core. Simple ion channels, likely the earliest membrane protein assemblies, could also be quite flexible, but still retain their functionality, again in contrast to their modern descendants. This is demonstrated in the example of antiamoebin, which can serve as a useful model of small peptides forming ancestral ion channels. Common features of the earliest, functional protein architectures discussed here include not only their flexibility, but also a low level of evolutionary optimization and heterogeneity in amino acid composition and, possibly, the type of peptide bonds in the protein backbone.