Clathrin-mediated endocytosis (CME) is crucial for modulating the protein composition of a cell's plasma membrane. Clathrin forms a cage-like, polyhedral outer scaffold around a vesicle, to which cargo-selecting clathrin adaptors are attached. AP2 is the key adaptor in CME. Crystallography has shown AP2 to adopt a range of conformations. Here we used cryo-electron microscopy, tomography and subtomogram averaging to determine structures, interactions and arrangements of clathrin and AP2 at the key steps of coat assembly, from AP2 in solution to membrane-assembled clathrin-coated vesicles (CCVs). AP2 binds cargo and PtdIns(4,5)P2-containing membranes via multiple interfaces, undergoing conformational rearrangement from its cytosolic state. The binding mode of AP2 β2-appendage into the clathrin lattice in CCVs and buds implies how the adaptor structurally modulates coat curvature and coat disassembly.