The volcanic island of Jan Mayen, remotely located in the Norwegian‐Greenland Sea, was covered by a contiguous ice cap during the Late Weichselian. Until now, it has been disputed whether parts of the island south of the presently glaciated Mount Beerenberg area were ever glaciated. Based on extensive field mapping we demonstrate that an ice cap covered all land areas and likely also extended onto the shallow shelf areas southeast and east of the island. Chronological interpretations are based on K‐Ar and 40Ar/39Ar dating of volcanic rocks, cosmogenic nuclide (36Cl) surface exposure dating of bedrock and glacial erratics, and radiocarbon dating. We argue that ice growth started after 34 ka and that an initial deglaciation started some 21.5–19.5 ka in the southern and middle parts of the island. In the northern parts, closer to the present glaciers, the deglaciation might have started later, as evidenced by the establishment of vegetation 17–16 cal. ka BP. During full glaciation, the ice cap was likely thickest over the southern part of the island. This may explain a seemingly delayed deglaciation compared with the northern parts despite earlier initial deglaciation. In a broader context, the new knowledge of the Late Weichselian of the island contributes to the understanding of glaciations surrounding the North Atlantic and its climate history.