Heparin belongs to glycosaminoglycans (GAGs), a class of periodic linear anionic polysaccharides, which are functionally important components of the extracellular matrix owing to their interactions with various protein targets. Heparin is known to be involved in many cell signaling processes, while the experimental data available for heparin are significantly more abundant than for other GAGs. At the same time, the length and conformational flexibility of the heparin represent major challenges for its theoretical analysis. Coarse‐grained (CG) approaches, which enable us to extend the size‐ and time‐scale by orders of magnitude owing to reduction of system representation, appear, therefore, to be useful in simulating these systems. In this work, by using umbrella‐sampling molecular dynamics simulations, we derived and parameterized the CG backbone‐local potentials of heparin chains and the orientational potentials for the interactions of heparin with amino acid side chains to be further included in the physics‐based Unified Coarse‐Grained Model of biological macromolecules. With these potentials, simulations of extracellular matrix processes where both heparin and multiple proteins participate will be possible.