Poly(vinylidene fluoride) (PVDF)‐based polymers demonstrate great potential for applications in flexible and wearable electronics but show low piezoelectric coefficients (e.g., −d33 < 30 pC N−1). The effective improvement for the piezoelectricity of PVDF is achieved by manipulating its semicrystalline structures. However, there is still a debate about which component is the primary contributor to piezoelectricity. Therefore, current methods to improve the piezoelectricity of PVDF can be classified into modulations of the amorphous phase, the crystalline region, and the crystalline–amorphous interface. Here, the basic principles and measurements of piezoelectric coefficients for soft polymers are first discussed. Then, three different categories of structural modulations are reviewed. In each category, the physical understanding and strategies to improve the piezoelectric performance of PVDF are discussed. In particular, the crucial role of the oriented amorphous fraction at the crystalline–amorphous interface in determining the piezoelectricity of PVDF is emphasized. At last, the future development of high performance piezoelectric polymers is outlooked.