Chirality is an important concept in chemistry revealing intriguing optical properties such as circular dichroism (CD), circularly polarized luminescence (CPL), etc. As one of the non-centrosymmetric (NCS) classes, chiral materials with extended structures may exhibit unique nonlinear optical (NLO) properties, such as second-harmonic generation (SHG). In this Concept article, a series of recently discovered NCS coordination polymers (CPs) from use of carefully designed chiral organic ligands are reviewed. Combining several metal cations such as lanthanides, lead, zinc, and cadmium with rigid chiral ligands has resulted in interesting CPs with both polar and nonpolar structures. Detailed structures, SHG properties, and structure-property relationships are provided. The importance of hyperpolarizability formed by intermolecular hydrogen boding interactions to SHG is emphasized.