We have investigated the dielectric response in an antiferromagnetic dimer-Mott insulator β'-(BEDT-TTF)2ICl2 with square dimer lattice, compared to a spin liquid candidate κ-(BEDT-TTF)2Cu2(CN)3. Temperature dependence of the dielectric constant shows a peak structure obeying Curie-Weiss law with a strong frequency dependence. We found an anisotropic glassy ferroelectricity by pyrocurrent measurements, which suggests the charge disproportionation resulting in an electric dipole in a dimer. Each ferroelectric and antiferromagnetic transition temperatures is closely related to the antiferromagnetic interaction energy and a freezing temperature of dipole dynamics in a dimer, respectively. These correspondences suggest the possible charge-spin coupled degrees of freedom in the system.