Poly(N,N‐dimethylaminoethyl methacrylate)/clay nanocomposites (4a–c) were prepared by in‐situ bulk polymerization method. N,N‐Dimethylaminoethyl methacrylate (DMAEMA) was alkylated using hexyl bromide to afford quaternary ammonium salt (2) which was used in the organomodification process of the clay. The organoclay (3) was dispersed in the DMAEMA monomer at concentrations 1, 3, and 5 wt% and bulk polymerization reactions were conducted to prepare nanocomposites (4a–c), respectively. The prepared nanocomposites were characterized by Fourier transform infrared, X‐ray diffraction (XRD), high‐resolution transmission electron microscopy, and thermogravimetric analysis. The XRD results showed that the polymer/clay nanocomposites have an exfoliated structure. Optical, dielectric, and mechanical properties were also investigated. The prepared polymer (PDMAEMA) film showed a transparency of about 88% and it slightly decreased to 80% for PDMAEMA/clay (5 wt%). The films showed indirectly allowed transition and the optical band gap of the films was evaluated. The dielectric properties of polymer and polymer nanocomposites were discussed. POLYM. COMPOS., 39:2603–2610, 2018. © 2016 Society of Plastics Engineers