A magnetic Fe3O4@MgAl-layered double hydroxide (MLDH) nanocomposite was successfully synthesized and applied as an effective adsorbent for preconcentration of trace As(III), Cd(II), Cr(III), Co(II), Ni(II), and Pb(II) ions from complex matrices. The quantification of the analytes was achieved using the inductively coupled plasma optical emission spectrometry (ICP-OES) technique. The nanocomposite was then characterized using BET, FTIR, SEM, and EDS. Due to its high adsorption surface area, compared to traditional metal oxide-based adsorbents, MLDH nanocomposite exhibited high extraction efficiency. Several experimental parameters controlling the preconcentration of the trace metals were optimized using response surface methodology based on central composite design. Under optimum conditions, the linearity ranged from 0.1 to 500 µg L−1 and the correlation of coefficients (R2) were higher than 0.999. The limits of detection (LODs) and quantification (LOQs) were 0.11–0.22 µg L−1 and 0.35–0.73 µg L−1, respectively. The intra-day (n = 10) and inter-day precisions (n = 5 working days) expressed in the form of percent relative standard deviations (%RSDs) were below 5%. The proposed method was successfully applied for the analysis of the As(III), Cd(II), Cr(III), Co(II), Ni(II), and Pb(II) ions in different environmental water samples.