This paper investigates the resource allocation design in device-to-device (D2D) communication underlying cellular networks, which is assisted by multiple intelligent reflecting surfaces (IRSs) deployed at the cell boundary to enhance desired signals and mitigate interference between D2D pairs and CUs. In this regard, a multi-objective optimization problem (MOOP) framework is formulated to jointly maximize the downlink sum-rate of the D2D pairs and cellular users (CUs). To doing so, the MOOP is first converted into a single-objective optimization problem (SOOP) by invoking the weighted sum method. Next, to facilitate the high-coupled non-convex SOOP formulation, it is decomposed into two sub-problems through the alternative optimization method. For the first sub-problem, the inner approximation and successive convex approximations are adopted for jointly allocating D2D transmission power, subcarrier assignment, and transmit beamforming matrix at the BS. For the second sub-problem, an iterative algorithm based on the penalty-based method as well as Fenchel's duality approach is adopted to design the passive beamforming matrices at IRSs, which is guaranteed to rapidly converge to a stationary point. Simulation results reveal that a non-trivial trade-off between the total throughput of CUs and D2D pairs exist. Furthermore, the proposed framework significantly outperforms existing works addressed in the literature.