MicroRNA (miRNA)-guided mRNA repression, mediated by the miRNA-induced silencing complex (miRISC), is an important component of post-transcriptional gene silencing. However, how miRISC identifies the target mRNA in vivo is not well understood. Here, we show that the nucleoporin Nup358 plays an important role in this process. Nup358 localizes to the nuclear pore complex and to the cytoplasmic annulate lamellae (AL), and these structures dynamically associate with two mRNP granules: processing bodies (P bodies) and stress granules (SGs). Nup358 depletion disrupts P bodies and concomitantly impairs the miRNA pathway. Furthermore, Nup358 interacts with AGO and GW182 proteins and promotes the association of target mRNA with miRISC. A well-characterized SUMO-interacting motif (SIM) in Nup358 is sufficient for Nup358 to directly bind to AGO proteins. Moreover, AGO and PIWI proteins interact with SIMs derived from other SUMO-binding proteins. Our study indicates that Nup358-AGO interaction is important for miRNA-mediated gene silencing and identifies SIM as a new interacting motif for the AGO family of proteins. The findings also support a model wherein the coupling of miRISC with the target mRNA could occur at AL, specialized domains within the ER, and at the nuclear envelope.