We investigate the nonequilibrium spin polarization due to a temperature gradient in antiferromagnetic insulators, which is the magnonic analogue of the inverse spin-galvanic effect of electrons. We derive a linear response theory of a temperature-gradient-induced spin polarization for collinear and noncollinear antiferromagnets, which comprises both extrinsic and intrinsic contributions. We apply our theory to several noncentrosymmetric antiferromagnetic insulators, i.e., to a one-dimensional antiferromagnetic spin chain, a single layer of kagome noncollinear antiferromagnet, e.g., KFe3(OH)6(SO4)2, and a noncollinear breathing pyrochlore antiferromagnet, e.g., LiGaCr4O8.