Shortwave infrared polarization imaging can increase the contrast of the target to the background to improve the detection system’s recognition ability. The division of focal plane polarization indium gallium arsenide (InGaAs) focal plane array (FPA) detector is the ideal choice due to the advantages of compact structure, real-time imaging, and high stability. However, because of the mismatch between nanostructures and photosensitive pixels as well as the crosstalk among the different polarization directions, the currently reported extinction ratio (ER) of superpixel-polarization-integrated detectors cannot meet the needs of high-quality imaging. In this paper, a 1024 × 4 InGaAs FPA detector on-chip integrated with a linear polarization grating (LPG) was realized and tested. The detector displayed good performance throughout the 0.9–1.7 um band, and the ERs at 1064 nm, 1310 nm and 1550 nm reached up to 22:1, 29:1 and 46:1, respectively. For the crosstalk investigation, the optical simulation of the grating-integrated InGaAs pixel was carried out, and the limitation of the ER was calculated. The result showed that the scattering of incident light in the InP substrate led to the crosstalk. Moreover, the deviation of the actual grating morphology from the designed structure caused a further reduction in the ER.