We report a double stage linearly polarized ytterbium-doped double clad fiber (YDCF) amplifier working at 1063.9 nm, which generates a diffraction-limited output with an average power of 102 W at a repetition rate of 100 kHz, a pulse duration of 14.9 ns, a peak power of 68 kW, a 3 dB spectral width of about 0.47 nm and a polarization extinction ratio (PER) of about 13 dB. The seed is modulated to work at a suitable Gaussian shape to restrain the pulse distortion in the fiber amplifier. To the best of our knowledge, this result represents the highest peak power with narrow line-width and excellent beam quality in linearly polarized YDCF.