Traditional detour‐phase hologram is a powerful optical device for manipulating phase and amplitude of light, but it is usually not sensitive to the polarization of light. By introducing the light‐metasurface interaction mechanism to the traditional detour phase hologram, we design a novel plasmonic nano‐slits assisted polarization selective detour phase meta‐hologram, which has attractive advantages of polarization multiplexing ability, broadband response, and ultra‐compact size. The meta‐hologram relies on the dislocations of plasmonic slits to achieve arbitrary phase distributions, showing strong polarization selectivity to incident light due to the plasmonic response of deep‐subwavelength slits. To verify its polarization sensitive and broadband responses, we experimentally demonstrate two holographic patterns of an optical vortex and an Airy beam at p‐ and s‐polarized light with wavelengths of 532nm, 633nm and 780nm, respectively. Furthermore, we realize an application example of the meta‐hologram as a polarization multiplexed photonic device for multi‐channel optical angular momentum (OAM) generation and detection. Such meta‐holograms could find widespread applications in photonics, such as chip‐level beam shaping and high‐capacity OAM communication.