Detecting light from a wealth of physical degrees of freedom (e.g., wavelength, intensity, polarization state, phase, etc.) enables the acquirement of more comprehensive information. In the past two decades, low-dimensional van der Waals materials (vdWMs) have established themselves as transformative building blocks toward lensless polarization optoelectronics, which is highly beneficial for optoelectronic system miniaturization. This review provides a comprehensive overview on the recent development of low-dimensional vdWM polarized photodetectors. To begin with, the exploitation of pristine 1D/2D vdWMs with immanent in-plane anisotropy and related heterostructures for filterless polarization-sensitive photodetectors is introduced. Then, we have systematically epitomized the various strategies to induce polarization photosensitivity and enhance the degree of anisotropy for low-dimensional vdWM photodetectors, including quantum tailoring, construction of core-shell structures, rolling engineering, ferroelectric regulation, strain engineering, etc., with emphasis on the fundamental physical principles. Following that, the ingenious optoelectronic applications based on the low-dimensional vdWM polarized photodetectors, including multiplexing optical communications and enhanced-contrast imaging, have been presented. In the end, the current challenges along with the future prospects of this burgeoning research field have been underscored. On the whole, the review depicts a fascinating landscape for the next-generation high-integration multifunctional optoelectronic systems.