Lately, the need for multi-feature photodetectors has created a rigor among researchers and academicians to explore the light-matter interaction beyond carrier generation and photon detection. The introduction of surface plasmon structures or photon trapping structures for wavelength selective absorption enhancement has been widely exploited. Researchers are exploring meta-materials for polarization and Direction of Arrival (DoA) sensing. However, there still is an unmet need for an in-built DoA capability in a photodetector compatible with the complementary metal oxide semiconductor fabrication process. In this work, we propose an asymmetric surface structure-equipped photodetector capable of sensing the DoA of the photon in addition to standard photon detection. We present a detailed Finite Difference Time Domain Lumerical simulation-based surface structure design for precise detection of the incidence angle (θ) and angle of azimuth (ϕ). The presence of the grated surface structures facilitates an asymmetric electromagnetic (EM) wave incidence and interaction and results in a change in the responsivity with the DoA. Using the detailed absorption profile simulated for a range of wavelengths, θ and ϕ, and the function regression model, we have devised a framework to predict the DoA, i.e., θ and ϕ. The proposed framework predicts the DoA accurately with an introduced signal-to-noise ratio (SNR) ≥160 dB and the predictions become indistinguishable for an SNR ≤100 dB. Such direction-sensitive photodetectors in combination with function regression models can revolutionize the field of object tracking in defense, indoor positioning in factories, wireless communication, and solar tracking.