We propose an algorithm for small-sized mobile object detection and trajectory parameter estimation for a passive positioning system that consists of several optical, thermal, and radio sensors. The algorithm is based on a combination of spatial and temporal processing of observation data. For spatial processing, a set of equations is solved that defines the sufficient condition for coupling the direction vectors to probable objects in the image stereo pair. Object coordinates and velocities for a single observation period are estimated. For temporal processing, the direction vectors are distributed based on connection to probable objects in a sequence of the capture intervals. The results of numerical modeling of the proposed algorithm show the advantage of combining the two approaches in comparison with the traditional object detection and tracking algorithms.