In this paper, the new equilibria realized by continuous optimal control inputs and the dynamic structure around them are studied. Using the Euler–Lagrange equation, which is a necessary condition for optimal control problems, the equations of motion of a dynamic system with optimal control inputs that minimize the quadratic cost function are described in terms of state and adjoint variables. Based on the equations of motion, equilibrium conditions are derived, and the properties of equilibria are analyzed for the two-body and Hill three-body problems. The stability and dynamic structure around unstable equilibria are also characterized to get insights into the properties of optimal trajectories.