This paper presents a belief-based formulation and a novel approach for the robust solution of optimal control problems under uncertainty. The introduced formulation, based on the Belief Markov Decision Process model, reformulates the control problem directly in terms of uncertainty distributions, called beliefs, rather than on realisations of the system state. Successively, an approach inspired by navigation analysis is developed to transcribe and solve such problem in the presence of observation windows, employing a polynomial expansion for the dynamical propagation. Finally, the developed method is applied to the robust optimisation of a flyby trajectory of Europa Clipper mission in a scenario characterised by knowledge, execution and observation errors.