The Ulysses spacecraft has been the first to orbit the Sun over its poles and to explore the heliosphere at these high heliolatitudes. It has now completed two fast latitude scans, one at solar minimum and one at solar maximum. Since its launch in October 1990, this mission has led to several surprising discoveries concerning energetic particles, cosmic rays, Jovian electrons, the solar wind, the heliospheric magnetic field and the global features of the heliosphere. This review addresses mainly the propagation and modulation of cosmic rays and other charged particles, from both an observational and theoretical point of view, with emphasis on what has been learned from exploring the inner heliosphere to high heliolatitudes. This is done for solar minimum and maximum conditions. The review is concluded with a summary of the main scientific discoveries and insights gained so far from the Ulysses mission.