The Milky Way is thought to host a huge population of interstellar objects (ISOs), numbering approximately 1015 pc−3 around the Sun, which are formed and shaped by a diverse set of processes ranging from planet formation to Galactic dynamics. We define a novel framework, first to predict the properties of this Galactic ISO population by combining models of processes across planetary and Galactic scales, and second to make inferences about the processes being modeled, by comparing the predicted population to what is observed. We predict the spatial and compositional distribution of the Galaxy’s population of ISOs by modeling the Galactic stellar population with data from the APOGEE survey and combining this with a protoplanetary disk chemistry model. Selecting the ISO water mass fraction as an example observable quantity, we evaluate its distribution both at the position of the Sun and averaged over the Galactic disk; our prediction for the solar neighborhood is compatible with the inferred water mass fraction of 2I/Borisov. We show that the well-studied Galactic stellar metallicity gradient has a corresponding ISO compositional gradient. We also demonstrate the inference part of the framework by using the current observed ISO composition distribution to constrain the parent star metallicity dependence of the ISO production rate. This constraint, and other inferences made with this framework, will improve dramatically as the Vera C. Rubin Observatory Legacy Survey of Space and Time progresses and more ISOs are observed. Finally, we explore generalizations of this framework to other Galactic populations, such as that of exoplanets.