Waste stored in a geological disposal facility can generate gas, and depending on the geological environment, this gas may migrate into the rock mass. Here we develop a simplified physical model to describe the initial stages of the dispersal of a gas plume as it rises from such a geological disposal facility, located at a depth of many hundreds of meters below the surface. Typically, the plume becomes confined below a low‐permeability layer and then spreads laterally until reaching a fault or fracture zone, when it may continue rising upward. Since the gas is soluble in the groundwater, the gas may partially dissolve as it displaces the groundwater. In addition, in the generic geology considered herein, since the source of gas gradually wanes with time, the spreading plume tends to thin out, leading to some residual trapping of the gas behind the plume. We show that depending on the distance of the fault or fracture zone from the geological disposal facility, different fractions of the source gas may be diverted farther upward into the formation rather than being trapped in the original layer. This can have an important impact on the subsequent pattern of dispersal of the gas by the groundwater flows, which may be key information in any safety assessment.