Gellan gum is one of the water-soluble anionic polysaccharides produced by the bacteria Sphingomonas elodea. In this study, we prepared gellan gum-inorganic composite films by mixing the gellan gum and a silane coupling reagent—3-glycidoxypropyltrimethoxysilane (GPTMS). These gellan gum-GPTMS composite films were stable in an aqueous solution and showed a thermal stability. In addition, these composite films indicated a mechanical strength by the formation of the three-dimensional network of siloxane. We demonstrated the accumulation of metal ions from a metal ion-containing aqueous solution by the composite film. As a result, although the composite film indicated the accumulation of heavy and rare-earth metal ions, the light metal ions, such as Mg(II) and Al(III) ions, did not interact with the composite material. Therefore, the accumulative mechanism of metal ions using a composite film was evaluated by IR measurements. As a consequence, although the accumulation of heavy and rare-earth metal ions occurred at both the −COO− group and the −OH group in the gellan gum, the accumulation of light metal ions occurred only at the −OH group.