In this paper, we consider a translating soliton for the inverse mean curvature flow given as a graph of a function on a domain in a unit sphere whose level sets give isoparametric foliation. First, we show that such function is given as a composition of an isoparametric function on the unit sphere and a function which is given as a solution of a certain ordinary differential equation. Further, we analyze the shape of the graphs of the solutions of the ordinary differential equation. This analysis leads to the classification of the shape of such translating solitons for the inverse mean curvature flow.