Recent work on hierarchical data analysis mainly focuses on the multilevel structure of the mean response. Little research for hierarchical heteroscedasticity was done in the literature. In this paper, we propose a class of hierarchical models with heteroscedasticity and then investigate the semi-parametric statistical inferences. Laplace's approximation is employed to obtain an approximated marginal likelihood function and splines method is used to estimate the unknown functions. We also provide the consistency of the estimators. Simulation studies and real data analysis show that the proposed estimation procedures work well.