This paper proposes a new face recognition approach by using Independent Component Analysis (ICA) and Hierarchical Radial Basis Function (HRBF) network classification model. To improve the quality of the face images, a series of image pre-processing techniques, which include histogram equalization, edge detection and geometrical transformation are used. The ICA based on Kernel Principal Component Analysis (KPCA) and FastICA is employed to extract features, and the HRBF network is used to identify the faces. To accelerate the convergence of the HRBF network and improve the quality of the solutions, the Extended Compact Genetic Programming (ECGP) and Particle Swarm Optimization (PSO) are applied to optimize the HRBF network structure and parameters. The experimental results show that the proposed framework is efficient for face recognition.