To solve the problem of trait differences in expression characteristics among different age groups, shortage of research on cross-age facial expression analysis, and the lack of datasets across ages, put forward the model in age factor deep sparse fusion extension of the expression recognition. The model utilizes a linear dictionary sequence of a high-level form as an input signal for a sparse representation, the input objects are constructed in a linear combination, and select the optimal solution in all solutions with the sparse level as an indicator, further through the convolutional, pooling and full connection processing of convolutional neural networks, the problems of high similarity, insufficient quantity and uneven distribution of data sets are solved through the fusion extension strategy, on this basis, the age operator is combined as feature elements and expression features are extracted and used as the basis for classification decision. Extension by deep sparse fusion, additional factors were extracted using anthropometric models, internal angle calculation and skin wrinkle detection of age operator as expression features, the comparison of results of multiple dataset experiments demonstrate the effectiveness and stability across datasets of the algorithm, the advantages of this algorithm are also demonstrated by the horizontal alignment of the representative cross-age expression classification algorithm. This method is effective for the accuracy and robustness of expression expressions across ages, it has the research value and the reference significance.