To estimate the remaining life of existing RC bridge decks damaged by alkali silica reaction (ASR), multi-scale numerical analysis with chemo-hygral model is integrated with visual inspection data at site. First, the applicability of the poro-mechanical models for ASR expansion in the multi-scale frame are examined with the experiments of the real scale RC slabs and the model is validated to bring about fair prediction of the 3D anisotropic expansion and the fatigue life of the slabs. Second, visually inspected cracks on bottom surfaces of RC decks are converted to space-averaged strains, and the magnitude of ASR is estimated from the vertical deformation, based on which the internal pre-stress and the damage fields are re-produced by numerical predictor-corrector cycles, and the remaining life of ASR damaged RC bridge decks is fairly estimated. By conducting sensitivity analyses in terms of ASR-gel volumes and cracks, allowable error range of site inspection data is clarified to meet the requirement of asset management.