A multi-scale prediction method was proposed to investigate the scatter of fracture toughness by combining the local approach (LA) to cleavage fracture and the crystal plasticity finite element method (CPFEM). The parameters in the crystal plasticity constitutive model were firstly determined by comparing the simulated stress-strain curves with tested curves for SA508-III steel. Then CT samples were modeled using the CPFEM to calculate Weibull stress. Using the calibration process of local approach, the relevant parameters of the Beremin model were obtained with m = 30 and σu = 2590 MPa. The fracture toughness was analyzed including the scatter for a given temperature, the master curve in a temperature range. The distribution of predicted fracture toughness shows good agreement with the test results. All of the tested fracture toughness value are fall in the range of 5% to 95% that precited using the proposed combined approach.