Computer modelling is a key tool in the optimisation and development of ceramic refractories utilised as insulation in high-temperature industrial furnaces and reactors. The paper is devoted to the mesoscale computer modelling of silica refractories using the method of homogeneously deformable discrete elements. Approaches to determine the local mechanical properties of the constituents from the global experimental failure parameters and respective crack trajectories are considered. Simulations of the uniaxial compressive and tensile failure in a wide range of quasi-static and dynamic loading rates (102 s−1) are performed. The upper limit of the dynamic loading rates corresponds to the most severe loading rates during the scrap loading on the refractory lining. The dependence of the strength, fracture energy, and brittleness at failure on the loading rate is analysed. The model illustrates that an increase in the loading rate is accompanied by a significant change in the mechanical response of the refractory, including a decrease in the brittleness at failure, a more dispersed failure process, and a higher fraction of the large grain failure. The variation of the grain–matrix interface’s strength has a higher impact on the static compressive than on the static tensile properties of the material, while the material’s dynamic tensile properties are more sensitive to the interface strength than the dynamic compressive properties.