In the theory of open quantum systems, the Markovian approximation is very widespread. Usually, it assumes the Gorini–Kossakowski–Sudarshan–Lindblad (GKSL) equation for density matrix dynamics and quantum regression formulae for multi-time correlation functions. Nevertheless, now, quantum non-Markovianity is being actively studied, especially the non-Markovianity of multi-time correlations. In this work, we consider dynamics with a random Hamiltonian, which can lead to GKSL dynamics of the density matrix for some special cases, but correlation functions generally do not satisfy the quantum regression formulae. Despite the fact that random Hamiltonians have been actively studied, dynamics with such Hamiltonians has been little discussed from the viewpoint of multi-time correlations. For specific models with a random Hamiltonian, we provide the formulae for multi-time correlations which occur instead of the usual regression formulae. Moreover, we introduce and calculate the memory tensor, which characterizes multi-time correlations against the Markovian ones. We think that, despite being applied to specific models, the methods developed in this work can be used in a much broader setup.