This paper presents a methodology to support the selection of optimal portfolios of preventive safety measures for time-dependent accident scenarios. This methodology captures the dynamics of accident scenarios through Dynamic Bayesian Networks which represent the temporal evolution of component failures that can lead to system failure. An optimization model is presented to determine all Pareto optimal portfolios for which the residual risk of the system at different time stages is minimized, subject to budget and technical constraints on the set of feasible portfolios. The resulting portfolios are then analyzed to support the optimal selection of preventive safety measures. We also develop a computationally efficient algorithm for solving the multi-objective optimization model. The method is illustrated by revisiting the accident scenario of a vapor cloud ignition which occurred at Universal Form Clamp in Bellwood (Illinois, U.S.) on 14 June 2006. Results are presented for different cost levels of implementing the preventive safety measures, which provides additional management insights.