The functional renormalization group (FRG) approach is a powerful tool for studies of a large variety of systems, ranging from statistical physics over the theory of the strong interaction to gravity. The practical application of this approach relies on the derivation of so-called flow equations, which describe the change of the quantum effective action under the variation of a coarse-graining parameter. In the present work, we discuss in detail a novel approach to solve such flow equations. This approach relies on the fact that RG equations can be rewritten such that they exhibit similarities with the conservation laws of fluid dynamics. This observation can be exploited in different ways. First of all, we show that this allows to employ powerful numerical techniques developed in the context of fluid dynamics to solve RG equations. In particular, it allows to reliably treat the emergence of non-analytic behavior in the RG flow of the effective action as it is expected to occur in studies of, e.g., spontaneous symmetry breaking. Second, the analogy between RG equations and fluid dynamics offers the opportunity to gain novel insights into RG flows and their interpretation in general, including the irreversibility of RG flows. We work out this connection in practice by applying it to zero-dimensional quantum-field theoretical models. The generalization to higherdimensional models is also discussed. Our findings are expected to help improving future FRG studies of quantum field theories in higher dimensions both on a qualitative and quantitative level.