Floquet theory provides rigorous foundations for the theory of periodically driven quantum systems. In the case of non-periodic driving, however, the situation is not so well understood. Here, we provide a critical review of the theoretical framework developed for quasi-periodically driven quantum systems. Although the theoretical footing is still under development, we argue that quasiperiodically driven quantum systems can be treated with generalisations of Floquet theory in suitable parameter regimes. Moreover, we provide a generalisation of the Floquet-Magnus expansion and argue that quasi-periodic driving offers a promising route for quantum simulations.