We present a survey of the fundamentals and the applications of sparse grids, with a focus on the solution of partial differential equations (PDEs). The sparse grid approach, introduced in Zenger (1991), is based on a higherdimensional multiscale basis, which is derived from a one-dimensional multiscale basis by a tensor product construction. Discretizations on sparse grids involve O(N ·(log N ) d−1 ) degrees of freedom only, where d denotes the underlying problem's dimensionality and where N is the number of grid points in one coordinate direction at the boundary. The accuracy obtained with piecewise linear basis functions, for example, is O(N −2 · (log N ) d−1 ) with respect to the L 2 -and L ∞ -norm, if the solution has bounded second mixed derivatives. This way, the curse of dimensionality, i.e., the exponential dependence O(N d ) of conventional approaches, is overcome to some extent. For the energy norm, only O(N ) degrees of freedom are needed to give an accuracy of O(N −1 ). That is why sparse grids are especially well-suited for problems of very high dimensionality.The sparse grid approach can be extended to nonsmooth solutions by adaptive refinement methods. Furthermore, it can be generalized from piecewise linear to higher-order polynomials. Also, more sophisticated basis functions like interpolets, prewavelets, or wavelets can be used in a straightforward way.We describe the basic features of sparse grids and report the results of various numerical experiments for the solution of elliptic PDEs as well as for other selected problems such as numerical quadrature and data mining.
CONTENTS1 Introduction 148 2 Breaking the curse of dimensionality 151 3 Piecewise linear interpolation on sparse grids 154 4 Generalizations, related concepts, applications 188 5 Numerical experiments 219 6 Concluding remarks 255 References 256
Breaking the curse of dimensionalityClassical approximation schemes exhibit the curse of dimensionality (Bellmann 1961) mentioned above. We havewhere r and d denote the isotropic smoothness of the function f and the problem's dimensionality, respectively. This is one of the main obstacles in the treatment of high-dimensional problems. Therefore, the question is whether we can find situations, i.e., either function spaces or error norms, for which the curse of dimensionality can be broken. At first glance, there is an easy way out: if we make a stronger assumption on the smoothness of the function f such thatOf course, such an assumption is completely unrealistic. However, about ten years ago, Barron (1993) found an interesting result. Denote by FL 1 the class of functions with Fourier transforms in L 1 . Then, consider the class of functions of R d with ∇f ∈ FL 1 .We expect an approximation rateMeanwhile, other function classes are known with such properties. These comprise certain radial basis schemes, stochastic sampling techniques, and approaches that work with spaces of functions with bounded mixed derivatives.A better understanding of these results is possible with the help of harmon...