Parallel telescoping is a natural generalization of differential creativetelescoping for single integrals to line integrals. It computes a linear ordinary differential operator L, called a parallel telescoper, for several multivariate functions, such that the applications of L to the functions yield antiderivatives of a single function. We present a necessary and sufficient condition guaranteeing the existence of parallel telescopers for differentially finite functions, and develop an algorithm to compute minimal ones for compatible hyperexponential functions. Besides computing annihilators of parametric line integrals, we use the parallel telescoping for determining Galois groups of parameterized partial differential systems of first order.