Excitons in van der Waals heterostructures come in many different forms. In bilayer structures, the electron and hole may be localized on the same layer or they may be separated forming an interlayer (IL) exciton with a finite out-of-plane dipole moment. Using first principles calculations, we investigate the excitons in a symmetric WS2/MoS2/WS2 heterostructure in the presence of a vertical electric field. The excitons exhibit a quadratic Stark shift for low field strengths and a linear Stark shift for stronger fields. This behavior is traced to the coupling of IL excitons with opposite dipole moments, which lead to the formation of quadrupolar excitons at small fields. The formation of quadrupolar excitons is determined by the relative size of the electric field-induced splitting of the dipolar excitons and the coupling between them given by the hole tunneling across the MoS2 layer. For the inverted structure, MoS2/WS2/MoS2, the dipolar excitons are coupled by electron tunneling across the WS2 layer. Because this effect is much weaker, the resulting quadrupolar excitons are more fragile and break at a weaker electric field.