A thermodynamically consistent, large-strain, multi-phase field approach (with consequent interface stresses) is generalized for the case with anisotropic interface (gradient) energy (e.g. an energy density that depends both on the magnitude and direction of the gradients in the phase fields). Such a generalization, if done in the "usual" manner, yields a theory that can be shown to be manifestly unphysical. These theories consider the gradient energy as anisotropic in the deformed configuration, and, due to this supposition, several fundamental contradictions arise. First, the Cauchy stress tensor is non-symmetric and, consequently, violates the moment of momentum principle, in essence the Herring (thermodynamic) torque is imparting an unphysical angular momentum to the system. In addition, this non-symmetric stress implies a violation of the principle of material objectivity. These problems in the formulation can be resolved by insisting that the gradient energy is an isotropic function of the gradient of the order parameters in the deformed configuration, but depends on the direction of the gradient of the order parameters (is anisotropic) in the undeformed configuration. We find that for a propagating nonequilibrium interface, the structural part of the interfacial Cauchy stress is symmetric and reduces to a biaxial tension with the magnitude