Many quantum dot qubits operate in regimes where the energy splittings between qubit states are large and phonons can be the dominant source of decoherence. The recently proposed charge quadrupole qubit, based on one electron in a triple quantum dot, employs a highly symmetric charge distribution to suppress the influence of long-wavelength charge noise. To study the effects of phonons on the charge quadrupole qubit, we consider Larmor and Ramsey pulse sequences to identify favorable operating parameters. We show that phonon-induced decoherence increases with the qubit frequency, in contrast to the effects of charge noise. We also show that there is an optimum value of the tunnel coupling of the qubit at which the decohering effects of phonons and charge noise are small enough to be consistent with single qubit gate fidelities > 99.99%.