A number of works have found evidence for a turn-over in the spectral lag data for individual Gamma-Ray Bursts (GRBs), caused by an energy-dependent speed of light, which could be a possible manifestation of Lorentz invariance violation (LIV). Here, we stack spectral lag data from a total of 37 GRBs (with a total of 91 measurements), to verify if the combined data is consistent with a unified model consisting of intrinsic astrophysical emission, along with another contribution due to LIV. We then carry out Bayesian model comparison to ascertain if this combined spectral lag data shows a preference for an energy-dependent speed of light, as compared to an intrinsic astrophysical emission mechanism. We do not find a decisive evidence for such an energy-dependent speed of light for two different models of LIV. Furthermore, none of the models considered provide a good fit to the stacked spectral lag data.