Simulations of elastic turbulence, the chaotic flow of highly elastic and inertialess polymer solutions, are plagued by numerical difficulties: the chaotically advected polymer conformation tensor develops extremely large gradients and can lose its positive-definiteness, which triggers numerical instabilities. While efforts to tackle these issues have produced a plethora of specialized techniques – tensor decompositions, artificial diffusion, and shock-capturing advection schemes – we still lack an unambiguous route to accurate and efficient simulations. In this work, we show that even when a simulation is numerically stable, maintaining positive-definiteness and displaying the expected chaotic fluctuations, it can still suffer from errors significant enough to distort the large-scale dynamics and flow structures. We focus on two-dimensional simulations of the Oldroyd-B and FENE-P equations, driven by a large-scale cellular body forcing. We first compare two positivity-preserving decompositions of the conformation tensor: symmetric square root (SSR) and Cholesky with a logarithmic transformation (Cholesky-log). While both simulations yield chaotic flows, only the latter preserves the pattern of the forcing, i.e. its fluctuating vortical cells remain ordered in a lattice. In contrast, the SSR simulation exhibits distorted vortical cells that shrink, expand and reorient constantly. To identify the accurate simulation, we appeal to a hitherto overlooked mathematical bound on the determinant of the conformation tensor, which unequivocally rejects the SSR simulation. Importantly, the accuracy of the Cholesky-log simulation is shown to arise from the logarithmic transformation. We also consider local artificial diffusion, a potential low-cost alternative to high-order advection schemes. Unfortunately, the artificially enhanced diffusive smearing of polymer stress in regions of intense stretching substantially modifies the global dynamics. We then show how the spurious large-scale motions, identified here, contaminate predictions of scalar mixing. Finally, we discuss the effects of spatial resolution, which controls the steepness of gradients in a non-diffusive simulation.