We present a simple thermostat device for performing dielectric spectroscopy measurements on polymers close to their glass transition temperature. By using a vacuum chamber containing a Peltier junction with its regulator, we show that a very simple setup yields a temperature accuracy which is good enough for accurate studies of polymer dielectric properties. This technique is also more cost effective than standard setups using cryogenic fluids.