We present the experimental demonstration of a sub-picosecond all-optical THz switch based on three-dimensional (3D) terahertz meta-atoms. Combining a special design of 3D meta-devices and the ultrafast dynamics of low temperature grown Gallium Arsenide, we can modulate the reflectance of the THz micro-cavities within 2.2 picoseconds. The device enables a 280 GHz switch in resonance frequency within less than 200 fs. The switch back to the original resonance takes 800 fs. Experimental results show that the speed values are strongly convoluted by the THz probing field and thus the real switching times are even shorter, in the few 100 fs range.