Optical robots are micro-scale structures actuated using laser trapping techniques. However, the lack of robust and real-time 3D actuation techniques reduces most applications to planar space. We present here a new approach to generate and control several optical traps synchronously in 3D with low latency and high bandwidth (up to 200 Hz). This timeshared technique uses only mirrors, hence is aberration-free. Simultaneous traps are used to actuate optical robots and provide 6-DoF telemanipulation. Experiments demonstrate the flexibility and dexterity of the implemented user control, paving the way to novel applications in micro-robotics and biology.