We present a material-robot system consisting of mobile robots which can assemble discrete cellular structures. We detail the manufacturing of cuboctahedral unit cells, termed voxels, which passively connect to neighboring voxels with magnets. We then describe "relative" robots which can locomote on, transport, and place voxels. These robots are designed relative to and in coordination with the cellular structure--the geometry of the voxel informs the robot's global geometric configuration, local mechanisms, and end effectors, and robotic assembly features are designed into the voxels. We describe control strategies for determining build sequence, robot path planning, discrete motion control, and feedback, integrated within a custom software environment for simulating and executing single or multi-robot construction. We use this material-robot system to build several types of structures, such as 1D beams, 2D plates, and 3D enclosures. The robots can navigate and assemble structures with minimal feedback, relying on voxelsized resolution to achieve successful global positioning. We show multi-robot assembly to increase throughput and expand system capability using a deterministic centralized control strategy.