We have produced 5 mJ, 13 ns pulses using a very large-mode-area rectangular fiber containing a high-aspect-ratio core with dimensions of ~30 μm×580 μm. The rectangular fiber design retains a thin cladding dimension ~0.5 mm, which is compatible with a compact coiled package. We have developed a theoretical model that achieves good agreement with the experimental data. This model indicates that an optimized fiber design can be scaled to pulse energies of several tens of millijoules. We also discuss a strategy for maintaining good beam quality in both transverse dimensions of this fiber.