Combining the advantages of high efficiency, environmental robustness, and anti-reflection behavior, oscillating-amplifying integrated fiber lasers have become popular for use in high-power laser structures in industrial applications, wherein the size of the laser source matters. Here, an oscillating-amplifying integrated fiber laser in an oval-shaped cylinder package has been proposed and demonstrated, the footprint for which only occupies an area of 0.024 m2 apart from the pump diode, which is much smaller than in traditional planar fiber laser packages. Numerical simulations have been carried out, which have revealed that an oval-shaped cylinder package can effectively suppress the high-order mode in large mode area fiber setups and thereby benefit the integration of fusion points and the unpackaged elements at the same time. Over 3.7 kW of transverse mode instability (TMI)-free output power has been obtained, with a slope efficiency higher than 80%. With a custom-made chirped and tilted fiber Bragg grating (CTFBG), the Raman suppression ratio is improved to reach 38 dB at peak output power. The oval-shaped design has been verified to assist with the realization of TMI suppression and improve the integration of high-power fiber lasers. To the best of our knowledge, this fiber laser has among the smallest footprints of the various fiber sources at such high-power operating levels.