Chaotic lasers are characterized with wide spectrum and noise-like features, which have been extensively used in various fields, such as secure communications and random bit generation (RBG). Since the physical RBG using optical chaos was demonstrated firstly by Uchida et al., the optical chaos has been widely investigated in terms of chaos bandwidth and flatness, which determines the rate and randomness of RBG. Due to the natural stability of semiconductor lasers, external perturbation is required to generate chaotic signals, such as optical injection, current modulation, and optical feedback. Among them, a semiconductor laser with optical feedback has attracted wide attention because of its simple structure and rich dynamic behaviors. Nonetheless, this configuration suffers from the influence of the relaxation oscillation, which results in a limited bandwidth (a few GHz) and an uneven power spectrum. To obtain broad-spectrum chaotic signals, considerable efforts have been dedicated in recent years. However, these solutions are associated with complex structures that require delicate manipulation because multiple parameters should be matched, so the cost of some of these schemes in terms of the system complexity can potentially outweigh the benefits.In this paper, we take into account the incorporation of an optical filter as well as an amplifier into the feedback loop of a conventional optical feedback system to generate broadband chaotic signals. The effects of the filter detuning frequency and feedback power on the bandwidth and flatness of the chaotic output are investigated experimentally. The experimental results demonstrate that by appropriately adjusting the feedback power and detuning frequency, both the low-frequency and high-frequency components of the chaotic output power spectrum can be increased, and the maximum chaotic bandwidth can reach 24.4 GHz with a flatness of 5.7 dB. This phenomenon is attributed to the fact that the physical process of beating between the filtered mode and the internal modes of the laser. Furthermore, the optimized chaotic output is processed by retaining the 4 least significant bits and implementing the delayed exclusive-OR (XOR) operation. Our scheme is capable of generating physical random numbers of the bit rate of 320 Gbit/s, which successfully pass the standard randomness test, i.e., the NIST test (NIST SP 800-22).