This study evaluates the effects of a broad-spectrum antibiotic (florfenicol) on antibiotic resistance genes (ARGs) and bacterial community structure in aquatic environments. We constructed an indoor aquatic microcosm model, adding different concentrations of florfenicol (0.1, 1, 10, 100 mg L−1), and water and sediment samples were collected after 0, 7, 30, and 60 days. qPCR and 16S rDNA amplicon sequencing were used to study the changes in the ARGs and bacterial community structure of the collected samples. The results show that the inclusion of florfenicol resulted in an increased abundance of the floR and optrA genes. Adding 100 mg L−1 florfenicol to the water increased the abundance of optrA gene copies with the maximum on the Day 7, and increased the abundance of floR gene copies with the maximum on Day 30. Adding 100 mg L−1 florfenicol to the sediment increased the abundance of floR and optrA genes by one order of magnitude on Day 60. Meanwhile, the average number of operational taxonomic units (OTUs) in the water samples was 257, and the average number of OTUs in sediment samples was 823. The bacterial community diversity and richness in sediments were higher than those in water. The difference between the maximal and minimal values of the Shannon diversity index in the water and sediment samples was 4.36 and 1.95, respectively. The effect of florfenicol on the bacterial community structure in water was much higher than that in sediment. At 30 days, the diversity index and richness index of the florfenicol treatment groups with 1 and 10 mg L−1 concentrations began to increase; at 60 days, the diversity and richness indices of the 100 mg L−1 florfenicol treatment group began to increase. The samples at the same sampling time in the sediments clustered closer together. The results of this study provide a scientific basis for guiding the rational use of florfenicol in aquaculture, maintaining a healthy and stable microecological environment in aquaculture, and provide theoretical data for environmental ecological risk assessment and safety management caused by microbial resistance under the abuse of florfenicol.