Imidazole alkaloids, a common class of five-membered aromatic heterocyclic compounds, exist widely in plants, animals and marine organisms. Because of imidazole’s extensive and excellent biological and pharmacological activities, it has always been a topic of major interest for researchers and has been widely used as an active moiety in search of bioactive molecules. To find more efficient antibacterial compounds, a series of novel imidazole-fragment-decorated 2-(pyrazol-4-yl)-1,3,4-oxadiazoles were designed and synthesized based on our previous works via the active substructure splicing principle, and their bioactivities were systematically evaluated both in vitro and in vivo. The bioassays showed that some of the target compounds displayed excellent in vitro antibacterial activity toward three virulent phytopathogenic bacteria, including Xanthomonas oryzae pv. oryzae (Xoo), Xanthomonas axonopodis pv. citri (Xac) and Pseudomonas syringae pv. actinidiae (Psa), affording the lowest EC50 values of 7.40 (7c), 5.44 (9a) and 12.85 (9a) μg/mL, respectively. Meanwhile, compound 7c possessed good in vivo protective and curative activities to manage rice bacterial leaf blight at 200 μg/mL, with control efficacies of 47.34% and 41.18%, respectively. Furthermore, compound 9a showed commendable in vivo protective and curative activities to manage kiwifruit bacterial canker at 200 μg/mL, with control efficacies of 46.05% and 32.89%, respectively, which were much better than those of the commercial bactericide TC (31.58% and 17.11%, respectively). In addition, the antibacterial mechanism suggested that these new types of title compounds could negatively impact the cell membranes of phytopathogenic bacteria cells and cause the leakage of the intracellular component, thereby leading to the killing of bacteria. All these findings confirm that novel 2-(pyrazol-4-yl)-1,3,4-oxadiazoles containing an imidazole fragment are promising lead compounds for discovering new bactericidal agents.