During the outbreak of Omicron BA.5 in June 2022, strong mitigation policies were still in place in Japan. This paper presents counterfactual experiments regarding testing, the quarantine of positive cases, and isolation, to evaluate the impact of implemented policies. Simulations using an agent-based model showed that high dependence on polymerase chain reaction (PCR) tests and low use of antigen tests exacerbated the outbreak. In addition, the required isolation periods for diagnosed cases were too long; that is, they could have been shortened from 10 to 7 days. Quarantine for those who have had contact with diagnosed patients lowered the epidemic curve; however, this was accompanied by a large number of uninfected quarantined individuals who could not work or go out, which led to economic and social losses. The size of the contribution of each mitigation policy depends on the abundancy of test opportunities. The high positive test rate over this period suggests scarce test opportunities, which led us to conclude that, even without contact tracing and with a shorter duration of isolation and wider use of low-sensitivity antigen tests, the impact of the outbreak could have been made milder.