Anthropogenic sound is a prevalent environmental stressor that can have significant impacts on aquatic species, including fishes. In this study, the effects of anthropogenic sound on the vocalization behavior of oyster toadfish (Opasnus tau) at multiple time scales was investigated using passive acoustic monitoring. The effects of specific vessel passages were investigated by comparing vocalization rates immediately after a vessel passage with that of control periods using a generalized linear model. The effects of increased ambient sound levels as a result of aggregate exposure within hourly periods over a month were also analyzed using generalized additive models. To place the response to vessel sounds within an ecologically appropriate context, the effect of environmental variables on call density was compared to that of increasing ambient sound levels. It was found that the immediate effect of vessel passage was not a significant predictor for toadfish vocalization rate. However, analyzed over a longer time period, increased vessel-generated sound lowered call rate and there was a greater effect size from vessel sound than any environmental variable. This demonstrates the importance of evaluating responses to anthropogenic sound, including chronic sounds, on multiple time scales when assessing potential impacts.