Motivated by the study of the directed polymer model with mobile Poissonian traps or catalysts and the stochastic parabolic Anderson model with time dependent potential, we investigate the asymptotic behavior ofwhere θ > 0 is a constant, V is the renormalized Poisson potential of the formand ω s is the measure-valued process consisting of independent Brownian particles whose initial positions form a Poisson random measure on R d with Lebesgue measure as its intensity. Different scaling limits are obtained according to the parameter p and dimension d. For the logarithm of the negative exponential moment, the range of d 2 < p < d is divided into 5 regions with various scaling rates of the orders t d/p , t 3/2 , t (4−d−2p)/2 , t log t and t, respectively. For the positive exponential moment, the limiting behavior is studied according to the parameters p and d in three regions. In the sub-critical region (p < 2), the double logarithm of the exponential moment has a rate of t. In the critical region (p = 2), it has different behavior over two parts decided according to the comparison of θ with the best constant in the Hardy inequality. In the super-critical region (p > 2), the exponential moments become infinite for all t > 0.