We give an analytic derivation of kernel of dynamic support vector machine (DSVM). We show them for the cases of stochastic and deterministic changes. For the stochastic case, Gaussian kernel is naturally derived. For the deterministic case, the kernel is derived in the form of traveling wave. We also give comments from physical viewpoints in the context of information geometry.