In this paper, a class of impulsive bidirectional associative memory (BAM) fuzzy cellular neural networks (FCNNs) with time delays in the leakage terms and distributed delays is formulated and investigated. By establishing an integro-differential inequality with impulsive initial conditions and employing M-matrix theory, some sufficient conditions ensuring the existence, uniqueness and global exponential stability of equilibrium point for impulsive BAM FCNNs with time delays in the leakage terms and distributed delays are obtained. In particular, the estimate of the exponential convergence rate is also provided, which depends on the delay kernel functions and system parameters. It is believed that these results are significant and useful for the design and applications of BAM FCNNs. An example is given to show the effectiveness of the results obtained here.