Summary. We investigate a class of Hilbert space valued martingale-valued measures whose covariance structure is determined by a trace class positive operator valued measure. The paradigm example is the martingale part of a Lévy process. We develop both weak and strong stochastic integration with respect to such martingale-valued measures. As an application, we investigate the stochastic convolution of a C 0 -semigroup with a Lévy process and the associated Ornstein-Uhlenbeck process. We give an infinite dimensional generalisation of the concept of operator self-decomposability and find conditions for random variables of this type to be embedded into a stationary Ornstein-Uhlenbeck process.