Consider a continuous time Markov chain with rates Q in the state space Λ ∪ {0}. In the associated Fleming-Viot process N particles evolve independently in Λ with rates Q until one of them attempts to jump to state 0. At this moment the particle comes back to Λ instantaneously, by jumping to one of the positions of the other particles, chosen uniformly at random. When Λ is finite, we show that the empirical distribution of the particles at a fixed time converges as N → ∞ to the distribution of a single particle at the same time conditioned on not touching {0}. Furthermore, the empirical profile of the unique invariant measure for the Fleming-Viot process with N particles converges as N → ∞ to the unique quasi-stationary distribution of the one-particle motion. A key element of the approach is to show that the two-particle correlations is of order 1/N .