The last decade has seen a growing number of experiments aimed at systematically mapping the effects of mutations in different proteins, and of attempting to correlate their biophysical and biochemical effects with organismal fitness. While insightful, systematic laboratory measurements of fitness effects present challenges and difficulties. Here, we discuss the limitations associated with such measurements, and in particular the challenge of correlating the effects of mutations at the single protein level ("protein fitness") with their effects on organismal fitness. A variety of experimental setups are used, with some measuring the direct effects on protein function and others monitoring the growth rate of a model organism carrying the protein mutants. The manners by which fitness effects are calculated and presented also vary, and the conclusions, including the derived distributions of fitness effects of mutations, vary accordingly. The comparison of the effects of mutations in the laboratory to the natural protein diversity, namely to amino acid changes that have fixed in the course of millions of years of evolution, is also debatable. The results of laboratory experiments may, therefore, be less relevant to understanding long-term inter-species variations yet insightful with regard to short-term polymorphism, for example, in the study of the effects of human SNPs.