Reconstructions of the past geomagnetic field provide fundamental constraints for understanding the dynamics of the Earth's interior, as well as serving as basis for magnetostratigraphic and archeomagnetic dating tools. Such reconstructions, when extending over epochs that precede the advent of instrumental measurements, rely exclusively on magnetic records from archeological artifacts, and, further in the past, from rocks and sediments. The most critical component of such indirect records is field intensity because of possible biases introduced by material properties and by laboratory protocols, which do not reproduce exactly the original field recording conditions. Large biases are usually avoided by the use of appropriate checking procedures; however, smaller ones can remain undetected in individual studies and might significantly affect field reconstructions. We introduce a new general approach for analyzing geomagnetic databases in order to investigate the reliability of indirect records. This approach is based on the comparison of historical records with archeomagnetic and volcanic data, considering temporal and spatial mismatches with adequate weighting functions and error estimation. A good overall agreement is found between indirect records and historical measurements, while for several subsets systematic bias is detected (e.g., inclination shallowing of lava records). We also demonstrate that simple approaches to analyzing highly inhomogeneous and internally correlated paleomagnetic data sets can lead to incorrect conclusions about the efficiency of quality checks and corrections. Consistent criteria for selecting and weighting data are presented in this review and can be used to improve current geomagnetic field modeling techniques.