In a recent paper in Cogent Social Sciences, 1 Samuel A. Hardy (2017) has attempted a wide-ranging comparison of the efficacy of different kinds of regulations of metal detecting. In it, he attempts to estimate the number of metal detectorists active, whether lawfully or illegally, in several different European countries, Australia, Canada, New Zealand, and the USA.He also attempts to estimate the 'damage' caused by their removal of artefacts ex situ. This, he does by first estimating the average amount of hours per year searched by the average metal detectorist, and then estimating the number of significant artefacts found per hour of searching. By multiplying these estimates, he arrives at the estimated number of significant artefacts removed ex situ per year in each of the examined countries, which he takes to be the 'damage' that is caused.These estimates he then compares transnationally, and arrives at the conclusion that comparably permissive or liberal regulatory regimes are ineffective in minimising harm to the archaeological heritage.
Methodical and arithmetic flaws in Hardy's (2017) paperWhile I appreciate Hardy's attempt, there sadly are serious flaws both in his methodology and arithmetic, and thus also his conclusions. Since he specifically quotes a recent paper on the matter that I co-authored (Karl & Möller 2016) as the inspiration for his method of estimating the number of metal detectorists active in different jurisdictions, I feel the need to respond directly to his paper.
Remarks on our methodologyThe methodology Möller and I used (also see "An empirical examination of metal detecting") in the paper cited by Hardy as an inspiration for his is based on a quite simple principle: the direct comparison of like data with like.In our paper, we specifically explained why such a direct comparison, rather than a comparison of estimates, is essential for debates about regulation of metal detecting: estimates of the total number of metal detectorists active in any particular country can and do vary widely, frequently by an order of magnitude or even more (see e.g. for Austria the range from as little as 250-500 to as many as 10,000+ in 2010, Karl 2011, 120 fig. 5; cf. the range of between as little as 9,000 to as many as 250,000 for England and Wales, Hardy 2017, 15).Comparing any estimates picked from these ranges with each other transnationally is obviously meaningless: if one compares, per capita, the lowest estimate for Austria of 250 active metal detectorists (1 metal detectorist per 34.340 inhabitants) with the highest estimate of 250.000 for 1 Cogent Social Sciences is a 'Pay to Publish' Open Access Journal, which allegedly ensures high quality standards of papers published in it by a rigorous process of peer-review. As recently demonstrated by Peter Boghossian and James Lindsay (2017), that quality assurance process seems to be less efficient than desired. This is also demonstrated by the fact that Cogent Social Sciences refused to correct the serious arithmetical error in Hardy's calculation of t...