Finding rare objects and building pure samples: probabilistic quasar classification from low-resolution Gaia spectra

Abstract

We develop and demonstrate a probabilistic method for classifying rare objects in surveys with the particular goal of building very pure samples. It works by modifying the output probabilities from a classifier so as to accommodate our expectation (priors) concerning the relative frequencies of different classes of objects. We demonstrate our method using the Discrete Source Classifier (DSC), a supervised classifier currently based on support vector machines, which we are developing in preparation for the Gaia data analysis. DSC classifies objects using their very low resolution optical spectra. We look in detail at the problem of quasar classification, because identification of a pure quasar sample is necessary to define the Gaia astrometric reference frame. By varying a posterior probability threshold in DSC, we can trade off sample completeness and contamination. We show, using our simulated data, that it is possible to achieve a pure sample of quasars (upper limit on contamination of 1 in 40 000) with a completeness of 65 per cent at magnitudes of G = 18.5, and 50 per cent at G = 20.0, even when quasars have a frequency of only 1 in every 2000 objects. The star sample completeness is simultaneously 99 per cent with a contamination of 0.7 per cent. Including parallax and proper motion in the classifier barely changes the results. We further show that not accounting for class priors in the target population leads to serious misclassifications and poor predictions for sample completeness and contamination. We discuss how a classification model prior may, or may not, be influenced by the class distribution in the training data. Our method controls this prior and so allows a single model to be applied to any target population without having to tune the training data and retrain the model.

Towards a library of synthetic galaxy spectra and preliminary results of classification and parametrization of unresolved galaxies for Gaia. II

“…For a more detailed description of SVMs and references, we refer to Paper I, while a more general aspect of the Gaia classification scheme can be found in Bailer-Jones et al (2008). Throughout this section, we consider truncated spectra, retaining only 77 of the 96 data points of the simulated BP and RP spectra corresponding to the wavelength range 321.43-998.02 nm and 613.78-1130.25 nm for the two photometers, respectively.…”

Spectral classification of stars based on LAMOST spectra

“…Carricajo et al 2004) etc. It is noted that Bailer-Jones et al (2008) and Saglia et al (2012) reported the applications of the support vector machine (SVM) in the star-galaxy-QSO classifications. In general, this new technique can also be used for the classification of stars.…”

Exploration of quasars with theGaiamission

“…From this analysis it follows that the calibration errors influence only bright objects (V < ∼ 16 mag), samples with low S/N remain almost unchanged. Scaling the S/N to fainter objects, we conclude that the main noise contribution for quasar spectra is Poisson noise from the source (Bailer-Jones et al 2008). From this, we can estimate that the S/N is proportional to the square root of the source flux.…”