A comparative study of methods for testing the equality of two or more ROC curves

Fanjul-Hevia, Arís; González–Manteiga, Wenceslao

doi:10.1007/s00180-017-0783-6

Cited by 7 publications

(2 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…ROC curves can be applied to unbalanced tasks and without knowing a priori the false positive and false negative costs [48]. The AUC metric was first studied for the binary classification task, but later it showed its potential also for the multiclass classification [49, 50]. In this work, following the research of [50], the AUC reported is the average value obtained on single pairwise ROC curve for each of the 10‐fold experiments for the prediction of the unknown

{tag}_t

.…”

Section: Proposed Methodsmentioning

confidence: 99%

An auxiliary Part‐of‐Speech tagger for blog and microblog cyber‐slang

Golia

Zola

2022

Statistical Analysis

View full text Add to dashboard Cite

The increasing impact of Web 2.0 involves a growing usage of slang, abbreviations, and emphasized words, which limit the performance of traditional natural language processing models. The state-of-the-art Part-of-Speech (POS) taggers are often unable to assign a meaningful POS tag to all the words in a Web 2.0 text.To solve this limitation, we are proposing an auxiliary POS tagger that assigns the POS tag to a given token based on the information deriving from a sequence of preceding and following POS tags. The main advantage of the proposed auxiliary POS tagger is its ability to overcome the need of tokens' information since it only relies on the sequences of existing POS tags. This tagger is called auxiliary because it requires an initial POS tagging procedure that might be performed using online dictionaries (e.g., Wikidictionary) or other POS tagging algorithms. The auxiliary POS tagger relies on a Bayesian network that uses information about preceding and following POS tags. It was evaluated on the Brown Corpus, which is a general linguistics corpus, on the modern ARK dataset composed by Twitter messages, and on a corpus of manually labeled Web 2.0 data.

show abstract

{tag}_t

.…”

Section: Proposed Methodsmentioning

confidence: 99%

An auxiliary Part‐of‐Speech tagger for blog and microblog cyber‐slang

Golia

Zola

2022

Statistical Analysis

View full text Add to dashboard Cite

show abstract

“…There are several methodologies discussed in the literature for making that sort of comparisons (for a review of such methodologies, see Fanjul-Hevia and González-Manteiga, 2018), although most of them do not consider the possible effect that the presence of covariates can have in the performance of the test. In the example provided, apart from the diagnostic variables there are other covariates such as the age or the neuron-specific enolase of the patients.…”

Section: Introductionmentioning

confidence: 99%

A test for comparing conditional ROC curves with multidimensional covariates

Fanjul-Hevia

Pardo–Fernández

Keilegom

et al. 2022

Journal of Applied Statistics

Self Cite

View full text Add to dashboard Cite

The comparison of Receiver Operating Characteristic (ROC) curves is frequently used in the literature to compare the discriminatory capability of different classification procedures based on diagnostic variables. The performance of these variables can be sometimes influenced by the presence of other covariates, and thus they should be taken into account when making the comparison. A new non-parametric test is proposed here for testing the equality of two or more dependent ROC curves conditioned to the value of a multidimensional covariate. Projections are used for transforming the problem into a one-dimensional approach easier to handle. Simulations are carried out to study the practical performance of the new methodology. A real data set of patients with Pleural Effusion is analysed to illustrate this procedure.

show abstract