On Digital Ethics for Artificial Intelligence and Information Fusion in the Defense Domain

Koch, Johann Wolfgang

doi:10.1109/maes.2021.3066841

Cited by 9 publications

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Given the tremendous success of AI, the opportunities and challenges of merging AI and sensor data fusion are under investigation by several research groups with special focus on computational efficiency, improved decision making, security, multi-domain operations, and human-machine teaming [39]. Ethical aspects concerning the AI are also of paramount importance; in this regard, digital ethics for AI and information fusion in the context of the defense domain is discussed in [40].…”

Section: Introductionmentioning

confidence: 99%

Statistical Hypothesis Testing Based on Machine Learning: Large Deviations Analysis

Braca¹,

Millefiori²,

Aubry³

et al. 2022

Preprint

View full text Add to dashboard Cite

We study the performance-and specifically the rate at which the error probability converges to zero-of Machine Learning (ML) classification techniques. Leveraging the theory of large deviations, we provide the mathematical conditions for a ML classifier to exhibit error probabilities that vanish exponentially, say ∼ exp (−n I + o(n)), where n is the number of informative observations available for testing (or another relevant parameter, such as the size of the target in an image) and I is the error rate. Such conditions depend on the Fenchel-Legendre transform of the cumulant-generating function of the Data-Driven Decision Function (D3F, i.e., what is thresholded before the final binary decision is made) learned in the training phase. As such, the D3F and, consequently, the related error rate I, depend on the given training set, which is assumed of finite size. Interestingly, these conditions can be verified and tested numerically exploiting the available dataset, or a synthetic dataset, generated according to the available information on the underlying statistical model. In other words, the classification error probability convergence to zero and its rate can be computed on a portion of the dataset available for training. Coherently with the large deviations theory, we can also establish the convergence, for n large enough, of the normalized D3F statistic to a Gaussian distribution. This property is exploited to set a desired asymptotic false alarm probability, which empirically turns out to be accurate even for quite realistic values of n. Furthermore, approximate error probability curves ∼ ζn exp (−n I) are provided, thanks to the refined asymptotic derivation (often referred to as exact asymptotics), where ζn represents the most representative sub-exponential terms of the error probabilities. Leveraging the refined asymptotic, we are able to compute an analytically accurate approximation of the classification performance for both the regimes of small and large values of n. Theoretical findings are corroborated by extensive numerical simulations. Real-world data, acquired by an X-band maritime radar system for surveillance, are exploited to assess the validity of the proposed theory.

show abstract

Section: Introductionmentioning

confidence: 99%