Machine learning aided noise filtration and signal classification for CREDO experiment

Credo,; Bibrzycki, Łukasz; Alvarez-Castillo, David; Bar, Olaf; Góra, Dariusz; Homola, P.; Kovács, Péter; Niedźwiecki, Michał; Piekarczyk, Marcin; Rzecki, Krzysztof; Stasielak, J.; Stuglik, Sławomir; Sushchov, Oleksandr; Tursunov, Arman

doi:10.22323/1.395.0227

Cited by 1 publication

(1 citation statement)

References 15 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Since the data is collected in continuous mode, it is necessary to take into account the possibility of streaming digging through the dataset for unusual observations. So far CREDO data has been analyzed for both background signal filtering and artifacts removal [ 91 , 92 , 93 ], as well as classification and recognition [ 92 , 94 , 95 , 96 ]. There have also been initial works on detecting abnormal data based on various techniques such as rough sets [ 97 ].…”

Section: Introductionmentioning

confidence: 99%

On the Search for Potentially Anomalous Traces of Cosmic Ray Particles in Images Acquired by Cmos Detectors for a Continuous Stream of Emerging Observational Data

Piekarczyk,

Hachaj

2024

Sensors

Self Cite

View full text Add to dashboard Cite

In this paper we propose the method for detecting potential anomalous cosmic ray particle tracks in big data image dataset acquired by Complementary Metal-Oxide-Semiconductors (CMOS). Those sensors are part of scientific infrastructure of Cosmic Ray Extremely Distributed Observatory (CREDO). The use of Incremental PCA (Principal Components Analysis) allowed approximation of loadings which might be updated at runtime. Incremental PCA with Sequential Karhunen-Loeve Transform results with almost identical embedding as basic PCA. Depending on image preprocessing method the weighted distance between coordinate frame and its approximation was at the level from 0.01 to 0.02 radian for batches with size of 10,000 images. This significantly reduces the necessary calculations in terms of memory complexity so that our method can be used for big data. The use of intuitive parameters of the potential anomalies detection algorithm based on object density in embedding space makes our method intuitive to use. The sets of anomalies returned by our proposed algorithm do not contain any typical morphologies of particle tracks shapes. Thus, one can conclude that our proposed method effectively filter-off typical (in terms of analysis of variance) shapes of particle tracks by searching for those that can be treated as significantly different from the others in the dataset. We also proposed method that can be used to find similar objects, which gives it the potential, for example, to be used in minimal distance-based classification and CREDO image database querying. The proposed algorithm was tested on more than half a million (570,000+) images that contains various morphologies of cosmic particle tracks. To our knowledge, this is the first study of this kind based on data collected using a distributed network of CMOS sensors embedded in the cell phones of participants collaborating within the citizen science paradigm.

show abstract