Proceedings of the 2009 SIAM International Conference on Data Mining 2009
DOI: 10.1137/1.9781611972795.22
|View full text |Cite
|
Sign up to set email alerts
|

Scalable Distributed Change Detection from Astronomy Data Streams using Local, Asynchronous Eigen Monitoring Algorithms

Abstract: This paper considers the problem of change detection using local distributed eigen monitoring algorithms for next generation of astronomy petascale data pipelines such as the Large Synoptic Survey Telescopes (LSST). This telescope will take repeat images of the night sky every 20 seconds, thereby generating 30 terabytes of calibrated imagery every night that will need to be coanalyzed with other astronomical data stored at different locations around the world. Change point detection and event classification in… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1

Citation Types

0
2
0

Year Published

2009
2009
2014
2014

Publication Types

Select...
2
2
1

Relationship

1
4

Authors

Journals

citations
Cited by 8 publications
(2 citation statements)
references
References 20 publications
0
2
0
Order By: Relevance
“…Apart from the above mentioned applications the field of radio astronomy has opened up a vast opportunity for knowledge discovery on distant galaxies through the use of data mining. Radio Astronomy data represents an ultra high speed data stream, is highly noisy, has slow rate of concept change and has potentially high false positive rate (Das et al 2009;Borne 2007).…”
Section: Motivating Examplementioning
confidence: 99%
“…Apart from the above mentioned applications the field of radio astronomy has opened up a vast opportunity for knowledge discovery on distant galaxies through the use of data mining. Radio Astronomy data represents an ultra high speed data stream, is highly noisy, has slow rate of concept change and has potentially high false positive rate (Das et al 2009;Borne 2007).…”
Section: Motivating Examplementioning
confidence: 99%
“…Local algorithms for P2P data mining include the majority voting and protocol developed by Wolff and Schuster [37]. Based on its variants, researchers have further proposed more complicated algorithms: facility location [22], outlier detection [7], meta-classification [25], eigen vector monitoring [8], multivariate regression [4], decision trees [5] and the generic local algorithms [36].…”
Section: Exact Algorithmsmentioning
confidence: 99%