Complex, high-dimensional data sets pose significant analytical challenges in the post-genomic era. Such data sets are not exclusive to genetic analyses and are also pertinent to epidemiology. There has been considerable effort to develop hypothesis-free data mining and machine learning methodologies. However, current methodologies lack exhaustivity and general applicability. Here we use a novel non-parametric, non-euclidean data mining tool, HyperCube®, to explore exhaustively a complex epidemiological malaria data set by searching for over density of events in m-dimensional space. Hotspots of over density correspond to strings of variables, rules, that determine, in this case, the occurrence of Plasmodium falciparum clinical malaria episodes. The data set contained 46,837 outcome events from 1,653 individuals and 34 explanatory variables. The best predictive rule contained 1,689 events from 148 individuals and was defined as: individuals present during 1992–2003, aged 1–5 years old, having hemoglobin AA, and having had previous Plasmodium malariae malaria parasite infection ≤10 times. These individuals had 3.71 times more P. falciparum clinical malaria episodes than the general population. We validated the rule in two different cohorts. We compared and contrasted the HyperCube® rule with the rules using variables identified by both traditional statistical methods and non-parametric regression tree methods. In addition, we tried all possible sub-stratified quantitative variables. No other model with equal or greater representativity gave a higher Relative Risk. Although three of the four variables in the rule were intuitive, the effect of number of P. malariae episodes was not. HyperCube® efficiently sub-stratified quantitative variables to optimize the rule and was able to identify interactions among the variables, tasks not easy to perform using standard data mining methods. Search of local over density in m-dimensional space, explained by easily interpretable rules, is thus seemingly ideal for generating hypotheses for large datasets to unravel the complexity inherent in biological systems.

There exists great disparity in the number of clinical P. falciparum episodes among children of the same age and living in similar conditions. The epidemiological determinants of such disparity are unclear. We used a data-mining approach to explore a nineteen-year longitudinal malaria cohort study dataset from Senegal and identify variables associated with increased risk of malaria episodes. These were then verified using classical statistics and replicated in a second cohort. In addition to age, we identified a novel high-risk group of children in whom the history of P. falciparum clinical episodes greatly increased risk of further episodes. Age and a high number of previous falciparum clinical episodes not only play major roles in explaining the risk of P. falciparum episodes but also are risk factors for different groups of people. Combined, they explain the majority of falciparum clinical attacks. Contrary to what is widely believed, clinical immunity to P. falciparum does not de facto occur following many P. falciparum clinical episodes. There exist a sub-group of children who suffer repeated clinical episodes. In addition to posing an important challenge for population stratification during clinical trials, this sub-group disproportionally contributes to the disease burden and may necessitate specific prevention and control measures.

Résumé De nouvelles approches mathématiques permettent de « faire parler » intelligemment les millions de données client détenues par les opérateurs de télécom.

No abstract

No abstract