Information Mining Over Heterogeneous and High-Dimensional Time-Series Data in Clinical Trials Databases

Abstract

An effective analysis of clinical trials data involves analyzing different types of data such as heterogeneous and high dimensional time series data. The current time series analysis methods generally assume that the series at hand have sufficient length to apply statistical techniques to them. Other ideal case assumptions are that data are collected in equal length intervals, and while comparing time series, the lengths are usually expected to be equal to each other. However, these assumptions are not valid for many real data sets, especially for the clinical trials data sets. An addition, the data sources are different from each other, the data are heterogeneous, and the sensitivity of the experiments varies by the source. Approaches for mining time series data need to be revisited, keeping the wide range of requirements in mind. In this paper, we propose a novel approach for information mining that involves two major steps: applying a data mining algorithm over homogeneous subsets of data, and identifying common or distinct patterns over the information gathered in the first step. Our approach is implemented specifically for heterogeneous and high dimensional time series clinical trials data. Using this framework, we propose a new way of utilizing frequent itemset mining, as well as clustering and declustering techniques with novel distance metrics for measuring similarity between time series data. By clustering the data, we find groups of analytes (substances in blood) that are most strongly correlated. Most of these relationships already known are verified by the clinical panels, and, in addition, we identify novel groups that need further biomedical analysis. A slight modification to our algorithm results an effective declustering of high dimensional time series data, which is then used for "feature selection." Using industry-sponsored clinical trials data sets, we are able to identify a small set of analytes that effectively models the state of normal health.

From Wearable Sensors to Smart Implants-–Toward Pervasive and Personalized Healthcare

“…This streamlines and accelerates data collection protocols. Data mining over trial data has been proposed as a method to identify predictive biomarkers of a treatment effect [76] or determining relevant groups of interest [77] by combining the details from several studies. These indicators may serve to specify the set of biomedical markers of interest where a pervasive health monitoring system can subsequently place special emphasis on.…”

Classifying pedestrian movement behaviour from GPS trajectories using visualization and clustering

“…To analyse the similarity of trajectories, we initially consider them as time series data (Altiparmak et al, 2006). Each time series is considered as a mathematical curve in a two-dimensional coordinate space with time on the x-axis.…”

Interpreting map usage patterns using geovisual analytics and spatio-temporal clustering

“…Trajectories can therefore be grouped by performing clustering on the dataset of numerically calculated first and second derivatives of each trajectory. Such slope based similarity computations are used for clustering of time series (Altiparmak et al 2006), however, there, only the first derivative of the time series (i.e. mathematical slope) is considered, while we add the second derivative (the rate of change of mathematical slope), for a more detailed approach and a more complex description of the movement being studied.…”