The public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing the burden
SPONSORINGIMONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR'S ACRONYM(S)Bureau of Medicine and Surgery BUMED (Med-02) 2300 E. Street, N.W.
SPONSORIMONITOR'S REPORT Washington, DC 20372-5300
NUMBER(S)
DN24112612. DISTRIBUTION/AVAILABILITY STATEMENT Approved for public release, distribution unlimited.
SUPPLEMENTARY NOTES
ABSTRACTGiven two time series X and Y, their mutual information, I(X,Y)=I(Y,X), is the average number of bits of X that can be predicted by measuring Y and vice versa. In the analysis of observational data, calculation of mutual information occurs in three contexts, identification of nonlinear correlation, determination of an optimal sampling interval particularly when embedding data, and in the investigation of causal relationships with directed mutual information. In this report a minimum description length argument is used to determine the optimal number of elements to use when characterizing the distributions of X and Y. However, even when using partitions of the X and Y axis indicated by minimum description length, mutual information calculations performed with a uniform partition of the XY plane can give misleading results. This motivated the construction of an algorithm for calculating mutual information that uses an adaptive partition. This algorithm also incorporates an explicit test of the statistical independence of X and Y in a calculation that returns an assessment of the corresponding null hypothesis.
SUBJECT