Newton, Nigel J (2016) Transfer Entropy and Directed Information in Gaussian diffusion processes. Working Paper. Arxiv. (Unpublished)
Newton, Nigel J (2016) Transfer Entropy and Directed Information in Gaussian diffusion processes. Working Paper. Arxiv. (Unpublished)
Newton, Nigel J (2016) Transfer Entropy and Directed Information in Gaussian diffusion processes. Working Paper. Arxiv. (Unpublished)
Abstract
Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these measures for the components of multidimensional Gaussian diffusion processes. When the components are jointly Markov, the Transfer Entropy and Directed Information are both measures of influence according to a simple physical principle. More generally, the effect of other components has to be accounted for, and this can be achieved in more than one way. We propose two definitions, one of which preserves the properties of influence of the jointly Markov case. The Transfer Entropy and Directed Information are expressed in terms of the solutions of matrix Riccati equations, and so are easy to compute. The definition of continuous-time Directed Information we propose differs from that previously appearing in the literature. We argue that the latter is not strictly directional.
Item Type: | Monograph (Working Paper) |
---|---|
Additional Information: | 20 pages |
Uncontrolled Keywords: | math.PR; cs.IT; math-ph; math.IT; math.MP; math.OC; 60J60, 94A17 (Primary), 62B10, 82C31, 93E11 (Secondary) |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 31 Jul 2019 13:58 |
Last Modified: | 16 May 2024 19:37 |
URI: | http://repository.essex.ac.uk/id/eprint/23660 |
Available files
Filename: 1604.01969v1.pdf