Research Repository

Transfer Entropy and Directed Information in Gaussian diffusion processes

Newton, Nigel J (2016) Transfer Entropy and Directed Information in Gaussian diffusion processes. Working Paper. Arxiv. (Unpublished)

[img]
Preview
Text
1604.01969v1.pdf - Submitted Version

Download (212kB) | Preview

Abstract

Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these measures for the components of multidimensional Gaussian diffusion processes. When the components are jointly Markov, the Transfer Entropy and Directed Information are both measures of influence according to a simple physical principle. More generally, the effect of other components has to be accounted for, and this can be achieved in more than one way. We propose two definitions, one of which preserves the properties of influence of the jointly Markov case. The Transfer Entropy and Directed Information are expressed in terms of the solutions of matrix Riccati equations, and so are easy to compute. The definition of continuous-time Directed Information we propose differs from that previously appearing in the literature. We argue that the latter is not strictly directional.

Item Type: Monograph (Working Paper)
Additional Information: 20 pages
Uncontrolled Keywords: math.PR, math.PR, cs.IT, math-ph, math.IT, math.MP, math.OC, 60J60, 94A17 (Primary), 62B10, 82C31, 93E11 (Secondary)
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Elements
Date Deposited: 31 Jul 2019 13:58
Last Modified: 31 Jul 2019 13:58
URI: http://repository.essex.ac.uk/id/eprint/23660

Actions (login required)

View Item View Item