Interactive Statistical Mechanics and Nonlinear Filtering

This paper connects non-equilibrium statistical mechanics and optimal nonlinear filtering. The latter concerns the observation-conditional behaviour of Markov signal processes, and thus provides a tool for investigating statistical mechanics with partial observations. These allow entropy reduction, illustrating Landauer's Principle in a quantitative way. The joint process comprising a signal and its nonlinear filter is irreversible in its invariant distribution, which therefore corresponds to a non-equilibrium stationary state of the associated joint system. Macroscopic entropy and energy flows are identified for this state. Since these are driven by observations internal to the system, they do not cause entropy increase, and so the joint system makes statistical mechanical sense in reverse time. Time reversal yields a dual system in which the signal and filter exchange roles. Despite the structural similarity of the original and dual systems, there is a substantial asymmetry in their complexities. This reveals the direction of time, despite the systems being in stationary states that do not produce entropy. © 2008 Springer Science+Business Media, LLC.