Wikipedia / Ergodicity
Wikipedia / Ergodicity
In mathematics, especially in ergodic theory, ergodicity is a way of saying that a dynamical system behaves as one indivisible statistical system, rather than being composed of statistically distinguishable subsystems. More precisely, a measure-preserving dynamical system is ergodic if every invariant measurable set has either measure zero or full measure. Equivalently, the system cannot be decomposed, up to sets of measure zero, into two smaller invariant parts of positive measure.
Ergodic theorems relate this condition to the equality of time averages and space averages. Under suitable hypotheses, the time average of an observable along almost every orbit is equal to its space average. Ergodicity itself, however, is not the same as randomness, mixing, chaos, or the assertion that every individual orbit visits every part of the space.
Ergodicity may also be described in terms of ergodic measures: an invariant probability measure is ergodic if it cannot be decomposed into a nontrivial convex combination of other invariant probability measures.
Ergodic systems occur in many areas of physics, geometry, probability theory, and dynamical systems. The origins of the subject lie in statistical physics, where Ludwig Boltzmann formulated the ergodic hypothesis in connection with the foundations of statistical mechanics.
Informal explanation and motivation
Ergodicity is a way of saying that a system has no hidden division into smaller statistically separate parts. If the system is observed for a long time, its long-run statistical behavior is governed by one invariant measure, rather than by a choice among several different invariant components.
First example: coin tossing
for almost every sequence.
. The chosen coin is then tossed forever. This process is stationary, but it is not ergodic. The hidden choice of coin is an invariant fact about the whole infinite sequence, and it separates the process into two statistically different components.
In a measure-preserving dynamical system, this idea is expressed by saying that every invariant measurable set has either measure zero or full measure. Equivalently, the system cannot be decomposed, up to sets of measure zero, into two invariant parts of positive measure.
Ergodicity is related to the equality of time averages and space averages through ergodic theorems. It should not be confused with randomness, mixing, chaos, or the claim that every individual orbit visits every part of the space.
Second example: irrational rotations of a circle
Another basic example comes from rotations of the circle..
iterations it returns to its original position. With respect to Lebesgue measure on the circle, this rotation is not ergodic. For example, the nonconstant function
.
is irrational, the orbit of every point is dense in the circle. In fact, the irrational rotation is ergodic with respect to Lebesgue measure: every measurable set that is invariant under the rotation has either measure zero or full measure. Thus the system has many different individual orbits, but it has no nontrivial measurable decomposition into invariant statistical components.
This example also shows that ergodicity is weaker than mixing. Irrational rotations are ergodic, but they are not mixing.
Measurable sets and invariant events
In the measure-theoretic definition of ergodicity, the basic data are a measure space, and a time-evolution of its points. In the coin-toss example, the state space may be taken to be the space of infinite sequences of outcomes, and the time evolution is the shift map on this space. In the rotation example, the state space is the circle, and the time evolution is repeated application of the rotation. Both are examples of discrete time is equipped with a sigma-algebra of sets that are allowed to be measured.
is a topological space, such as an interval, a circle, or a manifold, the usual choice is often the Borel sigma-algebra".
, this is usually written as
or, more generally, denoting the symmetric difference:
is a measure-preserving transformation.
An invariant measurable set represents a statistical property of the state that persists under the dynamics. Ergodicity says that every such persistent measurable property is trivial: it holds either almost nowhere (i.e., only on a set of measure zero) or almost everywhere (i.e., everywhere except a set of measure zero).
Physical motivation
The original motivation for ergodicity came from statistical mechanics. In classical mechanics, the state of a system is represented by a point in phase space: for example, the positions and momenta of all particles in a gas. The time evolution of the system moves this point through phase space.
For an isolated Hamiltonian system, the energy is conserved, so the motion is confined to an energy surface
Hamiltonian flow preserves the natural phase-space volume, called Liouville measure. After restricting to an energy surface, this gives the measure underlying the microcanonical ensemble.
, this asks whether a time average such as
over the energy surface. The ergodic hypothesis was an early attempt to justify this replacement.
In modern measure-theoretic language, ergodicity does not mean that a trajectory literally passes through every point of the energy surface. Rather, it means that, relative to the chosen invariant measure, there is no further invariant measurable decomposition of the system into smaller statistical components. Under suitable hypotheses, ergodic theorems then imply the equality of time averages and space averages for many observables.
History and etymology
The term ergodic is usually attributed to Ludwig Boltzmann and is commonly explained as a combination of the Greek words (ergon, "work") and (hodos, "path"). The exact historical development of the term is not entirely straightforward; it has also been connected with Boltzmann's term ergomonode, used in his work on statistical mechanics.
The concept arose in the attempt to justify the use of statistical methods in statistical mechanics. In that setting, one wants to relate time averages along the motion of a mechanical system to averages over a space of possible states. This motivation led to the ergodic hypothesis, according to which a mechanical system may, under suitable assumptions, be treated as if its long-time behavior samples the relevant state space.
The original physical form of the hypothesis was later replaced by more precise mathematical notions in ergodic theory, especially the measure-theoretic definition in terms of invariant measurable sets. In 1913, Michel Plancherel showed that one natural formulation of the classical mechanical ergodic hypothesis could not hold as originally stated.
Ergodicity in physics and geometry
Ergodicity appears in several related settings in physics and geometry. In each case, one must specify both the state space and the invariant measure. The common measure-theoretic question is whether the system has nontrivial invariant measurable subsets.
In statistical mechanics
In statistical mechanics, ergodicity is used to justify replacing long-time averages of observables by averages over an invariant ensemble. For isolated Hamiltonian systems, the relevant ensemble is usually the microcanonical ensemble on an energy surface. This is the setting of the classical ergodic hypothesis.
Rigorous proofs of ergodicity for realistic many-particle systems are difficult. Important mathematical examples come from dynamical billiards, where idealized particle collisions provide systems for which ergodicity can sometimes be proved.
Simple dynamical systems
Basic examples of ergodic and non-ergodic systems occur already in low-dimensional dynamics. Irrational rotations of the circle are ergodic with respect to Lebesgue measure, but they are not mixing. Other standard examples include the baker's map, Arnold's cat map, Bernoulli shifts, and certain billiard systems. These examples illustrate different relations between ergodicity, mixing, entropy, and chaotic behavior.
In geometry
Ergodic flows also arise naturally in geometry. A central example is the geodesic flow on a Riemannian manifold, usually considered on the unit tangent bundle with its natural invariant measure.
On a flat torus, motion in a fixed irrational direction is dense on the torus and is ergodic after restricting to that direction. The full geodesic flow on the unit tangent bundle is not ergodic, since the direction of motion is conserved. By contrast, the geodesic flow on a compact Riemannian manifold of negative curvature is ergodic with respect to the natural invariant measure. This provides one of the classical families of examples in ergodic theory and is closely related to Anosov flows.
Other geometric examples include horocycle flows, flows on translation surfaces, and billiard flows. In these settings, ergodicity concerns invariant measurable subsets of the appropriate phase space, not whether a single path literally passes through every point.
In quantum mechanics
In quantum mechanics, the word ergodicity is used more cautiously, since quantum evolution is not described by point trajectories in classical phase space. Related notions appear in quantum chaos and in the quantum ergodicity theorem, which concerns the distribution of eigenfunctions in a semiclassical limit. These ideas are related to, but not identical with, classical measure-theoretic ergodicity.
Definition for discrete-time systems
Ergodic measures provide one of the cornerstones with which ergodicity is generally discussed. A formal definition follows.
Invariant measure
be a measurable space is a measurable function a probability measure, then a measure-preserving dynamical system-invariant.
Ergodic measure
is said to be -ergodic or that and the following condition holds:
.
In other words, there are no T-invariant subsets).
Some authors is.
Examples
is the normalized counting measure has only one orbit then the cycle).
Equivalent formulations
The definition given above admits the following immediate reformulations:
denotes the symmetric difference);
;
;
is constant on a subset of full measure.
Importantly for applications, the condition in the last characterisation can be restricted to square-integrable functions only:
is constant almost everywhere.
Further examples
Bernoulli shifts and subshifts
the product measure being endowed with its normalized counting measure). Then the shift operator is .
. Periodic sequences give finitely supported measures. More interestingly, there are infinitely-supported ones which are subshifts of finite type.
Irrational rotations
is ergodic.
Arnold's cat map
one obtains the so-called Arnold's cat map, which is ergodic for the Lebesgue measure on the torus.
Ergodic theorems
the pointwise ergodic theorem of G. D. Birkhoff.
The mean ergodic theorem of J. von Neumann is a similar, weaker statement about averaged translates of square-integrable functions.
Related properties
Dense orbits
-almost every orbit is dense.
but its orbits are dense in the support. Explicit examples can be constructed with shift-invariant measures.
The topological counterpart to ergodicity is a minimal dynamical system, in which the orbit of every point is dense.
Mixing
A measure-preserving system is called mixing if sets become asymptotically independent under iteration. Mixing implies ergodicity under standard hypotheses. The converse is not true, for example a rotation with irrational angle on the circle (which is ergodic per the examples above) is not mixing (for a sufficiently small interval its successive images will not intersect itself most of the time). Bernoulli shifts are mixing, and so is Arnold's cat map.
the following holds:
its complement).
Entropy
Kolmogorov–Sinai entropy is another invariant of measure-preserving systems. It measures the average information produced by the dynamics, rather than whether the system decomposes into invariant measurable components. Thus entropy and ergodicity answer different questions: an ergodic system may have zero entropy, while positive entropy alone does not imply ergodicity unless one restricts to an ergodic component.
Proper ergodicity
is said to be properly ergodic if it does not have an orbit of full measure..
Definition for continuous-time dynamical systems
The definition is essentially the same for continuous-time dynamical systems as for a single transformation. then we say that -ergodic or and the following condition holds:
.
Examples
is ergodic for Lebesgue measure.
this is ergodic for the Lebesgue measure.
Ergodic flows
Further examples of ergodic flows are:
Certain billiards in convex Euclidean domains, such as Sinai billiards;
the geodesic flow of a negatively curved Riemannian manifold of finite volume is ergodic (for the normalised volume measure);
the horocycle flow on a hyperbolic manifold of finite volume is ergodic (for the normalised volume measure)
Ergodicity in compact metric spaces
is a compact metric space it is naturally endowed with the σ-algebra of Borel sets.
Functional analysis interpretation
A very powerful alternate characterization of ergodic measures can be given using the theory of Banach spaces. The signed Radon measures is a convex if and only if it is an extreme point of this convex set.
Existence of ergodic measures
is nonempty. It is also compact and convex in the weak-* topology; hence by the Krein–Milman theorem it has extreme points. Therefore a continuous transformation of a compact metric space always admits ergodic measures.
Ergodic decomposition
In general an invariant measure need not be ergodic. In the compact metric setting, Choquet theory of invariant probability measures implies that an invariant measure can be expressed as the barycenter of a probability measure supported on the set of ergodic measures. This is referred to as the ergodic decomposition of the measure.
Example
are the uniform measures is the ergodic decomposition of the normalized counting measure.
Continuous systems
on compact metric spaces, with invariant measures taken with respect to the corresponding flow or semigroup.
Unique ergodicity
is said to be uniquely ergodic.
In the examples considered above, irrational rotations of the circle are uniquely ergodic; shift maps are not.
Probabilistic interpretation: ergodic processes
. The process is stationary if this probability measure is invariant under the shift map
A stationary process is said to be ergodic if this shift-invariant probability measure is ergodic. Equivalently, every shift-invariant event has probability zero or one. This is a particular case of the notions discussed above.
The simplest case is that of an independent and identically distributed process, which corresponds to a product measure on the path space and is ergodic for the shift map. Another important case is that of a stationary Markov chain, which is discussed in detail below.
A similar interpretation holds for continuous-time stochastic processes, though the construction of the measurable structure of the action is more complicated.
Ergodicity of Markov chains
The dynamical system associated with a Markov chain
be a finite set. A Markov chain. A stationary measure; that is,
.
with its product σ-algebra by giving the measures of cylinder sets as follows:
is invariant under the shift map
Criterion for ergodicity
is ergodic for the shift map if the associated finite Markov chain is irreducible, that is, if any state can be reached with positive probability from any other state in a finite number of steps.
.
Note that in probability theory a finite Markov chain is often called ergodic to be ergodic; it is instead related to stronger convergence and mixing properties. Hence the notion of "ergodicity" for a Markov chain and the notion of ergodicity for the associated shift-invariant measure are closely related but not identical.
Examples
Uniform transition matrix
is the product of uniform probability measures. This gives the Bernoulli shift example from above.
Non-ergodic Markov chains
are ergodic on their separate components, but a nontrivial convex combination of them is not ergodic.
given by the matrix
in which both states are absorbing.
A periodic chain
given by the matrix
is ergodic for the shift map. However, the shift is not mixing for this measure. For the sets
and
, but
Generalisations
The definition of ergodicity extends from a single transformation to group actions., meaning that
satisfying
. Equivalently, every invariant measurable set is either null or conull.
, respectively. The same definition also applies to non-abelian groups.
is called quasi-invariant. In that setting, the action is called ergodic if every measurable set that is invariant modulo null sets is either null or conull.
Important examples include actions of semisimple Lie groups and their lattices, such as boundary actions on Furstenberg boundaries.
The same terminology is also used for measurable equivalence relations. A measurable equivalence relation is said to be ergodic if every saturated measurable subset is either null or conull.
Representation-theoretic formulation
. In this context, the representation is sometimes called ergodic if it has no nonzero invariant vectors, that is,
, define
Matrix coefficients of unitary representations are weakly almost periodic, the representation is ergodic if and only if
. is compact, this invariant mean is integration with respect to normalized Haar measure, so the condition becomes
.
by measure-preserving transformations. The associated Koopman representation defined by
are the constant functions. Equivalently,
denote the orthogonal complement of the constant functions,
is ergodic in the representation-theoretic sense, meaning that it has no nonzero invariant vector.
consists only of the constant functions.
Notes
References
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
External links
Karma Dajani and Sjoerd Dirksin, "A Simple Introduction to Ergodic Theory"