Subshift of finite type

In mathematics, subshifts of finite type are used to model dynamical systems, and in particular are the objects of study in symbolic dynamics and ergodic theory. They also describe the set of all possible sequences executed by a finite state machine. The most widely studied shift spaces are the subshifts of finite type.

Definition

Let $V$ be a finite set of $n$ symbols (alphabet). Let X denote the set V^Z of all bi-infinite sequences of elements of V with T the shift operator. We endow V with the discrete topology and X with the product topology. A symbolic flow or subshift is a closed T-invariant subset Y of X ^[1] and the associated language L_Y is the set of finite subsequences of Y.^[2]

Now let A be a $n\times n$ adjacency matrix with entries in {0,1}. Using these elements we construct a directed graph G=(V,E) with V the set of vertices, the set of edges E defined with A: so x→y is in E iff A_x,y=1. Let Y be the set of all infinite admissible sequences of edges, where by admissible it is meant that the sequence is a walk of the graph. Let T be the shift operator on such sequences; it plays the role of the time-evolution operator of the dynamical system. A subshift of finite type is then defined as a pair (Y, T) obtained in this way. If the sequence extends to infinity in only one direction, it is called a one-sided subshift of finite type, and if it is bilateral, it is called a two-sided subshift of finite type.

Formally, one may define the sequence of edges as

\Sigma_{A}^{+} = \left\{ (x_0,x_1,\ldots): x_j \in V, A_{x_{j}x_{j+1}}=1, j\in\mathbb{N} \right\}.

This is the space of all sequences of symbols such that the symbol p can be followed by the symbol q only if the (p,q)^th entry of the matrix A is 1. The space of all bi-infinite sequences is defined analogously:

\Sigma_{A} = \left\{ (\ldots, x_{-1},x_0,x_1,\ldots): x_j \in V, A_{x_{j}x_{j+1}}=1, j\in\mathbb{Z} \right\}.

The shift operator T maps a sequence in the one- or two-sided shift to another by shifting all symbols to the left, i.e.

\displaystyle(T(x))_{j}=x_{j+1}.

Clearly this map is only invertible in the case of the two-sided shift.

A subshift of finite type is called transitive if G is strongly connected: there is a sequence of edges from any one vertex to any other vertex. It is precisely transitive subshifts of finite type which correspond to dynamical systems with orbits that are dense.

An important special case is the full n-shift: it has a graph with an edge that connects every vertex to every other vertex; that is, all of the entries of the adjacency matrix are 1. The full n-shift corresponds to the Bernoulli scheme without the measure.

Terminology

By convention, the term shift is understood to refer to the full n-shift. A subshift is then any subspace of the full shift that is shift-invariant (that is, a subspace that is invariant under the action of the shift operator), non-empty, and closed for the product topology defined below. Some subshifts can be characterized by a transition matrix, as above; such subshifts are then called subshifts of finite type. Often, this distinction is relaxed, and subshifts of finite type are called simply shifts of finite type. Subshifts of finite type are also sometimes called topological Markov shifts.

Generalizations

A sofic system is a subshift of finite type where different edges of the transition graph may correspond to the same symbol. It may be regarded as the set of labellings of paths through an automaton: a subshift of finite type then corresponds to an automaton which is deterministic.^[3]

A renewal system is defined to be the set of all infinite concatenations of a finite set of finite words.

Subshifts of finite type are identical to free (non-interacting) one-dimensional Potts models (n-letter generalizations of Ising models), with certain nearest-neighbor configurations excluded. Interacting Ising models are defined as subshifts together with a continuous function of the configuration space (continuous with respect to the product topology, defined below); the partition function and Hamiltonian are explicitly expressible in terms of this function.

Subshifts may be quantized in a certain way, leading to the idea of the quantum finite automata.

Topology

The subshift of finite type has a natural topology, derived from the product topology on $V^\mathbb{Z}$ , where

V^\mathbb{Z}= \Pi_{n \in \mathbb{Z}} V = \{ x=(\ldots,x_{-1},x_0,x_1,\ldots) : x_k \in V \; \forall k \in \mathbb{Z} \}

and V is given the discrete topology.

A basis for the topology of the shift of finite type is the family of cylinder sets

C_t[a_0, \ldots, a_s]= \{x \in V^\mathbb{Z} : x_t = a_0, \ldots ,x_{t+s} = a_s \}

The cylinder sets are clopen sets. Every open set in the subshift of finite type is a countable union of cylinder sets. In particular, the shift T is a homeomorphism; that is, with respect to this topology, it is continuous with continuous inverse.

Metric

A variety of different metrics can be defined on a shift space. One can define a metric on a shift space by considering two points to be "close" if they have many initial symbols in common; this is the p-adic metric. In fact, both the one- and two-sided shift spaces are compact metric spaces.

Measure

A subshift of finite type may be endowed with any one of several different measures, thus leading to a measure-preserving dynamical system. A common object of study is the Markov measure, which is an extension of a Markov chain to the topology of the shift.

A Markov chain is a pair (P,π) consisting of the transition matrix, an $n \times n$ matrix $P=(p_{ij})$ for which all $p_{ij} \ge 0$ and

\sum_{j=1}^np_{ij}=1

for all i. The stationary probability vector $\pi=(\pi_i)$ has all $\pi_{i} \ge 0,\sum \pi_i = 1$ and has

\sum_{i=1}^n \pi_i p_{ij}= \pi_j

A Markov chain, as defined above, is said to be compatible with the shift of finite type if $p_{ij} = 0$ whenever $A_{ij} = 0$ . The Markov measure of a cylinder set may then be defined by

\mu(C_t[a_0,\ldots,a_s]) = \pi_{a_0} p_{a_0,a_1} \cdots p_{a_{s-1}, a_s}

The Kolmogorov-Sinai entropy with relation to the Markov measure is

s_\mu = -\sum_{i=1}^n \pi_i \sum_{j=1}^n p_{ij} \log p_{ij}

Zeta function

The Artin–Mazur zeta function is defined as the formal power series

\zeta(z)=\exp (\sum_{n=1}^\infty \left|\textrm{Fix} (T^n)\right| \frac {z^n}{n}),

where Fix(Tⁿ) is the set of fixed points of the n-fold shift.^[4] It has a product formula

\zeta(z) = \prod_\gamma (1-z^{|\gamma|})^{-1} \

where γ runs over the closed orbits.^[4] For subshifts of finite type, the zeta function is a rational function of z:^[5]

\zeta(z) = (\det(I-zA))^{-1} \ .

Notes

↑ Xie (1996) p.21
↑ Xie (1996) p.22
↑ Pytheas Fogg (2002) p.205
1 2 Brin & Stuck (2002) p.60
↑ Brin & Stuck (2002) p.61

References

Brin, Michael; Stuck, Garrett (2002). Introduction to Dynamical Systems (2nd ed.). Cambridge University Press. ISBN 0-521-80841-3.
David Damanik, Strictly Ergodic Subshifts and Associated Operators, (2005)
Pytheas Fogg, N. (2002). Substitutions in dynamics, arithmetics and combinatorics. Lecture Notes in Mathematics 1794. Editors Berthé, Valérie; Ferenczi, Sébastien; Mauduit, Christian; Siegel, A. Berlin: Springer-Verlag. ISBN 3-540-44141-7. Zbl 1014.11015.
Natasha Jonoska, Subshifts of Finite Type, Sofic Systems and Graphs, (2000).
Michael S. Keane, Ergodic theory and subshifts of finite type, (1991), appearing as Chapter 2 in Ergodic Theory, Symbolic Dynamics and Hyperbolic Spaces, Tim Bedford, Michael Keane and Caroline Series, Eds. Oxford University Press, Oxford (1991). ISBN 0-19-853390-X (Provides a short expository introduction, with exercises, and extensive references.)
Lind, Douglas; Marcus, Brian (1995). An introduction to symbolic dynamics and coding. Cambridge University Press. ISBN 0-521-55124-2. Zbl 1106.37301.
Teschl, Gerald (2012). Ordinary Differential Equations and Dynamical Systems. Providence: American Mathematical Society. ISBN 978-0-8218-8328-0.
Xie, Huimin (1996). Grammatical Complexity and One-Dimensional Dynamical Systems. Directions in Chaos 6. World Scientific. ISBN 9810223986.