The Kolmogorov continuity theorem, Hölder continuity, and the Kolmogorov-Chentsov theorem
1 Modifications
Let be a probability space, let be a nonempty set, and let be a measurable space. A stochastic process with index set and state space is a family of random variables . If and are stochastic processes, we say that is a modification of if for each ,
Lemma 1.
If is a modification of , then and have the same finite-dimensional distributions.
Proof.
For , let for each , and let
If then there is some for which , and so . Therefore
Because is a modification of , the right-hand side is a union of finitely many -null sets, hence is itself a -null set. and each belong to , so .11 1 We have not assumed that is a complete measure space, so we must verify that a set is measurable before speaking about its measure. Because , , i.e.
This implies that22 2 http://individual.utoronto.ca/jordanbell/notes/finitedimdistributions.pdf
namely, and have the same finite-dimensional distributions. ∎
2 Continuous modifications
Let be a Polish space with Borel -algebra . A stochastic process is called continuous if for each , the path is continuous .
A dyadic rational is an element of
The Kolmogorov continuity theorem gives conditions under which a stochastic process whose state space is a Polish space has a continuous modification.33 3 Heinz Bauer, Probability Theory, p. 335, Theorem 39.3. It was only after working through the proof given by Bauer that I realized that the statement is true when the state space is a Polish space rather than merely . In the proof I do not use that is a norm on , and only use that is a metric on , so it is straightforward to rewrite the proof. This is like the Sobolev lemma,44 4 Walter Rudin, Functional Analysis, second ed., p. 202, Theorem 7.25. which states that if and , then there is some such that almost everywhere. It does not make sense to say that an element of a Sobolev space is itself , because elements of Sobolev spaces are equivalence classes of functions, but it does make sense to say that there is a version of this element.
Theorem 2 (Kolmogorov continuity theorem).
Suppose that is a stochastic process with state space . If there are such that
(1) |
then the stochastic process has a continuous modification that itself satisfies (1).
Proof.
Let and let
For , let be the set of all pairs with
and . There are such pairs, i.e. . Let
For , using Chebyshev’s inequality and (1) we get
Hence
Because , the Borel-Cantelli lemma tells us that
where for each there is some such that when . That is, for there is some such that
(2) |
Now let and let be dyadic rationals satisfying
Let be the greatest integer such that :
(3) |
which implies that . There are some such that
As and , there are sequences , , each of which have cofinitely many zero entries, such that
Because and ,
and with (3),
Thus , so and so either or . In the first case, . In the second case, since , by (2) we have
(4) |
Define by induction
i.e.
For each , , so either or , and because , applying (2) yields
Because the sequence is eventually equal to , the sequence is eventually equal to . Thus
whence
By the same reasoning we get
Using these and (4) yields
for . By (3), , hence
(5) |
This is true for all dyadic rationals with ; when it is immediate.
For , let , which satisfies (1). By what we have worked out, there is a -null set such that for each there is some such that and imply that . Let , which is -null, and for let . For with , what we have worked out yields
By induction, we get that for each there are -null sets and for each there is some such that for with ,
Let
which is an increasing sequence of sets whose union is -null. For , there is a nondecreasing sequence such that when and with , it is the case that . For with , because , either there is some for which or there is some for which, say, . In the first case, . In the second case, because and , we get, because and ,
Thus for
we have established that for , , and satisfying , it is the case that
(6) |
This implies that for each and for , the mapping is uniformly continuous on . For and , define
(7) |
For each , because is uniformly continuous , where is dense in and is a complete metric space, the map is uniformly continuous .55 5 Charalambos D. Aliprantis and Kim C. Border, Infinite Dimensional Analysis: A Hitchhiker’s Guide, third ed., p. 77, Lemma 3.11. Then is continuous . For , we define
Then for each , is continuous . For , is the pointwise limit of the sequence of mappings as , . For each , is measurable , which implies that is itself measurable .66 6 Charalambos D. Aliprantis and Kim C. Border, Infinite Dimensional Analysis: A Hitchhiker’s Guide, third ed., p. 142, Lemma 4.29. Namely, is a continuous stochastic process.
We must show that is a modification of . For , for all we have . For , there is a sequence tending to , and then for all by (7) we have . , namely, converges to almost surely. Because converges to almost surely and is a probability measure, converges in measure to .77 7 Charalambos D. Aliprantis and Kim C. Border, Infinite Dimensional Analysis: A Hitchhiker’s Guide, third ed., p. 479, Theorem 13.37. On the other hand, for , by Chebyshev’s inequality and (1),
and because this is true for each , this shows that converges in measure to . Hence, the limits and are equal as equivalence classes of measurable functions .88 8 http://individual.utoronto.ca/jordanbell/notes/L0.pdf That is, . This is true for each , showing that is a modification of , completing the proof. ∎
3 Hölder continuity
Let and be metric spaces, let , and let be a function. For , we say that is -Hölder continuous at if there is some and some such that when ,
We say that is locally -Hölder continuous if for each there is some and some such that when and ,
We say that is uniformly -Hölder continuous if there is some such that for all ,
We establish properties of Hölder continuous functions in the following.99 9 Achim Klenke, Probability Theory: A Comprehensive Course, p. 448, Lemma 21.3.
Lemma 3.
Let be a nonempty subset of , let , and let be locally -Hölder continuous.
-
1.
If then is locally -Hölder continuous.
-
2.
If is compact, then is uniformly -Hölder continuous.
-
3.
If is an interval of length and there is some and some such that for all with we have
(8) then
Proof.
For , there is some and some such that when ,
showing that is locally -Hölder continuous.
With the metric inherited from , is a compact metric space. For and , write
which is an open subset of . Because is locally -Hölder continuous, for each there is some and some such that for all ,
(9) |
Write . Because , is an open cover of , and because is compact there are such that is an open cover of . Because is a compact metric space, there is a Lebesgue number of the open cover :1010 10 Charalambos D. Aliprantis and Kim C. Border, Infinite Dimensional Analysis: A Hitchhiker’s Guide, third ed., p. 85, Lemma 3.27. for each , there is some such that . Let
For with , i.e. , there is some with . By (9),
On the other hand, for with ,
Thus, for all ,
showing that is uniformly -Hölder continuous.
The following theorem does not speak about a version of a stochastic process. Rather, it shows what can be said about a stochastic process that satisfies (1) when almost all of its sample paths are continuous.1111 11 Heinz Bauer, Probability Theory, p. 338, Theorem 39.4.
Theorem 4.
If a stochastic process with state space satisfies (1) and for almost every the map is continuous , then for almost every , for every , the map is locally -Hölder continuous.
Proof.
There is a -null set such that for , the map is continuous . For each , we have established in (6) that there is a -null set such that for there is some such that when and ,
(10) |
where . Write , and let . For , the map is continuous . For and for satisfying , say with , let and let be a sequence of dyadic rationals decreasing to and let be a sequence of dyadic rationals inceasing to . Then and , so by (10),
Because , and , so
thus
showing that for and , the map is locally -Hölder continuous.
Let be a sequence increasing to and let
which is a -null set. Let and let be such that . For , the map is locally -Hölder continuous, and because this implies that the map is locally -Hölder continuous, completing the proof. ∎
Bauer attributes the following theorem to Kolgmorov and Chentsov.1212 12 Nikolai Nikolaevich Chentsov, 1930–1993, obituary in Russian Math. Surveys 48 (1993), no. 2, 161–166. It does not merely state that for any there is a modification that is locally -Hölder continuous, but that there is a modification that for all is locally -Hölder continuous.1313 13 Heinz Bauer, Probability Theory, p. 339, Corollary 39.5.
Theorem 5 (Kolmogorov-Chentsov theorem).
If a stochastic process with state space satisfies (1), then has a modification such that for all and , the path is locally -Hölder continuous.
Proof.
Applying the Kolmogorov continuity theorem, there is a continuous modification of that also satisfies (1). By Theorem 4, there is a -null set such that for and , the map is locally -Hölder continuous. For , define
i.e. , which is measurable , and so is a stochastic process. For every and , the map is locally -Hölder continuous. For ,
Because and , since is a modification of , we get , namely, is a modification of . ∎