Gaussian measures, Hermite polynomials, and the Ornstein-Uhlenbeck semigroup
1 Definitions
For a topological space , we denote by the Borel -algebra of .
We write . With the order topology, is a compact metrizable space, and has the subspace topology inherited from , namely the inclusion map is an embedding . It follows that11 1 Charalambos D. Aliprantis and Kim C. Border, Infinite Dimensional Analysis: A Hitchhiker’s Guide, third ed., p. 138, Lemma 4.20.
If is a collection of functions on a set , we define and by
and
If is a measurable space and is a countable collection of measurable functions , it is a fact that and are measurable .
2 Kolmogorov’s inequality
Kolmogorov’s inequality is the following.22 2 Gerald B. Folland, Real Analysis: Modern Techniques and Their Applications, second ed., p. 322, Theorem 10.11.
Theorem 1 (Kolmogorov’s inequality).
Suppose that is a probability space, that , that , and that are independent. Let
for . Then for any ,
3 Gaussian measures on R
For real and , one computes that
(1) |
Suppose that is a Borel probability measure on . If
for some or has density
for some and some , with respect to Lebesgue measure on , we say that is a Gaussian measure. We say that is a Gaussian measure with mean and variance , and that a Gaussian measure with density has mean and variance . A Gaussian measure with mean and variance is said to be standard.
One calculates that the characteristic function of a Gaussian measure with density is
(2) |
The cumulative distribution function of a standard Gaussian measure is, for ,
We define and also define
using (1).
is strictly increasing, thus makes sense, and is itself strictly increasing. Then is strictly decreasing. By (1),
The following lemma gives an estimate for that tells us something substantial as , beyond the immediate fact that .33 3 Vladimir I. Bogachev, Gaussian Measures, p. 2, Lemma 1.1.3.
Lemma 2.
For ,
Proof.
Integrating by parts,
On the other hand, using the above work and again integrating by parts,
∎
The following theorem shows that if the variances of a sequence of independent centered random variables are summable then the sequence of random variables is summable almost surely.44 4 Karl R. Stromberg, Probability for Analysts, p. 58, Theorem 4.6.
Theorem 3.
Suppose that , , are independent random variables each with mean . If , then converges almost surely.
Proof.
Define by
define by
and define by
If converges and , there is some such that for all , and so and . Therefore, if converges then . On the other hand, if and , there is some such that , hence for all . That is, is a Cauchy sequence in , and hence converges. Therefore
(3) |
Let . For any and , using Kolmogorov’s inequality with for ,
Because this is true for each , it follows that
hence, for each ,
Because , as , so
Because this is true for all , we get , i.e. . By (3), this means that converges almost surely. ∎
The following theorem gives conditions under which the converse of the above theorem holds.55 5 Karl R. Stromberg, Probability for Analysts, p. 59, Theorem 4.7.
Theorem 4.
Suppose that , , are independent random variables each with mean , and let . If
(4) |
and there is some such that almost surely, then
Proof.
By (4), there is some such that , for
For , let
which satisfies as . For each , the random variables and are independent and the random variables and are independent, whence
Set . For , , and for almost all , , so for almost all ,
hence
Adding the inequalities for , because are pairwise disjoint,
Because this is true for all and ,
and with this completes the proof. ∎
4 Rn
If is a finite Borel measure on , we define the characteristic function of by
A Borel probability measure on is said to be Gaussian if for each , the pushforward measure on is a Gaussian measure on , where
for a Borel set in .
We now give a characterization of Gaussian measures on and their densities.66 6 Vladimir I. Bogachev, Gaussian Measures, p. 3, Proposition 1.2.2; Michel Simonnet, Measures and Probabilities, p. 303, Theorem 14.5. In the following theorem, the vector is called the mean of and the linear transformation is called the covariance operator of . When and , we say that is standard.
Theorem 5.
A Borel probability measure on is Gaussian if and only if there is some and some positive semidefinite such that
(5) |
If is a Gaussian measure whose covariance operator is positive definite, then the density of with respect to Lebesgue measure on is
Proof.
Suppose that (5) is satisfied. Let , i.e. a linear map , and put . Using the change of variables formula, the characteristic function of is
Let be the unique element of such that for all . Then
so by (5),
This implies that is a Gaussian measure on with mean and variance : if then , and if then has density
with respect to Lebesgue measure on . That is, for any , the pushforward measure is a Gaussian measure on , which is what it means for to be a Gaussian measure on .
Suppose that is Gaussian and let . Then the pushforward measure is a Gaussian measure on . Let be the mean of and let be the variance of , and let be the unique element of such that for all . Using the change of variables formula,
and
Because is linear , there is a unique such that
For ,
so
is a symmetric bilinear form on , and
namely, is positive semidefinite. It follows that there is a unique positive semidefinite such that for all . For and for , using the change of variables formula, using the fact that is a Gaussian measure on with mean
and variance
and using (2),
which shows that (5) is satisfied.
Suppose that is a Gaussian measure and further that the covariance operator is positive definite. By the spectral theorem, there is an orthonormal basis for such that for each . Write , and for set , with which and then
And
Let be the Gaussian measure on with mean and variance . Because , the measure has density with respect to Lebesgue measure on , and thus
This implies that has density
with respect to Lebesgue measure on . Moreover,
so we have, as ,
∎
Because is a second-countable topological space, the Borel -algebra is equal to the product -algebra . The density of the standard Gaussian measure with respect to Lebesgue measure on is, by Theorem 5,
It follows that is equal to the product measure , and thus that the probability space is equal to the product .
For , we define , called the tensor product of , by
It is straightforward to check that for ,
One proves that the linear span of the collection of all tensor products is dense in , and that is an orthonormal basis for , then
(6) |
is an orthonormal basis for .
We will later use the following statement about centered Gaussian measures.77 7 Vladimir I. Bogachev, Gaussian Measures, p. 5, Lemma 1.2.5.
Theorem 6.
Let be a Gaussian measure on with mean and let . Then the pushforward of the product measure on under the mapping , , is equal to .
Proof.
Let be the pushforward of under the above mapping. and let be the covariance operator of . For , using the change of variables formula,
By Theorem 5,
Thus, the characteristic function of is
which implies that is equal to the Gaussian measure with mean and covariance operator , i.e., . ∎
5 Hermite polynomials
For , we define the Hermite polynomial by
It is apparent that is a polynomial of degree .
Theorem 7.
For real and ,
Proof.
For , let . For ,
Therefore, for real and ,
∎
Theorem 8.
Let be the standard Gaussian measure on , with density . Then
is an orthonormal basis for .
Proof.
For , on the one hand, using (1) with and ,
On the other hand, using Theorem 7,
Therefore
From this, we get that if then , i.e.
If , then , i.e.
Therefore, is an orthonormal set in .
Suppose that satisfies for each . Because is a polynomial of degree , for each we have
Hence for each , . One then proves that is dense in , from which it follows that the linear span of the Hermite polynomials is dense in and thus that they are an orthonormal basis. ∎
Lemma 9.
For ,
Proof.
For , we define the Hermite polynomial by
Because the collection of all Hermite polynomials is an orthonormal basis for the Hilbert space , following (6) we have that the collection of all Hermite polynomials is an orthonormal basis for the Hilbert space .
Theorem 10.
For the standard Gaussian measure on , with mean and covariance operator , the collection
is an orthonormal basis for .
For , write . For , we define
which is a subspace of of dimension
As is a finite dimensional subspace of , it is closed. is equal to the orthogonal direct sum of the :
Let
be the orthogonal projection onto .
6 Ornstein-Uhlenbeck semigroup
Let be a Gaussian measure on with mean and covariance operator . For , we define by
By Theorem 6, . Therefore, for and , using the change of variables formula,
Applying Fubini’s theorem, the function
belongs to . We define the Ornstein-Uhlenbeck semigroup on , , by
for .
Theorem 11.
Let be a Gaussian measure on with mean . If , then
Proof.
Theorem 12.
Let be a Gaussian measure on with mean . For and , is a bounded linear operator with operator norm .
Proof.
For , using Jensen’s inequality and then Theorem 11,
i.e. . This shows that the operator norm of is . But, as is a probability measure,
so has operator norm . ∎
For a Banach space , we denote by the set of bounded linear operators . The strong operator topology on is the coarsest topology on such that for each , the map is continuous . To say that a map is strongly continuous means that for each , in the strong operator topology as , i.e., for each , in .
A one-parameter semigroup in is a map such that (i) and (ii) for , . For a one-parameter semigroup to be strongly continuous, one proves that it is equivalent that in the strong operator topology as , i.e. for each , .88 8 Walter Rudin, Functional Analysis, second ed., p. 376, Theorem 13.35.
We now establish that the is indeed a one-parameter semigroup and that it is strongly continuous.99 9 Vladimir I. Bogachev, Gaussian Measures, p. 10, Theorem 1.4.1.
Theorem 13.
Suppose is a Gaussian measure on with mean and let . Then is a strongly continuous one-parameter semigroup in .
Proof.
For , because is a probability measure,
hence . For , define by
By Theorem 6, , whence
hence . This establishes that is a semigroup.
For , , and , as we have
thus by the dominated convergence theorem, since
and is a probability measure, we have
and hence
Because this is true for each and
by the dominated convergence theorem we then have
(7) |
Now let . There is a sequence satisfying , with for all . For any ,
Let and let be so large that . Because , by (7) there is some such that when , . Then when ,
which shows that for each , as , which suffices to establish that is strongly continuous . ∎
For , we define by
We define to be the set of those such that converges to some element of as , and we define . This is the infinitesimal generator of the semigroup , and the infinitesimal generator of the Ornstein-Uhlenbeck semigroup is called the Ornstein-Uhlenbeck operator. Because the Ornstein-Uhlenbeck semigroup is strongly continuous, we get the following.1010 10 Walter Rudin, Functional Analysis, second ed., p. 376, Theorem 13.35.
Theorem 14.
Suppose is a Gaussian measure on with mean , let , and let be the infinitesimal generator of the Ornstein-Uhlenbeck semigroup . Then:
-
1.
is a dense linear subspace of and is a closed operator.
-
2.
For each and for each ,
-
3.
For and a compact subset of , as uniformly for .
-
4.
For with , defined by
belongs to , the range of is equal to , and
where is the identity operator on .
We remind ourselves that if is a Hilbert space with inner product , an element of is said to be a positive operator when for all . We prove that each is a positive operator on the Hilbert space .1111 11 Vladimir I. Bogachev, Gaussian Measures, p. 10, Theorem 1.4.1.
Theorem 15.
Suppose is a Gaussian measure on with mean . For each , is a positive operator.
Proof.
For , define by
whose transpose is the linear operator defined by
For , we calculate
which shows that and have equal characteristic functions and hence are themselves equal.
For and ,
which establishes that is a self-adjoint operator on .
Furthermore, using that and that is self-adjoint,
which is , which establishes that is a positive operator on . ∎
We now write the Ornstein-Uhlenbeck semigroup using the orthogonal projections , where is the standard Gaussian measure on .1212 12 Vladimir I. Bogachev, Gaussian Measures, p. 11, Theorem 1.4.4.
Theorem 16.
For each and ,
Proof.
Define by , which satisfies, using that the subspaces are pairwise orthogonal,
so . To prove that , it suffices to prove that for each Hermite polynomial, which are an orthonormal basis for . For with ,
and
To prove that , it thus suffices to prove that for any , for any , and for any ,
(8) |
For , as and is a probability measure, (8) is true. Suppose that (8) is true for . That is, for each , . For any , because the Hermite polynomial is a polynomial of degree , one checks that is a polynomial of degree : using the binomial formula,
is a polynomial in of degree . Hence a linear combination of . For ,
Therefore there is some such that . Then check that . ∎
We now give an explicit expression for the domain of the Ornstein-Uhlenbeck operator and for applied to an element of its domain.1313 13 Vladimir I. Bogachev, Gaussian Measures, p. 12, Proposition 1.4.5.
Theorem 17.
For ,
Proof.
Let satisfy
For ,
For and ,
and thus
For each , as ,
thus as ,
and hence
This means that converges in to as , and since converges, . ∎