Orthonormal bases for product measures

Jordan Bell
October 22, 2015

1 Measure and integration theory

Let ℬ be the Borel σ-algebra of ℝ, and let ℬ¯ be the Borel σ-algebra of [-∞,∞]=ℝ∪{-∞,∞}: the elements of ℬ¯ are those subsets of ℝ¯ of the form B,B∪{-∞},B∪{∞},B∪{-∞,∞}, with B∈ℬ.

Let (X,𝒜,μ) be a measure space. It is a fact that if fn is a sequence of 𝒜→ℬ¯ measurable functions then supn⁡fn and infn⁡fn are 𝒜→ℬ¯ measurable, and thus if fn is a sequence of 𝒜→ℬ¯ measurable functions that converge pointwise to a function f:X→ℝ¯, then f is 𝒜→ℬ¯ measurable.11 1 Heinz Bauer, Measure and Integration Theory, p. 52, Corollary 9.7. If f1,…,fn are 𝒜→ℬ¯ measurable, then so are f1∨⋯∨fn and f1∧⋯∧fn, and a function f:X→ℝ¯ is 𝒜→ℬ¯ measurable if and only if both f+=f∨0 and f-=-(f∧0) are 𝒜→ℬ¯ measurable. In particular, if f is 𝒜→ℬ¯ measurable then so is |f|=f++f-.

A simple function is a function f:X→ℝ that is 𝒜→ℬ measurable and whose range is finite. Let E=E⁢(𝒜) be the collection of nonnegative simple functions. It is straightforward to prove that

u,v∈E,α≥0 ⇒ α⁢u,u+v,u⋅v,u∨v,u∧v∈E.

Define Iμ:E→[0,∞] by

Iμ⁢u=∑i=1nai⁢μ⁢(Ai),

where u has range {a1,…,an} and Ai=u-1⁢(ai). One proves that Iμ:E→[0,∞] is positive homogeneous, additive, and order preserving.22 2 Heinz Bauer, Measure and Integration Theory, pp. 55–56, §10.

It is a fact33 3 Heinz Bauer, Measure and Integration Theory, p. 57, Theorem 11.1. that if un is a nondecreasing sequence in E and u∈E then

u≤supn⁡un ⇒ Iμ⁢u≤supn⁡Iμ⁢un.

It follows that if un and vn are sequences in E then

supn⁡un=supn⁡vn ⇒ supn⁡Iμ⁢un=supn⁡Iμ⁢vn. (1)

Define E*=E*⁢(𝒜) to be the set of all functions f:X→[0,∞] for which there is a nondecreasing sequence un in E satisfying supn⁡un=f, in other words, there is a sequence un in E satisfying un↑f. From (1), for f∈E* and sequences un,vn∈E with supn⁡un=f and supn⁡vn=f, it holds that supn⁡Iμ⁢un=supn⁡Iμ⁢vn. Also, if u∈E then un=u is a nondecreasing sequence in E with u=supn⁡un, so u∈E*. Then it makes sense to extend Iμ from E→[0,∞] to E*→[0,∞] by defining Iμ⁢f=supn⁡Iμ⁢un. One proves44 4 Heinz Bauer, Measure and Integration Theory, pp. 58–59, §11. that

f,g∈E*,α≥0 ⇒ α⁢f,f+g,f⋅g,f∨g,f∧g∈E*

and that Iμ:E*→[0,∞] is positive homogeneous, additive, and order preserving.

The monotone convergence theorem55 5 Heinz Bauer, Measure and Integration Theory, p. 59, Theorem 11.4. states that if fn is a sequence in E* then supn⁡fn∈E* and

Iμ⁢(supn⁡fn)=supn⁡Iμ⁢fn.

We now prove a characterization of E*.66 6 Heinz Bauer, Measure and Integration Theory, p. 61, Theorem 11.6.

Theorem 1.

E* is equal to the set of functions X→[0,∞] that are A→B¯ measurable.

Proof.

If f∈E*, then there is a sequence un in E with un↑f. Because each un is measurable 𝒜→ℬ¯, so is f.

Now suppose that f:X→[0,∞] is 𝒜→ℬ¯ measurable. For n≥1 and 0≤i≤n⁢2n-1 let

Ai,n={f≥i2-n}∩{f<(i+1)2-n}={i2-n≤f<(i+1)2-n},

and for i=n⁢2n let

Ai,n={f≥n}.

Because f is 𝒜→ℬ¯ measurable, the sets Ai,n belong to 𝒜. For each n, the sets A0,n,…⁢An⁢2n-1,n,An⁢2n,n are pairwise disjoint and their union is equal to X. It is apparent that

Ai,n=A2⁢i,n+1∪A2⁢i+1,n+1,0≤i≤n⁢2n-1. (2)

Define

un=∑i=0n⁢2ni⁢2-n⁢1Ai,n,

which belongs to E. For x∈X, either f⁢(x)=∞ or 0≤f⁢(x)<∞. In the first case, un⁢(x)=n for all n≥1. In the second case, un⁢(x)≤f⁢(x)<un⁢(x)+2-n for all n>f⁢(x). Therefore un⁢(x)↑f⁢(x) as n→∞, and because this is true for each x∈X, this means un↑f and so f∈E*. ∎

So far we have defined Iμ:E*→[0,∞]. Suppose that f:X→ℝ¯ is 𝒜→ℬ¯ measurable. Then f+,f-:X→[0,∞] are 𝒜→ℬ¯ measurable so by Theorem 1, f+,f-∈E*. Then Iμ⁢f+,Iμ⁢f-∈[0,∞]. We say that a function f:X→ℝ¯ is μ-integrable if it is 𝒜→ℬ¯ measurable and Iμ⁢f+<∞ and Iμ⁢f-<∞. One checks that a function f:X→ℝ¯ is μ-integrable if and only if it is 𝒜→ℬ¯ measurable and Iμ⁢|f|<∞. If f:X→ℝ¯ is μ-integrable, we now define Iμ⁢f∈ℝ by

Iμ⁢f=Iμ⁢f+-Iμ⁢f-.

For example, if μ⁢(X)<∞ and S is a subset of X that does not belong to 𝒜, define f:X→ℝ by f=1S-1X∖S. Then f+=1S and f-=1X∖S, and thus f is not 𝒜→ℬ¯ measurable, so it is not μ-integrable. But |f|=1 belongs to E, and Iμ⁢|f|=μ⁢(X)<∞ by hypothesis, showing that |f| is μ-integrable while f is not.

One proves that if f,g:X→ℝ¯ are μ-integrable and α∈ℝ then α⁢f is μ-integrable and

Iμ⁢(α⁢f)=α⁢Iμ⁢f,

if f+g is defined on all X then f+g is μ-integrable and

Iμ⁢(f+g)=Iμ⁢f+Iμ⁢g,

and f∨g,f∧g are μ-integrable.77 7 Heinz Bauer, Measure and Integration Theory, p. 65, Theorem 12.3. Furthermore, Iμ is order preserving.

Let f:X→ℂ be a function and write f=u+i⁢v. One proves that f is Borel measurable (i.e. 𝒜→ℬℂ measurable), if and only if u and v are measurable 𝒜→ℬ. We define f to be μ-integrable if both u and v are μ-integrable, and define

Iμ⁢f=Iμ⁢u+i⁢Iμ⁢v.

2 ℒ²

Let (X,𝒜,μ) be a measure space and for 1≤p<∞ let ℒp⁢(μ) be the collection of Borel measurable functions f:X→ℂ such that |f|p is μ-integrable. For complex a,b, because x↦xp is convex we have by Jensen’s inequality

|a+b2|p≤(12⁢|a|+12⁢|b|)p≤12⁢|a|p+12⁢|b|p=12⁢(|a|p+|b|p),

so |a+b|p≤2p-1⁢(|a|p+|b|p). Thus if f,g∈ℒp⁢(μ) then

|f+g|p≤2p-1⁢(|f|p+|g|p),

which implies that ℒp⁢(μ) is a linear space.

For Borel measurable f:X→ℂ define

∥f∥Lp=(∫X|f|p⁢𝑑μ)1/p.

For f,g∈ℒp⁢(μ), by Hölder’s inequality, with 1p+1p′=1 (for which p′=pp-1),

∥f+g∥Lpp ≤∫X|f|⁢|f+g|p-1⁢𝑑μ+∫X|g|⁢|f+g|p-1⁢𝑑μ
≤∥f∥Lp⁢∥|f+g|p-1∥Lp′+∥g∥Lp⁢∥|f+g|p-1∥Lp′
=∥f∥Lp⁢∥f+g∥Lpp-1+∥g∥Lp⁢∥f+g∥Lpp-1,

which implies that ∥f+g∥Lp≤∥f∥Lp+∥g∥Lp, and hence ∥⋅∥Lp is a seminorm on ℒp⁢(μ).

Let 𝒩p⁢(μ) be the set of those f∈ℒp⁢(μ) such that ∥f∥Lp=0. 𝒩p⁢(μ) is a linear subspace of ℒp⁢(μ), and we define

Lp⁢(μ)=ℒp⁢(μ)/𝒩p⁢(μ)={f+𝒩p⁢(μ):f∈ℒp⁢(μ)}.

Lp⁢(μ) is a normed linear space with the norm ∥⋅∥Lp.

It is a fact that if V is a normed linear space then V is complete if and only if each absolutely convergent series in V converges in V. Suppose that fk is a sequence in ℒp⁢(μ) with ∑k=1∞∥f∥Lp<∞. For n≥1 let gn⁢(x)=(∑k=1n|fk⁢(x)|)p and define g:X→[0,∞] by

g⁢(x)=(∑k=1∞|fk⁢(x)|)p=limn→∞⁡gn⁢(x),

which is 𝒜→ℬ¯ measurable, being the pointwise limit of a sequence of functions each of which is 𝒜→ℬ¯ measurable. Because g1≤g2≤⋯, by the monotone convergence theorem,

∫Xg⁢𝑑μ=limn→∞⁡∫Xgn⁢𝑑μ.

But

(∫Xgn⁢𝑑μ)1/p=∥∑k=1n|fk|∥Lp≤∑k=1n∥fk∥Lp≤∑k=1∞∥fk∥Lp,

which implies that ∫Xg⁢𝑑μ<∞, meaning that g:X→[0,∞] is integrable. The fact that g is integrable implies μ⁢(E)=0, where E={x∈X:g⁢(x)=∞}∈𝒜. For x∈X∖E, ∑k=1∞|fk⁢(x)|<∞ and because ℂ is complete this implies that ∑k=1∞fk⁢(x)∈ℂ, and so it makes sense to define f:X→ℂ by

f⁢(x)=1X∖E⁢(x)⁢∑k=1∞fk⁢(x),

which is Borel measurable. Furthermore, |f|p≤g, and because g is integrable this implies that f∈ℒp⁢(μ). For x∈X∖E,

limn→∞⁡|∑k=1nfk⁢(x)-f⁢(x)|p=0

and

|∑k=1nfk⁢(x)-f⁢(x)|p≤g⁢(x),

so by the dominated convergence theorem,88 8 Heinz Bauer, Measure and Integration Theory, p. 83, Theorem 15.6.

limn→∞⁡∫X|∑k=1nfk⁢(x)-f⁢(x)|p⁢𝑑μ=0.

Because x↦x1/p is continuous this implies

limn→∞⁡∥∑k=1nfk-f∥Lp=0.

Hence, if fk is a sequence in Lp⁢(μ) such that ∑k=1∞∥fk∥Lp<∞ then there is some f∈Lp⁢(μ) such that ∑k=1nfk→f in the norm ∥⋅∥Lp. This implies that Lp⁢(μ) is a Banach space.

We say that the σ-algebra 𝒜 is countably generated if there is a countable subset 𝒞 of 𝒜 such that 𝒜=σ⁢(𝒞) and we say that a topological space is separable if there exists a countable dense subset of it. It can be proved that if 𝒜 is countably generated and μ is σ-finite, then for 1≤p<∞ there is a countable collection of simple functions that is dense in Lp⁢(μ), showing that Lp⁢(μ) is separable.99 9 Donald L. Cohn, Measure Theory, second ed., p. 102, Proposition 3.4.5.

Theorem 2.

Let (X,A,μ) be a measure space and let 1≤p<∞. Lp⁢(μ) with the norm ∥⋅∥Lp is a Banach space, and if A is countably generated and μ is σ-finite then Lp⁢(μ) is separable.

For f,g∈ℒ2⁢(μ), let

⟨f,g⟩L2⁢(μ)=∫Xf⋅g¯⁢𝑑μ.

This is an inner product on L2⁢(μ), and thus L2⁢(μ) is a Hilbert space.

3 Product measures

Let (X1,𝒜1,μ1) and (X1,𝒜1,μ1) be measure spaces and let 𝒜1⊗𝒜2 be the product σ-algebra. For Q⊂X1×X2, write

Qx1={x2∈X2:(x1,x2)∈Q},Qx2={x1∈X1:(x1,x2)∈Q}.

One proves that if μ1 and μ2 are σ-finite, then for each Q∈𝒜1⊗𝒜2 the function x1↦μ2⁢(Qx1) is 𝒜1→ℬ¯ measurable and the function x2↦μ1⁢(Qx2) is 𝒜2→ℬ¯ measurable.1010 10 Heinz Bauer, Measure and Integration Theory, p. 135, Lemma 23.2. If μ1 and μ2 are σ-finite, one proves1111 11 Heinz Bauer, Measure and Integration Theory, p. 136, Theorem 23.3. that there is a unique measure μ:𝒜1⊗𝒜2→[0,∞] that satisfies

μ⁢(A1×A2)=μ1⁢(A1)⁢μ2⁢(A2),A1∈𝒜1,A2∈𝒜2.

The measure μ satisfies

μ⁢(Q)=∫X1μ2⁢(Qx1)⁢𝑑μ1⁢(x1)=∫X2μ1⁢(Qx2)⁢𝑑μ2⁢(x2)

for Q∈𝒜1⊗𝒜2, and is itself σ-finite. We write μ=μ1⊗μ2, and call μ the product measure of μ1 and μ2.

Let X′ be a set and let f:X1×X2→X′ be a function. For x1∈X1, define fx1:X2→X′ by

fx1⁢(x2)=f⁢(x1,x2),x2∈X2

and for x2∈X2, define fx2:X1→X′ by

fx2⁢(x1)=f⁢(x1,x2),x1∈X1.

For Q⊂X1×X2,

(1Q)x1=1Qx1,(1Q)x2=1Qx2.

It is straightforward to prove that if (X′,𝒜′) is a measurable space and f:(X1×X2,𝒜1⊗𝒜2)→(X′,𝒜′) is measurable, then for each x1∈X1 the function fx1:X2→X′ is measurable 𝒜2→𝒜′ and for each x2∈X2 the function fx2:X1→X′ is measurable 𝒜1→𝒜′.1212 12 Heinz Bauer, Measure and Integration Theory, p. 138, Lemma 23.5.

Tonelli’s theorem1313 13 Heinz Bauer, Measure and Integration Theory, p. 138, Theorem 23.6. states that if (X1,𝒜1,μ1) and (X1,𝒜1,μ1) are σ-finite measure spaces and f:X1×X2→[0,∞] is 𝒜1⊗𝒜2→ℬ¯ measurable, then the functions

x2↦∫X1fx2⁢𝑑μ1,x1↦∫X2fx1⁢𝑑μ2

are 𝒜2→ℬ¯ measurable and 𝒜1→ℬ¯ measurable respectively, and

∫X1×X2f⁢d⁢(μ1⊗μ2)=∫X2(∫X1fx2⁢𝑑μ1)⁢𝑑μ2⁢(x2)=∫X1(∫X2fx1⁢𝑑μ2)⁢𝑑μ1⁢(x1). (3)

Fubini’s theorem1414 14 Heinz Bauer, Measure and Integration Theory, p. 139, Corollary 23.7. states that if (X1,𝒜1,μ1) and (X2,𝒜2,μ2) are σ-finite measure spaces and f:X1×X2→ℝ¯ is μ1⊗μ2-integrable then there is some A1∈𝒜1 with μ1⁢(A1)=0 such that for x1∈X1∖A1 the function fx1:X2→ℝ¯ is μ2-integrable, and there is some A2∈𝒜2 with μ2⁢(A2)=0 such that for x2∈X2∖A2 the function fx2:X1→ℝ¯ is μ1-integrable. Furthermore, define F1:X1→ℝ by F1⁢(x1)=∫X2fx1⁢𝑑μ2 for x1∈X1∖A1 and F1⁢(x1)=0 for x1∈A1, and define F2:X2→ℝ by F2⁢(x2)=∫X1fx2⁢𝑑μ1 for x2∈X2∖A2 and F2⁢(x2)=0 for x2∈A2. The functions F1 and F2 are μ1-integrable and μ2-integrable respectively, and

∫X1×X2f⁢d⁢(μ1⊗μ2)=∫X1F1⁢𝑑μ1=∫X2F2⁢𝑑μ2.

Suppose that (X1,𝒜1,μ1) and (X2,𝒜2,μ2) are σ-finite measure spaces. For e:X1→ℂ and f:X2→ℂ, define e⊗f:X1×X2→ℂ by

(e⊗f)⁢(x1,x2)=e⁢(x1)⁢f⁢(x2),

which is Borel measurable X1×X2→ℂ if e and f are Borel measurable. If e∈ℒ2⁢(μ1) and f∈ℒ2⁢(μ2), then by Tonelli’s theorem e⊗f:X1×X2→ℂ belongs to ℒ2⁢(μ1⊗μ2). For e,e′∈ℒ2⁢(μ1) and f,f′∈ℒ2⁢(μ2), by Fubini’s theorem,

⟨e⊗f,e′⊗f′⟩L2⁢(μ1⊗μ2)=∫X1×X2e⁢(x1)⁢f⁢(x2)⁢e′⁢(x1)⁢f′⁢(x2)¯⁢d⁢(μ1⊗μ2)⁢(x1,x2)=∫X2(∫X1e⁢(x1)⁢e′⁢(x1)¯⁢𝑑μ1⁢(x1))⁢f⁢(x2)⁢f′⁢(x2)¯⁢𝑑μ2⁢(x2)=⟨e,e′⟩L2⁢(μ1)⋅⟨f,f′⟩L2⁢(μ2).

Therefore, if E⊂ℒ2⁢(μ1) is an orthonormal set in L2⁢(μ1) and F⊂ℒ2⁢(μ2) is an orthonormal set in L2⁢(μ2), then {e⊗f:e∈E,f∈F}⊂ℒ2⁢(μ1⊗μ2) is an orthonormal set in L2⁢(μ1⊗μ2).

Theorem 3.

Let (X1,A1,μ1) and (X2,A2,μ2) be σ-finite measure spaces and suppose that L2⁢(μ1) and L2⁢(μ2) are separable. If E⊂L2⁢(μ1) is an orthonormal basis for L2⁢(μ1) and F⊂L2⁢(μ2) is an orthonormal basis for L2⁢(μ2), then Φ={e⊗f:e∈E,f∈F}⊂L2⁢(μ1⊗μ2) is an orthonormal basis for L2⁢(μ1⊗μ2).

Proof.

To show that Φ is an orthonormal basis for L2⁢(μ1⊗μ2) it suffices to prove that if h∈ℒ2⁢(μ1⊗μ2) belongs to the orthogonal complement of Φ then h∈𝒩2⁢(μ1⊗μ2). Thus, suppose that h∈ℒ2⁢(μ1⊗μ2) and that ⟨h,e⊗f⟩L2⁢(μ1⊗μ2)=0 for all e∈E,f∈F. Using Fubini’s theorem,

∫X1e⁢(x1)⁢(∫X2hx1⁢(x2)⁢f⁢(x2)⁢𝑑μ2⁢(x2))⁢𝑑μ1⁢(x1)=0.

Because this is true for all e∈E and E is dense in L2⁢(μ1), it follows that there is some Af∈𝒜1 with μ1⁢(Af)=0 such that ∫X2hx1⁢f⁢𝑑μ2=0 for x1∉Af. Let A1=⋃f∈FAf, for which μ1⁢(A1)=0. If x1∉A1 then ∫X2hx1⁢f⁢𝑑μ2=0 for all f∈F, and because F is dense in L2⁢(μ2) this implies that hx1=0 μ2-almost everywhere. Then

∫X1×X2|h|2⁢d⁢(μ1⊗μ2) =∫X1(∫X2|hx1|2⁢𝑑μ2)⁢𝑑μ1⁢(x1)
=∫X1∖A1(∫X2|hx1|2⁢𝑑μ2)⁢𝑑μ1⁢(x1)
=0,

which implies that h=0 μ1⊗μ2-almost everywhere. ∎