Compact operators on Banach spaces
1 Introduction
In this note I prove several things about compact linear operators from one Banach space to another, especially from a Banach space to itself. Some of these may things be simpler to prove for compact operators on a Hilbert space, but since often in analysis we deal with compact operators from one Banach space to another, such as from a Sobolev space to an space, and since the proofs here are not absurdly long, I think it’s worth the extra time to prove all of this for Banach spaces. The proofs that I give are completely detailed, and one should be able to read them without using a pencil and paper. When I want to use a fact that is not obvious but that I do not wish to prove, I give a precise statement of it, and I verify that its hypotheses are satisfied.
2 Preliminaries
If and are normed spaces, let be the set of bounded linear maps . It is straightforward to check that is a normed space with the operator norm
If is a normed space and is a Banach space, one proves that is a Banach space.11 1 Walter Rudin, Functional Analysis, second ed., p. 92, Theorem 4.1. Let . If is a Banach space then so is , and it is straightforward to verify that is a Banach algebra.
To say is invertible means that there is some such that and , and we write . It follows from the open mapping theorem that if , , and , then is invertible (i.e. if a bounded linear map is bijective then its inverse is also a bounded linear map, where we use the open mapping theorem to show that the inverse is continuous).
The spectrum of is the set of all such that is not invertible. If is not injective, we say that is an eigenvalue of , and then there is some nonzero , which thus satisfies ; we call any nonzero element of an eigenvector of . The point spectrum of is the set of eigenvalues of .
We say that a subset of a topological space is precompact if its closure is compact. The Heine-Borel theorem states that a subset of a complete metric space is precompact if and only if it is totally bounded: to be totally bounded means that for every there are finitely many points such that , where is the open ball of radius and center .
If and are Banach spaces and is the open unit ball in , a linear map is said to be compact if is precompact; equivalently, if is totally bounded. Check that a linear map is compact if and only if the image of every bounded set is precompact. Thus, if we want to prove that a linear map is compact we can show that the image of the open unit ball is precompact, while if we know that a linear map is compact we can use that the image of every bounded set is precompact. It is straightforward to prove that a compact linear map is bounded. Let denote the set of compact linear maps . It does not take long to prove that is an ideal in the algebra .
3 Basic facts about compact operators
Theorem 1.
Let and be Banach spaces. If is linear, then is compact if and only if being a bounded sequence implies that there is a subsequence such that converges in .
Proof.
Suppose that is compact and let be bounded, with
Let be the closed ball in of radius and center . is bounded in , so is compact in . As , there is some convergent subsequence that converges to some .
Suppose that if is a bounded sequence in then there is a subsequence such that is convergent, let be the open unit ball in , and let be a sequence. It is a fact that a subset of a metric space is precompact if and only if every sequence has a subsequence that converges to some element in the space; this is not obvious, but at least we are only taking as given a fact about metric spaces. (What we have asserted is that a set in a metric space is precompact if and only if it is sequentially precompact.) As are in the image of , there is a subsequence such that is convergent and this implies that is precompact, and so is a compact operator. ∎
Theorem 2.
Let and be Banach spaces. If , then is separable.
Proof.
Let be the closed ball of radius in . As is a compact metric space it is separable, and hence , a subset of it, is separable too, say with dense subset . We have
and one checks that is a dense subset of the right-hand side, showing that is separable. ∎
The following theorem gathers some important results about compact operators.22 2 Walter Rudin, Functional Analysis, second ed., p. 104, Theorem 4.18.
Theorem 3.
Let and be Banach spaces.
-
•
If , is compact, and is a closed subset of , then .
-
•
is a closed subspace of .
-
•
If , is compact, and , then .
-
•
If , , and is compact, then .
Proof.
If is compact and is closed then as a closed subspace of a Banach space, is itself a Banach space. Of course is surjective, and is a Banach space so by the open mapping theorem is an open map. Let . As is an open map, is open, and hence is a neighborhood of . But because is compact and is bounded, is compact. Hence is a compact neighborhood of . As every element of has a compact neighborhood, is locally compact. But a locally compact topological vector space is finite dimensional, so .
It is straightforward to check that is linear subspace of . Let be in the closure of and let be the open unit ball in . We wish to show that is totally bounded. Let . As is in the closure of , there is some with . As is compact, its image is totally bounded, so there are finitely many , with , such that . If , then
Let . Then there is some such that , and
so , showing that is totally bounded and hence that is a compact operator.
If is compact and , let . (If is not an eigenvalue of , then .) is a closed subspace of , and hence is itself a Banach space. If then . Define by , and as is compact so is . Now we use the hypothesis that : if , then , so is surjective. We have shown that is compact and that is a closed subset of (as it is equal to ), and as a closed image of a compact operator is finite dimensional, we obtain , i.e. .
If and is compact, suppose by contradiction that . So is invertible, with . As is an ideal in the algebra , is compact. Of course is a closed subset of . But we proved that if the image of a compact linear operator is closed then that image is finite dimensional, contradicting . ∎
4 Dual spaces
If is a normed space, let , the set of bounded linear maps . is called the dual space of , and is a Banach space since is a Banach space. Define by
This is called the dual pairing of and .
The following theorem gives an expression for the norm of an element of the dual space.33 3 Walter Rudin, Functional Analysis, second ed., p. 94, Theorem 4.3 (b).
Theorem 4.
If is a normed space and is the closed unit ball in , then
Proof.
It follows from the Hahn-Banach extension theorem that if , then there is some such that and such that if then .44 4 Walter Rudin, Functional Analysis, second ed., p. 58, Theorem 3.3. That is, that there is some such that . Hence
If , then
so
∎
Let be a Banach space. For , it is apparent that is a linear map . From Theorem 4, it is bounded, with norm . Define by
It is apparent that is a linear map. By Theorem 4, if then , so is an isometry. Let be a Cauchy sequence. is an isometry, so is a Cauchy sequence, i.e. is a Cauchy sequence, and so, as is a Banach space, converges to some . Then converges to , and thus is a complete metric space. But a subset of a complete metric space is closed if and only if it is complete, so is a closed subspace of . Hence, is a Banach space and is an isometric isomorphism. A Banach space is said to be reflexive if , i.e. if every bounded linear map is of the form for some .
5 Adjoints
If and are normed spaces and , define by ; as is the composition of two bounded linear maps it is indeed a bounded linear map . is called the adjoint of . It is straightforward to check that is linear and that it satisfies, for ,
(1) |
On the other hand, suppose that is a function that satisfies (1). Let , and let . Then
This is true for all , so , and that is true for all , so . Thus is the unique function that satisfies (1), not just the unique bounded linear map that does. (That is, satisfying (1) completely determines a function.)
In the following we prove that the adjoint of a compact operator is itself a compact operator, and that if the adjoint of a bounded linear operator is compact then the original operator is compact.55 5 Walter Rudin, Functional Analysis, second ed., p. 105, Theorem 4.19. In the proof we only show that if we take any sequence in the closed unit ball then it has a subsequence such that converges. Check that it suffices merely to do this rather than showing that this happens for any bounded sequence.
Theorem 5.
If and are Banach spaces and , then is compact if and only if is compact.
Proof.
Suppose that is compact, and let , , be a sequence in the closed unit ball in .
If is a metric space with metric and is a set of functions , we say that is equicontinuous if for every there exists a such that if and then . We say that is pointwise bounded if for every there is some such that if and then . The Arzelà-Ascoli theorem66 6 Walter Rudin, Real and Complex Analysis, third ed., p. 245, Theorem 11.28. states that if is a separable metric space and is a set of functions that is equicontinuous and pointwise bounded, then for every sequence there is a subsequence that converges uniformly on every compact subset of .
Let be the closed unit ball in . As is a compact operator, is compact and therefore separable, because any compact metric space is separable. Define by
For we have
Hence for , if and then . This shows that is equicontinuous. If , then, for any ,
showing that is pointwise bounded. Therefore we can apply the Arzelà-Ascoli theorem: there is a subsequence such that converges uniformly on every compact subset of , in particular on itself and therefore on any subset of it, in particular . We are done using the Arzelà-Ascoli theorem: we used it to prove that there is a subsequence that converges uniformly on .
Let . As converges uniformly on , there is some such that if and , then . Thus, if ,
This means that is a Cauchy sequence. As is a Banach space, this sequence converges, and therefore is a compact operator.
Suppose that is compact. Therefore, by what we showed in the first half of the proof we have that is compact. If be the closed unit ball in , then is totally bounded.
We have seen that defined by , , , is an isometric isomorphism . Let be the same for , and let be the closed unit ball in . If and then
Therefore . If then , as is an isometry. Hence if then , thus
As is contained in a totally bounded set it is itself totally bounded, and as is an isometry, it follows that is totally bounded. Hence is a compact operator. ∎
6 Complemented subspaces
If is a closed subspace of a topological vector space and there exists a closed subspace of such that
we say that is complemented in and that is the direct sum of and , which we write as .
We are going to use the following lemma to prove the theorem that comes after it.77 7 Walter Rudin, Functional Analysis, second ed., p. 106, Lemma 4.21.
Lemma 6.
If is a locally convex topological vector space and is a subspace of with , then is complemented in .
In particular, a normed space is locally convex so the lemma applies to normed spaces. In the following theorem we prove that if is compact and then has closed image.88 8 Walter Rudin, Functional Analysis, second ed., p. 107, Theorem 4.23.
Theorem 7.
If is a Banach space, is compact, and , then the image of is closed.
Proof.
According to Theorem 3, , and we can then use Lemma 6: is a finite dimensional subspace of the locally convex space , so there is a closed subspace of such that .
Define by , so . It is apparent that and that is injective, and we shall prove that is closed. To show that is closed, check that it suffices to prove that is bounded below: that there is some such that if then .99 9 A common way of proving that a linear operator is invertible is by proving that it has dense image and that it is bounded below: bounded below implies injective and bounded below and dense image imply surjective.
Suppose by contradiction that for every there is some such that . So for each , let with , and put , so that and . As is compact, there is some subsequence such that converges, say to . Combining this with we get . On the one hand, , so . On the other hand, since and is closed, we get . is continuous and , so
Because is injective and , we get , contradicting . Therefore is bounded below, and hence has closed image, completing the proof. ∎
The following theorem states that the point spectrum of a compact operator is countable and bounded, and that if there is a limit point of the point spectrum it is .1010 10 Walter Rudin, Functional Analysis, second ed., p. 107, Theorem 4.24. By countable we mean bijective with a subset of the integers.
Theorem 8.
If is a Banach space, is compact, and , then there are only finitely many eigenvalues of such that .
The following theorem shows that if is compact and , then the operator is injective if and only if it is surjective.1111 11 Paul Garrett, Compact operators on Banach spaces: Fredholm-Riesz, http://www.math.umn.edu/~garrett/m/fun/fredholm-riesz.pdf This tells us that if is not an eigenvalue of , then is both injective and surjective, and hence is invertible, which means that if is not an eigenvalue of then . This is an instance of the Fredholm alternative.
Theorem 9 (Fredholm alternative).
Let be a Banach space, be compact, and . is injective if and only if it is surjective.
Proof.
Suppose that is injective and let , . If , then, as , we have
so . Thus
Certainly is a normed vector space. Define by , namely, is the restriction of to .
As is a compact operator, by Theorem 7 we get that is closed. Hence is a Banach space, being a closed subspace of a Banach space. Assume as induction hypothesis that is a closed subset of . Thus is a Banach space, and is a compact operator, as it is the restriction of the compact operator to . Therefore by Theorem 7, the image of is closed, but this image is precisely . Therefore, if then is a closed subspace of .
Suppose by contradiction that there is some . If then
As , we have . As we have supposed that is injective, any positive power of it is injective, and hence the right hand side of the above equation is not . Thus , and as was arbitrary,
However, of course , so if then strictly contains .
Riesz’s lemma states that if is a normed space, is a proper closed subspace of , and , then there is some with and .1212 12 Paul Garrett, Riesz’s lemma, http://www.math.umn.edu/~garrett/m/fun/riesz_lemma.pdf In this reference, Riesz’s lemma is stated for Banach spaces, but the proof in fact works for normed spaces with no modifications. For each , using Riesz’s lemma there is some , , such that
we proved that each is closed and that is a strictly decreasing sequence to allow us to use Riesz’s lemma.
If , then and check that , so
From this and the definition of the sequence , we get
That is, the distance between any two terms in is , which is a fixed positive constant, hence has no convergent subsequence. But , so is bounded and therefore, as is compact, the sequence has a convergent subsequence, a contradiction. Therefore is surjective.
Suppose that is surjective. One checks that if a bounded linear operator is surjective then its adjoint is injective. For and , , so . Hence . is compact so is compact. As is injective and is compact, is surjective, whence its adjoint is injective. One checks that if and is injective then is injective; this is proved using the fact that defined by is an isometric isomorphism . Using this, is injective, completing the proof. ∎
7 Compact metric spaces
In the proof of Theorem 5 we stated the Arzelà-Ascoli theorem. First we state definitions again. If is a metric space with metric and is a set of functions , we say that is equicontinuous if for all there is some such that and imply that . We say that is pointwise bounded if for all there is some such that if then . The Arzelà-Ascoli theorem states that if is a separable metric space and is equicontinuous and pointwise bounded, then every sequence in has a sequence that converges uniformly on every compact subset of .1313 13 Walter Rudin, Real and Complex Analysis, third ed., p. 245, Theorem 11.28.
We are going to use a converse of the Arzelà-Ascoli theorem in the case of a compact metric space.1414 14 John B. Conway, A Course in Functional Analysis, second ed., p. 175, Theorem 3.8. Let be a compact metric space and let be the set of continuous functions . It does not take long to prove that with the norm , is a Banach space.
Theorem 10.
Let be a compact metric space and let . is precompact in if and only if is bounded and equicontinuous.
Proof.
Suppose that is bounded and equicontinuous. To say that is bounded is to say that there is some such that if then , and this implies that is pointwise bounded. As is compact it is separable, so the Arzelà-Ascoli theorem tells us that every sequence in has a subsequence that converges on every compact subset of . To say that a sequence of functions converges uniformly on the compact subsets of is to say that the sequence converges in the norm of the Banach space , and thus if is a subset of , then to say that every sequence in has a subsequence that converges uniformly on every compact subset of is to say that is precompact in .
In the other direction, suppose that is precompact. Hence it is totally bounded in . It is straightforward to verify that is bounded. We have to show that is equicontinuous. Let . As is totally bounded, there are such that . As each is continuous and is compact, there is some such that if then . Let . If and , then, taking such that ,
showing that is equicontinuous. ∎
We now show that if is a compact metric space then the Banach space has the approximation property: every compact linear operator is the limit of a sequence of bounded finite rank operators.1515 15 John B. Conway, A Course in Functional Analysis, second ed., p. 176, Theorem 3.11.
Theorem 11.
If is a compact metric space, then is a dense subset of .
Proof.
Let , let be the closed unit ball in , and let . Because is precompact in , by Theorem 10 it is bounded and equicontinuous. Then there is some such that if and then . is compact, so there are such that . It is a fact that there is a partition of unity that is subordinate to this open covering of : there are continuous functions such that if then , and if .1616 16 John B. Conway, Functional Analysis, second ed., p. 139, Theorem 6.5. Define by
It is apparent that is linear. , so . And the image of is contained in the span of . Therefore .
If and , then for each either , in which case , or , in which case . This gives us
showing that , and as this is true for all we get . ∎