Cauchy sequences and Bolzano-Weierstrass
Anchor (Master): Bolzano 1817 *Rein analytischer Beweis des Lehrsatzes* (originator of the bounded-set-clustering lemma); Weierstrass 1860s Berlin lectures (published 1885); Cauchy 1821 *Cours d'analyse* (originator of the Cauchy criterion); Apostol *Calculus* Vol. 1 Ch. 10; Bourbaki *Topologie Générale* Ch. II §3
Intuition [Beginner]
A sequence is an infinite list of real numbers , one for every counting number. Two questions matter most. First: do the numbers in the list eventually settle down to a single target? Second: even if the whole list does not settle, can we pick out a sub-list of terms that does?
The first question is the question of convergence. The second is the question of subsequence existence. The pair of theorems in this unit answers both for real-number sequences and ties the two answers together.
The Cauchy criterion answers convergence from the inside. Instead of naming the target in advance, it asks whether the later terms of the list get arbitrarily close to each other. If they do — if every pair of late terms eventually fits inside a tiny window — the sequence converges, and the target it converges to is automatically a real number. No target needs to be guessed.
The Bolzano-Weierstrass theorem answers subsequence existence by a simple bounded-list rule. If every term of the list lies inside a fixed interval like , then no matter how erratically the terms jump around, some pattern of choices through the list picks out a sub-list that homes in on a single real number. Boundedness alone is enough to guarantee a convergent sub-list.
Together the two theorems say: in the real line, a list converges exactly when its later terms cluster against each other, and a bounded list always contains a sub-list that converges. These rules are what let calculus turn boundedness into limits and limits into computations.
Visual [Beginner]
The figure has two parts. The top is a number line with sequence terms placed on it, with the early terms scattered and the later terms packed tighter and tighter around a single marked point. The bottom is a bounded interval being cut in half repeatedly: at each step one half contains infinitely many terms of the sequence and is shaded; the shaded halves shrink down to a single point on the line.
The top picture is the Cauchy criterion in cartoon form: late terms huddle together. The bottom picture is the Bolzano-Weierstrass construction: a bounded sequence, no matter how it jumps, must have an infinitely populated half at every bisection step, and the shrinking shaded halves trap a single real-number target.
Worked example [Beginner]
Take the specific sequence , whose first ten terms are . Every term lies between and , so the sequence is bounded.
Pick the even-indexed terms: , , , . These are all positive and they shrink toward — that is a sub-list that converges to . Pick the odd-indexed terms: , , . These are all negative and they also shrink toward . So both natural sub-lists converge to , and Bolzano-Weierstrass is delivering one of them as the guaranteed convergent sub-list.
The full sequence happens to converge to as well, since every term has size at most and shrinks to . To see the Cauchy criterion in action, take any small window — say width . Once is at least , every term has size at most , so any two terms from index onward differ by at most . That is the Cauchy condition meeting its bound.
What this tells us: even a sequence that jumps signs forever can be both Cauchy and convergent, and a bounded sequence always serves up a convergent sub-list — here, the even-index one — for free.
Check your understanding [Beginner]
Formal definition [Intermediate+]
Fix the real line with its absolute value and the usual order from 02.02.01. A sequence in is a function , written or simply .
Definition (Cauchy sequence). A sequence in is Cauchy iff for every there exists such that implies .
Definition (bounded sequence). A sequence is bounded iff there exists such that for all .
Definition (subsequence). A subsequence of is a sequence of the form , where is a strictly increasing sequence of indices in . Formally, is a strictly increasing function .
Definition (convergence). converges to iff for every there exists such that implies . Write or .
The presentation follows Apostol [Apostol Ch. 10 §10.7] and Rudin [Rudin Ch. 3]; both organise the chapter so that the Cauchy criterion follows boundedness and precedes Bolzano-Weierstrass.
Counterexamples to common slips
- Cauchy is not the same as "consecutive differences shrink". The harmonic sequence has , yet is not Cauchy: the gap exceeds for every . The Cauchy condition controls all pairs , not just adjacent ones.
- Bolzano-Weierstrass needs boundedness. The sequence has no convergent subsequence — every subsequence is unbounded. Drop the boundedness hypothesis and the theorem fails.
- A convergent subsequence does not force convergence of the full sequence. has subsequences converging to and to ; the full sequence converges to neither.
- The rationals fail the Cauchy criterion. The sequence of rational truncations of — — is Cauchy in but has no rational limit. The Cauchy criterion's equivalence with convergence is a statement about , not about ordered fields in general.
Key theorem with proof [Intermediate+]
Theorem (Bolzano-Weierstrass). Every bounded sequence in has a convergent subsequence.
Proof. Let satisfy for every , so every term lies in the closed interval . The proof constructs a nested sequence of closed intervals together with an increasing sequence of indices such that each has length and contains together with infinitely many other terms of the sequence.
The construction is recursive. At step , set and ; the interval contains infinitely many terms of since it contains all of them. Given the interval of length together with infinitely many terms of inside it, bisect into two closed subintervals of length , namely and . The union of these two subintervals is , and each contains infinitely many or finitely many terms of . The union infinite, so at least one of the two halves contains infinitely many terms. Choose such a half and call it . Since infinitely many terms of lie in , and only finitely many have index at most , an index exists with .
The resulting nested sequence has interval lengths . By the nested-interval property — a direct consequence of the completeness axiom of 02.02.01 — the intersection contains a unique real number . For each , both and lie in , so . Given , the Archimedean property of 02.02.01 supplies an index with ; for every this forces . Hence , and is the convergent subsequence.
Theorem (Cauchy criterion). A sequence in converges iff it is Cauchy.
Proof. Suppose . Fix and choose such that implies . For , the triangle inequality gives . So is Cauchy.
Suppose is Cauchy. Three steps:
Step 1 (Cauchy implies bounded). Take in the Cauchy condition: some satisfies for . For , the triangle inequality gives . Set ; then for every .
Step 2 (a convergent subsequence exists). By Bolzano-Weierstrass applied to the bounded sequence , a subsequence converges to some .
Step 3 (the full sequence converges to the same limit). Fix . By the Cauchy condition, choose so that implies . By the subsequence convergence, choose so that implies . Choose any with — such exists because as , by strict monotonicity of . For every , . So .
Bridge. The Cauchy criterion and Bolzano-Weierstrass are two faces of one structural fact about : completeness. The LUB axiom of 02.02.01 guarantees a least upper bound for every non-empty bounded-above subset; that axiom, paired with the Archimedean property, gives the nested-interval property; the nested-interval property powers the bisection construction in Bolzano-Weierstrass; Bolzano-Weierstrass, combined with the triangle inequality, gives the Cauchy criterion. Reversing the chain, the Cauchy criterion plus Archimedean recovers the LUB axiom — given a non-empty bounded-above with an upper bound , repeated halving of an interval to track a candidate supremum produces a Cauchy sequence whose limit is exactly . The four reformulations of completeness — LUB, Cauchy convergence, nested intervals, monotone convergence — are inter-derivable over the Archimedean ordered field axioms, and each reformulation is the natural one in a different context: LUB for subsets, Cauchy for sequences with unknown limit, nested intervals for bisection arguments, monotone convergence for ordered sequences. The pair developed in this unit is the metric face of completeness, the face that survives the move from to general metric spaces in 02.01.05 and beyond. Taking these together, completeness is the structural feature that makes calculus possible: limits exist when they ought to, integrals exist for continuous integrands, fixed points exist for contractive maps, and every -argument from 02.02.01 forward draws on one of these four equivalent forms.
Exercises [Intermediate+]
Lean formalization [Intermediate+]
lean_status: partial — Mathlib provides the Cauchy criterion, the completeness of , and the Bolzano-Weierstrass theorem in the bornology framework. The Codex module gathers these under one namespace, records the textbook form of each statement, and flags the missing single-package theorem.
The full companion module at Codex.Analysis.Sequences.CauchyBolzanoWeierstrass adds the unified Cauchy-convergence equivalence and records the textbook-packaging gap.
Advanced results [Master]
The Cauchy criterion and Bolzano-Weierstrass admit generalisations along three independent axes: from to general metric spaces, from sequences to nets and filters, and from classical to constructive foundations. Each axis exposes a different aspect of completeness.
Theorem (Cauchy completeness in metric spaces). A metric space is complete iff every Cauchy sequence in converges to a point of . The space with the Euclidean metric is complete; the space with the restricted Euclidean metric is not; every Banach space is complete by the defining axiom of 02.11.04.
Theorem (Cauchy completion). Every metric space embeds isometrically as a dense subset of a complete metric space , unique up to isometry. The construction takes to be the set of equivalence classes of Cauchy sequences in under the equivalence iff , with inherited from via the diagonal. The map sends to the class of the constant sequence . [Bourbaki Ch. II §3]
The classical construction of from via Cauchy sequences (Cantor 1872) [Cauchy 1821] is the prototype: is the Cauchy completion of under the absolute-value metric. The construction is functorial — a uniformly continuous map extends uniquely to a uniformly continuous map — and reproduces up to the unique order-isomorphism guaranteed by the categoricity result of 02.02.01.
Theorem (Bolzano-Weierstrass in ). Every bounded sequence in has a convergent subsequence. The proof iterates the one-dimensional argument along each coordinate axis, extracting subsubsequences and applying Bolzano-Weierstrass to each.
Theorem (sequential compactness and compactness in metric spaces). Let be a metric space. The following are equivalent:
(i) every open cover of has a finite subcover (compactness); (ii) every sequence in has a convergent subsequence (sequential compactness); (iii) is complete and totally bounded.
The equivalence (i) (ii) for metric spaces is delicate: in general topological spaces the two notions diverge. The Stone-Čech compactification is compact but not sequentially compact (no convergent subsequence of the inclusion ); a sequentially compact non-compact space arises in the long-line construction. Metric spaces, and more generally first-countable Hausdorff spaces, are the natural setting where sequences suffice. [Munkres §28]
Theorem (Heine-Borel in ). A subset is compact iff it is closed and bounded. The forward direction uses that compact subsets of any Hausdorff space are closed and that compactness implies boundedness in any metric space. The converse uses Bolzano-Weierstrass: a closed bounded set is sequentially compact (sequences have convergent subsequences whose limits land back inside, by closedness), and sequential compactness coincides with compactness in metric spaces.
Failure of Bolzano-Weierstrass in infinite dimensions. In the Hilbert space , the closed unit ball is bounded but not compact, because the standard-basis sequence has pairwise distance and so admits no Cauchy subsequence. The failure characterises finite-dimensional normed spaces: a Banach space has compact closed unit ball iff it is finite-dimensional (Riesz's lemma plus a covering argument). The failure of Heine-Borel in is the reason the spectral theory of compact operators in 02.11.04 cannot proceed by bare boundedness arguments and requires the additional ingredient of weak compactness from the Banach-Alaoglu theorem.
Banach's contraction principle. Let be a complete metric space and a contraction with constant , meaning for every . Then has a unique fixed point $x^ \in Xx_0 \in XT^n x_0x^$.
The proof shows that is Cauchy because and the geometric series converges; completeness delivers the limit; uniqueness follows from the contraction estimate applied at the fixed point. The principle is the workhorse behind the Picard-Lindelöf theorem for ordinary differential equations and the inverse-function theorem on Banach spaces, and it uses Cauchy completeness as its only hypothesis on the underlying space.
Constructive content. In the Bishop-Bridges constructive analysis programme, the Cauchy criterion is the working definition of convergence: a real number is a Cauchy sequence of rationals equipped with a modulus of convergence — an explicit function such that whenever . Bolzano-Weierstrass in its classical form fails constructively: the bisection argument requires a choice at each step between two halves, and the disjunction "left half has infinitely many terms or right half does" is non-effective when the sequence does not provide an effective method of decision. A weaker constructive version — every Cauchy sequence with explicit modulus has a limit — is the substitute. The classical equivalence with the LUB axiom of 02.02.01 hides this dependence on the law of the excluded middle, exposed only in the constructive reformulation.
Synthesis. The Cauchy criterion and Bolzano-Weierstrass identify completeness as the structural fact that makes real analysis cohere. The LUB axiom of 02.02.01 is the order-theoretic face; the Cauchy criterion is the metric face; Bolzano-Weierstrass is the compactness face; the nested-interval property is the geometric face. Each face emphasises a different working framework. The order-theoretic face powers supremum-and-infimum manipulations and the proofs of 02.02.02 pending sup/inf properties. The metric face survives the move to general metric spaces in 02.01.05 and is the only face that generalises to infinite-dimensional Banach and Hilbert spaces in 02.11.04. The compactness face is the lynchpin of the extreme-value theorem, the existence of integrals via Riemann sums, and the proof of Heine-Cantor uniform continuity. The geometric face is the working tool in bisection proofs and in the construction of pathological examples. Drawing the four together gives the picture in which is the unique structure where every -argument lands inside the space; in which compactness on the line equals closed-plus-bounded; and in which the move to or to the long line breaks one of the four faces at a time, revealing which axiom each piece of analysis actually uses. The Cauchy completion functor universalises the construction: every metric space embeds into its completion, and the embedding is initial among isometric embeddings into complete metric spaces — a universal property that recovers as the completion of and Banach spaces as the completions of normed function spaces such as under the norms.
Full proof set [Master]
Proposition (uniqueness of limit). If and in , then .
Proof. Fix . Choose so gives both and . Triangle inequality: . Since is arbitrary, .
Proposition (Cauchy implies bounded). Every Cauchy sequence in is bounded.
Proof. As in Step 1 of the Cauchy-criterion proof: take , find with for , set .
Proposition (Bolzano-Weierstrass). Proved in §"Key theorem with proof" above.
Proposition (Cauchy criterion). Proved in §"Key theorem with proof" above.
Proposition (Bolzano-Weierstrass in ). Every bounded sequence has a convergent subsequence.
Proof. The coordinate sequences for are bounded real sequences. Apply Bolzano-Weierstrass on to the first coordinate, extracting a subsequence on which the first coordinate converges. Apply Bolzano-Weierstrass to the second coordinate along that subsequence, refining to a sub-subsequence on which both first and second coordinates converge. Iterate times. The final sub-subsequence converges in every coordinate, hence in with respect to any equivalent norm.
Proposition (Heine-Borel in ). A subset is compact iff it is closed and bounded.
Proof. Compact subsets of any Hausdorff space are closed. For boundedness, cover by open balls of growing radius ; the cover has a finite subcover, whose union is contained in for some .
Let be closed and bounded. Every sequence in is bounded, hence by Bolzano-Weierstrass in admits a convergent subsequence; the limit lies in by closedness. So is sequentially compact, and on a metric space sequential compactness equals compactness.
Proposition (Banach contraction principle). Let be complete and satisfy for some . Then has a unique fixed point.
Proof. Fix and set . Iterating, . For , the triangle inequality and the geometric series bound give
As , , so is Cauchy. By completeness, for some . The map is continuous (the contraction condition implies , a Lipschitz bound), so ; but . Hence .
Uniqueness: if and , then , forcing since .
Proposition (Cauchy completion exists and is unique). Every metric space admits a Cauchy completion , unique up to isometry over .
Proof sketch. Define to be the set of equivalence classes of Cauchy sequences in under the equivalence . Define ; the limit exists in by the Cauchy criterion applied to the sequence , since . The map sends to the class of the constant sequence. Density: every Cauchy sequence in converges in to its own equivalence class. Completeness of : a Cauchy sequence in is a Cauchy sequence of equivalence classes, and a diagonalisation produces a representing Cauchy sequence in whose class is the limit. Uniqueness: any complete metric space containing densely with the inherited metric is isometric to over by the universal property — every isometric embedding into a complete metric space extends uniquely to an isometric embedding . [Bourbaki Ch. II §3]
Connections [Master]
The Cauchy criterion is the metric specialisation of completeness used throughout 02.01.05 (metric space). The same Cauchy-sequence-equivalence-class construction that builds from builds the completion of any metric space , the spaces of Lebesgue-integrable functions from the simple-function spaces, and the Banach completion of normed vector spaces in 02.11.04. Every appearance of Cauchy completeness in the curriculum traces back to the equivalence proved here.
Bolzano-Weierstrass underwrites the compactness theorems of 02.01.02 (compact spaces) and 02.04.02 pending (continuous functions on compact intervals). The Heine-Borel theorem in — closed and bounded equals compact — depends on Bolzano-Weierstrass for the bounded-implies-sequentially-compact direction, and sequential compactness equals topological compactness on metric spaces. The extreme-value theorem on a closed bounded interval, the intermediate-value theorem via interval-bisection, and the integrability of continuous functions on in 02.04.03 pending all draw on Bolzano-Weierstrass at the structural level.
The Cauchy-Banach contraction principle in 02.11.04 uses Cauchy completeness as its only hypothesis on the ambient space. The principle proves the Picard-Lindelöf existence theorem for ordinary differential equations and the inverse-function theorem on Banach spaces; both downstream applications inherit the dependence on the equivalence of Cauchy convergence with limit existence proved in this unit.
The failure of Bolzano-Weierstrass in — the standard-basis sequence with pairwise distance — is the entry point to weak compactness, the Banach-Alaoglu theorem, and the spectral theory of compact operators in 02.11.04. The transition from finite-dimensional to infinite-dimensional analysis is precisely the transition from Heine-Borel to its failure, with weak topology and reflexive Banach spaces as the substitute machinery.
The construction of from via Cauchy sequences from 02.02.01 is the historical precursor to the Cauchy completion of an arbitrary metric space. The equivalence of the construction with the LUB axiom of 02.02.01 is what licences calculus textbooks to axiomatise rather than construct it. The Cauchy-completion functor sits parallel to the LUB-supremum operator: the first organises completeness as a universal property in the category of metric spaces, the second organises completeness as a least-upper-bound statement in the order-theoretic setting.
Historical & philosophical context [Master]
Bernard Bolzano's 1817 Rein analytischer Beweis des Lehrsatzes (Prague) [Bolzano 1817] introduced the bounded-set-clustering lemma now bearing his name, in the course of giving the first analytic proof of the intermediate value theorem. Bolzano framed the result as a tool for an existence argument: a continuous function changing sign on a bounded interval must vanish somewhere inside, because the supremum of the set where the function is negative is a candidate zero whose existence the lemma supplies. The lemma sat dormant in the German-reading mathematical community for half a century, recovered only after Weierstrass's Berlin lectures in the 1860s gave the bisection proof that became standard. The bisection argument was published in Weierstrass's Werke (1894-1895) [Weierstrass 1894].
Augustin-Louis Cauchy's Cours d'analyse of 1821 [Cauchy 1821] introduced the Cauchy criterion as a working definition of convergence — Cauchy stated that a sequence converges iff its terms eventually cluster against each other, and used the criterion freely without proving that Cauchy sequences in always have limits. Cauchy worked in the implicit setting of the "real numbers" as understood by Euler and Lagrange — a notion of magnitude rather than an axiomatised structure — so the assumption that Cauchy sequences converge was a kind of geometric postulate rather than a derivable theorem. Cantor's 1872 construction [Cantor 1872] of from via equivalence classes of Cauchy sequences is the construction that justified Cauchy's working assumption, and Dedekind's 1872 cuts gave the order-theoretic alternative.
The modern unified treatment of the two theorems in Apostol's Calculus Vol. 1 Ch. 10 [Apostol Ch. 10] and Rudin's Principles of Mathematical Analysis Ch. 3 [Rudin Ch. 3] organises them as twin metric reformulations of the LUB axiom. Bourbaki's Topologie Générale Ch. II §3 [Bourbaki Ch. II §3] generalised both to uniform spaces, identifying completeness as a uniform-structural property and the Cauchy completion as a universal construction.