\( \definecolor{colordef}{RGB}{249,49,84} \definecolor{colorprop}{RGB}{18,102,241} \)
CommeUnJeu · L1 PCSI

Finite-dimensional vector spaces

⌚ ~147 min ▢ 18 blocks ✓ 55 exercises Prerequisites : Vector spaces
The chapter Vector spaces introduced the notions of generating family, free family, and basis in arbitrary dimension. The central idea of the present chapter is to introduce a single number --- the dimension --- that captures « how many degrees of freedom » a vector space has, and to exploit dimension counting to short-circuit many existence arguments. Once dimension is in place, three structural results follow almost mechanically: every basis of a finite-dimensional space has the same cardinal; every subspace has a supplement; the Grassmann formula relates the dimensions of \(F + G\), \(F \cap G\), \(F\), \(G\).
The chapter ends with three program-mandated outcomes about dimensions of natural solution spaces: linear homogeneous first-order ODE, linear homogeneous second-order ODE with constant coefficients, linear homogeneous recurrence of order \(2\) with constant coefficients. Their derivation lives in the relevant analysis chapters; here we only state the dimensions.
The official 2021 syllabus states: « Tout développement théorique sur les espaces de dimension infinie est hors programme. »
I Existence of finite bases
I.1 Vector spaces of finite dimension
The starting definition is short: a vector space is « of finite dimension » when it admits a finite generating family. Most of the reference vector spaces we know fit, but \(\mathbb{K}[X]\) does not. The chapter develops the theory only for finite-dimensional spaces; nothing more is said about \(\mathbb{K}[X]\) qua infinite-dimensional space.
Definition — Vector space of finite dimension
Let \(E\) be a \(\mathbb{K}\)-vector space. We say that \(E\) is of finite dimension if it admits a finite generating family. Otherwise \(E\) is said of infinite dimension.
Example
The reference vector spaces \(\mathbb{K}^n\), \(\mathcal{M}_{n,p}(\mathbb{K})\), and \(\mathbb{K}_n[X]\) are of finite dimension because their canonical bases (introduced in Vector spaces) are finite generating families: \((e_1, \ldots, e_n)\) in \(\mathbb{K}^n\), \((E_{ij})_{1 \le i \le n,\, 1 \le j \le p}\) in \(\mathcal{M}_{n,p}(\mathbb{K})\), \((1, X, X^2, \ldots, X^n)\) in \(\mathbb{K}_n[X]\).
Example
The space \(\mathbb{K}[X]\) of all polynomials with coefficients in \(\mathbb{K}\) is of infinite dimension.

We show that no finite family generates \(\mathbb{K}[X]\). Let \((P_1, \ldots, P_r)\) be a finite family of polynomials of \(\mathbb{K}[X]\). If all \(P_i = 0\), then \(\mathrm{Vect}(P_1, \ldots, P_r) = \{0\} \ne \mathbb{K}[X]\). Otherwise set \(m := \max\{\deg P_i : 1 \le i \le r,\, P_i \ne 0\} \in \mathbb{N}\). Every linear combination of \(P_1, \ldots, P_r\) has degree at most \(m\) (linear combinations of non-zero \(P_i\) have degree \(\le m\); the zero \(P_i\) contribute \(0\)), so \(\mathrm{Vect}(P_1, \ldots, P_r) \subset \mathbb{K}_m[X]\). But \(X^{m+1} \in \mathbb{K}[X] \setminus \mathbb{K}_m[X]\), hence \(\mathrm{Vect}(P_1, \ldots, P_r) \ne \mathbb{K}[X]\): the family does not generate \(\mathbb{K}[X]\). No finite family generates \(\mathbb{K}[X]\), so \(\mathbb{K}[X]\) is of infinite dimension.

Warning --- no theory of infinite dimension
The example \(\mathbb{K}[X]\) is included only to distinguish finite-dimensional spaces from infinite-dimensional ones; no general theory of infinite-dimensional spaces is developed here --- any theoretical development on infinite-dimensional spaces is hors programme at this level.
Skills to practice
  • Recognizing a finite-dimensional space
I.2 Maximal free family in a finitely generated space
The bridge from « \(E\) has a finite generating family » to « every basis of \(E\) has a finite cardinal » is the following bounding result: in an \(E\) that has a generating family of \(n\) elements, no free family contains more than \(n\) vectors. It is the technical engine of the entire theory of dimension.
Theorem — Maximal number of linearly independent vectors
Let \(E\) be a \(\mathbb{K}\)-vector space generated by \(n\) elements. Then every free family of \(E\) has at most \(n\) elements. Equivalently: any family of \(n+1\) or more vectors of \(E\) is dependent.

Let \(X = (x_1, \ldots, x_n)\) generate \(E\) and let \(Y\) be a free family of \(E\). Suppose, for contradiction, that \(Y\) has at least \(n + 1\) elements. We prove by induction on \(k \in \llbracket 0, n \rrbracket\) the property $$ \mathcal{P}(k) : \ E \text{ is generated by a family of } n \text{ vectors: the first } n - k \text{ from } X, \text{ the last } k \text{ from } Y. $$
  • Initialization. For \(k = 0\): \(E\) is generated by \((x_1, \ldots, x_n)\), the original \(X\). This is the hypothesis.
  • Heredity. Suppose \(\mathcal{P}(k)\) holds for some \(k \in \llbracket 0, n - 1 \rrbracket\). So \(E\) is generated by \((x_1, \ldots, x_{n-k}, y_1, \ldots, y_k)\) for some labelling. As \(Y\) has at least \(n + 1\) elements, pick \(y_{k+1} \in Y\) distinct from \(y_1, \ldots, y_k\). By the induction hypothesis \(y_{k+1}\) is a linear combination of \((x_1, \ldots, x_{n-k}, y_1, \ldots, y_k)\): $$ y_{k+1} = \lambda_1 x_1 + \cdots + \lambda_{n-k} x_{n-k} + \mu_1 y_1 + \cdots + \mu_k y_k. $$ The coefficients \(\lambda_1, \ldots, \lambda_{n-k}\) are not all zero, otherwise \(y_{k+1}\) would be a linear combination of \(y_1, \ldots, y_k\) and the subfamily \((y_1, \ldots, y_{k+1})\) of \(Y\) would be dependent, contradicting freeness of \(Y\). Pick an index \(i\) with \(\lambda_i \ne 0\); up to relabelling, \(\lambda_{n-k} \ne 0\). Solve for \(x_{n-k}\) as a linear combination of \((x_1, \ldots, x_{n-k-1}, y_1, \ldots, y_{k+1})\). Hence \(E\) is generated by \((x_1, \ldots, x_{n-k-1}, y_1, \ldots, y_{k+1})\): \(\mathcal{P}(k + 1)\) holds.
At \(k = n\): \(E\) is generated by \((y_1, \ldots, y_n)\). Then \(y_{n+1} \in E\) is a linear combination of \((y_1, \ldots, y_n)\), so the subfamily \((y_1, \ldots, y_{n+1})\) of \(Y\) is dependent --- contradicting freeness of \(Y\). Hence \(Y\) cannot have more than \(n\) elements.

Example
In \(\mathbb{R}^2\), which is generated by the canonical basis \(\bigl((1, 0), (0, 1)\bigr)\) of cardinal \(2\), no \(3\) vectors are free: any family of three or more vectors of \(\mathbb{R}^2\) is dependent.
Skills to practice
  • Using the max-free bound
I.3 Theorem of the incomplete basis and theorem of the extracted basis
The program mandates two existence theorems: every free family can be completed into a basis, every generating family contains a basis (which can be extracted). Both follow from one constructive algorithm.
Theorem — Algorithm of the incomplete basis
Let \(E\) be a \(\mathbb{K}\)-vector space of finite dimension and let \((x_1, \ldots, x_n)\) generate \(E\), the first \(p\) vectors forming a free family. Then \(E\) admits a basis consisting of \(x_1, \ldots, x_p\) and some of \(x_{p+1}, \ldots, x_n\).

Initialize the family \(\mathcal{B} := (x_1, \ldots, x_p)\) --- free by hypothesis. Loop over \(k\) from \(p + 1\) to \(n\):
  • if the family \(\mathcal{B}\) extended by \(x_k\) is still free, replace \(\mathcal{B}\) by this extended family --- the new \(\mathcal{B}\) is again free;
  • if not, leave \(\mathcal{B}\) unchanged and continue the loop.
At each step \(\mathcal{B}\) is free, so the final \(\mathcal{B}\) is free. It remains to show that the final \(\mathcal{B}\) generates \(E\). Since \((x_1, \ldots, x_n)\) generates \(E\), it suffices to show that every \(x_k\) is a linear combination of vectors of \(\mathcal{B}\):
  • if \(x_k\) was added to \(\mathcal{B}\) during the loop, it is in \(\mathcal{B}\), so a (trivial) linear combination;
  • if \(x_k\) was not added, this is because \(\mathcal{B}\) extended by \(x_k\) was dependent at that step; by the freeness-extension proposition (chapter Vector spaces, Proposition « Properties of free and dependent families »), \(x_k\) is a linear combination of \(\mathcal{B}\) at that step, hence of the final \(\mathcal{B}\).
Hence the final \(\mathcal{B}\) is free and generating: a basis of \(E\) containing \(x_1, \ldots, x_p\) and a subfamily of \(x_{p+1}, \ldots, x_n\).

Example
Find a basis of \(F\) in \(\mathbb{R}^3\), where $$F = \mathrm{Vect}\bigl((1, -5, 7),\ (2, 6, 8),\ (3, 1, 15),\ (1, 11, 1)\bigr).$$

Apply the algorithm of the incomplete basis to the four generators.
  • \((1, -5, 7)\) is non-zero: \(\mathcal{B} = \bigl((1, -5, 7)\bigr)\) is free.
  • Extend by \((2, 6, 8)\). Is \(\bigl((1, -5, 7), (2, 6, 8)\bigr)\) free? \(\lambda (1, -5, 7) + \mu (2, 6, 8) = (0, 0, 0)\) reads \(\lambda + 2 \mu = 0\), \(-5 \lambda + 6 \mu = 0\), \(7 \lambda + 8 \mu = 0\); the first two give \(\lambda = -2 \mu\) then \(10 \mu + 6 \mu = 16 \mu = 0\), so \(\mu = 0\), \(\lambda = 0\). Free. Keep.
  • Extend by \((3, 1, 15)\). Note \((3, 1, 15) = (1, -5, 7) + (2, 6, 8)\) --- yes: \((1+2, -5+6, 7+8) = (3, 1, 15)\). So the extended family is dependent. Drop \((3, 1, 15)\).
  • Extend by \((1, 11, 1)\). Note \((1, 11, 1) = (2, 6, 8) - (1, -5, 7)\) --- yes: \((2-1, 6+5, 8-7) = (1, 11, 1)\). Dependent. Drop.
The final \(\mathcal{B} = \bigl((1, -5, 7), (2, 6, 8)\bigr)\) is a basis of \(F\).

Method
To find a basis of a subspace \(F\) given as a \(\mathrm{Vect}\): apply the algorithm of the incomplete basis to the given generators. Keep generators one by one; drop those that are linear combinations of the kept ones.
Geometric picture --- base incomplète in \(\mathbb{R}^3\)
A free vector \(v_1\) in \(\mathbb{R}^3\) spans a line. Adding \(v_2\) not on that line gives a free pair spanning a plane. Adding \(v_3\) not in that plane completes to a basis of \(\mathbb{R}^3\). A candidate vector in the plane (e.g. \(v_1 + v_2\)) is rejected by the algorithm as dependent.
The same algorithm yields three corollaries: extract a basis from a generating family (start with the empty free family); complete a free family into a basis (start with the free family and use any generating family); existence of a finite basis (special case of either corollary).
Theorem — Extracted basis and incomplete basis
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space.
  1. Theorem of the extracted basis. Every finite generating family of \(E\) contains a basis of \(E\) (obtained by dropping the « redundant » vectors).
  2. Theorem of the incomplete basis. Every free family of \(E\) can be completed into a basis of \(E\) by adding vectors from any chosen finite generating family.
In particular, \(E\) admits a finite basis.

  • Base extraite. Apply the algorithm with \(p = 0\): \(\mathcal{B}\) starts as the empty family (free), the loop processes all \(n\) generators; the final \(\mathcal{B}\) is a basis contained in the original generating family.
  • Base incomplète. Let \(\mathcal{L} = (\ell_1, \ldots, \ell_p)\) be free in \(E\). Pick a finite generating family \((g_1, \ldots, g_q)\) of \(E\). The concatenated family \((\ell_1, \ldots, \ell_p, g_1, \ldots, g_q)\) generates \(E\) (it contains a generating family) and its first \(p\) vectors are free. Apply the algorithm: the resulting basis contains \(\ell_1, \ldots, \ell_p\) and a subfamily of \(g_1, \ldots, g_q\).
  • Existence of a finite basis. A consequence of either: extract a basis from any generating family of \(E\).

Skills to practice
  • Applying the incomplete-basis algorithm
  • Extracting a basis from a generating family
II Dimension and rank
II.1 Dimension of a finite-dimensional vector space
The fundamental observation: all bases of a finite-dimensional space have the same cardinal. This unique cardinal is the dimension. The fact is not obvious from the definition of a basis --- a basis is a free generating family, but a priori different bases could have different sizes. The maximal-free theorem closes that loop.
Theorem — Dimension theorem --- all bases have the same cardinal
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space. All bases of \(E\) are finite and have the same cardinal.

\(E\) has a finite basis by the existence-of-a-finite-basis theorem. Let \(\mathcal{B}\) and \(\mathcal{B}'\) be two bases of \(E\), of respective cardinals \(n\) and \(n'\). As \(\mathcal{B}\) generates \(E\) and \(\mathcal{B}'\) is free, the maximal-free theorem gives \(n' \le n\). By symmetry, \(n \le n'\). Hence \(n = n'\): all bases have the same cardinal.

Definition — Dimension
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space. The common cardinal of all bases of \(E\) is called the dimension of \(E\) and is denoted \(\dim E\) (or \(\dim_\mathbb{K} E\) if the field needs to be specified).
Convention --- empty family and the zero space
By convention, the empty family is the unique basis of \(\{0_E\}\) --- it is free by convention and generates \(\{0_E\}\). Hence \(\dim \{0_E\} = 0\). If \(\dim E = 1\), we call \(E\) a (vector) line. If \(\dim E = 2\), a (vector) plane.
Example
The zero space \(\{0_E\}\) has dimension \(0\).
Example
Classical reference dimensions: $$ \dim \mathbb{K}^n = n, \qquad \dim \mathcal{M}_{n,p}(\mathbb{K}) = np, \qquad \dim \mathbb{K}_n[X] = n + 1. $$ The cardinals of the canonical bases \((e_1, \ldots, e_n)\), \((E_{ij})\), \((1, X, \ldots, X^n)\) give the values directly.
Example
Assume \(\mathbb{K} \in \{\mathbb{R}, \mathbb{C}\}\) (more generally, \(\mathrm{char}\,\mathbb{K} \ne 2\), so that the diagonal entries of a skew-symmetric matrix vanish). The subspaces \(\mathcal{T}_n(\mathbb{K})\) of upper-triangular matrices, \(\mathcal{S}_n(\mathbb{K})\) of symmetric matrices, and \(\mathcal{A}_n(\mathbb{K})\) of skew-symmetric matrices in \(\mathcal{M}_n(\mathbb{K})\) have dimensions $$ \dim \mathcal{T}_n(\mathbb{K}) = \dim \mathcal{S}_n(\mathbb{K}) = \tfrac{n(n+1)}{2}, \qquad \dim \mathcal{A}_n(\mathbb{K}) = \tfrac{n(n-1)}{2}. $$

  • \(\mathcal{T}_n(\mathbb{K})\). The family \((E_{ij})_{1 \le i \le j \le n}\) of canonical matrices with a single \(1\) at upper-triangular position is generating (every upper-triangular matrix is the sum of its non-zero entries times \(E_{ij}\)) and free (subfamily of the canonical basis of \(\mathcal{M}_n(\mathbb{K})\)). Cardinal: \(1 + 2 + \cdots + n = \tfrac{n(n+1)}{2}\).
  • \(\mathcal{S}_n(\mathbb{K})\). Decompose a symmetric matrix \(M = (m_{ij})\) as $$ M = \sum_{i=1}^n m_{ii} E_{ii} + \sum_{1 \le i < j \le n} m_{ij} (E_{ij} + E_{ji}). $$ The family \(\bigl(E_{kk}\bigr)_{1 \le k \le n} \cup \bigl(E_{ij} + E_{ji}\bigr)_{1 \le i < j \le n}\) is generating (above expansion) and free (each generator's support is disjoint or distinct). Cardinal: \(n + \tfrac{n(n-1)}{2} = \tfrac{n(n+1)}{2}\).
  • \(\mathcal{A}_n(\mathbb{K})\). Same construction with \(E_{ij} - E_{ji}\) for \(1 \le i < j \le n\) (diagonal entries vanish in a skew-symmetric matrix). Cardinal: \(\tfrac{n(n-1)}{2}\).

Reference dimensions to remember
A summary of the dimensions encountered so far (\(n, p \ge 1\); for \(\mathcal{S}_n\) and \(\mathcal{A}_n\), \(\mathbb{K} \in \{\mathbb{R}, \mathbb{C}\}\)): $$ \begin{array}{l|c} \text{Space} & \text{Dimension} \\ \hline \{0_E\} & 0 \\ \mathbb{K} & 1 \\ \mathbb{K}^n & n \\ \mathbb{K}_n[X] & n + 1 \\ \mathcal{M}_{n,p}(\mathbb{K}) & np \\ \mathcal{T}_n(\mathbb{K}) & \tfrac{n(n+1)}{2} \\ \mathcal{S}_n(\mathbb{K}) & \tfrac{n(n+1)}{2} \\ \mathcal{A}_n(\mathbb{K}) & \tfrac{n(n-1)}{2} \end{array} $$
Skills to practice
  • Computing the dimension of a space
II.2 Cardinal of free and generating families in dimension \(n\)
Dimension constrains the size of free and generating families: in an \(n\)-dimensional space, free families have at most \(n\) elements and generating ones have at least \(n\). This « pinches » bases at exactly \(n\) vectors and gives a powerful shortcut: in dimension \(n\), a family of exactly \(n\) vectors is a basis as soon as it is free OR generating --- half the work.
Proposition — Cardinal of free and generating families
Let \(E\) be a \(\mathbb{K}\)-vector space of dimension \(n\). Then:
  1. every free family of \(E\) has at most \(n\) elements;
  2. every generating family of \(E\) has at least \(n\) elements.

  • Free \(\le n\). \(E\) has a basis \(\mathcal{B}\) of cardinal \(n\) which generates \(E\). By the maximal-free theorem, every free family has at most \(n\) elements.
  • Generating \(\ge n\). Let \(\mathcal{G}\) be a finite generating family of \(E\). By the « base extraite » theorem, \(\mathcal{G}\) contains a basis of \(E\), which has cardinal \(n\). Hence \(\#\mathcal{G} \ge n\). (If \(\mathcal{G}\) is infinite, it has \(\ge n\) elements a fortiori.)

Proposition — Characterisation of bases in dimension \(n\)
Let \(E\) be a \(\mathbb{K}\)-vector space of dimension \(n\) and let \(\mathcal{F}\) be a family of exactly \(n\) vectors of \(E\). The following three assertions are equivalent:
  1. \(\mathcal{F}\) is a basis of \(E\);
  2. \(\mathcal{F}\) is free;
  3. \(\mathcal{F}\) is generating.

\((1) \Rightarrow (2)\) and \((1) \Rightarrow (3)\) are by definition of « basis ». We prove \((2) \Rightarrow (1)\) and \((3) \Rightarrow (1)\).
  • \((2) \Rightarrow (1)\). Suppose \(\mathcal{F}\) is free of cardinal \(n\). By the « base incomplète » theorem, \(\mathcal{F}\) can be completed into a basis of \(E\). By the cardinal bound, this basis has cardinal \(n\). So no vectors were added: \(\mathcal{F}\) is already a basis.
  • \((3) \Rightarrow (1)\). Suppose \(\mathcal{F}\) is generating of cardinal \(n\). By the « base extraite » theorem, one can extract a basis from \(\mathcal{F}\). By the cardinal bound, this basis has cardinal \(n\). So no vectors were dropped: \(\mathcal{F}\) is already a basis.

Method
In dimension \(n\), to show that a family of exactly \(n\) vectors is a basis, check only one: free OR generating. The other follows by the basis characterisation in dimension \(n\) --- half the work.
Example
Show that \(\mathcal{F} = \bigl((0, 1, 2), (1, 2, 0), (2, 0, 1)\bigr)\) is a basis of \(\mathbb{R}^3\).

\(\mathcal{F}\) has \(3\) vectors in \(\mathbb{R}^3\) (dim \(3\)). By the « half-the-work » method, check only freeness: \(\lambda (0, 1, 2) + \mu (1, 2, 0) + \nu (2, 0, 1) = (0, 0, 0)\) reads $$ \begin{cases} \mu + 2 \nu = 0, \\ \lambda + 2 \mu = 0, \\ 2 \lambda + \nu = 0. \end{cases} $$ From (1): \(\mu = -2 \nu\). From (2): \(\lambda = -2 \mu = 4 \nu\). From (3): \(2 \cdot 4 \nu + \nu = 9 \nu = 0\), so \(\nu = 0\), then \(\mu = 0\), then \(\lambda = 0\). Free of cardinal \(3 = \dim \mathbb{R}^3\), so a basis (basis characterisation in dimension \(n\)).

Example
Show that \(\mathcal{F} = \bigl(X^2 + 3 X + 5, 2 X^2 + X, X^2\bigr)\) is a basis of \(\mathbb{R}_2[X]\).

\(\mathcal{F}\) has \(3\) polynomials in \(\mathbb{R}_2[X]\) (dim \(3\)). By the « half-the-work » method, check freeness. Suppose $$ \lambda (X^2 + 3 X + 5) + \mu (2 X^2 + X) + \nu X^2 = 0. $$ Identifying coefficients:
  • constant: \(5 \lambda = 0\), so \(\lambda = 0\);
  • coefficient of \(X\): \(3 \lambda + \mu = 0\), with \(\lambda = 0\) gives \(\mu = 0\);
  • coefficient of \(X^2\): \(\lambda + 2 \mu + \nu = 0\), with \(\lambda = \mu = 0\) gives \(\nu = 0\).
Free of cardinal \(3 = \dim \mathbb{R}_2[X]\), so a basis. Note: the three polynomials all have degree \(2\), so this is NOT a staggered-degree family in the sense of Vector spaces; the trick that worked is to read the lowest non-zero coefficient (the constant of the first polynomial), which forces \(\lambda = 0\) first, then propagates upwards.

Warning --- the exact-cardinal hypothesis matters
The basis characterisation in dimension \(n\) requires the family to have exactly \(\dim E\) vectors. A free family of \(2\) vectors in \(\mathbb{R}^3\) is generally NOT a basis (it generates a plane, not the whole space). A generating family of \(4\) vectors in \(\mathbb{R}^3\) is generally NOT free (it has more vectors than the dimension). Outside the cardinal-equals-dim case, free \(\nLeftrightarrow\) generating \(\nLeftrightarrow\) basis.
Skills to practice
  • Showing a family is a basis by counting
  • Cardinality traps
II.3 Dimension of a product
The dimension of a product is the sum of the dimensions --- a small but useful result.
Proposition — Dimension of a product
Let \(E\) and \(F\) be two finite-dimensional \(\mathbb{K}\)-vector spaces. Then \(E \times F\) is of finite dimension and $$ \textcolor{colorprop}{\dim(E \times F) = \dim E + \dim F}. $$ The result extends to a finite product of finite-dimensional spaces.

Let \((e_1, \ldots, e_m)\) be a basis of \(E\) and \((f_1, \ldots, f_n)\) a basis of \(F\). We show that the concatenated family $$ \mathcal{B} := \bigl((e_1, 0_F), \ldots, (e_m, 0_F), (0_E, f_1), \ldots, (0_E, f_n)\bigr) $$ is a basis of \(E \times F\).
  • Generating. Every \((x, y) \in E \times F\) writes \(x = \sum_{i=1}^m x_i e_i\) and \(y = \sum_{j=1}^n y_j f_j\), so $$ (x, y) = \sum_{i=1}^m x_i (e_i, 0_F) + \sum_{j=1}^n y_j (0_E, f_j) \in \mathrm{Vect}(\mathcal{B}). $$
  • Free. Suppose \(\sum_{i=1}^m \lambda_i (e_i, 0_F) + \sum_{j=1}^n \mu_j (0_E, f_j) = (0_E, 0_F)\). Reading the two coordinates separately: \(\sum \lambda_i e_i = 0_E\) and \(\sum \mu_j f_j = 0_F\). By freeness of each basis, all \(\lambda_i = 0\) and all \(\mu_j = 0\).
So \(\mathcal{B}\) is a basis of \(E \times F\), of cardinal \(m + n = \dim E + \dim F\).

Skills to practice
  • Computing the dimension of a product
II.4 Rank of a finite family of vectors
The rank of a family is the dimension of the subspace it generates. It measures « how many genuinely independent vectors » the family contains.
Definition — Rank of a finite family
Let \(E\) be a \(\mathbb{K}\)-vector space (not necessarily of finite dimension) and \(x_1, \ldots, x_n \in E\). The rank of the family \((x_1, \ldots, x_n)\), denoted \(\mathrm{rg}(x_1, \ldots, x_n)\), is the dimension of the subspace \(\mathrm{Vect}(x_1, \ldots, x_n)\): $$ \mathrm{rg}(x_1, \ldots, x_n) := \dim \mathrm{Vect}(x_1, \ldots, x_n). $$ The subspace \(\mathrm{Vect}(x_1, \ldots, x_n)\) is finite-dimensional (it is generated by \(n\) vectors), so the dimension is well-defined.
Proposition — Rank bound and equality case
For any \(x_1, \ldots, x_n \in E\): $$ \textcolor{colorprop}{\mathrm{rg}(x_1, \ldots, x_n) \le n}, \quad \text{with equality if and only if } (x_1, \ldots, x_n) \text{ is free}. $$

The family \((x_1, \ldots, x_n)\) generates \(\mathrm{Vect}(x_1, \ldots, x_n)\). By the cardinal bound applied to this subspace, \(\dim \mathrm{Vect}(x_1, \ldots, x_n) \le n\). Equality case: if the family is free, then it is a basis of \(\mathrm{Vect}(x_1, \ldots, x_n)\) (free + generating in its own span), so \(\dim = n\). Conversely if \(\dim \mathrm{Vect}(x_1, \ldots, x_n) = n\), then by the basis characterisation in dimension \(n\) applied in \(\mathrm{Vect}(x_1, \ldots, x_n)\) (dim \(n\) with a generating family of cardinal \(n\)), the family is a basis, hence free.

Example
Sample ranks: $$ \mathrm{rg}(1, X, X^2, X^3) = 4, \quad \mathrm{rg}(X, 2X, 3X) = 1, \quad \mathrm{rg}\bigl((1, 1, 0), (0, 0, 1)\bigr) = 2. $$ The third family is free in \(\mathbb{R}^3\), so its rank equals its cardinal \(2\).
Method
To compute \(\mathrm{rg}(x_1, \ldots, x_n)\): apply the algorithm of the incomplete basis to the family viewed as a generating set of \(\mathrm{Vect}(x_1, \ldots, x_n)\). The cardinal of the extracted basis is the rank.
Proposition — Rank invariance under adding/removing redundant vectors
The rank of a family is unchanged if one of the following operations is performed:
  1. remove a vector that is a linear combination of the others;
  2. add a vector already in \(\mathrm{Vect}\) of the family.

Both operations leave \(\mathrm{Vect}\) of the family unchanged, hence the dimension --- which is the rank --- unchanged.

Example
\(\mathrm{rg}\bigl((1, 1, 0), (0, 0, 1), (1, 1, 1)\bigr) = 2\): the vector \((1, 1, 1) = (1, 1, 0) + (0, 0, 1)\) is redundant, so removing it leaves \(\bigl((1, 1, 0), (0, 0, 1)\bigr)\), which is free of cardinal \(2\), hence of rank \(2\).
Skills to practice
  • Computing the rank of a family
III Subspaces and dimension
III.1 Dimension of a subspace
A subspace of a finite-dimensional space is itself finite-dimensional, with no more degrees of freedom. The equality case \(\dim F = \dim E\) forces \(F = E\) --- a powerful shortcut for proving that a subspace fills its ambient space.
Theorem — Dimension of a subspace
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F\) a subspace of \(E\). Then \(F\) is of finite dimension and $$ \textcolor{colorprop}{\dim F \le \dim E}, \quad \text{with equality if and only if } F = E. $$

Set \(n := \dim E\). Consider the set $$ \mathcal{N} := \{k \in \mathbb{N} : F \text{ contains a free family of cardinal } k\}. $$ \(\mathcal{N}\) is non-empty (it contains \(0\), the empty family) and bounded above by \(n\) (any free family of \(F\) is free in \(E\), hence has cardinal \(\le n\) by the cardinal bound). Let \(r := \max \mathcal{N} \le n\). Pick a free family \(\mathcal{L} = (\ell_1, \ldots, \ell_r)\) of \(F\) realising this maximum. We claim \(\mathcal{L}\) is a basis of \(F\). Freeness is by construction. For generating: take \(x \in F\). The extended family \((\ell_1, \ldots, \ell_r, x)\) has cardinal \(r + 1 > r\), so it is not in \(\mathcal{N}\) --- it is dependent. By the freeness-extension proposition (chapter Vector spaces), \(x\) is a linear combination of \(\mathcal{L}\). Hence \(\mathcal{L}\) generates \(F\). So \(F\) has a finite basis of cardinal \(r\), hence \(F\) is of finite dimension with \(\dim F = r \le n = \dim E\). Equality case. If \(\dim F = n\): \(\mathcal{L}\) is a free family of \(E\) of cardinal \(n = \dim E\), hence a basis of \(E\) by the basis characterisation in dimension \(n\). So \(\mathrm{Vect}(\mathcal{L}) = E\). But \(\mathrm{Vect}(\mathcal{L}) = F\) (basis of \(F\)). Hence \(F = E\). Conversely, \(F = E\) trivially gives \(\dim F = \dim E\).

Method
To prove \(F = E\) when \(F\) is known to be a subspace of \(E\) of finite dimension: check \(\dim F = \dim E\). (Bypasses the direct inclusion proof \(E \subset F\).)
Example
Set \(F := \{P \in \mathbb{R}_3[X] : P(0) = 0\}\). Compare \(F\) to \(\mathbb{R}_3[X]\).

\(F\) is a subspace of \(\mathbb{R}_3[X]\) (kernel of \(P \mapsto P(0)\)). A polynomial \(P = a_0 + a_1 X + a_2 X^2 + a_3 X^3\) lies in \(F\) iff \(a_0 = 0\), so \(F = \mathrm{Vect}(X, X^2, X^3)\) with \((X, X^2, X^3)\) free (staggered degree). Hence \(\dim F = 3\). Since \(\dim \mathbb{R}_3[X] = 4 > 3\), by the subspace-dimension theorem the inequality \(\dim F < \dim \mathbb{R}_3[X]\) implies \(F \subsetneq \mathbb{R}_3[X]\) (strict).

Skills to practice
  • Comparing subspace dimensions
III.2 Grassmann formula
The Grassmann formula is the central dimension-counting result for sums of subspaces. It quantifies how much « overlap » two subspaces share via their intersection.
Theorem — Grassmann formula
Let \(E\) be a \(\mathbb{K}\)-vector space and \(F, G\) two finite-dimensional subspaces of \(E\) (\(E\) itself need not be finite-dimensional). Then \(F + G\) is of finite dimension and $$ \textcolor{colorprop}{\dim(F + G) = \dim F + \dim G - \dim(F \cap G)}. $$

Set \(r := \dim(F \cap G)\). The subspace \(F \cap G\) is finite-dimensional (subspace of \(F\) which is finite-dimensional, by the subspace-dimension theorem). Take a basis \((e_1, \ldots, e_r)\) of \(F \cap G\). Step 1 --- complete the basis of \(F \cap G\) to bases of \(F\) and \(G\). The family \((e_1, \ldots, e_r)\) is free in \(F\). By the « base incomplète » theorem applied in \(F\), complete to a basis \((e_1, \ldots, e_r, f_1, \ldots, f_p)\) of \(F\), where \(p = \dim F - r\). Similarly, complete to a basis \((e_1, \ldots, e_r, g_1, \ldots, g_q)\) of \(G\), where \(q = \dim G - r\). Step 2 --- \(F + G\) is generated by the concatenated family. Set \(\mathcal{C} := (e_1, \ldots, e_r, f_1, \ldots, f_p, g_1, \ldots, g_q)\). Every \(f + g \in F + G\) writes as a combination of vectors of bases of \(F\) and \(G\) (and combinations of \(\mathcal{C}\)). So \(F + G \subset \mathrm{Vect}(\mathcal{C})\). Conversely \(\mathcal{C} \subset F \cup G \subset F + G\), so \(\mathrm{Vect}(\mathcal{C}) \subset F + G\). Hence \(F + G = \mathrm{Vect}(\mathcal{C})\). Step 3 --- the family \(\mathcal{C}\) is free. Suppose $$ \sum_{i=1}^r \lambda_i e_i + \sum_{j=1}^p \mu_j f_j + \sum_{k=1}^q \nu_k g_k = 0_E. $$ Set \(v := \sum_{i=1}^r \lambda_i e_i + \sum_{j=1}^p \mu_j f_j \in F\) and \(w := -\sum_{k=1}^q \nu_k g_k \in G\). The relation reads \(v = w\), so \(v \in F \cap G\). Then \(v = \sum_{i=1}^r \alpha_i e_i\) for some \(\alpha_i\). Using freeness of the basis \((e_1, \ldots, e_r, f_1, \ldots, f_p)\) of \(F\): $$ \sum_{i=1}^r \alpha_i e_i = \sum_{i=1}^r \lambda_i e_i + \sum_{j=1}^p \mu_j f_j, $$ gives \(\mu_j = 0\) for all \(j\) and \(\alpha_i = \lambda_i\) for all \(i\). So on the one hand \(w = v = \sum_{i=1}^r \lambda_i e_i\), and on the other \(w = -\sum_{k=1}^q \nu_k g_k\), hence \(\sum_{i=1}^r \lambda_i e_i + \sum_{k=1}^q \nu_k g_k = 0_E\). By freeness of the basis \((e_1, \ldots, e_r, g_1, \ldots, g_q)\) of \(G\), all \(\lambda_i = 0\) and all \(\nu_k = 0\). Hence all coefficients vanish: \(\mathcal{C}\) is free. Step 4 --- count. \(\mathcal{C}\) is a basis of \(F + G\) of cardinal \(r + p + q\). Therefore \(F + G\) is of finite dimension and $$ \dim(F + G) = r + p + q = r + (\dim F - r) + (\dim G - r) = \dim F + \dim G - r = \dim F + \dim G - \dim(F \cap G). $$

Geometric picture --- Grassmann in three dimensions
Two planes \(F\) and \(G\) of \(\mathbb{R}^3\) intersect in a line \(F \cap G\); their sum \(F + G\) is the whole space. Grassmann: \(\dim(F+G) = 2 + 2 - 1 = 3\).
Example
In \(\mathbb{R}^4\), set $$F = \mathrm{Vect}\bigl((1, 0, 0, 1),\ (0, 1, 1, 0)\bigr) \quad \text{and} \quad G = \mathrm{Vect}\bigl((1, 1, 1, 1),\ (1, 0, 1, 0)\bigr).$$ Determine \(\dim(F + G)\) and \(\dim(F \cap G)\).

Each generating family is free (quick check), so \(\dim F = \dim G = 2\). Compute \(\dim(F + G)\): $$F + G = \mathrm{Vect}\bigl((1,0,0,1),\ (0,1,1,0),\ (1,1,1,1),\ (1,0,1,0)\bigr).$$ Check freeness of the four vectors: note \((1, 1, 1, 1) = (1, 0, 0, 1) + (0, 1, 1, 0)\), so \((1, 1, 1, 1)\) is redundant. The three vectors \((1, 0, 0, 1), (0, 1, 1, 0), (1, 0, 1, 0)\) are free (check by linear system). So \(\dim(F + G) = 3\). By Grassmann: $$ \dim(F \cap G) = \dim F + \dim G - \dim(F + G) = 2 + 2 - 3 = 1. $$

Method
Reading Grassmann two ways: from \(\dim F\), \(\dim G\), \(\dim(F+G)\), deduce \(\dim(F \cap G)\) by subtraction; from \(\dim F\), \(\dim G\), \(\dim(F \cap G)\), deduce \(\dim(F + G)\) by addition. Use the one that is easiest to compute first.
Skills to practice
  • Applying Grassmann
III.3 Supplementary subspaces in finite dimension
The chapter Vector spaces introduced supplements via concrete examples (parity, symmetric/skew-symmetric matrices, line \(\oplus\) plane in \(\mathbb{R}^3\)) without claiming general existence. We can now prove existence: in finite dimension, every subspace admits a supplement, with dimension complementary to that of the subspace.
Theorem — Existence of supplements in finite dimension
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F\) a subspace of \(E\). Then \(F\) admits at least one supplement \(G\) in \(E\). Every such supplement satisfies $$ \textcolor{colorprop}{\dim G = \dim E - \dim F}. $$

By the subspace-dimension theorem, \(F\) is of finite dimension; take a basis \((e_1, \ldots, e_p)\) of \(F\), where \(p = \dim F\). By the « base incomplète » theorem applied in \(E\), complete to a basis \((e_1, \ldots, e_p, e_{p+1}, \ldots, e_n)\) of \(E\), where \(n = \dim E\). Set \(G := \mathrm{Vect}(e_{p+1}, \ldots, e_n)\). Direct sum. If \(w \in F \cap G\): \(w = \sum_{i=1}^p \alpha_i e_i = \sum_{j=p+1}^n \beta_j e_j\), so \(\sum_{i=1}^p \alpha_i e_i - \sum_{j=p+1}^n \beta_j e_j = 0\). By freeness of the basis of \(E\), all \(\alpha_i = 0\) and \(\beta_j = 0\), hence \(w = 0\). Sum is \(E\). Every \(x \in E\) writes \(x = \sum_{i=1}^n \lambda_i e_i = \underbrace{\sum_{i=1}^p \lambda_i e_i}_{\in F} + \underbrace{\sum_{j=p+1}^n \lambda_j e_j}_{\in G}\). So \(E = F \oplus G\). Dimension of \(G\). \(G\) has the basis \((e_{p+1}, \ldots, e_n)\) of cardinal \(n - p\), so \(\dim G = n - p = \dim E - \dim F\). Any other supplement \(G'\) of \(F\) in \(E\) satisfies, by Grassmann, \(\dim E = \dim(F + G') = \dim F + \dim G' - \dim(F \cap G') = \dim F + \dim G' - 0\), hence \(\dim G' = \dim E - \dim F\).

Method
To exhibit a supplement of \(F\) in \(E\) (dim finie): take a basis of \(F\), complete it via the « base incomplète » theorem into a basis of \(E\), the supplement is the \(\mathrm{Vect}\) of the added basis vectors.
Example
In \(\mathbb{R}^2\), the line \(F = \mathrm{Vect}\bigl((1, 0)\bigr)\) has \(G = \mathrm{Vect}\bigl((0, 1)\bigr)\) as supplement: \(\dim F + \dim G = 1 + 1 = 2 = \dim \mathbb{R}^2\), and the basis \((e_1)\) of \(F\) completes into \((e_1, e_2)\) of \(\mathbb{R}^2\). The geometric picture:
The next theorem turns the « hard » direct sum check \(E = F \oplus G\) (two conditions: \(F \cap G = \{0\}\) AND \(F + G = E\)) into a « two-of-three » dimensional check, often faster in practice.
Theorem — Dimensional characterisation of supplementarity
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F, G\) subspaces of \(E\). Any two of the following three assertions imply the third, and when all three hold, \(E = F \oplus G\):
  1. \(F \cap G = \{0_E\}\);
  2. \(F + G = E\);
  3. \(\dim F + \dim G = \dim E\).

Apply the Grassmann formula \(\dim(F + G) = \dim F + \dim G - \dim(F \cap G)\).
  • \((1) + (2) \Rightarrow (3)\). \(F \cap G = \{0\}\) gives \(\dim(F \cap G) = 0\); \(F + G = E\) gives \(\dim(F + G) = \dim E\). Grassmann: \(\dim E = \dim F + \dim G\).
  • \((1) + (3) \Rightarrow (2)\). \(\dim(F \cap G) = 0\); Grassmann gives \(\dim(F + G) = \dim F + \dim G = \dim E\). So \(F + G\) is a subspace of \(E\) with \(\dim(F + G) = \dim E\), hence \(F + G = E\) by the subspace-dimension theorem (equality case).
  • \((2) + (3) \Rightarrow (1)\). \(\dim(F + G) = \dim E\); Grassmann gives \(\dim(F \cap G) = \dim F + \dim G - \dim E = 0\). Hence \(F \cap G = \{0\}\) (only the zero subspace has dimension \(0\)).
When all three hold, \((1)\) and \((2)\) together say \(E = F \oplus G\) by definition of supplementarity.

Method
In dim finie, to prove \(E = F \oplus G\), check any two among: \(F \cap G = \{0\}\), \(F + G = E\), \(\dim F + \dim G = \dim E\). Pick the easiest two. In practice, often « trivial intersection + dimension count » is the easiest combination.
Example
In \(\mathbb{R}^3\), set \(F = \mathrm{Vect}\bigl((0, 1, 0)\bigr)\) and \(G = \{(x, y, z) \in \mathbb{R}^3 : x + 2 y + 3 z = 0\}\). Show \(F \oplus G = \mathbb{R}^3\).

\(\dim F = 1\). For \(G\): it is the kernel of the linear form \(\varphi : (x, y, z) \mapsto x + 2y + 3z\), parametrized as \(G = \{(-2y - 3z, y, z) : y, z \in \mathbb{R}\} = \mathrm{Vect}\bigl((-2, 1, 0), (-3, 0, 1)\bigr)\). The two generators are free (check), so \(\dim G = 2\). By the « two-of-three » method with conditions \((1)\) and \((3)\):
  • Trivial intersection. If \(v \in F \cap G\): \(v = \lambda (0, 1, 0)\), plugging into the equation \(x + 2y + 3z = 0\) gives \(0 + 2\lambda + 0 = 2\lambda = 0\), so \(\lambda = 0\), \(v = 0\).
  • Dimension count. \(\dim F + \dim G = 1 + 2 = 3 = \dim \mathbb{R}^3\).
By the dimensional characterisation of supplementarity, \(F \oplus G = \mathbb{R}^3\).

Skills to practice
  • Finding a supplement
  • Using the two-of-three characterisation
III.4 Bases adapted to a subspace or to a direct sum
The program mandates the notion of « basis adapted to a subspace » and « basis adapted to a direct sum decomposition ». These are bases that respect the geometric structure: the first \(\dim F\) vectors form a basis of \(F\), the next \(\dim G\) form a basis of \(G\). Such bases are an immediate by-product of the « base incomplète » theorem.
Definition — Basis adapted to a subspace
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F\) a subspace of \(E\). A basis \((e_1, \ldots, e_n)\) of \(E\) is adapted to \(F\) if its first \(\dim F\) vectors \((e_1, \ldots, e_p)\) form a basis of \(F\).
Definition — Basis adapted to a direct sum
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F, G\) subspaces with \(E = F \oplus G\). A basis of \(E\) is adapted to the decomposition \(E = F \oplus G\) if it is the concatenation of a basis of \(F\) and a basis of \(G\) (in this order).
Proposition — Existence of a basis adapted to a subspace
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F\) a subspace of \(E\). Every basis of \(F\) can be completed into a basis of \(E\) adapted to \(F\). In particular, \(E\) admits a basis adapted to \(F\).

Direct application of the « base incomplète » theorem: a basis of \(F\) is in particular a free family of \(E\), and \(E\) has a finite generating family. Complete using the algorithm; the result is a basis of \(E\) whose first \(\dim F\) vectors are the basis of \(F\) we started with --- a basis adapted to \(F\).

Proposition — Basis adapted to a direct sum
Let \(E\) be a finite-dimensional \(\mathbb{K}\)-vector space and \(F, G\) subspaces with \(E = F \oplus G\). The concatenation of any basis of \(F\) with any basis of \(G\) is a basis of \(E\) (adapted to the decomposition).

Let \((e_1, \ldots, e_p)\) be a basis of \(F\) and \((f_1, \ldots, f_q)\) a basis of \(G\). We show \(\mathcal{B} := (e_1, \ldots, e_p, f_1, \ldots, f_q)\) is a basis of \(E\).
  • Generating. Every \(w \in E = F \oplus G\) writes \(w = f + g\) with \(f \in F\), \(g \in G\) (definition of sum). Expand \(f = \sum_{i=1}^p \lambda_i e_i\) in the basis of \(F\) and \(g = \sum_{j=1}^q \mu_j f_j\) in the basis of \(G\). Hence \(w\) is a linear combination of \(\mathcal{B}\).
  • Free. Suppose \(\sum_{i=1}^p \lambda_i e_i + \sum_{j=1}^q \mu_j f_j = 0_E\). Set \(f := \sum_{i=1}^p \lambda_i e_i \in F\) and \(g := \sum_{j=1}^q \mu_j f_j \in G\). The relation reads \(f + g = 0_E\). Since the sum is direct (\(F \cap G = \{0\}\)), the decomposition of \(0_E\) as element of \(F\) plus element of \(G\) is unique, namely \(0_E = 0_F + 0_G\). So \(f = 0_E\) and \(g = 0_E\). By freeness of the basis of \(F\), all \(\lambda_i = 0\); by freeness of the basis of \(G\), all \(\mu_j = 0\).
\(\mathcal{B}\) is free and generating: a basis of \(E\). The first \(p\) vectors form a basis of \(F\) and the next \(q\) form a basis of \(G\), so \(\mathcal{B}\) is adapted to the decomposition \(E = F \oplus G\).

Geometric picture --- basis adapted to a direct sum
Geometric picture in \(\mathbb{R}^3\): \(F\) is a plane (basis \((e_1, e_2)\)), \(G\) is a line (basis \((f_1)\)), and \((e_1, e_2, f_1)\) is a basis of \(\mathbb{R}^3 = F \oplus G\) adapted to this decomposition.
Example
In \(\mathbb{R}^4\), set \(F := \{(x, y, z, t) \in \mathbb{R}^4 : x + y = 0 \text{ and } z = t\}\). Find a basis of \(F\), then complete it into a basis of \(\mathbb{R}^4\) adapted to \(F\).

Basis of \(F\). The constraints \(x + y = 0\) and \(z = t\) give \(y = -x\) and \(t = z\); so \(F = \{(x, -x, z, z) : x, z \in \mathbb{R}\} = \mathrm{Vect}\bigl((1, -1, 0, 0), (0, 0, 1, 1)\bigr)\). The two generators are free (different non-zero coordinate patterns), so \((e_1, e_2) := \bigl((1, -1, 0, 0), (0, 0, 1, 1)\bigr)\) is a basis of \(F\) and \(\dim F = 2\). Completing. Apply the algorithm of the incomplete basis to extend \((e_1, e_2)\) via the canonical basis of \(\mathbb{R}^4\). Try adding \((1, 0, 0, 0)\): the family \(\bigl((1, -1, 0, 0), (0, 0, 1, 1), (1, 0, 0, 0)\bigr)\) is free (system check: \(\alpha(1,-1,0,0) + \beta(0,0,1,1) + \gamma(1,0,0,0) = 0\) gives \(\alpha + \gamma = 0\), \(-\alpha = 0\), \(\beta = 0\), \(\beta = 0\), so \(\alpha = \beta = \gamma = 0\)). Keep. Try \((0, 0, 1, 0)\): the family \(\bigl(e_1, e_2, (1, 0, 0, 0), (0, 0, 1, 0)\bigr)\) in \(\mathbb{R}^4\) has \(4 = \dim \mathbb{R}^4\) vectors; check freeness (\(\delta (0, 0, 1, 0) + \cdots = 0\) leads to all coefficients zero by reading the four coordinates). Free of cardinal \(4\), so a basis by the basis characterisation in dimension \(n\). A basis of \(\mathbb{R}^4\) adapted to \(F\): \(\bigl((1, -1, 0, 0), (0, 0, 1, 1), (1, 0, 0, 0), (0, 0, 1, 0)\bigr)\).

Skills to practice
  • Completing a basis of \(F\) into a basis of \(E\)
  • Writing a basis adapted to a direct sum
IV Application: dimensions of natural solution spaces
Three explicit required outcomes connect dimension theory to differential equations and linear recurrent sequences. The full derivation of each result lives in the respective analysis chapter; here we state the dimensions and admit the proofs at this stage. The unifying principle: an equation of « order \(k\) » needs \(k\) initial conditions to single out a solution; the solution space has dimension \(k\).
IV.1 First-order linear homogeneous ODE
Proposition — First-order ODE
Let \(I\) be an interval of \(\mathbb{R}\), \(a : I \to \mathbb{R}\) continuous, and fix \(x_0 \in I\). The set of solutions \(y : I \to \mathbb{R}\) of the linear homogeneous ODE $$ y' + a(x) y = 0 $$ is a \(\mathbb{R}\)-vector space of dimension \(1\): every solution writes \(y = \lambda y_0\) where \(y_0(x) = \exp\bigl(-\int_{x_0}^x a(t)\,dt\bigr)\) is a particular non-zero solution and \(\lambda \in \mathbb{R}\).

Admitted here, proved in Differential equations.

Skills to practice
  • Computing dimensions of solution spaces
IV.2 Second-order linear ODE with constant coefficients
Proposition — Second-order ODE with constant coefficients
Let \(p, q \in \mathbb{R}\). The set of solutions \(y : \mathbb{R} \to \mathbb{R}\) of the linear homogeneous ODE $$ y'' + p y' + q y = 0 $$ is a \(\mathbb{R}\)-vector space of dimension \(2\).

Admitted here, proved in Differential equations.

Example
The solution space of \(y'' + y = 0\) on \(\mathbb{R}\) is a \(\mathbb{R}\)-vector space of dimension \(2\) (second-order ODE proposition with \(p = 0\), \(q = 1\)). It contains \(\cos\) and \(\sin\); the family \((\cos, \sin)\) is free (evaluate at \(0\) and \(\pi/2\)), so by the basis characterisation in dimension \(n\) it is a basis. Every solution writes \(y(x) = \alpha \cos x + \beta \sin x\) with \(\alpha, \beta \in \mathbb{R}\).
Skills to practice
  • Computing dimensions of solution spaces
IV.3 Linear recurrent sequences of order 2
Proposition — Linear recurrence of order 2
For any \(a, b \in \mathbb{R}\), the set of sequences \((u_n) \in \mathbb{R}^\mathbb{N}\) satisfying $$ \forall n \in \mathbb{N}, \quad u_{n+2} = a u_{n+1} + b u_n $$ is a \(\mathbb{R}\)-vector space of dimension \(2\). No condition on \(a, b\) is needed: the initial pair \((u_0, u_1) \in \mathbb{R}^2\) is arbitrary and uniquely determines the sequence by the recurrence.

Admitted here, proved in Recurrent sequences.

Example
The space of sequences \((u_n) \in \mathbb{R}^\mathbb{N}\) satisfying \(u_{n+2} = u_{n+1} + u_n\) (the Fibonacci-style recurrence) is a \(\mathbb{R}\)-vector space of dimension \(2\) (linear-recurrence dimension proposition with \(a = b = 1\)). Setting \(\phi = (1 + \sqrt{5})/2\) and \(\psi = (1 - \sqrt{5})/2\) (roots of \(X^2 - X - 1\)), the sequences \((\phi^n)_{n \in \mathbb{N}}\) and \((\psi^n)_{n \in \mathbb{N}}\) satisfy the recurrence (the characteristic equation \(X^2 = X + 1\) is satisfied by \(\phi\) and \(\psi\)). They are free: if \(\alpha \phi^n + \beta \psi^n = 0\) for every \(n \in \mathbb{N}\), evaluate at \(n = 0\) and \(n = 1\): $$ \begin{cases} \alpha + \beta = 0, \\ \alpha \phi + \beta \psi = 0. \end{cases} $$ From the first, \(\beta = -\alpha\); substituting in the second, \(\alpha (\phi - \psi) = 0\). Since \(\phi - \psi = \sqrt{5} \ne 0\), \(\alpha = 0\), then \(\beta = 0\). So the family is free; by the basis characterisation in dimension~\(2\), it is a basis. Every solution writes \(u_n = \alpha \phi^n + \beta \psi^n\).
Method
Reading the dimension of a linear-homogeneous solution space: count the number of initial conditions needed to single out a solution. An ODE of order \(k\) needs \(k\) initial conditions (the values \(y(x_0), y'(x_0), \ldots, y^{(k-1)}(x_0)\)); the solution space has dimension \(k\). Same for linear recurrent sequences of order \(k\) (the initial \(k\)-tuple \((u_0, \ldots, u_{k-1})\)).
Skills to practice
  • Computing dimensions of solution spaces