Posts
Showing posts with the label Level 3
Recall from Part II Definition of subsequence Let $X$ be a non-empty set, and let $(x_n)_{n\in\N}$ be a sequence of elements of $X$. Then a subsequence of $(x_n)$ is a sequence of the form $x_{n_1},x_{n_2},x_{n_3},\dots$, where $(n_k)_{k\in\N}$ is a strictly increasing sequence of natural numbers. The subsequence can also be written as $(x_{n_k})_{k\in\N}$, always remembering that we require that $n_1<n_2<n_3<\cdots$. In this setting, as discussed last time, we may apply the definition above to the sequence $(n_k)_{k\in\N}$, and we see that $(n_k)_{k\in\N}$ is a subsequence of the sequence of $1,2,3,\dots$. Now let us revisit this in terms of functions from $\N$ to $X$ and functions from $\N$ to $\N$. We can define $f:\N\to X$ by $f(n)=x_n$, and we can define $g:\N\to\N$ by $g(k)=n_k$. Then $g$ is a strictly increasing function from $\N$ to $\N$, and we have $x_{n_k}= x_{g(k)}=f(g(k))\;(k\in\N)$. Thus, if we define $h:\N\to X$ by $h(k)=x_{n_k}$, we have...
Sequences and subsequences, Part II
- Get link
- X
- Other Apps
In this part, we will have a closer look at strictly increasing sequences of natural numbers, before beginning to discuss subsequences of sequences. Recall that I work with the convention that $\N=\{1,2,3,\dots\}$, so that $0\notin\N$. Let $(n_k)_{k\in\N}$ be a sequence of natural numbers (so $n_k\in\N$ for all $k\in \N$). As discussed in Part I, we may identify this sequence $(n_k)_{k\in\N}$ with a function $g:\N\to\N$, where $g(k)=n_k\;(k\in\N).$ We will be particularly interested in the case when the sequence $(n_k)$ is strictly increasing , i.e., when $n_1<n_2<n_3<\cdots\,.$ This is equivalent to saying that the function $g:\N \to \N$ above is a strictly increasing function . This way of thinking might be helpful to us later, because of the fact that if you compose two strictly increasing functions from $\N$ to $\N$, you obtain another strictly increasing function from $\N$ to $\N$. There is, however, another way to think about strictly increasing sequences of natural num...
Sequences and subsequences, Part I
- Get link
- X
- Other Apps
Sequences and subsequences play an important role throughout mathematics, and especially in mathematical analysis. In this series (or sequence?) of posts, I will combine some standard theory with some of my own musings on the subject. These posts will be mainly about the theory around sequences etc. But to understand mathematics properly, you also need to play around with lots of examples and look at their properties. Here let me plug some old videos on Core Topics in University Mathematics ( YouTube PlayList ) that a group of us from Nottingham put together (funded by a teaching grant of Steve Cox ). Among other videos there you can find two videos by Dan Nicks on Convergence of sequences , and three videos of my own on Sequences and their properties (including discussion of a few examples, and a quiz). I also have a video there on the topic Think of a function . For the purposes of these posts, note that I work with the convention that $\N=\{1,2,3,\dots\}$, so that $0\notin\N$. Let...
Young's inequality (for products) and the AM-GM inequality: random musings
- Get link
- X
- Other Apps
Young's inequality (for products) is related to the AM-GM (arithmetic mean -geometric mean) inequality . Let $a$ and $b$ be non-negative real numbers. Then $(ab)^{1/2} \leq (a+b)/2$, with equality if and only if $a=b$. This can be seen easily by multiplying both sides by $2$, then squaring both sides and noting that $(a+b)^2=(a-b)^2+4ab$. This is the special case of the AM-GM inequality for two non-negative real numbers (and the result generalises to any finite number of non-negative real numbers). However it is also the special case of Young's inequality when $p=q=2$. Young's inequality states that for non-negative real numbers $x$ and $y$ and positive real numbers $p$ and $q$ satisfying $1/p + 1/q = 1$, we have $xy \leq x^p/p + y^q/q$, with equality if and only if $x^p=y^q$. When $p=q=2$ this says that $xy \leq (x^2+y^2)/2$ with equality if and only if $x^2=y^2$, which is the same as the version of AM-GM above above when you set $a=x^2$ and $b=y^2$. Both AM-GM and Youn...
Some musings on Cauchy-Schwarz, Part Vb
- Get link
- X
- Other Apps
Recall our claim from Part I Cauchy-Schwarz in complex inner product spaces can be deduced from Cauchy-Schwarz in real inner product spaces. This is essentially because every complex inner product space can also be regarded as a real inner product space with the same norm, but where the real inner product is the real part of the complex inner product. The last bit of the deduction uses a fairly standard "rotation trick": for any complex number \(z\), we have \[|z|=\max\{\Re(\alpha z):\alpha \in \C, |\alpha|=1\,\}\,.\qquad(*)\] Let's check $(*)$ first. Let $z\in\C$, and set \[A=\{\Re(\alpha z):\alpha \in \C, |\alpha|=1\,\} \subseteq \R\,.\] Clearly $A$ is non-empty. Let $\alpha \in \C$ with $|\alpha|=1$. Then certainly we have \[\Re(\alpha z) \leq |\alpha z| = |z|\,.\] Thus we have \[\sup A \leq |z|\,.\] We now need to prove that equality holds, and that the supremum is actually a maximum. For this we just need to show that $|z| \in A$. This is trivial if $z=0$, b...
Some musings on Cauchy-Schwarz, Part Va
- Get link
- X
- Other Apps
In this part, we take as our starting point the (easy) results discussed so far for real inner product spaces of dimensions less than or equal to $2$. That is, that for a given dimension $n$ (and we only need $n\leq 2$ below), up to "real inner product space isomorphism", all $n$-dimensional inner product spaces over $\R$ are the same as $\R^n$ with the usual dot product. In particular, the Cauchy-Schwarz inequality holds in all real inner product spaces of dimension $\leq 2$, with equality if and only if the two vectors involved are linearly dependent. Now let $V$ be any inner product space over $\R$, with inner product $\langle \cdot,\cdot \rangle_V$ and associated norm $\|\cdot\|_V$. (Here $V$ can be infinite-dimensional, and need not be separable.) Let $\vx, \vy \in V$, let $W$ be the linear subspace of $V$ spanned by $\vx$ and $\vy$, i.e., $\lin\{\vx,\vy\}$. Clearly $W$ is then itself a real inner product space of dimension at most $2$. Thus the Cauchy-Schwarz inequalit...
Some musings on Cauchy-Schwarz, Part IVc
- Get link
- X
- Other Apps
To conclude Part IV, we prove the easy fact that all two-dimensional real inner product spaces are "essentially the same" as $\R^2$ with the usual dot product and the associated (Euclidean) norm $\|\vx\|_2 = \sqrt{\vx\cdot\vx}$. Of course what we need is a linear isomorphism which preserves norms and inner products. The argument is almost identical to that in Part III (and, unsurprisingly, generalises via the usual Gram-Schmidt process to higher dimensions). As an exercise you should check for yourselves the details of any unproven claims below. Now let $V$ be any two-dimensional inner product space over $\R$, with inner product $\langle \cdot,\cdot \rangle_V$ and associated norm $\|\cdot\|_V$. Let $\{\vv_1,\vv_2\}$ be a basis of $V$. Then $\vv_1\neq 0$, so we can normalize by setting \[\Ve_1=\frac{1}{\|\vv_1\|_V} \vv_1\,.\] Then $\{\Ve_1,\vv_2\}$ is easily seen to still be a basis of $V$. Next we write $\vv_2=\va+\vb$ with $\va=\langle \Ve_1,\vv_2\rangle\Ve_1$ being the com...
Some musings on Cauchy-Schwarz, Part IVb
- Get link
- X
- Other Apps
In this part we will look at two-dimensional real inner product spaces, which are all essentially identical to $\R^2$ with the standard dot product. They are also all essentially identical to $\C$ when $\C$ is regarded as a real inner product space, using the real inner product (as discussed in Part II). \[\langle z,w \rangle = \Re(\bar z w)= \Re(z) \Re(w) + \Im(z) \Im(w)\,,\] and the Cauchy-Schwarz inequality for all two-dimensional real inner product spaces is immediate from this, because $|\Re(\bar z w)| \leq |\bar z w|$. (Of course, Cauchy-Schwarz in $\R^2$ is easy to prove anyway!) We already discussed the connection between $\R^2$ and $\C$ in Part II. Recall the following from that part (also discussed in intermediate parts). The (linear in the second variable) standard complex inner product on $\C$ is given by $\langle z,w \rangle = \bar z w$, with the associated norm given by modulus. Writing $z=a_1+\i a_2$ and $w=b_1+\i b_2$, with $a_1,a_2,b_1,b_2$ real,...
Some musings on Cauchy-Schwarz, Part IVa
- Get link
- X
- Other Apps
In this very short part we look briefly at one-dimensional complex inner product spaces, essentially repeating some of the material from previous posts. As we noted in Part II, the standard (linear in the second variable) complex inner product on $\C$ is given by $\langle z,w \rangle_\C = \bar z w$, with the associated norm given by the usual modulus, $\|z\|_\C=|z|$. Since we have (by standard properties of $\C$) that \[|\langle z,w \rangle_\C|=|\bar z w| = |z| |w| = \|z\|_\C \|w\|_\C\,,\] the Cauchy-Schwarz inequality holds for $\C$, and in fact equality always holds here. We can now repeat the reasoning from Part III to see that all one-dimensional complex inner product spaces are essentially the same as $\C$ with its standard inner product (given above). Unsurprisingly, this means that equality always holds in the Cauchy-Schwarz inequality in one-dimensional complex inner product spaces. In part IVb we will look at two-dimensional real inner product spaces, which are all ...
Some musings on Cauchy-Schwarz, Part III
- Get link
- X
- Other Apps
In this part we look at the very trivial case of one-dimensional inner product spaces over $\R$. As an exercise you can check any details omitted below, and identify the famous named theorems we are discussing the one-dimensional versions of! Almost everything discussed below is just the trivial one-dimensional case of standard facts about finite-dimensional, real inner product spaces. More advanced readers may wish to skip or merely skim Parts III and IV and move on to Part V. The standard inner product on $\R$ is just the usual product in $\R$, so, for $x,y \in \R$, \[\langle x,y\rangle_\R=xy\,.\] This is, of course, the one-dimensional version of the dot product! You can check that this really is a (real) inner product. (This is mostly just the standard rules of arithmetic in $\R$, along with properties of modulus.) Unsurprisingly, the associated norm is given by \[||x||_\R=\sqrt{\langle x,x \rangle}_\R = \sqrt{x^2} = |x|\,,\] i.e., the usual modulus of $x$. In this special case, th...
Some musings on Cauchy-Schwarz, Part II
- Get link
- X
- Other Apps
In this part we'll have an initial look at some of the connections between real inner product spaces and complex inner product spaces. In a previous post, I discussed the fact that every vector space over $\C$ can be regarded as a vector space over $\R$ with respect to the same addition, and the restricted scalar multiplication obtained by using only real scalars (where we regard $\R$ as a subset of $\C$, as usual). If we have a finite-dimensional vector space over $\C$, then the dimension doubles when we regard it as a vector space over $\R$. In particular, $\C$ is a $1$-dimensional complex vector space, but is a $2$-dimensional real vector space. This is no surprise, since we often identify $\C$ with $\R^2$ (and may well define $\C$ that way as a set). Similarly, every normed space over $\C$ can also be regarded as a normed apace over $\R$, with the same addition and norm, and restricting attention to multiplication by only real scalars. Now, however, we are talking about inner p...
Some musings on Cauchy-Schwarz: Part I
- Get link
- X
- Other Apps
I'm currently thinking about the Cauchy-Schwarz inequality for multiple reasons, including the following: I'm currently teaching a Level 4 module on Linear Analysis which includes material on inner product spaces and Hilbert spaces; I'm also still the Teaching Support Officer in our school, and one of the first-year students asked me why the dot product formula in terms of components gives the same answer as the formula in terms of norms and angles, as in \[\va \cdot \vb = ||\va||\cdot||\vb|| \cos \theta,\] where \(\theta\) is the angle between \(\va\) and \(\vb.\) For the first-year student, I drew a picture to illustrate the special case in \(\R^2\) where \(\va\) has the form \((||\va||,0)\) and \(\vb\) is written in the form \((||\vb|| \cos \theta,||\vb||\sin \theta).\) I then noted that the two formulae clearly agreed here, and so, as long as you know that the dot product formulae are invariant under rotations about the origin , the general fact follows. Now I'm ...
Measures, outer measures and measurable sets I
- Get link
- X
- Other Apps
Although I have taught Measure and Integration many times over the years, typically I don't have time to prove all of the details of the Carathéodory theory of outer measures and their associated $\sigma$-algebras and measures. I've been thinking about how we prove some of the fiddly bits at the end, and trying to decide how to make some of the final bootstrapping from finite unions to infinite unions a bit more natural. One possibility I have thought of is to change the order in which we prove some of the results, essentially in order to avoid proving some facts twice. However, this might be at the cost of having to prove some results again for general measures that we first prove for measures coming from outer measures. On the other hand, every measure on a $\sigma$-algebra is actually the restriction to that $\sigma$-algebra of a measure that comes from some outer measure! The same is also true for the more general "measures" on rings of sets and on semi-rings of...
An introduction to the Hahn-Banach extension theorem: Part VI
- Get link
- X
- Other Apps
In this post we sketch a second proof of the Hahn-Banach Extension Theorem for continuous linear functionals on real normed spaces, this time using transfinite induction. We omit some of the details, which the reader can fill in. In particular, some of the details are similar to those involved in proving the claim made in Part V (when we obtained an upper bound for a chain). For a non-zero ordinal $\gamma$, recall that, with ordinal interval notation, we have $\gamma=[0,\gamma)$. That is, $\gamma$ is equal to the set of all ordinals which are strictly less than $\gamma$. However, we use ordinal interval notation throughout. If you prefer to use $\gamma$ instead of $[0,\gamma)$ that is fine, of course! Looking at the Wikipedia page on the Hahn-Banach Theorem , apparently both Hahn and Banach (independently) used transfinite induction in their proofs, rather than Zorn's Lemma. Theorem (Hahn-Banach Extension Theorem for linear functionals on normed spaces over $\R$) Let $(E,\jnorm)$ ...
An introduction to the Hahn-Banach extension theorem: Part V
- Get link
- X
- Other Apps
In this post we prove the general Hahn-Banach Extension Theorem for continuous linear functionals on real normed spaces. (As we saw in Part IV, the result for complex normed spaces then follows from this.) Here we give the usual proof using Zorn's Lemma. In the next post we will give a second proof using transfinite induction, similar to the proof we gave for separable normed spaces. Theorem (Hahn-Banach Extension Theorem for linear functionals on normed spaces over $\R$) Let $(E,\jnorm)$ be a normed space over $\R,$ and let $F$ be a linear subspace of $E$. Let $\psi \in F^*$. Then there exists $\phi \in E^*$ with $\|\phi\|_\op=\|\psi\|_\op$ and such that $\phi$ is an extension of $\psi$. Proof using Zorn's Lemma Let set $S$ to be the set of all ordered pairs $(Y,\theta)$ of the following form: $Y$ is a linear subspace of $E$ with $F \subseteq Y$ and $\theta \in Y^*$, $\theta|_F=\psi$, and $\|\theta\|_\op = \|\psi\|_\op.$ Certainly $(F,\psi) \in S$, and so $S \neq ...
An introduction to the Hahn-Banach extension theorem: Part IV
- Get link
- X
- Other Apps
In this post we look at how every complex normed space can also be regarded as a real normed space, and how this fits with bounded linear functionals and the Hahn-Banach theorem. Let $(E,\jnorm)$ be a normed space over $\C$. Then $E$ is also a normed space over $\R$, with the same addition, but only considering multiplication by real scalars. This has no effect on the metric induced by $\jnorm$ or the topology. In particular, separability is not affected by this. Still, let us denote the real version by $E_\R$, so that $(E_\R,\jnorm)$ is the corresponding real normed space. If $E$ is finite-dimensional (over $\C$), then $E_\R$ is finite-dimensional (over $\R$), but the dimension doubles. Indeed, if $E$ is $n$-dimensional over $\C$ with basis $x_1,x_2,\dots,x_n$ (over $\C$), then it is easy to see that $x_1, \i x_1, x_2, \i x_2, \dots, x_n, \i x_n$ is a basis for $E_\R$ (over $\R$). Now let $F$ be a (complex) linear subspace of $E$. Then $F_\R$ is a real linear subspace of $E_R$. H...
An introduction to the Hahn-Banach extension theorem: Part III
- Get link
- X
- Other Apps
In this post we will see how the Hahn-Banach key lemma from Part II allows us to prove the Hahn-Banach theorem for extensions of bounded linear functionals on separable normed spaces, without the need to use Zorn's Lemma (or equivalent). First, we recall an easy result about extensions of bounded linear functionals to the closure of a linear subspace. Let $\F$ be $\R$ or $\C$, and let $(E,\jnorm)$ be a normed space over $\F.$ Now let $F$ be a linear subspace of $E$. Then the closure of $F$ in $E$, $\overline{F}$, is also a linear subspace of $E$. As usual, we give $F$ and $\overline{F}$ the norm obtained by restricting $E$'s norm, $\jnorm$. Proposition 1 (extensions of linear functionals to the closure of a subspace) Let $\psi \in F^*$. Then $\psi$ has a unique extension $\tilde \psi \in {\overline{F}\,}^*$ (the dual space of $\overline{F}$), and we have \[\|\tilde\psi\|_\op = \|\psi\|_\op\,.\] Comments This is a special case of a more general result about extensions of conti...
An introduction to the Hahn-Banach extension theorem: Part II
- Get link
- X
- Other Apps
In this post we establish (in Lemma 2 below) the "key step" needed for the Hahn-Banach theorem (as described in the previous post), where we extend our linear functional by one real dimension. First we note an elementary fact about the operator norm for continuous linear functionals on real normed spaces. Lemma 1 (Operator norm for real linear functionals) Let $(E,\jnorm)$ be a normed space over $\R$, and let $\phi \in E^*.$ Then $(1)\Jdisplay\|\phi\|_\op = \sup \{\phi(x): x \in E, \|x\| \leq 1\,\}\,.$ Comment This looks very like the definition of the operator norm! However the subtle difference is that we work with $\phi(x)$ instead of $|\phi(x)|$ here. Our actual definition of the operator norm is that \[\|\phi\|_\op = \sup \{|\phi(x)|: x \in E, \|x\| \leq 1\,\}\,.\] Note that this would make no sense, as it stands, for complex normed spaces (though we could work with the real part of $\phi(x)$ in that case, and we would again obtain a true result). Let us refer to the ...
An introduction to the Hahn-Banach extension theorem: Part I
- Get link
- X
- Other Apps
In this series of posts (intended for mathematics undergraduate students in their 3rd or 4th year) I am going to focus on the Hahn-Banach extension theorem for bounded linear functionals on normed spaces. I may also say something about more general versions in terms of sublinear functions. Let $\F$ be $\R$ or $\C$, and let $(E,\jnorm)$ be a normed space over $\F$. We denote by $E^*$ the set of continuous (bounded) linear functionals on $E$, that is, the set of continuous linear maps from $(E,\jnorm)$ to $(\F,|\cdot|).$ Since $(\F,|\cdot|)$ is complete, it follows that $E^*$ is always complete when given the operator norm $\jnorm_\op$ defined, for $\phi\in E^*$, by \[\|\phi\|_\op = \sup\{|\phi(x)|:x \in E, \|x\|\leq 1\,\}\,.\] Now let $F$ be a linear subspace of $E,$ and give $F$ the norm obtained by restricting $\jnorm$ to $F.$ We still denote this restricted norm by $\jnorm$. We now have another dual space $F^*,$ along with a restriction map $R:E^*\to F^*$ defin...
Other approaches to connected components (from this year's MATH4085 Metric and Topological Spaces)
- Get link
- X
- Other Apps
Hi everyone, In a previous post we looked at a sufficient condition for a union of connected sets to be connected. A relatively easy special case of Lemma 6.12 is the following. Lemma Let \(X\) be a (non-empty) topological space, and let \(E_1\) and \(E_2\) be connected subsets of \(X\) such that \(E_1 \cap E_2 \neq \emptyset\,.\) Then \(E_1 \cup E_2\) is also connected. Armed just with this lemma, we can define an equivalence relation \(\sim\) on a non-empty topological space \((X,\tau)\) as follows: for \(x,y \in X\), \(x\sim y\) if and only if there exists a connected subset \(E\) of \(X\) such that both \(x\) and \(y\) are elements of \(E\). Let's check that this really is an equivalence relation. Since single point sets \(\{x\}\) are connected, reflexivity is easy. Symmetry is also immediate (it doesn't matter in which order you say that both \(x\) and \(y\) are elements of \(E\)). That leaves transitivity, which is where we use the lemma above. Let \(x,y,z \in X\) and ...