DOC PREVIEW
TAMU MATH 304 - Lecture27web

This preview shows page 1-2-3-4-5 out of 15 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 15 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Math 304–504Linear AlgebraLecture 27:Inner product spaces.NormThe notion of norm generalizes the notion of lengthof a vector in Rn.Definition. Let V be a vector space. A functionα : V → R is called a norm on V if it has thefollowing properties:(i) α(x) ≥ 0, α (x) = 0 only for x = 0 (posi tivity)(ii) α(rx) = |r|α(x) for all r ∈ R (homogeneity)(iii) α(x + y) ≤ α(x) + α(y) (triangle inequality)Notation. The norm o f a vector x ∈ V is usuallydenoted kxk. Different norms on V aredistinguished by subscripts, e.g., kxk1and kxk2.Examples. V = Rn, x = (x1, x2, . . . , xn) ∈ Rn.• kxk∞= max(|x1|, |x2|, . . . , |xn|).• kxkp=|x1|p+ |x2|p+ ··· + |xn|p1/p, p ≥ 1.In particular, kxk2= |x|.Examples. V = C [a , b], f : [a, b] → R.• kf k∞= maxa≤x≤b|f (x)|.• kf kp=Zba|f (x)|pdx1/p, p ≥ 1 .Inner productThe notion of inner product generalizes the notionof dot product of vectors in Rn.Definition. Let V be a vector space. A functionβ : V ×V → R, usually denoted β(x, y) = hx, yi, iscalled an inner product on V if it is po s itive,symmetric, and bilinear. That is, if(i) hx, yi ≥ 0, hx, xi = 0 only for x = 0 (positivity)(ii) hx, yi = hy, xi (symmetry)(iii) hrx, yi = r hx, yi (homogeneity)(iv) hx + y, zi = hx, zi + hy, zi (distributive law)An inner product space is a vector space endowedwith an inner product.Examples. V = Rn.• hx, yi = x · y = x1y1+ x2y2+ ··· + xnyn.• hx, yi = d1x1y1+ d2x2y2+ ··· + dnxnyn,where d1, d2, . . . , dn> 0.Example. V = Pn, polynomials o f degree < n.• hp, qi = p(x1)q(x1) + p(x2)q(x2) + ···+ p(xn)q(xn),where x1, x2, . . . , xnare di s tinct points on R.We have hp, pi = 0 =⇒ p = 0 since a nonzeropolynomial of degree les s than n cannot have nroots.Examples. V = C [a , b].• hf , gi =Zbaf (x)g(x) dx.• hf , gi =Zbaf (x)g (x)w(x) dx,where w is bounded, piecewise continuous, andw > 0 everywhere on [a, b].w is called the weight function.Theorem Suppose hx, yi is an inner product on avector space V . Thenhx, yi2≤ hx, xihy, yi for all x, y ∈ V .Proof: For any t ∈ R let vt= x + ty. Thenhvt, vti = hx, xi+ 2thx, yi + t2hy, yi.The right-hand side is a quadratic polynomial in t(provided that y 6= 0). Since hvt, vti ≥ 0 for all t,the discriminant D is nonpositive. ButD = 4hx, yi2− 4hx, xihy, yi.Cauchy-Schwarz Inequality:|hx, yi| ≤phx, xiphy, yi.Cauchy-Schwarz Inequality:|hx, yi| ≤phx, xiphy, yi.Corollary 1 |x · y| ≤ |x||y| for all x, y ∈ Rn.Equivalently, for all xi, yi∈ R,(x1y1+ ··· + xnyn)2≤ (x21+ ··· + x2n)(y21+ ··· + y2n).Corollary 2 For any f , g ∈ C [a, b],Zbaf (x)g (x) dx2≤Zba|f (x)|2dx ·Zba|g(x)|2dx.Norms induced by inner productsTheorem Suppose hx, yi is an inner product on avector space V . Then kxk =phx, xi is a norm.Proof: Positivity is obvious. Homogeneity:krxk =phrx, rxi =pr2hx, xi = |r|phx, xi.Triangle inequality (follows from Cauchy-Schwarz’s) :kx + yk2= hx + y, x + yi= hx, xi + hx, yi + hy, xi + hy, yi≤ hx, xi + |hx, yi| + |hy, xi|+ hy, yi≤ kxk2+ 2kxkkyk + kyk2= (kxk + kyk)2.Examples. • The length of a vector in Rn,|x| =px21+ x22+ ··· + x2n,is the norm induced by the dot productx · y = x1y1+ x2y2+ ··· + xnyn.• The norm kf k2=Zba|f (x)|2dx1/2on thevector space C[a , b] is induced by the inner producthf , gi =Zbaf (x)g (x) dx.AngleSince |hx, yi| ≤ kxkkyk, we can define the anglebetween nonzero vectors in any vector space withan inner product (and induced norm):∠(x, y) = arccoshx, yikxkkyk.Then hx, yi = kxkkykcos ∠(x, y).In particular, vectors x and y are orthogonal(denoted x ⊥ y) if hx, yi = 0.Problem. Find the angle between functionsf1(x) = x and f2(x) = x2in the inner space C [0, 1]with the inner producthf , gi =Z10f (x)g (x) dx.hf1, f2i =Z10x · x2dx =14,hf1, f1i =Z10x2dx =13, hf2, f2i =Z10(x2)2dx =15.cos ∠(f1, f2) =hf1, f2ikf1kkf2k=1/4p1/3p1/5=√154sin ∠(f1, f2) =p1 − cos2∠(f1, f2) = 1/4∠(f1, f2) = arcsin14xx + yyPythagorean Theorem:x ⊥ y =⇒ kx + yk2= kxk2+ kyk2Proof: kx + yk2= hx + y, x + yi= hx, xi + hx, yi + hy, xi + hy, yi= hx, xi + hy, yi = kxk2+ kyk2.xxx + yx − yyyParallelogram Identity:kx + yk2+ k x − yk2= 2kxk2+ 2kyk2Proof: kx+yk2= hx+y, x+yi = hx, xi + hx, yi+ hy, xi+ hy, yi.Similarly, kx−yk2= hx, xi−hx, yi −h y, xi + hy, yi.Then kx+yk2+ kx−yk2= 2hx, xi+ 2hy, yi = 2kxk2+ 2kyk2.Example. Norms on Rn, n ≥ 2:• kxk∞= max(|x1|, |x2|, . . . , |xn|),• kxkp=|x1|p+ |x2|p+ ··· + |xn|p1/p, p ≥ 1.Theorem The norms kxk∞and kxkp, p 6= 2 donot satisfy the Par allelogr am Identity. Hence theyare not induced by any inner product on Rn.Proof: A counterexample to the Parallelogram Identity isprovided by vectors e1= (1, 0, 0, . . . , 0) and e2= (0, 1, 0, . . . , 0).ke1k∞= ke2k∞= 1, ke1kp= ke2kp= 1 for any p ≥ 1.ke1+ e2k∞= ke1− e2k∞= 1,ke1+ e2kp= ke1− e2kp= 21/pfor any p ≥ 1.Thus 2ke1k2∞+ 2ke2k2∞= 2ke1k2p+ 2ke2k2p= 4.On the other hand, ke1+ e2k2∞+ ke1− e2k2∞= 2 6= 4 andke1+ e2k2p+ ke1− e2k2p= 2(21/p)2= 21+2/p6= 4 unless p =


View Full Document

TAMU MATH 304 - Lecture27web

Documents in this Course
quiz1

quiz1

2 pages

4-2

4-2

6 pages

5-6

5-6

7 pages

Lecture 9

Lecture 9

20 pages

lecture 8

lecture 8

17 pages

5-4

5-4

5 pages

Load more
Download Lecture27web
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Lecture27web and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Lecture27web 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?