Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Matrices
Definition III.1 An m n matrix is a set of numbers arranged in a rectangular array having m rows and n
columns. It is written
A11
A21
A=
...
Am1
A12
A22
..
.
..
.
A1n
A12
..
.
Am2
Amn
There are two important special cases. A 1 n matrix (that is, a matrix with 1 row) is called a row vector.
An m 1 matrix (that is, a matrix with 1 column) is called a column vector. Our convention will be that row
indices are always written before column indices. As a memory aid, I think of matrices as being RC (Roman
Catholic or rows before columns).
III.1.
Matrix Operations
Definitions
1. Equality. For any two matrices A and B
A = B (a) A and B have the same number of rows and the same number of columns and
(b) Aij = Bij for all i, j
2. Addition. For any two m n matrices A and B
(A + B)ij = Aij + Bij for all 1 i m, 1 j n
That is, the entry in row i, column j of the matrix A + B is defined to be the sum of the corresponding entries
in A and B. Note: The sum A + B is only defined if A and B have the same number of rows and the same
number of columns.
3. Scalar multiplication. For any number and any m n matrix A
(A)ij = Aij for all 1 i m, 1 j n
For example
2 5
21+0 22+1
0 1
1 2
=
=
+
2
1 7
20+1 23+1
1 1
0 3
p
X
j=1
Note (a) AB is only defined if the number of columns of A is the same as the number of rows of B. If A is
m p and B is p n, then AB is m n.
(b) (AB)ik is the dot product of the ith row of A (viewed as a row vector) and the k th column of B
(c) Here is a memory aid. If you write the first factor of AB to the left of AB and the second factor above
AB, then each entry (AB)ik of AB is built from the entries Aij j = 1, 2, of A that are directly to
B is 3 n
A is m 3
AB is m n
its left and the entries Bjk j = 1, 2, of B that are directly above it. These entries are multiplied in
pairs, Aij Bjk , j = 1, 2, , starting as far from AB as possible and then the products are added up to
P
yield (AB)ik = j Aij Bjk .
(d) If A is a square matrix, then AAA A (n factors) makes sense and is denoted A n .
(e) At this stage we have no idea why it is useful to define matrix multiplication in this way. Well get
some first hints shortly.
Example III.2 Here is an example of the product of a 2 3 matrix with a 3 2 matrix, yielding a 2 2 matrix
1 3
0 1 2
01+12+23 03+12+21
8 4
2 2 =
=
3 4 5
31+42+53 33+42+51
26 22
3 1
Example III.3 Here is an example of the product of a 3 3 matrix with a 3 1 matrix, yielding a 3 1 matrix
x1 + x 2 + x 3
x1
1 1 1
1 2 3 x2 = x1 + 2x2 + 3x3
2x1 + 3x2 + x3
x3
2 3 1
1 1 1
A = the matrix of coefficients 1 2 3
2 3 1
x1
~x = the column vector x2
x3
4
~b = the column vector 9
7
8. A + (1)A = 0
9. A(B + C) = AB + AC
10. (A + B)C = AC + BC
11. A(BC) = (AB)C
12. (AB) = (A)B = A(B)
These properties are all almost immediate consequences of the definitions. For example to verify property 9, it
suffices to write down the definitions of the two sides of property 9
[A(B + C)]ik =
Aij (B + C)jk =
Aij Bjk +
Aij Cjk
B=
A = [1 2]
B=
3
4
0 0
A=
1 0
3 5
4 6
0 1
B=
0 0
AB = [ 11 17 ] BA is not defined
AB = [ 11 ]
0 0
AB =
0 1
3 6
4 8
1 0
BA =
0 0
BA =
A consequence of this unproperty is that (A B)(A + B) need not equal A 2 B 2 . Multiplying out
(A B)(A + B) carefully gives AA + AB BA BB. The middle two terms need not cancel. For
3
example
0 0
A=
1 0
0 1
AB =
1 0
0 1
B=
0 0
0 1
A+B =
1 0
0
0 0
A B =
0
0 0
1
(A B)(A + B) =
0
2
0 0
0
=
0 0
0
0
1
A consequence of this is that AB = AC does not force B = C even if every entry of A is nonzero. For
example
1
A=
2
0 0
3 4
1 2
1
and yet AB = AC =
6 C=
=
, B=
0 0
3 4
1 2
2
Example III.4 (The Form of the General Solution of Systems of Linear Equations Revisited) We
have just seen that any system of linear equations can be written
A~x = ~b
where A is the matrix of coefficients, ~x is the column vector of unknowns, ~b is the column vector of right hand
sides and A~x is the matrix product of A and ~x. We also saw in II.3 that, if the ranks of [A] and [A | ~b] are the
same, the general solution to this system is of the form
~x = ~u + c1~v1 + + cn~vn
where n is the number of unknowns (that is, the number of components of ~x, or equivalently, the number of
columns of A), is the rank of A and c1 , , cn are arbitrary constants. That ~u + c1~v1 + + cn~vn
is a solution of A~x = ~b for all values of c1 , , cn means that
(Set c1 = = cn = 0)
In other words ~u is a solution of A~x = ~b and each of ~v1 , , ~vn is a solution of A~x = ~0.
Exercises for III.1
1) Define
A=
1 2 3
1 2 1
1 2
B = 3 1
2 1
C = [ 2 2 0 ]
2
D = 11
2
Compute all pairwise products (AA, AB, AC, AD, BA, ) that are defined.
2) Compute A2 = AA and A3 = AAA for
0 a b
a) A = 0 0 c
0 0 0
1 1
3) Let A =
.
0 1
b)
1 0 a
A = 0 1 0
0 0 1
a) Find A2 , A3 , A4 .
III.2
1
0
0
0
0
1
0
0
0
0
1
0
Definition III.5 A transformation (a.k.a. map, a.k.a. function) T from IRn to IRm is a rule which assigns
to each vector ~x in IRn a vector T (~x) in IRm . T should be thought of as a machine: if you put a vector ~x into
~x
T
T (~x)
the input hopper, it spits out a new vector T (~x). A transformation is said to be linear if
T (~x + ~
y ) = T (~x) + T (~y)
Later in this section, we shall see that for each linear transformation T (~x) there is a matrix M T such
that T (~x) is the matrix product of MT times the column vector ~x. In other words, such that T (~x) = MT ~x. First,
5
however, we look at a number of examples, both of transformations that are not linear and transformations
that are linear.
The map
T ([x1 , x2 ]) = x22
is not linear, because the two quantities
T (2~x) = (2x2 )2
2T (~x) = 2(x2 )2
are not equal whenever x2 6= 0. Another example of a map that is not linear is
Example III.6 Translation Define tran~v (~x) be the vector gotten by translating the head of the arrow ~x by
tran~v (~x)
~v
~x
~v (while leaving the tail of the arrow fixed). In equations, tran~v (~x) = ~x + ~v . If translation were linear the two
expressions
tran~v (~x + ~
y ) = ~x + ~
y + ~v
tran~v (~x) + tran~v (~y ) = (~x + ~v ) + (~y + ~v )
= ~x + ~
y + ( + )~v
would be equal for all and . But if ~v 6= ~0 and + 6= 1, the two expressions are not equal.
We have just seen an example of a geometric operation that is not linear. Many other geometric
operations are linear maps. As a result, linear maps play a big role in computer graphics. Here are some
examples.
Example III.7 Projection. Define proj (~x) to be the projection of the vector ~x on the line in IR2 that passes
through the origin at an angle from the xaxis.
proj (~x)
the line. So proj (~x) must have direction [cos , sin ] (or its negative) and must have length k~xk cos = ~x b,
where is the angle between ~x and b. The unique vector with the right direction and length is
proj (~x) = (~x b) b
6
= (~x b) b + (~y b) b
= proj (~x) + proj (~y )
cos2
sin cos
Notice that this is the matrix product of a matrix that depends only on (not on ~x) times the column vector
~x.
Example III.8 Reflection. Define refl (~x) to be the reflection of the vector ~x on the line in IR2 that passes
through the origin at an angle from the xaxis.
refl (~x)
proj (~x)
~x
~x
proj (~x) and continuing in the same direction an equal distance on the far side of the line. In terms of vectors,
to get from ~x to proj (~x), you have to add the vector proj (~x) ~x to ~x. To continue an equal distance in the
same direction, you have to add a second copy of proj (~x) ~x. So
refl (~x) = ~x + 2[proj (~x) ~x] = 2proj (~x) ~x
We may, once again, write this as the matrix product of a matrix that depends only on (not on ~x) times the
column vector ~x.
1 1 + cos 2
1 + cos 2
sin 2
1 0
sin 2
x1
x1
x1
x1
=
refl (~x) = 2
x2
sin 2
1 cos 2
x2
0 1
x2
sin 2
1 cos 2
x2
2
1 + cos 2
sin 2
1 0
cos 2
sin 2
x1
x1
=
=
sin 2
1 cos 2
0 1
x2
sin 2 cos 2
x2
Example III.9 Rotation. Define rot (~x) to be the result of rotating the vector ~x by an angle about the
origin.
rot (~x)
~x
If we denote by r the length of ~x and by the angle between ~x and the xaxis, then
r cos
~x =
r sin
Note that in each of examples 7, 8 and 9 there was a matrix A such that the map could be written
T (~x) = A~x, where A~x is the matrix product of the matrix A times the column vector ~x. Every map of the
form T (~x) = A~x is automatically linear, because A(~x + ~
y ) = (A~x) + (A~y ) by properties (9) and (12) of
matrix operations. We shall now show that, conversely, for each linear map T (~x) there is a matrix A such that
T (~x) = A~x.
First we consider the case that T (~x) is a linear map from IR2 (that is, two component vectors) to IR2 .
Any vector ~x in IR2 can be written
x1
x2
= x1
1
0
+ x2
= x1~e1 + x2~e2
0
1
e1 =
1
0
where
~e2 =
0
1
Because T is linear
T (~x) = T (x1~e1 + x2~e2 ) = x1 T (~e1 ) + x2 T (~e2 )
Define the numbers a11 , a12 , a21 , a22 by
a
T (~e1 ) = 11
a21
a12
T (~e2 ) =
a22
Then
T (~x) = x1 T (~e1 ) + x2 T (~e2 ) = x1
a11
a11 x1 + a12 x2
a12
a11
=
=
+ x2
a21
a21 x1 + a22 x2
a22
a21
a12
a22
x1
x2
The same construction works for linear transformations from IRm to IRn . Define ~ei to be the column
vector all of whose entries are zero, except for the ith , which is one. Note that every m component vector can
be written
x1
1
0
0
x2
0
1
0
~x =
... = x1 ... + x2 ... + + +xm ... = x1~e1 + x2~e2 + xm~em
xm
For each i between 1 and m, T (~ei ) is an ncomponent vector. Think of this vector as a column vector. Then
define the matrix A = T (~e1 ) T (~e2 ) T (~em ) . That is, A is the matrix whose ith column is T (~ei ). This is
the matrix we want, because
x1
x2
xm
= T (~x)
This formula T (~x) = A~x is the reason we defined matrix multiplication the way we did. More generally, if S and
T are two linear transformations with associated matrices MS and MT respectively, then the map constructed
by first applying T and then applying S obeys
S T (~x) = MS T (~x) = MS MT ~x
so that the matrix associated with the composite map S T (~x) is the matrix product MS MT of MS and MT .
It is traditional to use the same symbol to stand for both a linear transformation and its associated matrix. For
example, the matrix associated with the linear transformation T (~x) is traditionally denoted T as well, so that
T (~x) = T ~x.
Exercises for III.2
1) Find the matrices which project on the lines
a) x = y
b) 3x + 4y = 0
b) 3x + 4y = 0
b) x + 2y + 2z = 0
b) x + 2y + 2z = 0
b) /2
c)
3+2
1
3 2
4
2
3 2 2
3+ 2
2
2
12
9
is a rotation in IR3 . What axis does it rotate about and what is the angle of rotation?
8) Find the matrix which first reflects about the line in IR2 that makes an angle with the xaxis and then
reflects about the line that makes an angle with the xaxis. Give another geometric interpretation of this
matrix.
III.3
Matrix Inverses
Suppose A is a matrix. What is A1 ? Its the thing you multiply A by to get 1. What is 1?
Definition III.10 The m m identity matrix Im (generally the subscript m is dropped from the notation) is
the m m matrix whose (i, j) matrix element is 1 if i = j and 0 if i 6= j.
For example
1 0
I2 =
0 1
The reason we call this the identity matrix is that, for any m n matrix A
Im A = AIn = A
It is easy to check that this is true. For example, fix any i and k with 1 i m, 1 k n. By the definition
Pm
of Iij the only nonzero term in the sum (IA)ik = j=1 Iij Ajk is that with j = i. Furthermore the Iii that
appears in that term takes the value one so (IA)ik = Iii Aik = Aik , as desired.
Definition III.11 A matrix B is called an inverse of the matrix A if AB = BA = I. If A has an inverse, then
A is said to be invertible or nonsingular. Otherwise, it is said to be singular. The inverse is generally denoted
A1 .
a
c
b
d
X
Y
Z
W
aX + bY
cX + dY
10
aZ + bW
cZ + dW
1 0
0 1
(1)
cX + dY = 0
(2)
aZ + bW = 0
(1)
cZ + dW = 1
(2)
(ad bc)X = d
d(1) b(2) :
(ad bc)Z = b
c(1) a(2) :
(bc ad)Y = c
X
B=
Y
Z
W
1
d
=
c
ad bc
b
a
Provided ad bc 6= 0, this B exists and obeys equations (1) through (2) and hence AB = I. For B to be an
inverse for A it must also obey
I = BA =
1
d
ad bc c
b
a
a
c
b
d
If you go ahead and multiply out the matrices on the right, you see that this condition is indeed satisfied. We
conclude that, if ad bc 6= 0, the inverse of A exists and is
a
c
b
d
1
1
d b
=
ad bc c a
On the other hand, if ad bc = 0, equations d(1)b(2), d(1)b(2), c(1)a(2) and c(1)a(2) force d = b =
c = a = 0 and then the left hand side of equation (1) is zero for all values of X and Y so that equation (1)
cannot be satisfied and A cannot have an inverse.
Properties of Inverses
1. A has at most one inverse.
Proof: If B and C are both inverses of A, then, by definition, AB = BA = I and AC = CA = I.
These imply B = BI = B(AC) = (BA)C = IC = C.
2. If A and B are both invertible, then so is AB and (AB)1 = B 1 A1 .
11
Proof: We have a guess for (AB)1 . To check that the guess is correct, we merely need to check the
requirements of the definition
(AB)(B 1 A1 ) = ABB 1 A1 = AIA1 = AA1 = I
(B 1 A1 )(AB) = B 1 A1 AB = B 1 IB = B 1 B = I
3. Suppose that A is invertible. Then A~x = ~b ~x = A1~b.
Proof: Multiplying the first equation by A1 gives the second and multiplying the second by A gives
the first.
WARNING: This property is conceptually important. But it is usually computationally much more
efficient to solve A~x = ~b by Gaussian elimination than it is to find A1 and then multiply A1~b.
4. Only square matrices can be invertible.
Outline of Proof: Let A be an invertible m n matrix. Then there exists an n m matrix B such that
AB = I, where I is the m m identity matrix. We shall see in the next section, that the j th column
of B is solves the system of equations A~x = ~ej , where ~ej is the j th column of I. Because the identity
matrix I has rank m, there must exist some 1 j m such that the augmented matrix [A|~e j ] also
has rank m. By property 1 above, the corresponding system of equations must have a unique solution.
Consequently, the number of unknowns, n, must equal the rank, m.
5. If A is an n n matrix then the following are equivalent:
(i) A is invertible.
(ii) ~x = ~0 is the only solution of A~x = ~0
(iii) A has rank n.
(iv) There is a matrix B such that AB = I (i.e. A has a right inverse).
(v) There is a matrix B such that BA = I (i.e. A has a left inverse).
In other words, if a given square matrix satisfies any one of properties (i)(v), it satisfies all of them.
Proof: The notation (i)(ii) means If statement (i) is true, then statement (ii) is also true.
(i)(ii): If A is invertible, then multiplying both sides of A~x = ~0 by A1 gives ~x = A1~0 = ~0.
(ii)(iii): A~x = ~0 has precisely one solution rank A = #unknowns = n .
(iii)(iv): In the next section, well develop a procedure for solving AB = I for B explicitly.
(iv)(v): Assume AB = I. Then B~x = ~0 AB~x = ~0 ~x = ~0. So condition (ii) is applicable to
B, which implies that (iii) and subsequently (iv) are also applicable to B. This implies that
there is a matrix C obeying BC = I. But C = (AB)C = A(BC) = A so BA = I.
(v)(i): Assume that BA = I. Then A~x = ~0 BA~x = ~0 ~x = ~0. So (ii) applies to A. So (iv)
and (v) apply to A.
12
Items (ii), (iii), (iv) and (v) of property 4 are all tests for invertibility. We shall get another test, once we have
generalized the definition of determinant to matrices larger than 3 3: a square matrix A is invertible if and
only if det A 6= 0.
Exercises for III.3
1) Determine which of the following matrices are invertible and, for each that is, find its inverse. Use the
method of Example II.10. Do not used the canned formula derived in Example II.10.
2 4
1 3
1 1
c)
b)
a)
1 2
2 2
1 1
2) Either prove or find a counterexample to the statement If BA = I and AC = I then B = C.
III.4
Finding Inverses
Suppose that we are given an n n matrix A and we wish to find a matrix B obeying AB = I. Denote
~ i the (as yet unknown) ith column of B and by ~ei the column vector having all entries zero except for a
by B
one in the ith row. For example, when n = 2
b11 b12
b11
~
B=
B1 =
b21 b22
b21
b12
~
B2 =
b22
1
~e1 =
0
0
~e2 =
1
a12
a22
b11
b21
a b + a12 b21
= 11 11
a21 b11 + a22 b21
~1 B
~2 B
~ n ] = [AB
~ 1 AB
~ 2 AB
~ n ] and [~e1 ~e2 ~en ] to be equal, all of their columns
For the two matrices A[B
must agree, so the requirement AB = I may be expressed as
~ i = ~ei
AB
for i = 1, , n
5
2
1
1
2 3 2 5 1
1 1 1 2 0
3 2
2 1 0
1 1 3 1 0
It is important to always remember that if we were to erase
0
1
0
0
all
0 0
0 0
1 0
0 1
columns to the right of the vertical line except
~ i = ~ei . So any
for the ith , we would have precisely the augmented matrix appropriate for the linear system A B
row operation applied to the big augmented matrix [A|~e1 ~e2 ~en ] really is a simultaneous application of the
same row operation to n different augmented matrices
2 3 2
(2) 0.5(1) 0 0.5 0
[A|ei ] at the
5 1
0.5 0.5
6.5 1.5
1.5 0.5
0 0 0
1 0 0
0 1 0
0 0 1
2 3 2
5 1
0
0
1
0
0 0.5 0 0.5 0.5
(3) 13(2) 0 0 1
0 5
13 1
(4) 5(2)
0 0 4
1
2
5 0
2 3 2
5 1
0
0
1
0
0 0.5 0 0.5 0.5
0 0 1
0 5
13 1
(4) 4(3) 0 0
0
1
18
47 4
0
0
0
1
0
0
0
1
We could at this stage backsolve the four systems individually. But it is easier to do all four at the same time
by applying more row operations chosen to turn the left hand side into the identity matrix.
2 3 2
5 1
0
0 0
0 0
0 0.5 0 0.5 0.5 1
0 5 13 1 0
(3) 0 0 1
0 0 0
1
18 47 4 1
2 3 2 5 1
0
0 0
2(2) + (4) 0 1 0 0 19 49 4 1
0 0 1 0 5 13 1 0
0 0 0 1 18 47 4 1
1
0
0
0
0
1
0
0
0
0
1
0
0
0
0
1
22 57 5 1
19 49 4 1
5
13 1 0
18 47 4 1
What conclusion do we come to? Concentrate on, for example, the first column to the right of the vertical line.
In fact, mentally erase the other three columns to the right of the vertical line in all of the above computations.
Then the above row operations converted
2 3 2 5 1
1 1 1 2 0
3 2
2 1 0
1 1 3 1 0
into
14
1
0
0
0
0
1
0
0
0
0
1
0
0
0
0
1
22
19
5
18
Because row operations have no effect on the set of solutions of a linear system we can conclude that any given
~ 1 obeys
B
2 3
1 1
3 2
1 1
As
2
1
2
3
5
1
2 ~
0
B1 =
1
0
1
0
1
0
0
0
0
1
0
0
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
0
0
22
0 ~
19
B1 =
0
5
1
18
0
0 ~
~1
B1 = B
0
1
22
19
~1 =
B
5
18
~ 1 , the first column of A1 is the first column to the right of the bar in the final augmented
In other words, B
matrix. Repeating this argument with the other columns
A1
22 57 5 1
19 49 4 1
=
5
13 1 0
18 47 4 1
2
3 1
b)
2
3
a) 1
1 1 4
1 1 1
c) 1 2 3
d)
1 4 9
1 a
f)
e)
0 1
1 0 a
g) 0 1 0
h)
0 0 1
III.5
1 1 1
1 2 1
2 1 1
2 1 4
3 2 5
0 1 1
a 0
where ab 6= 0
0 b
1 a b
0 1 c
0 0 1
Determinants Definition
For n > 2, (in fact n 2) the determinant of an n n matrix A, whose ij entry is denoted a ij , is defined by
det [A] =
n
X
j=1
where M1j is the (n 1) (n 1) matrix formed by deleting, from the original matrix A, the row and column
containing a1j . This formula is called expansion along the top row. There is one term in the formula for each
entry in the top row. The term is a sign times the entry times the determinant of the (n 1) (n 1) matrix
obtained by deleting the row and column that contains the entry. The sign alternates, starting with a +.
a11
det a21
a31
a12
a22
a32
a13
a11
a23 = a11 det a21
a33
a31
a12
a22
a32
a13
a11
a23 a12 det a21
a33
a31
a12
a22
a32
a13
a11
a23 + a13 det a21
a33
a31
a12
a22
a32
a13
a23
a33
Example III.14
1 2 3
0 2
1 2
1 0
det 1 0 2 = 1 det
2 det
+ 3 det
2 1
3 1
3 2
3 2 1
= 1 (0 4) 2(1 6) + 3(2 0) = 12
d)
cos
sin
sin
cos
2) Evaluate the determinant of each of the following matrices by expanding along the top row
1 a b
7 1 5
2 1 5
2 0
0
d) 0 1 c
c) 3 4 5
b) 1 0 3
a) 1 1 5
0 0 1
2 3
0
1 2 0
2 3 1
III.6
Determinants Properties
Property E
If two rows of an n n matrix are exchanged, the determinant is multiplied by 1.
..
..
.
.
~ai
~aj
..
det . = det ...
~aj
~ai
..
..
.
.
16
Property M
Multiplying any single row of a matrix by k multiplies the determinant by k as well.
~a1
~a1
..
..
.
.
To multiply every entry in an n n matrix by k, we have to apply Property M once for each row in the matrix,
so we end up with a factor k n . For example
k
det
0
0
1 0
1 0
= k det
= k k det
= k2
k
0 k
0 1
Property A
Adding any multiple of any row to any other row has no effect on the determinant.
.
..
..
.
~ai + k~am
~ai
..
= det ..
det
.
~am
~am
..
..
.
.
Property D
The determinant of any triangular matrix is the product of its diagonal entries.
a11
0
det
a22
0
0
..
.
an1 n1
ann
Property P
All of these properties follow fairly easily from another (in fact the standard) definition of determinant,
which in turn follows fairly easily from our definition. For any n n matrix A
X
det A =
Pn
Here Pn is the set of all orderings of (1, 2, , n). The symbol P stands for permutation, which is the
mathematical name for a reordering. So
P3 = (1, 2, 3), (1, 3, 2), (2, 1, 3), (2, 3, 1), (3, 1, 2), (3, 2, 1)
We use (i) to denote the ith entry of the permutation . For example, when = (2, 3, 1), (2) = 3. The sign
of a permutation, here denoted sgn is +1 if (1, 2, , n) can be transformed into using an even number of
exchanges of pairs of numbers. Otherwise, the sign is 1. For example (1, 2, 3) can be tranformed into (1, 3, 2)
by just exchanging 2 and 3, so the sign of = (1, 3, 2) is 1. On the other hand, (1, 2, 3) can be tranformed
into (3, 1, 2) by first exchanging 1 and 3 to yield (3, 2, 1) and then exchanging 1 and 2 to yield (3, 1, 2). So the
sign of = (3, 1, 2) is +1. Of course (1, 2, 3) can also be transformed into (3, 1, 2) by first exchanging 1 and 2
to yield (2, 1, 3), then exchanging 1 and 3 to yield (2, 3, 1), then exchanging 2 and 3 to yield (3, 2, 1) and finally
exchanging 1 and 2 to yield (3, 1, 2). This used four exchanges, which is still even. It is possible to prove that
the number of exchanges of pairs of numbers used to transform (1, 2, 3) to (3, 1, 2) is always even. It is also
possible to prove the sgn is welldefined for all permutations .
If A is a 2 2 matrix, the above definition is
det A = A11 A22 A12 A21
with the first term being the = (1, 2) contribution and the second term being the = (2, 1) contribution. If
A is a 3 3 matrix, the above definition is
det A = A11 A22 A33 A11 A23 A32 A12 A21 A33 + A12 A23 A31 + A13 A21 A32 A13 A22 A31
with the terms being the contributions, in order, from = (1, 2, 3), (1, 3, 2), (2, 1, 3), (2, 3, 1), (3, 1, 2), (3, 2, 1).
To verify that the new and old definitions of determinant agree, it suffices to prove that they agree for
1 1 matrices, which is trivial, and that the new definition obeys the expansion along the first row formula.
Outline of Proof of Property P
Once again, we will not give a complete proof. First assume that A is invertible. Then there is a
sequence of row operations, that when applied to A, convert it into the identity matrix. That was the basis
of the algorithm for computing A1 that we developed in III.4. Any row operation can be implemented by
multiplication by a matrix. For example, if A is a
1
0
4
0
0 0 0
1 0 0
A
0 1 0
0 0 1
18
with the exception of row (3) coincide with the corresponding row of A. Row (3) of the product is row (3) of
A plus 4 times row (1) of A. The matrices that implement row operations are called elementary matrices. We
shall denote them by Qj here. We have
Qh Q1 A = I
for some sequence Q1 , , Qh of row operation implementing matrices.
The next step is to check that
det QC = det Q det C
for any elementary matrix Q and any square matrix C. This is straight forward because we already know the
effect that any row operation has on a determinant. Then
Qh Q1 A = I
Qh Q1 AB = B
Now suppose that A is not invertible. Then there is a sequence of row operations, that when applied
whose last row is identically zero. Implementing these row operations using
to A, convert it into a matrix A,
multiplication by elementary matrices, we have
Q
1 A = A
Q
h
det Q
1 det A = det A
det Q
h
det Qh det Q1 det A = 1 with h = 1 and A replaced by the inverse of Q1 , we see that every elementary
matrix has nonzero determinant. So we conclude that if A is not invertible it necessarily has determinant zero.
Finally, observe that if A fails to be invertible, the same is true for AB (otherwise B(AB) 1 is an inverse for
A) and so both det A = 0 and det AB = 0.
Implications of Properties E, M, A ,D, P
1) If any two rows of a matrix A are the same, then det A = 0 because
~a1
~a1
..
..
.
.
~
~
b
b
.
= det ..
.
det
.
.
~
~
b
b
.
.
..
..
~an
~an
On the right hand side, the two rows containing ~b have been interchanged.
n
X
j=1
19
where Mij is the (n 1) (n 1) matrix formed by deleting from the original matrix A the row and column
containing aij . To get the signs (1)i+j right, you
+
..
.
1 2
det 1 0
3 2
+
+
+
.. . .
..
.
.
.
3
2 3
1 3
1 2
2 = 1 det
+ 0 det
2 det
2 1
3 1
3 2
1
= 1 (2 6) + 0 2(2 6) = 12
3) We can now use Gaussian elimination to evaluate determinants. Properties A, E, M say that if you take a
matrix U and apply to it a row operation, the resulting matrix V obeys
det U = det V
det U = det V
det U =
1
k
det V
These properties, combined with Gaussian elimination, allow us to relate the determinant of any given matrix
to the determinant of a triangular matrix, that is trivially computed using Property D.
Example III.16
1
2
det
1
1
2
4
3
3
1
0
5
3
1
2
3 A
0
= det
0
6
0
9
(1)
1
2 1
2
0 2 1 (2) 2(1) E
0
= det
(3) (1)
0
1 4
4
(4) (1)
0
1 2
7
1
A
0
= det
0
0
1
(1)
2 1
2
(2)
1 4
4
A
0
= det
0
(3)
0 2 1
0
(4) (2)
0 2 3
= 1 1 (2) 4 = 8
2 1
2
1 4
4
0 2 1
1 2
7
(1)
(3)
(2)
(4)
(1)
2 1
2
(2)
1 4
4
(3)
0 2 1
(4) (3)
0 0
4
det A 6= 0
Proof: Let R be the triangular matrix that results from the application of Gaussian elimination to the
matrix A. Then, by properties E, M and A,
det A = (nonzero number) det R
20
So
det A 6= 0 det R 6= 0
the diagonal entries Rjj of R are all nonzero (Property D)
rank R = n
A is invertible
(Property 4 of III.3)
5)
det A1 = det A
det Am = det A
are easy consequences of property P.
1
m
2 1 5
1 0 3
1 2 0
a)
b)
7 1 5
3 4 5
2 3
0
c)
1 a b
0 1 c
0 0 1
2) Evaluate the determinant of each of the following matrices using row reduction
a)
c)
1
1
1
1
3
2
1
4
1
2
2
1
1
1
3
1
1 1
4 8
4 8
1 1
2 0
5 2
1 1
2 3
b)
d)
0
1
2
3
1
1
1
1
21
23
1
2
52
have an inverse?
4) For which values of the parameter does the system of linear equations
2x1 x2 = x1
2x1 + 5x2 = x2
have a solution other than x1 = x2 = 0?
21
1
0
1
2
1 1
2 4
3 9
4 16
2 3
1 2
0 1
1 0
1
8
27
64
III.7
Determinants Applications
= (1)i+j
ij
det Mji
det A
where Mji is the matrix gotten by deleting from A the row and column containing Aji .
WARNING: This formula is useful, for example, for studying the dependence of A1 on matrix
elements of A. But it is usually computationally much more efficient to solve AB = I by Gaussian
elimination than it is to apply this formula.
Proof: The foundation for this formula is the expansion formula
det A =
It is true for any j. This was implication number 2 in the last section. Let B be the matrix with
Bij = (1)i+j det Mji
We have to show that (AB)kj is det A if j = k and 0 if j 6= k. But
(AB)kj =
Aki Bij =
If k = j this is precisely the formula for det A given above. If k 6= j, this is the expansion along row j
of A by row k of A. Row numbers j and k of A are identical so that det A = 0 by implication number
1 of Property E.
1 1 1
A = 1 2 3
2 3 1
22
Then
det M11
det M21
det M31
2 3
1 3
1 2
= det
= 7 det M12 = det
= 5 det M13 = det
= 1
3 1
2 1
2 3
1 1
1 1
1 1
=1
= 1 det M23 = det
= 2 det M22 = det
= det
2 3
2 1
3 1
1 1
1 1
1 1
= det
=1
det M32 = det
=2
det M33 = det
=1
2 3
1 3
1 2
so that
det A = 1 M11 1 M12 + 1 M13 = 7 + 5 1 = 3
and
A1
7 2
1
1
5 1 2
=
3
1 1 1
WARNING: This formula is useful, for example, for studying the dependence of A1~b on matrix
elements of A and ~b. But it is usually computationally much more efficient to solve A~x = ~b by Gaussian
elimination than it is to apply this formula.
Proof: Since ~x = A1~b,
det A xi = det A A1~b)i = det A
~
A1
ij bj =
The right hand side is the expansion along column i of the determinant of the matrix constructed from
A by replacing column number i with ~b.
1 1 1
A = 1 2 3
2 3 1
4
~b = 9
7
23
4
1
x1 =
det 9
3
7
1
1
det 1
x2 =
3
2
1
1
x3 =
det 1
3
2
(1)
1 1
4
1 1
3
1
2 3 = det 3 1 0 (2) 3(1) =
=1
3
3
3 1
3
2 0 (3) (1)
4 1
1 4
1
(1)
1
3
=1
9 3 = det 0 5
2 (2) (1) =
3
3
7 1
0 1 1 (3) 2(1)
1 4
1 1 4
(1)
1
6
=2
2 9 = det 0 1 5 (2) (1) =
3
3
3 7
0 1 1 (3) 2(1)
~a ~b = a1
b1
a2
b2
k
a3
b3
We have aready seen in I.2 that areas of parallelograms and volumes of parallelopipeds are given by
determinants.
a
volume of parallelogram with sides ~a, ~b = det 1
b1
a1
volume of parallelopiped with edges ~a, ~b, ~c = det b1
c1
a2
b2
a2
b2
c2
a3
b3
c3
As a result, the standard change of variables formula for integrals in more than one dimension involves a
determinant.
III.8
Worked Problems
Questions
1) Compute the following matrix products:
(a)
1 0
3 5
0 3
1 4
(b)
(g)
(j)
2 1
0 4
0 1
1 2
x
2
a b
1 4
y
3
1 0 1
2 1 0
2 1
1 2 0
0 1
0 1 1
3 0
2 3
(e) [ 3 1 0 ] 3 0
0 5
1 0
1 0 3 5
(d) 2 3
0 1 1 2
5 0
(h)
3 3 5
3 2
2 1 0
1 0 01 0
0 0 3
2 0
0 2 0
24
1 2 3
0 4 3
(c) 0 0 1 2 1 1
1 0 0
8 0 4
4
(f ) [ 2 3 ]
5
(i)
1 3
5 4
a
c
b
d
2) Let
A=
1 2 3
4 5 6
B=
3 1 2
3 2 0
1 2
A=
3 1
2 6 1
B=
1 1 0
3 2
C = 1 2
4 1
(a) Compute AB, (AB)C, BC and A(BC) and verify that (AB)C = A(BC). So it is not necessary to
bracket ABC.
(b) Can the order of the factors in the product ABC be changed?
4) Let
1 2
A=
3 4
1 1
B=
0 3
1 0
0 1
B=
0 1
1 0
(a) Find all matrices that commute with A. That is, find all matrices M that obey AM = M A.
(b) Find all matrices that commute with B. That is, find all matrices M that obey BM = M B.
(c) Find all matrices that commute with both A and B. That is, find all matrices M that obey AM = M A
and BM = M B.
6) Suppose the matrix B obeys B 7 3B + I = 0. Is B invertible? If so, what is its inverse?
7) State whether each of the following statments is true or false. In each case give a brief reason.
(a) No square matrix with real entries can obey A2 = I.
8) Suppose that a taxicab company uses the following strategy to maintain a fleet of fixed size: on December
31 of each year it sells 25% of the cars that are one year old (the lemons), 50% of all two year cars and all
three year old cars; the next day, January 1, it buys enough new cars to replace those sold the previous day.
(a) Let ~x(n) be the vector which gives the number of cars that are in each age category during year n.
Find a 3 3 matrix B such that ~x(n + 1) = B~x(n).
25
(b) Suppose the company starts with a fleet consisting of entirely third year cars. What proportion of the
fleet will consist of third year cars in each of the following four years?
(c) Find all equilibrium fleet vectors. That is, all vectors ~x(n) obeying ~x(n + 1) = ~x(n).
(d) Find a matrix C that moves the fleet ahead two years. That is ~x(n + 2) = C~x(n).
(e) Are there any fleet vectors which repeat themselves every two years, but not every year?
9) Determine whether or not each of the following functions is a linear transformation.
(a) f (x, y, z) = 3x 2y + 5z
(b) f (x, y, z) = 2y + 9z 12
(c) f (x, y, z) = x 2 + y 2 + z 2
(d) f (x, y, z) = [x + y, x y, 0]
(e) f (x, y, z) = [x + y, x y, 1]
10) Suppose that a linear transformation maps [1, 1] to [4, 7] and [1, 1] to [8, 3]. What vector does it map
[5, 14] to?
11) Is it possible for a linear transformation to map [1, 2] to [1, 0, 1], [3, 4] to [1, 2, 3] and [5, 8] to [3, 1, 6]?
12) Find the matrices representing the linear transformations
(a) f (x, y) = [x + 2y, y x, x + y]
(b) g(x, y, z) = [x y z, 2y + 5z 3x]
(c) f g(x, y, z)
(d) g f (x, y)
13) A linear transformation maps to
, to k and k to .
(a) Find the matrix of the linear transformation.
(b) The linear transformation is a rotation. Find the axis of rotation.
(c) Find the angle of rotation.
(d) Show that this linear transformation really is a rotation.
14) Determine the matrices of the reflections in the following planes in IR 3
(a) x + y + z = 0
(b) 2x 2y z = 0
~ = 1 +2 +3 k.
15) A solid body is rotating about an axis which passes through the origin and has direction
~ radians per second. Denote by ~x the coordinates, at some fixed time, of a point
The rate of rotation is kk
fixed to the body and by ~v the velocity vector of the point at that time. Find a matrix A such that ~v = A~x.
16) Find the matrix of the linear transformation on IR2 which
(a) rotates each vector ~x clockwise by 45 .
(b) reflects each vector ~x in the xaxis and then rotates the result counterclockwise by 90 .
(c) reflects each vector ~x about the line x = y and then projects the result onto the xaxis.
17) The matrix on the left below is the inverse of the matrix on the right below. Fill in the missing entires.
4
3
2
4
3
1
5
2 2 1 1
11
6
4
3
26
1 1 0
3 1 1
7
10 5
8
3 1
(a)
1 4
2 7
1 2 3
(f ) 4 5 6
7 8 9
(b)
2 5
4 8
0
0
(g)
0
3
0
0
2
0
(c)
1
0
0
0
3 4
4 3
1 2 1
(d) 2 5 3
1 3 9
0
1
0
0
1 2 3
(e) 2 3 4
3 4 6
19) Let
1 2 p
B = 0 1 1
2
1 0
n=0
(I A)1 =
An
n=0
21) Suppose that some square matrix obeys An = 0 for some positive integer.
(a) Find the inverse of A.
(b) Find the inverse of I A.
22) Suppose that L is a linear transformation from IRn to IRn . Prove that its inverse, if it exists, is also linear.
3 2 p
23) Suppose that det 0 p 1 = 10. What are the possible values of p?
1 0 2
24) Let
1
0
A=
0
3
3
4
1
5
0
0
7
2
8
where the s denote unknown entries. Find all possible values of det A.
25) Suppose that the 3 3 matrix A obeys det A = 5. Compute (a) det(4A) (b) det(A 2 ) (c) det(4A2 )
26) Suppose that the 6 6 matrix A obeys A4 = 2A. Find all possible values of det A.
27) Evaluate
1
a
det 2
a
a3
a
a2
a3
1
27
a2
a3
1
a
a3
1
a
a2
Solutions
1) Compute the following matrix products:
(a)
1 0
3 5
0 3
1 4
(b)
1 0
1 0 3 5
(d) 2 3
0 1 1 2
5 0
(g)
2 1
0 4
0 1
1 2
(j)
x
2
a b
1 4
y
3
2 1
1 2 0
0 1
0 1 1
3 0
2 3
(e) [ 3 1 0 ] 3 0
0 5
1 0 1
2 1 0
(h)
3 3 5
3 2
2 1 0
1 0 01 0
0 0 3
0 2 0
2 0
1 2 3
0 4 3
(c) 0 0 1 2 1 1
1 0 0
8 0 4
4
(f ) [ 2 3 ]
5
(i)
1 3
5 4
a
c
b
d
Solution.
(a)
1 0
3 5
0 3
10+01 13+04
0 3
=
=
5 29
30+51 33+54
1 4
(b)
(c)
2 1
12+20+03 11+21+00
2 3
1 2 0
=
0 1 =
0210+13 0111+10
3 1
0 1 1
3 0
28 6 17
= 8 0 4
0 4 3
(d)
11+00 10+01 13+01 15+02
1 0
2 3 1 0 3 5 = 21+30 20+31 23+31 25+ 32
0 1 1 2
51+00 50+01 53+01 55+02
5 0
1 0 3 5
= 2 3 9 16
5 0 15 25
(e)
(f)
2 3
[3 1 0]3 0 = [3 2 + 1 3 + 0 0 3 3 + 1 0 + 0 5] = [9 9]
0 5
[2 3]
4
= [ 2 4 + 3 5 ] = [ 23 ]
5
28
(g)
2 1
0 4
0 1
1 2
1 0 1
1 4
1 0 1
7 4 1
=
=
2 1 0
4 8
2 1 0
12 8 4
(h)
(i)
3 2
3 2
3 3 5
5 6 10
2 1 0
41 10
1 0 =
1 0 01 0 =
0 6 0
0 0 3
6 0
2 0
2 0
0 2 0
1 3
5 4
y
3
b
a + 3c b + 3d
=
d
5a + 4c 5b + 4d
a
c
(j)
x
2
ax y
a b
=
2a 3
1 4
bx + 4y
2b + 12
2) Let
A=
1 2 3
4 5 6
B=
3 1 2
3 2 0
(b)
27 9 18
6 12 18
9B =
6A =
27 18 0
24 30 36
6 12 18
27 9 18
21 21 36
6A + 9B =
+
=
24 30 36
27 18 0
3 48 36
(c) Applying properties 3 and 5 of the Basic Properties of Matrix Operations given in III.1, we have,
3
1 2
A=
3 1
2 6 1
B=
1 1 0
3 2
C = 1 2
4 1
(a) Compute AB, (AB)C, BC and A(BC) and verify that (AB)C = A(BC). So it is not necessary to
bracket ABC.
(b) Can the order of the factors in the product ABC be changed?
29
Solution. (a)
4 4 1
AB =
5 19 3
16 17
BC =
2 0
3 2
4 4 1
20
1 2 =
(AB)C =
5 19 3
46
4 1
20
1 2
16 17
A(BC) =
=
46
3 1
2 0
17
51
17
51
1 2
3 4
B=
1 1
0 3
2AB
B2
A2 + 2AB + B 2
7
10
1 2
1 2
=
=
15 22
3 4
3 4
1 2
1 1
1
7
2 14
=2
=2
=
3 4
0 3
3 15
6 30
1 1
1 1
1 4
=
=
0 3
0 3
0 9
6 0
1 4
2 14
7
10
=
+
+
=
9 1
0 9
6 30
15 22
(b)
0 1
1 1
1 2
=
+
A+B =
3 1
0 3
3 4
0 1
0 1
3 1
2
(A + B) =
=
3 1
3 1
3 4
(c) (A + B)2 = A(A + B) + B(A + B) = A2 + AB + BA + B 2 , so the answer to part a minus the answer
to part b ought to be
1 2
1 1
1 1
1 2
3 4
0 3
0 3
3 4
3
1
4
6
1
7
=
=
6 3
9 12
3 15
1 0
0 1
B=
30
0 1
1 0
(a) Find all matrices that commute with A. That is, find all matrices M that obey AM = M A.
(b) Find all matrices that commute with B. That is, find all matrices M that obey BM = M B.
(c) Find all matrices that commute with both A and B. That is, find all matrices M that obey AM = M A
and BM = M B.
Solution. (a) In order for both AM and M A to be defined, M must be a 2 2 matrix. Let
M=
Then
a
c
b
d
1 0
a b
a
b
=
0 1
c d
c d
a b
1 0
a b
MA =
=
c d
0 1
c d
AM =
These are the same if and only if b = b and c = c which in turn is the case if and only if b = c = 0. So
a 0
for some numbers a and d.
we need M to be of the form
0 d
a
c
b
d
c d
b
=
a b
d
b a
0 1
b
=
d c
1 0
d
0 1
1 0
a
c
a
c
These are the same if and only if c = b and a = d. So we need M to be of the form
numbers a and b.
a
b
b
a
for some
(c) In order to satisfy the conditions of both part a and part b, we need b = c = 0 and a = d, so M must
1 0
be of the form a
for some number a.
0 1
6) Suppose the matrix B obeys B 7 3B + I = 0. Is B invertible? If so, what is its inverse?
Solution. Because B(3I B 6 ) = 3B B 7 = I, the matrix B is invertible with inverse 3I B 6 .
7) State whether each of the following statments is true or false. In each case give a brief reason.
(a) No square matrix with real entries can obey A2 = I.
0 a
b 0
So if ab = 1 (e.g. a = 1, b = 1), A2 = I.
31
A2 =
ab
0
0
ab
0 a
b 0
A2 =
ab
0
0
ab
a2
A =
0
0
b2
So if ab = 0 (e.g. a = 1, b = 0), A2 = 0.
(c) This statement is false . For example
a 0
A=
0 b
= x2 (n + 1) = .75x1 (n)
= x3 (n + 1) =
.50x2 (n)
32
So
.25 .5 1
B = .75 0 0
0 .5 0
1 7
.25 .5 1
4q
16 q
3
3
= 16
q
~x(4) = B~x(3) = .75 0 0
4q
3
0 .5 0
0
q
3
3
8 , 32
1
q
.25 .5 1
4q
~x(3) = B~x(2) = .75 0 0 0 = 34 q
0
0 .5 0
0
q
0
.25 .5 1
~x(2) = B~x(1) = .75 0 0 0 = 0
0
q
0 .5 0
7 37
.25 .5 1
16 q
64 q
3
64
.75 .5
1
0
(B I)~x(n) = .75 1 0 = 0
0
.5 1
0
The last equation forces = 2 and the second equation forces = 43 = 38 . In order to have an integer
numbers of cars, has to be a positive multiple of 3. Let = 3p. The general solution is
8
~x(n) = p 6 , p = 0, 1, 2, 3
3
(d) We wish to find a matrix C obeying ~x(n + 2) = C~x(n). As ~x(n + 1) = B~x(n) and ~x(n + 2) = B~x(n + 1),
we have ~x(n + 2) = B~x(n + 1) = B 2 ~x(n). So
1/4 2/4 1
1/4 2/4 1
C = B 2 = 3/4 0 0 3/4 0 0 =
0 2/4 0
0 2/4 0
33
7 10 4
1
3 6 12
16
6 0 0
9 10
4
0
1
(C I)~x(n) =
3 10 12 = 0
16
6
0
16
0
The last equation forces = 83 , just as in part c. The last equation minus twice the second equation forces
20 40 = 0 or = 2 just as in part c. The general solution is once again
8
~x(n) = p 6 , p = 0, 1, 2, 3
3
No fleet vector repeats itself every two years but not every year.
9) Determine whether or not each of the following functions is a linear transformation.
(a) f (x, y, z) = 3x 2y + 5z
(b) f (x, y, z) = 2y + 9z 12
(c) f (x, y, z) = x 2 + y 2 + z 2
(d) f (x, y, z) = [x + y, x y, 0]
(e) f (x, y, z) = [x + y, x y, 1]
Solution. We use the notations ~x to stand for [x, y, z], ~x0 to stand for [x0 , y 0 , z 0 ] and f (~x) to stand for
f (x, y, z). Observe that ~x + ~x0 = [x + x0 , y + y 0 , z + z 0 ].
(a) f (~x) = 3x 2y + 5z is a function from IR3 to IR. For it to be linear, the two expressions
f (~x + ~x0 ) = 3(x + x0 ) 2(y + y 0 ) + 5(z + z 0 )
f (~x) + f (x~0 ) = (3x 2y + 5z) + (3x0 2y 0 + 5z 0 )
have to be equal for all ~x, ~x0 in IR3 and all , in IR. They are, so this f is linear .
(b) f (~x) = 2y + 9z 12 is a function from IR3 to IR. For it to be linear, the two expressions
f (~x + ~x0 ) = 2(y + y 0 ) + 9(z + z 0 ) 12
f (~x) + f (x~0 ) = (2y + 9z 12) + (2y 0 + 9z 0 12)
have to be equal for all ~x, ~x0 in IR3 and all , in IR. They arent, because when x = y = z = x0 = y 0 =
z 0 = 0 the first expression reduces to 12 and the second reduces to 12( + ). These are equal only
when + = 1. So this f is not linear .
(c) f (~x) = x2 + y 2 + z 2 is a function from IR3 to IR. For it to be linear, the two expressions
f (~x + ~x0 ) = (x + x0 )2 + (y + y 0 )2 + (z + z 0 )2
2
34
(d) f (~x) = [x + y, x y, 0] is a function from IR3 to IR3 . For it to be linear, the two expressions
f (~x + ~x0 ) = [(x + x0 ) + (y + y 0 ), (x + x0 ) (y + y 0 ), 0]
f (~x) + f (x~0 ) = [x + y, x y, 0] + [x0 + y 0 , x0 y 0 , 0]
= [x + y + x0 + y 0 , x y + x0 y 0 , 0]
have to be equal for all ~x, ~x0 in IR3 and all , in IR. They are, so this f is linear .
(e) f (~x) = [x + y, x y, 1] is a function from IR3 to IR3 . For it to be linear, the two expressions
f (~x + ~x0 ) = [(x + x0 ) + (y + y 0 ), (x + x0 ) (y + y 0 ), 1]
f (~x) + f (x~0 ) = [x + y, x y, 1] + [x0 + y 0 , x0 y 0 , 1]
= [x + y + x0 + y 0 , x y + x0 y 0 , + ]
have to be equal for all ~x, ~x0 in IR3 and all , in IR. The third components are equal only for + = 1,
so this f is not linear .
(f) f (~x) = [x, y, z 2 ] is a function from IR3 to IR3 . For it to be linear, the two expressions
f (~x + ~x0 ) = [x + x0 , y + y 0 , (z + z 0 )2 ]
2
f (~x) + f (x~0 ) = [x, y, z 2 ] + [x0 , y 0 , z 0 ]
2
= [x + x0 , y + y 0 , z 2 + z 0 ]
have to be equal for all ~x, ~x0 in IR3 and all , in IR. If z 0 = 0 the third component of the first expression
reduces to 2 z 2 while that of the second expression reduces to z 2 . These agree only for z = 0 or = 0, 1.
So this f is not linear .
10) Suppose that a linear transformation maps [1, 1] to [4, 7] and [1, 1] to [8, 3]. What vector does it map
[5, 14] to?
Solution 1. The vector
[5, 14] = 5[1, 0] + 14[0, 1] = 25 ([1, 1] + [1, 1]) +
14
2 ([1, 1]
[1, 1]) =
19
2 [1, 1]
29 [1, 1]
is mapped to
19
2 [4, 7]
92 [8, 3] =
4
106
2, 2
= [2, 53]
Solution 2. Write the vectors as column, rather than row vectors. Let
a
c
b
d
a
c
b
d
4
a+b
1
=
=
7
c+d
1
35
a
c
b
d
8
ab
1
=
=
3
cd
1
This consists of a system of two equations in the two unknowns a and b as well as a system of two equations
in the two unknowns c and d. Both systems are easy to solve
a+b=4 ab=8
a=6
b = 2
c+d =7 cd=3
c=5 d=2
Now that we know the matrix of the linear transformation, we just have to apply it to the specified input
vector.
a
c
b
d
2
5
6 2
5
30 28
=
=
=
53
14
5 2
14
25 + 28
11) Is it possible for a linear transformation to map [1, 2] to [1, 0, 1], [3, 4] to [1, 2, 3] and [5, 8] to [3, 1, 6]?
Solution. [5, 8] = 2[1, 2] + [3, 4]. So for the map to be linear, it is necessary that [3, 1, 6] = 2[1, 0, 1] +
[1, 2, 3] = [3, 2, 1], which is false. So, it is not possible .
12) Find the matrices representing the linear transformations
(a) f (x, y) = [x + 2y, y x, x + y]
(b) g(x, y, z) = [x y z, 2y + 5z 3x]
(c) f g(x, y, z)
(d) g f (x, y)
Solution. Writing column, rather than row vectors.
(a)
x + 2y
a b
ax + by
y x = c d x = cx + dy
y
x+y
e f
ex + f y
1 2
1 1
1 1
(b)
x
ax + by + cz
a b c
xyz
y =
=
dx + ey + f z
d e f
2y + 5z 3x
z
1 1 1
3 2
5
(c) Substituting
into
x
x
1
1
1
u
y
= g y =
3 2
5
v
z
z
1 2
u
u
f
= 1 1
v
v
1 1
36
gives
1 2
x
1 2
x
1
f g y = 1 1 g y = 1 1
3
1 1
z
1 1
z
x
5 3 9
x
1 1
y = 4 3 6 y
2
5
z
2 1 4
z
(d) Substituting
u
1 2
x
x
v=f
= 1 1
y
y
w
1 1
into
u
u
1
1
1
v
g v =
3 2
5
w
w
gives
1 2
x
1 1 1
x
1 1 1
x
1 0
x
=
1 1
=
f
=
g f
y
3 2
5
y
3 2
5
y
0 1
y
1 1
13) A linear transformation maps to
, to k and k to .
(a) Find the matrix of the linear transformation.
(b) The linear transformation is a rotation. Find the axis of rotation.
(c) Find the angle of rotation.
(d) Show that this linear transformation really is a rotation.
Solution. (a) The matrix must obey
a b c
1
0
d e f 0 = 1
g h i
0
0
a b c
0
0
d e f 1 = 0
g h i
0
1
a b c
0
1
d e f 0 = 0
g h i
1
0
0 0 1
T = 1 0 0
0 1 0
(b) Perform the following little experiment. Take a book. Rotate the book, about its spine, by 45 . Observe
that the spine of the book does not move at all. Vectors lying on the axis of rotation, do not change when
the rotation is executed. To find the axis of rotation of T , we just need to find a nonzero vector ~n obeying
T ~n = ~n.
n1
0 0 1
n1
1 0 0 n2 = n2
n3
n3
0 1 0
n1
n3
n1 = n2
n3
n2
n1
1
n2 = c 1 for any c
n3
1
(c) Rotate the book, about its spine, by 45 again. Observe that the bottom and top edges of the book
rotate by 45 . Under a rotation of , vectors perpendicular to the axis of rotation rotate by . Vectors
that are neither perpendicular to nor parallel to the axis of rotation, rotate by angles that are strictly
37
between 0 and . (Repeat the book experiment a few times, concentrating on vectors that are almost
parallel to the spine and then on vectors that are almost perpendicular to the spine, to convince yourself
that this is true.) So to determine the angle of rotation, we select a vector, ~v , perpendicular to the axis of
rotation, [1, 1, 1], and compute the angle between ~v and T~v. The vector ~v = + is perpendicular to
the axis of rotation, because [1, 1, 0] [1, 1, 1] = 0. It gets mapped to
0 0 1
1
0
1 0 0 1 = 1
0 1 0
0
1
The angle, , between + and the vector
+ k that it is mapped to obeys
= k + k k + kk
cos
( + ) (
+ k)
2 cos = 1
= 120
k,
+ bk and makes an angle 120 with respect to (a + b) + a
+ bk.
The vector (a + b) + a
+ bk gets mapped to
0 0 1
a+b
b
1 0 0 a = a b
0 1 0
b
a
by the dot product test. The lengths k(a + b) + a
=
This vector is again perpendicular to k,
+ bkk
p
p
p
= b2 + (a + b)2 + a2 both equal 2(a2 + b2 + ab). The
(a + b)2 + a2 + b2 and k b (a + b)
+ akk
dot product
[b (a + b)
= b(a + b) a(a + b) + ab
[(a + b) + a
+ bk]
+ ak]
= a2 b2 ab
b (a + b)
= 21 k(a + b) + a
+ bkkk
+ akk
shows that the angle between the two vectors is 120 .
14) Determine the matrices of the reflections in the following planes in IR 3
(a) x + y + z = 0
(b) 2x 2y z = 0
Solution. (a) The vector ~n = + + k is perpendicular to the given plane. The projection of any vector ~x
on ~n is
1
~n ~x
x+y+z
proj~n (~x) =
~
n
=
1
k~nk2
3
1
38
The reflection is
refl(~x)
x
2
x 2y 2z
1 2 2
x
1
x
+
y
+
z
1
2 = y 2x 2z = 2 1 2 y
~x2proj~n (~x) = y
proj~n (~x)
3
3
3
z
2
z 2x 2y
2 2 1
z
~x
Check: The vector ~n, which is perpendicular to the plane, should be mapped to ~n. On the other hand,
both of which are parallel to the plane, should be mapped to themselves.
the vectors and k,
1 2 2
1
1
1
2 1 2 1 = 1
3
2 2 1
1
1
1 2 2
1
1
1
2 1 2 1 = 1
3
2 2 1
0
0
0
0
1 2 2
1
2 1 2 1 = 1
3
1
1
2 2 1
(b) The vector ~n = 2 2
k is perpendicular to the given plane. The projection of any vector ~x on ~n is
2
~n ~x
2x 2y z
proj~n (~x) =
2
~n =
k~nk2
9
1
The reflection is
x
2
x + 8y + 4z
1 8
4
x
2x
2y
z
1
1
2 = y + 8x 4z = 8 1 4 y
~x 2proj~n (~x) = y 2
9
9
9
z
1
7z + 4x 4y
4 4 7
z
Check: The vector ~n, which is perpendicular to the plane, should be mapped to ~n. On the other hand,
both of which are parallel to the plane, should be mapped to themselves.
the vectors + and + 2k,
2
2
1 8
4
1
8 1 4 2 = 2
9
1
1
4 4 7
1
1
1 8
4
1
8 1 4 1 = 1
9
0
0
4 4 7
1 8
4
1
1
1
8 1 4 0 = 0
9
4 4 7
2
2
~ = 1 +2 +3 k.
15) A solid body is rotating about an axis which passes through the origin and has direction
~ radians per second. Denote by ~x the coordinates, at some fixed time, of a point
The rate of rotation is kk
fixed to the body and by ~v the velocity vector of the point at that time. Find a matrix A such that ~v = A~x.
39
~ ~x = 1
~v =
x
2
y
2 z 3 y
0
k
3 = 1 z + 3 x = 3
1 y 2 x
2
z
3
0
1
2
x
1 y
z
0
1 (
)
2
1 1
1 1
1 (
+ ).
2
The matrix
0 1
1 0
0 1
0 0
4
3
2
4
3
1
5
2 2 1 1
11
6
4
3
1 1 0
3 1 1
7
10 5
8
3 1
1
b
1 1 0
4
3
2
a
7
3
1
1
5
4
3
1
0
0
10 5 c d
2 2 1 1
0
8
3 e 1
11
6
4
3
40
0
1
0
0
0
0
1
0
0
0
0
1
In particular, using (m, n) to denote the equation that matches the matrix element in row m and column n
of the product of the two matrices on the left with the corresponding matrix element of the identity matrix
on the right
(3, 4) :
(2)(0) + (2)(1) +
(1, 4) :
(4)(0) + (3)(1) +
(3, 1) :
d=1
(a)(1) = 0
a=1
b=2
(2, 3) :
(5)(1) +
(1)d + (1)(1) = 0
(2)d +
(4)(1) +
(3)(c) +
(1)(e) = 0
3c + e = 9
(1)(c) + (1)(e) = 1
c + e = 5
The solution is a = 1, b = 2, c = 2, d = 1, e = 3 .
18) Find, if possible, the inverses of each of the following matrices.
(a)
1 4
2 7
(b)
1 2 3
(f ) 4 5 6
7 8 9
2 5
4 8
0
0
(g)
0
3
0
0
2
0
(c)
1
0
0
0
3 4
4 3
1 2 1
(d) 2 5 3
1 3 9
0
1
0
0
1 2 3
(e) 2 3 4
3 4 6
Solution. We have a canned formula for the inverse of 2 2 matrices. But Ill use row reduction, just for
practice.
(a)
Check:
1 4 1 0
2 7 0 1
(1)
(2) 2(1)
1 4 1 0
0 1 2 1
1 4
2 7
2 5 1 0
0 2 2 1
(1) + 4(2)
(2)
"
7 4
1 0
=
2 1
0 1
#
1 0 7 4
0 1 2 1
(b)
Check:
2 5 1 0
4 8 0 1
(1)
(2) 2(1)
(1)/2 + 5(2)/4
(2)/2
1 0
2 5/4
=
0 1
1 1/2
2 5
4 8
1
4/3 1/3 0
0 25/3 4/3 1
"
#
1 0 2 5/4
0 1 1 1/2
(c)
Check:
3 4 1 0
4 3 0 1
(1)/3
(2) 4(1)/3
3 4
4 3
(1) + 4(2)/25
3(2)/25
1 0
3/25 4/25
=
0 1
4/25 3/25
41
"
#
1 0 3/25 4/25
0 1 4/25 3/25
(d)
1 2 1 1 0 0
2 5 3 0 1 0
1 3 9 0 0 1
(1)
1 2 1 1 0 0
(2) 2(1) 0 1 5 2 1 0
(3) (1)
0 1 10 1 0 1
Check:
0 0
(1)
1 2 1 1
0 1 5 2 1 0
(2)
(3) (2) 0 0 5 1 1 1
(1) 2(2) 1 0 0 36/5 21/5 11/5
2
1
(2)
0 1 0 3
(3)
0 0 1 1/5 1/5 1/5
1 2 1
36/5 21/5 11/5
1 0 0
2 5 3 15/5 10/5 5/5 = 0 1 0
1 3 9
1/5
1/5
1/5
0 0 1
(e)
1 2 3 1 0 0
2 3 4 0 1 0
3 4 6 0 0 1
(1)
1 2
3 1 0 0
(2) 2(1) 0 1 2 2 1 0
(3) 3(1) 0 2 3 3 0 1
1 2 0 2 6 3
(1) 3(3)
3 2
(2) 2(3) 0 1 0 0
0 0 1 1 2 1
(3)
Check:
1
(1) 2(2) 1 0 0 2 0
3 2
(2)
0 1 0 0
(3)
0 0 1 1 2 1
1 2 3
2 0
2 3 4 0
3
3 4 6
1 2
(f)
1 2 3 1 0 0
4 5 6 0 1 0
7 8 9 0 0 1
1
1 0 0
2 = 0 1 0
1
0 0 1
(1)
1 2
3 1 0 0
(2) 4(1) 0 3 6 4 1 0
(3) 7(1) 0 6 12 7 0 1
(1)
0 0
1 2
3 1
0 1 2 2 1 0
(2)
(3) 2(2) 0 0
1 1 2 1
(1)
1 2
3 1
0 0
0 3 6 4 1 0
(2)
(3) 2(2) 0 0
0 1 2 1
The last equation has a zero left hand side and nonzero right hand side and so cannot be satisfied. There
is no inverse . As a check, observe that
1 2 3
1
0
4 5 6 2 = 0
7 8 9
1
0
No invertible matrix can map a nonzero vector to the zero vector.
(g)
0
0
0
3
Check:
0
0
2
0
1
0
0
0
0
1
0
0
0
0
0
3
1
0
0
0
0
0
2
0
0
1
0
0
1
0
0
0
0
0
1
0
0
0
0
1
0
0
10
0
1
0
0
(4)/3 1 0 0
(3)/2
0 1 0
(1) 0 0 1
0 0 0
(2)
0
0
0
1
0
0
1
0
1 0
0 0 1/3
0 1/2 0 0 1
=
0 0
0 0
0
0 0
1 0
0
42
0 0 1/3
0 1/2 0
0 0
0
1 0
0
0
0
1
0
0
0
0
1
19) Let
1 2 p
B = 0 1 1
2
1 0
1 2 p 1 0 0
(1)
1 2
0 1 1 0 1 0
0 1
(2)
2
1 0 0 0 1
(3) + 2(1)
0
5
(1)
1 2
p 1 0 0
0 1
(2)
1 0 1 0
(3) + 5(2)
0
0 2p + 5 2 5 1
p 1 0 0
1 0 1 0
2p 2 0 1
1 2 p 1
(1)
0 1 1 0
(2)
2
1 2p+5
(3)/(2p + 5) 0 0
(1) + 2(2) 1 0 0
(2)
0 1 0
(3)
0 0 1
5
2p+5
p
2p+5
2p
2p+5
5
2p+5
1
2p+5
2
2p+5
2
2p+5
(1) + p(3) 1 2 0
(2) + (3) 0 1 0
(3)
0 0 1
0
0
0
1
1
2p+5
p+2
2p+5
1
2p+5
1
2p+5
n=0
(I A)1 =
P
n=0
An
n=0
n=0
n=0
n=0
n=0
n=0
An+1 = A + A2 + A3 + =
(I A)
P
n=0
P
An =
An (I A) = I
P
P
P
P
An =
An A
An =
An
An+1
so
P
P
n=0
p
2p+5
1
2p+5
1
2p+5
5p
2p+5
2p
2p+5
5
2p+5
5
2p+5
2
2p+5
2
2p+5
n=0
An
n=1
P
P
An =
An
An = I
n=0
n
A
(I A) is similar.
n=0
43
n=1
21) Suppose that some square matrix obeys An = 0 for some positive integer.
(a) Find the inverse of A.
(b) Find the inverse of I A.
Solution. (a) Trick question!! A has no inverse. If A had an inverse then multiplying both sides of A n = 0
by (A1 )n would give A1 A1 A A = 0 (with n A1 s and n As) and then I = 0.
(b) From problem 20, we would guess (I A)1 = I + A + A2 + + An1 . All the remaining terms in
the series I + A + A2 + vanish because of An = 0. To verify that the guess is correct we multiply out
(I A)(I + A + A2 + + An1 ) = (I + A + A2 + + An1 ) A(I + A + A2 + + An1 )
= (I + A + A2 + + An1 ) (A + A2 + A3 + + An )
= I An = I
The same argument also gives (I + A + A2 + + An1 )(I A) = I
22) Suppose that L is a linear transformation from IRn to IRn . Prove that its inverse, if it exists, is also linear.
Solution. We are to assume that there exists a map M such that L(~x) = y~ if and only if M (~y ) = ~x. Let
~x and ~x0 be two arbitrary vectors in IRn and let and be two arbitrary numbers. Define ~u = M (~x)
and ~u0 = M (~x0 ). By hypothesis, ~u = M (~x) ~x = L(~u) and ~u0 = M (~x0 ) ~x0 = L(~u0 ). As L is linear
L(~u + ~u0 ) = ~x + ~x0 , which in turn implies M (~x + ~x0 ) = ~u + ~u0 = M (~x) + M (~x0 ). Thus,
M is linear .
3
23) Suppose that det 0
1
Solution. Expanding
2 p
p 1 = 10. What are the possible values of p?
0 2
along the last row
3 2 p
3 2
2 p
det 0 p 1 = det
+ 2 det
0 p
p 1
1 0 2
= (2 p2 ) + 2(3p 0) = p2 + 6p + 2
For this to be 10
p2 + 6p + 2 = 10 p2 6p + 8 = 0 p = 2, 4
24) Let
1
0
A=
0
3
3
4
1
5
0
0
7
2
8
where the s denote unknown entries. Find all possible values of det A.
44
Solution.
1
0
det
0
3
1
6
0
= det
2
0
8
0
4 0 6
0
= det 1 0 2 = det 1
8
3
4
1
5
0
0
7
1 0
= 2 det
8
3 5
4 0
1 0
8
(1)
6
(2)
2
(3)
(4) 3(1)
0 2 (1) 4(2)
0
2
(2)
8
(3)
= 16
4 0 0
4 0 0
det(4A) = det 0 4 0 A = det 0 4 0 det A = 43 5 = 320
0 0 4
0 0 4
det(A4 ) = det(2A)
Consequently det A = 0 or (det A)3 = 64 or det A = 0, 4 , assuming that A has real matrix entries.
27) Evaluate
1
a
det 2
a
a3
Solution.
a
a2
a3
1
a2
a3
1
a
a3
1
a
2
a
1 a a 2 a3
1
a
a2
a3
(1)
2
3
4
1
0
0
1 a (2) a(1)
a a a
0
det 2
= det
a a3 1 a
0
0
1 a4 a a5 (3) a2 (1)
3
2
4
5
2
6
a
1 a a
0 1a aa a a
(4) a3 (1)
0
0
1 a4
0
1 a4
4
4
5
= det
0
1a
aa
= (1 a ) det
1 a4 a a5
1 a 4 a a 5 a2 a 6
= (1 a4 ) (1 a4 )(1 a4 )
= (1 a4 )3 = (a4 1)3
We expanded along the first row to achieve each of the the second, third and fourth equalities.
45