Math 1080:      Numerical Linear Algebra      Spring 2008

Instructor: David Swigon

Office: Thackeray 519, 412-624-4689, swigon@pitt.edu

Lectures:  MWF 11:00-11:50am, Thackeray 627

Office Hours: MW 1:00-3:00pm, Thackeray 519, or by appointment.

Course Web Page: (check frequently for changes and updates) http://www.math.pitt.edu/~swigon/math1080.html

Course Description

The course M1080 gives an introduction to the basic areas of numerical linear algebra. The course will cover the development and analysis of algorithms that are used in the solution of linear algebraic equations, algebraic eigenvalue problems and linear least-square minimization problems. 

Prerequisites

Basic knowledge of matrix theory and linear algebra (one of MATH 0250, MATH 0280, or MATH 1180) plus knowledge of computer programming (one of CS 0002, CS 0007, CS 0401, CS 0132) is expected.

Textbook

L. N. Trefethen & D. Bau III, Numerical Linear Algebra, SIAM, 1997.
ISBN 0898713617

Grading Scheme

Homework assignments: 30%

Two midterm exams: 20% + 20%

Final exam: 30%

Schedule

The precise schedule and a list of homework problems will be given out in advance and posted on the web. Homework is due in the beginning of a class one week after it was assigned. You may work with other students on homework but do not submit solutions that are identical copies of each other as such will be discarded. 

Programming

Many assignments will require computer programming. You are expected to be proficient in at least one computer language, such as Matlab, Fortran, C, Basic, etc. to such an extent that you can write a numerical subroutine, debug it, run it and print out the output.  I personally recommend Matlab as it makes manipulation of matrices easy and requires the least coding overhead. I can provide introduction to programming in Matlab but there will be no scheduled computer lab sessions.

You can use any of the University computing labs to work on your assignments.

Matlab resources

Matlab Primer of Professor Sigmon of the University of Florida:  http://www.math.pitt.edu/~swigon/Matlab/primer.pdf

Matlab documentation: http://www.mathworks.com/access/helpdesk/help/techdoc/matlab.html

Policy

Attendance is expected.  No late homework will be accepted and there will be no make up exams.

Note

This is a course in applied mathematics and hence emphasis will be placed on practical usage of methods and algorithms.  Other texts on numerical linear algebra include:

C. G. Cullen, An Introduction to Numerical Linear Algebra, (out of print)

C. F. van Loan, Introduction to Scientific Computing

G. Golub and C. van Loan, Matrix Computation

G. Strang, Linear Algebra and Its Applications

Syllabus

Date

Reading

Topics

Homework Assigned

Notes

Jan 7

I.1-2

pp. 3-16

Matrix Multiplication, Orthogonality, Norms

 

 

Jan 9

II.6

pp. 41-47

Projectors

 

 

Jan 11

II.7

pp. 48-52

QR factorization

 HW 1

solutions

 

Jan 14

II.7

 

QR factorization (cont’d)

 

Jan 16

II.8-9

pp. 56-68

Gram-Schmidt Orthogonalization

 

 

Jan 18

II.8-9

pp. 56-68

Gram-Schmidt Orthogonalization

 HW 2

solutions

 

Jan 21

 

No Class

 

 

Jan 23

II.8-9

pp. 56-68

Gram-Schmidt Orthogonalization

 

Jan 25

II.10

 

Householder Triangularization

 

 

Jan 28

II.11
pp. 77-83

Householder Triangularization (cont’d)

 HW 3

solutions

 

Jan 30

II.11
pp. 77-83

Householder Triangularization (cont’d)

 

 

Feb 1

II.11
pp. 77-83

Applications of QR factorization

 

Feb 4

Review

 

Feb 6

Midterm Exam I
Covers Lectures of Jan 7 – Feb 1

Solutions

 

Feb 8

III.12

pp.89-96

 Conditioning

 

Feb 11

III.13

pp.97-101

Floating point arithmetic

 

 

Feb 13

III.14

pp.102-107

Stability

 

 

Feb 15

III.14

pp.108-113

Stability (contd.)

HW 4

solutions

 

Feb 18

III.16

pp.114-120

Stability of Householder triangularization

 

 

Feb 20

IV.20

pp.147-154

Gaussian Elimination

 

Feb 22

IV.20

pp.147-154

Gaussian Elimination (cont’d)

 HW 5

solutions

 

Feb 25

IV.21

pp.155-162

Pivoting

 

 

Feb 27

IV.21

pp.155-162

Pivoting (cont’d)

 

Feb 29

IV.22

pp.163-171

Stability of Gaussian Elimination

 HW 6

Solutions

 

Mar 3

IV.23

pp.172-178

Cholesky Factorization

 

 

Mar 5

Review

 

Mar 7

Midterm Exam II

Covers Lectures of Feb 8 – Mar 3

 Solutions

 

Mar 10-14

 

Spring Break – No Classes

 

 

Mar 17

V.24

pp.181-189

Eigenvalue Problems

 

 

Mar 19

V.24

pp.181-189

Eigenvalue Problems (cont’d)

 

Mar 21

V.24

pp.181-189

Eigenvalue Problems (cont’d)

HW 7

Solutions

 

Mar 24

V.25

pp. 190-195

Overview of Eigenvalue Algorithms

 

 

Mar 26

V.26

pp.196-201

Reduction to Hessenberg Form

 

 

Mar 28

V.27

pp.202-210

Rayleigh Quotient, Inverse iteration

HW 8

Solutions

 

Mar 31

V.27

pp.202-210

Rayleigh Quotient, Inverse iteration (cont’d)

 

 

Apr 2

V.28

pp.211-218

QR Algorithm

 

 

Apr 4

V.28

pp.211-218

QR Algorithm (cont’d)

HW 9

Solutions

 

Apr 7

V.29

pp.219-223

QR Algorithm with shifts

 

 

Apr 9

I.4

pp.25-31

Singular Value Decomposition

 

 

Apr 11

I.5

pp.32-37

More on the SVD

HW 10

Solutions

 

Apr 14

V.31

pp.234-240

Computing the SVD

 

 

Apr 16

 

Review

 

Apr 18

 

Q & A

 

 

Apr 22

 

 

FINAL EXAM

8-9:50am

Thack 627