For the linear algebra portion of the course the book: Linear Algebra and its Applications (David Lay, Pearson/Addison Wesley 2004)
provides an excellent reference to a variety of interesting applications
in engineering, science and social science.
The sections on SVD and PCA are of particular interest.