Matrix Algebra Useful for Statistics, 2nd Edition

Books

A thoroughly updated guide to matrix algebra and it uses in statistical analysis and features SAS®, MATLAB®, and R throughout

This Second Edition addresses matrix algebra that is useful in the statistical analysis of data as well as within statistics as a whole. The material is presented in an explanatory style rather than a formal theorem-proof format and is self-contained. Featuring numerous applied illustrations, numerical examples, and exercises, the book has been updated to include the use of SAS, MATLAB, and R for the execution of matrix computations. In addition, André I. Khuri, who has extensive research and teaching experience in the field, joins this new edition as co-author. The Second Edition also:

Contains new coverage on vector spaces and linear transformations and discusses computational aspects of matrices

Covers the analysis of balanced linear models using direct products of matrices

Analyzes multiresponse linear models where several responses can be of interest

Includes extensive use of SAS, MATLAB, and R throughout

Contains over 400 examples and exercises to reinforce understanding along with select solutions

Includes plentiful new illustrations depicting the importance of geometry as well as historical interludes

Matrix Algebra Useful for Statistics, Second Edition is an ideal textbook for advanced undergraduate and first-year graduate level courses in statistics and other related disciplines. The book is also appropriate as a reference for independent readers who use statistics and wish to improve their knowledge of matrix algebra.

THE LATE SHAYLE R. SEARLE, PHD, was professor emeritus of biometry at Cornell University. He was the author of Linear Models for Unbalanced Data and Linear Models and co-author of Generalized, Linear, and Mixed Models, Second Edition, Matrix Algebra for Applied Economics, and Variance Components, all published by Wiley. Dr. Searle received the Alexander von Humboldt Senior Scientist Award, and he was an honorary fellow of the Royal Society of New Zealand.

ANDRÉ I. KHURI, PHD, is Professor Emeritus of Statistics at the University of Florida. He is the author of Advanced Calculus with Applications in Statistics, Second Edition and co-author of Statistical Tests for Mixed Linear Models, all published by Wiley. Dr. Khuri is a member of numerous academic associations, among them the American Statistical Association and the Institute of Mathematical Statistics.

PREFACE xvii

PREFACE TO THE FIRST EDITION xix

INTRODUCTION xxi

ABOUT THE COMPANION WEBSITE xxxi

PART I DEFINITIONS, BASIC CONCEPTS, AND MATRIX OPERATIONS 1

1 Vector Spaces, Subspaces, and Linear Transformations 3

1.1 Vector Spaces 3

1.2 Base of a Vector Space 5

1.3 Linear Transformations 7

2 Matrix Notation and Terminology 11

2.1 Plotting of a Matrix 14

2.2 Vectors and Scalars 16

2.3 General Notation 16

3 Determinants 21

3.1 Expansion by Minors 21

3.2 Formal Definition 25

3.3 Basic Properties 27

3.4 Elementary Row Operations 34

3.5 Examples 37

3.6 Diagonal Expansion 39

3.7 The Laplace Expansion 42

3.8 Sums and Differences of Determinants 44

3.9 A Graphical Representation of a 3 × 3 Determinant 45

4 Matrix Operations 51

4.1 The Transpose of a Matrix 51

4.2 Partitioned Matrices 52

4.3 The Trace of a Matrix 55

4.4 Addition 56

4.5 Scalar Multiplication 58

4.6 Equality and the Null Matrix 58

4.7 Multiplication 59

4.8 The Laws of Algebra 74

4.9 Contrasts With Scalar Algebra 76

4.10 Direct Sum of Matrices 77

4.11 Direct Product of Matrices 78

4.12 The Inverse of a Matrix 80

4.13 Rank of a MatrixSome Preliminary Results 82

4.14 The Number of LIN Rows and Columns in a Matrix 84

4.15 Determination of the Rank of a Matrix 85

4.16 Rank and Inverse Matrices 87

4.17 Permutation Matrices 87

5 Special Matrices 97

5.1 Symmetric Matrices 97

5.2 Matrices Having All Elements Equal 102

5.3 Idempotent Matrices 104

5.4 Orthogonal Matrices 106

5.5 Parameterization of Orthogonal Matrices 109

5.6 Quadratic Forms 110

5.7 Positive Definite Matrices 113

6 Eigenvalues and Eigenvectors 119

6.1 Derivation of Eigenvalues 119

6.2 Elementary Properties of Eigenvalues 122

6.3 Calculating Eigenvectors 125

6.4 The Similar Canonical Form 128

6.5 Symmetric Matrices 131

6.6 Eigenvalues of Orthogonal and Idempotent Matrices 135

6.7 Eigenvalues of Direct Products and Direct Sums of Matrices 138

6.8 Nonzero Eigenvalues of AB and BA 140

7 Diagonalization of Matrices 145

7.1 Proving the Diagonability Theorem 145

7.2 Other Results for Symmetric Matrices 148

7.3 The Cayley–Hamilton Theorem 152

7.4 The Singular-Value Decomposition 153

8 Generalized Inverses 159

8.1 The Moore–Penrose Inverse 159

8.2 Generalized Inverses 160

8.3 Other Names and Symbols 164

8.4 Symmetric Matrices 165

9 Matrix Calculus 171

9.1 Matrix Functions 171

9.2 Iterative Solution of Nonlinear Equations 174

9.3 Vectors of Differential Operators 175

9.4 Vec and Vech Operators 179

9.5 Other Calculus Results 181

9.6 Matrices with Elements That Are Complex Numbers 188

9.7 Matrix Inequalities 189

PART II APPLICATIONS OF MATRICES IN STATISTICS 199

10 Multivariate Distributions and Quadratic Forms 201

10.1 Variance-Covariance Matrices 202

10.2 Correlation Matrices 203

10.3 Matrices of Sums of Squares and Cross-Products 204

10.4 The Multivariate Normal Distribution 207

10.5 Quadratic Forms and 2-Distributions 208

10.6 Computing the Cumulative Distribution Function of a Quadratic Form 213

Our site uses cookies to improve your experience. You can find out more about our use of cookies
in our "standard cookie policy", including
instructions on how to reject and delete cookies if you wish to do so. By continuing to browse this site you agree
to us using cookies as described in our "standard cookie policy".

Our site uses cookies to improve your experience. You can find out more about our use of cookies
in our "standard cookie policy", including
instructions on how to reject and delete cookies if you wish to do so. By continuing to browse this site you agree
to us using cookies as described in our "standard cookie policy".