Linear algebra and optimization for machine learning : a textbook / Charu C. Aggarwal.

This textbook introduces linear algebra and optimization in the context of machine learning. Examples and exercises are provided throughout this text book together with access to a solutions manual. This textbook targets graduate level students and professors in computer science, mathematics and dat...

Full description

Saved in:
Bibliographic Details
Main Author: Aggarwal, Charu C.
Format: eBook
Language:English
Published: Cham : Springer, 2020.
Subjects:
Online Access:Click for online access

MARC

LEADER 00000cam a2200000 a 4500
001 on1154532327
003 OCoLC
005 20240909213021.0
006 m o d
007 cr un|---aucuu
008 200516s2020 sz ob 001 0 eng d
040 |a EBLCP  |b eng  |e pn  |c EBLCP  |d GW5XE  |d LQU  |d YDX  |d UPM  |d OCLCF  |d UKMGB  |d UKAHL  |d NLW  |d N$T  |d OCLCQ  |d OCLCO  |d OCLCQ  |d OCLCO  |d OCLCL  |d SXB 
015 |a GBC077337  |2 bnb 
016 7 |a 019814127  |2 Uk 
019 |a 1155880172  |a 1156611509  |a 1156765184  |a 1157272089  |a 1157781277  |a 1158343107 
020 |a 9783030403447  |q (electronic bk.) 
020 |a 3030403440  |q (electronic bk.) 
020 |z 9783030403430  |q (print) 
020 |z 3030403432 
024 7 |a 10.1007/978-3-030-40344-7  |2 doi 
024 8 |a 10.1007/978-3-030-40 
035 |a (OCoLC)1154532327  |z (OCoLC)1155880172  |z (OCoLC)1156611509  |z (OCoLC)1156765184  |z (OCoLC)1157272089  |z (OCoLC)1157781277  |z (OCoLC)1158343107 
037 |a com.springer.onix.9783030403447  |b Springer Nature 
050 4 |a QA184.2 
072 7 |a UYQM  |2 bicssc 
072 7 |a COM004000  |2 bisacsh 
072 7 |a UYQM  |2 thema 
049 |a HCDD 
100 1 |a Aggarwal, Charu C. 
245 1 0 |a Linear algebra and optimization for machine learning :  |b a textbook /  |c Charu C. Aggarwal. 
260 |a Cham :  |b Springer,  |c 2020. 
300 |a 1 online resource (507 pages) 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
347 |a text file 
347 |b PDF 
588 0 |a Print version record. 
505 0 |a Intro -- Contents -- Preface -- Acknowledgments -- Author Biography -- 1 Linear Algebra and Optimization: An Introduction -- 1.1 Introduction -- 1.2 Scalars, Vectors, and Matrices -- 1.2.1 Basic Operations with Scalars and Vectors -- 1.2.2 Basic Operations with Vectors and Matrices -- 1.2.3 Special Classes of Matrices -- 1.2.4 Matrix Powers, Polynomials, and the Inverse -- 1.2.5 The Matrix Inversion Lemma: Inverting the Sum of Matrices -- 1.2.6 Frobenius Norm, Trace, and Energy -- 1.3 Matrix Multiplication as a Decomposable Operator 
505 8 |a 1.3.1 Matrix Multiplication as Decomposable Row and ColumnOperators -- 1.3.2 Matrix Multiplication as Decomposable Geometric Operators -- 1.4 Basic Problems in Machine Learning -- 1.4.1 Matrix Factorization -- 1.4.2 Clustering -- 1.4.3 Classification and Regression Modeling -- 1.4.4 Outlier Detection -- 1.5 Optimization for Machine Learning -- 1.5.1 The Taylor Expansion for Function Simplification -- 1.5.2 Example of Optimization in Machine Learning -- 1.5.3 Optimization in Computational Graphs -- 1.6 Summary -- 1.7 Further Reading -- 1.8 Exercises -- 2 Linear Transformations and Linear Systems 
505 8 |a 2.1 Introduction -- 2.1.1 What Is a Linear Transform? -- 2.2 The Geometry of Matrix Multiplication -- 2.3 Vector Spaces and Their Geometry -- 2.3.1 Coordinates in a Basis System -- 2.3.2 Coordinate Transformations Between Basis Sets -- 2.3.3 Span of a Set of Vectors -- 2.3.4 Machine Learning Example: Discrete Wavelet Transform -- 2.3.5 Relationships Among Subspaces of a Vector Space -- 2.4 The Linear Algebra of Matrix Rows and Columns -- 2.5 The Row Echelon Form of a Matrix -- 2.5.1 LU Decomposition -- 2.5.2 Application: Finding a Basis Set -- 2.5.3 Application: Matrix Inversion 
505 8 |a 2.5.4 Application: Solving a System of Linear Equations -- 2.6 The Notion of Matrix Rank -- 2.6.1 Effect of Matrix Operations on Rank -- 2.7 Generating Orthogonal Basis Sets -- 2.7.1 Gram-Schmidt Orthogonalization and QR Decomposition -- 2.7.2 QR Decomposition -- 2.7.3 The Discrete Cosine Transform -- 2.8 An Optimization-Centric View of Linear Systems -- 2.8.1 Moore-Penrose Pseudoinverse -- 2.8.2 The Projection Matrix -- 2.9 Ill-Conditioned Matrices and Systems -- 2.10 Inner Products: A Geometric View -- 2.11 Complex Vector Spaces -- 2.11.1 The Discrete Fourier Transform -- 2.12 Summary 
505 8 |a 2.13 Further Reading -- 2.14 Exercises -- 3 Eigenvectors and Diagonalizable Matrices -- 3.1 Introduction -- 3.2 Determinants -- 3.3 Diagonalizable Transformations and Eigenvectors -- 3.3.1 Complex Eigenvalues -- 3.3.2 Left Eigenvectors and Right Eigenvectors -- 3.3.3 Existence and Uniqueness of Diagonalization -- 3.3.4 Existence and Uniqueness of Triangulization -- 3.3.5 Similar Matrix Families Sharing Eigenvalues -- 3.3.6 Diagonalizable Matrix Families Sharing Eigenvectors -- 3.3.7 Symmetric Matrices -- 3.3.8 Positive Semidefinite Matrices 
500 |a 3.3.9 Cholesky Factorization: Symmetric LU Decomposition 
504 |a Includes bibliographical references and index. 
520 |a This textbook introduces linear algebra and optimization in the context of machine learning. Examples and exercises are provided throughout this text book together with access to a solutions manual. This textbook targets graduate level students and professors in computer science, mathematics and data science. Advanced undergraduate students can also use this textbook. The chapters for this textbook are organized as follows: 1. Linear algebra and its applications: The chapters focus on the basics of linear algebra together with their common applications to singular value decomposition, matrix factorization, similarity matrices (kernel methods), and graph analysis. Numerous machine learning applications have been used as examples, such as spectral clustering, kernel-based classification, and outlier detection. The tight integration of linear algebra methods with examples from machine learning differentiates this book from generic volumes on linear algebra. The focus is clearly on the most relevant aspects of linear algebra for machine learning and to teach readers how to apply these concepts. 2. Optimization and its applications: Much of machine learning is posed as an optimization problem in which we try to maximize the accuracy of regression and classification models. The "parent problem" of optimization-centric machine learning is least-squares regression. Interestingly, this problem arises in both linear algebra and optimization, and is one of the key connecting problems of the two fields. Least-squares regression is also the starting point for support vector machines, logistic regression, and recommender systems. Furthermore, the methods for dimensionality reduction and matrix factorization also require the development of optimization methods. A general view of optimization in computational graphs is discussed together with its applications to back propagation in neural networks. A frequent challenge faced by beginners in machine learning is the extensive background required in linear algebra and optimization. One problem is that the existing linear algebra and optimization courses are not specific to machine learning; therefore, one would typically have to complete more course material than is necessary to pick up machine learning. Furthermore, certain types of ideas and tricks from optimization and linear algebra recur more frequently in machine learning than other application-centric settings. Therefore, there is significant value in developing a view of linear algebra and optimization that is better suited to the specific perspective of machine learning 
650 0 |a Algebras, Linear. 
650 0 |a Machine learning  |x Mathematics. 
650 7 |a Algebra.  |2 bicssc 
650 7 |a Computer networking & communications.  |2 bicssc 
650 7 |a Machine learning.  |2 bicssc 
650 7 |a Mathematics  |x Algebra  |x Linear.  |2 bisacsh 
650 7 |a Computers  |x Online Services  |x General.  |2 bisacsh 
650 7 |a Computers  |x Intelligence (AI) & Semantics.  |2 bisacsh 
650 7 |a Algebras, Linear  |2 fast 
758 |i has work:  |a Linear algebra and optimization for machine learning (Text)  |1 https://id.oclc.org/worldcat/entity/E39PCG7D8qGVMcmHBY9kbV79ym  |4 https://id.oclc.org/worldcat/ontology/hasWork 
776 0 8 |i Print version:  |a Aggarwal, Charu C.  |t Linear Algebra and Optimization for Machine Learning : A Textbook.  |d Cham : Springer International Publishing AG, ©2020  |z 9783030403430 
856 4 0 |u https://holycross.idm.oclc.org/login?auth=cas&url=https://link.springer.com/10.1007/978-3-030-40344-7  |y Click for online access 
903 |a SPRING-COMP2020 
994 |a 92  |b HCD