About Kevin Murphy's book series on Probabilistic Machine Learning

My thoughts about these books after two months of reading.

To start learning maths, I looked up the potential resources and found some of the books just perfect. The books which I found most perfect are actually two book series by Kevin Murphy - (Murphy, 2022), (Murphy, 2023). He calls them simply book1 and book2, with a total of 860 and 1369 pages, respectively. These are very comprehensive books on machine learning and deep learning. It covers maths fundamentals of ML in a very detailed manner. 7 chapters on maths in book1 covered in 290 pages. 5 chapters on maths in book2 covered in 340 pages. And mentions many good references for further understanding. That’s a total of 630 pages of mathematics, which is like a book of mathematics within a larger book on ML. And the best part is that this mathematics is just for ML. So, when you study the maths from these books, you won’t doubt whether a topic of maths is useful for AI or how it will be used in an AI algorithm. Because you know that if it is mentioned in the book, it will be used further in the book to explain atleast one of the AI algorithms.

And in the rest of the pages, it covers almost every idea of ML (including DL) in a mathematical manner. And mentions the corresponding research papers. Once you complete reading the two books, you would have either already understood or would be able to easily understand most of the AI literature, and you would be ready to do research. There are many great reviews from great researchers (I do not think they are paid reviews). Let me mention one of the reviews which precisely summarises what other reviewers said about the book.

“This book could be titled ‘What every ML PhD student should know’. If you master the material in this book, you will have an outstanding foundation for successful research in machine learning.” – Tom Dietterich, Oregon State U.

There are two qualities of Murphy’s books which make them perfect. First is the comprehensive coverage of almost all the topics of ML and maths fundamentals, rather than covering few topics in a detailed manner. Because there are already plenty of resources like research papers, blogs, lecture notes and videos, other books, etc., which cover each topic in a detailed manner, and you can use these to understand properly. What is needed is to coherently bind together all the topics in one place, which this book does perfectly.

The second quality is that it covers each topic of ML in a mathematical manner. Just like the saying that “a picture speaks a thousand words”, in the same spirit, the mathematics of a topic is like a picture which explains a topic more comprehensively than explaining it in words. Because one can extend that mathematical explanation further logically and find more insights about a topic. This book provides enough maths of a topic which you can use to extend the explanation.