• Title: Pen and Paper Exercises in Machine Learning
• Author(s) Michael U. Gutmann
• Publisher: University of Edinburgh; eBook (Creative Commons Licensed)
• License(s): CC BY 4.0
• Hardcover: N/A
• eBook: PDF (211 pages)
• Language: English
• ISBN-10: N/A
• ISBN-13: N/A
• Share This:  

Book Description

This is a collection of (mostly) pen-and-paper exercises in machine learning. The exercises are on the following topics: linear algebra, optimisation, directed graphical models, undirected graphical models, expressive power of graphical models, factor graphs and message passing, inference for hidden Markov models, model-based learning (including ICA and unnormalised models), sampling and Monte-Carlo integration, and variational inference.

The author assumes basic calculus, linear algebra, probability and statistics but no prior exposure to machine learning. The text introduces each method clearly and concisely "from scratch" based on the fundamentals. All methods and algorithms are described by a clean and consistent style, with a minimum of unnecessary detail. Numerous case studies and concrete examples demonstrate how the methods can be applied in a variety of contexts.

"Train a small machine learning model to play chess or a similar game and then actually run that model in real time, pen and paper, entirely by hand, and in so doing, eventually win against an opponent that i couldn’t beat myself."

• Michael U. Gutmann is a Senior Lecturer in Machine Learning at The University of Edinburg.

• Amazon

• Machine Learning
• Neural Networks and Deep Learning
• Statistics
• Probability Theory

• Pen and Paper Exercises in Machine Learning (Michael U. Gutmann)
• The Mirror Site (1) - PDF
• The Mirror Site (2) - PDF

• The Hundred-Page Machine Learning Book (Andriy Burkov)

  Everything you really need to know in Machine Learning in a hundred pages! This book provides a great practical guide to get started and execute on ML within a few days without necessarily knowing much about ML apriori.

• Foundations of Machine Learning (Mehryar Mohri, et al)

  This book is a general introduction to machine learning. It covers fundamental modern topics in machine learning while providing the theoretical basis and conceptual tools needed for the discussion and justification of algorithms.

• Machine Learning Yearning (Andrew Ng)

  You will learn how to align on ML strategies in a team setting, as well as how to set up development (dev) sets and test sets. After finishing this book, you will have a deep understanding of how to set technical direction for a machine learning project.

• Machine Learning Engineering (Andriy Burkov)

  The most complete applied AI book out there. It is filled with best practices and design patterns of building reliable machine learning solutions that scale. It embraces the most important thing you need to know about machine learning: mistakes are possible.

• Understanding Machine Learning: From Theory to Algorithms

  Explains the principles behind the automated learning approach and the considerations underlying its usage. Provides an extensive theoretical account of the fundamental ideas underlying machine learning and the mathematical derivations.

• Reinforcement Learning: An Introduction, Second Edition

  It provides a clear and simple account of the key ideas and algorithms of reinforcement learning that is accessible to readers in all the related disciplines. Focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes.

• Probabilistic Machine Learning: An Introduction (Kevin Murphy)

  This book is a comprehensive introduction to machine learning that uses probabilistic models and inference as a unifying approach. It is written in an informal, accessible style, complete with pseudo-code for the most important algorithms.

• Pattern Recognition and Machine Learning (Christopher Bishop)

  This is the first textbook on pattern recognition to present the Bayesian viewpoint. The book presents approximate inference algorithms that permit fast approximate answers in situations where exact answers are not feasible.

• Gaussian Processes for Machine Learning (Carl E. Rasmussen)

  This book provides a long-needed systematic and unified treatment of theoretical and practical aspects of Gaussian Processes (GPs) in machine learning. It deals with the supervised-learning problem for both regression and classification.