• Title: Introduction to Online Convex Optimization
• Author(s) Elad Hazan
• Publisher: The MIT Press; 2nd edition (September 6, 2022);
• License(s): arXiv.org Non-exclusive license
• Hardcover: 248 pages
• eBook: PDF (Manuscript, 260 pages)
• Language: English
• ISBN-10: 0262046989
• ISBN-13: 978-0262046985
• Share This:  

Book Description

This book portrays optimization as a process. In many practical applications, the environment is so complex that it is not feasible to lay out a comprehensive theoretical model and use classical algorithmic theory and/or mathematical optimization.

This book presents a robust machine learning approach that contains elements of mathematical optimization, game theory, and learning theory: an optimization method that learns from experience as more aspects of the problem are observed. This view of optimization as a process has led to some spectacular successes in modeling and systems that have become part of our daily lives.

Based on the "Theoretical Machine Learning" course taught by the author at Princeton University, This book is a widely used graduate level textbook.

• Elad Hazan is an Israeli-American computer scientist, academic, author and researcher. He is Professor of Computer Science at Princeton University and cofounder and director of Google AI Princeton. An innovator in the design and analysis of algorithms for basic problems in machine learning and optimization, he is coinventor of the AdaGrad optimization algorithm for deep learning, the first adaptive gradient method.

• Amazon

• Operations Research (OR), Mathematical Optimization, Approximation, etc.
• Machine Learning
• Game Theory
• Applied Mathematics

• Introduction to Online Convex Optimization (Elad Hazan)

• Convex Optimization (Stephen Boyd, et al.)

  On recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples in fields such as engineering, computer science, mathematics, statistics, finance, and economics.

• Convex Optimization for Machine Learning (Changho Suh)

  This book covers an introduction to convex optimization, one of the powerful and tractable optimization problems that can be efficiently solved on a computer. The goal is to help develop a sense of what convex optimization is, and how it can be used.

• Global Optimization Algorithms - Theory and Application

  This book is devoted to global optimization algorithms, which are methods to find optimal solutions for given problems. It especially focuses on Evolutionary Computation by discussing evolutionary algorithms, genetic algorithms, Genetic Programming, etc.

• Algorithms for Decision Making (Mykel Kochenderfer, et al)

  This textbook provides a broad introduction to algorithms for decision making under uncertainty, covering the underlying mathematical problem formulations and the algorithms for solving them.

• Engineering Design Optimization (Joaquim R. Martins, et al)

  The philosophy of this book is to provide a detailed enough explanation and analysis of optimization methods so that readers can implement a basic working version. Practical tips are included for common issues encountered in practical engineering design optimization.

• Probabilistic Machine Learning: An Introduction (Kevin Murphy)

  This book is a comprehensive introduction to machine learning that uses probabilistic models and inference as a unifying approach. It is written in an informal, accessible style, complete with pseudo-code for the most important algorithms.

• Knapsack Problems: Algorithms and Computer Implementations

  The text fully develops an algorithmic approach to Knapsack Problems without losing mathematical rigor. It provides a comprehensive overview of the methods for solving Knapsack Problems (KP), its variants and generalizations.