• Title: How to Scale Your Model: A Systems View of LLMs on TPUs
• Author(s) Jacob Austin, et al.
• Publisher: Self-Publishing;
• Hardcover: N/A
• eBook: HTML
• Language: English
• ISBN-10: N/A
• ISBN-13: N/A
• Share This:  

Book Description

This book takes a very practical, systems-oriented approach to explain the performance side of Large Language Models (LLMs) like how Tensor Processing Units (TPUs) (and GPUs) work under the hood, how these devices communicate, and how LLMs actually run on real hardware. It also covers parallelism strategies for both training and inference to efficiently scale models at massive sizes.

• N/A

• Amazon

• Natural Language Processing (NLP)
• Computational Linguistics
• Machine Learning
• Deep Learning and Neural Networks
• Artificial Intelligence

• How to Scale Your Model: A Systems View of LLMs on TPUs (Jacob Austin, et al)

• Foundation Models for Natural Language Processing

  This open access book provides a comprehensive overview of the state of the art in research and applications of Foundation Models and is intended for readers familiar with basic Natural Language Processing (NLP) concepts.

• Quick Start Guide to Large Language Models: Early Release

  The Practical, Step-by-Step Guide to Using Large Language Models (LLMs) at Scale in Projects and Products. Clears away those obstacles and provides a guide to working with, integrating, and deploying LLMs to solve practical problems.

• Foundations of Large Language Models (Tong Xiao, et al.)

  This is a book about Large Language Models (LLMs). It primarily focuses on foundational concepts rather than comprehensive coverage of all cutting-edge technologies: pre-training, generative models, prompting techniques, and alignment methods.

• Large Language Models in Cybersecurity: Threats and Mitigation

  This open access book provides cybersecurity practitioners with the knowledge needed to understand the risks of the increased availability of powerful Large Language Models (LLMs) and how they can be mitigated.

• Understanding Large Language Models (Jenny Kunz)

  This practical book offers clear, example-rich explanations of how Large Language Models (LLMs) work, how you can interact with them, and how to integrate LLMs into your own applications.

• Speech and Language Processing (Dan Jurafsky, et al)

  This text takes an empirical approach to the subject, based on applying statistical and other machine-learning algorithms to large corporations. It describes a unified vision of speech and language processing. Emphasis is on practical and scientific applications.

• Representation Learning for Natural Language Processing

  This book provides an overview of the recent advances in representation learning theory, algorithms, and applications for natural language processing (NLP), ranging from word embeddings to pre-trained language models.

• Linguistics for the Age of AI (Marjorie McShane, et al)

  This book summarizes an exciting approach to knowledge-rich natural language understanding, in the context of language - using AI agents. Anyone interested in building cognitive systems that use language should read this book.

• Computational Linguistics: Models, Resources, Applications

  This comprehensive reference work provides an overview of the concepts, methodologies, and applications in computational linguistics and natural language processing (NLP). It will be of interest and practical use to a wide range of linguists.