Pretrain Vision and Large Language Models in Python End-To-end Techniques for Building and Deploying Foundation Models on AWS /

Master the art of training vision and large language models with conceptual fundaments and industry-expert guidance. Learn about AWS services and design patterns, with relevant coding examples Key Features Learn to develop, train, tune, and apply foundation models with optimized end-to-end pipelines...

Descripción completa

Detalles Bibliográficos
Clasificación:Libro Electrónico
Autor principal: Webber, Emily
Otros Autores: Olgiati, Andrea
Formato: Electrónico eBook
Idioma:Inglés
Publicado: Birmingham : Packt Publishing, Limited, 2023.
Edición:1st edition.
Temas:
Amazon Web Services (Firm)
Machine learning > Mathematical models.
Cloud computing.
Acceso en línea:Texto completo (Requiere registro previo con correo institucional)

MARC

LEADER 00000cam a22000007a 4500
001 OR_on1381712207
003 OCoLC
005 20231017213018.0
006 m o d
007 cr cnu||||||||
008 230610s2023 enk o 000 0 eng d
040 |a EBLCP  |b eng  |c EBLCP  |d ORMDA  |d OCLCF  |d IEEEE 
020 |a 9781804612545 
020 |a 1804612545 
029 1 |a AU@  |b 000074864826 
035 |a (OCoLC)1381712207 
037 |a 9781804618257  |b O'Reilly Media 
037 |a 10251209  |b IEEE 
050 4 |a Q325.5 
082 0 4 |a 006.31  |2 23/eng/20230612 
049 |a UAMI 
100 1 |a Webber, Emily. 
245 1 0 |a Pretrain Vision and Large Language Models in Python  |h [electronic resource] :  |b End-To-end Techniques for Building and Deploying Foundation Models on AWS /  |c Emily Webber ; foreword by Andrea Olgiati. 
250 |a 1st edition. 
260 |a Birmingham :  |b Packt Publishing, Limited,  |c 2023. 
300 |a 1 online resource (258 p.) 
500 |a Description based upon print version of record. 
520 |a Master the art of training vision and large language models with conceptual fundaments and industry-expert guidance. Learn about AWS services and design patterns, with relevant coding examples Key Features Learn to develop, train, tune, and apply foundation models with optimized end-to-end pipelines Explore large-scale distributed training for models and datasets with AWS and SageMaker examples Evaluate, deploy, and operationalize your custom models with bias detection and pipeline monitoring Book Description Foundation models have forever changed machine learning. From BERT to ChatGPT, CLIP to Stable Diffusion, when billions of parameters are combined with large datasets and hundreds to thousands of GPUs, the result is nothing short of record-breaking. The recommendations, advice, and code samples in this book will help you pretrain and fine-tune your own foundation models from scratch on AWS and Amazon SageMaker, while applying them to hundreds of use cases across your organization. With advice from seasoned AWS and machine learning expert Emily Webber, this book helps you learn everything you need to go from project ideation to dataset preparation, training, evaluation, and deployment for large language, vision, and multimodal models. With step-by-step explanations of essential concepts and practical examples, you'll go from mastering the concept of pretraining to preparing your dataset and model, configuring your environment, training, fine-tuning, evaluating, deploying, and optimizing your foundation models. You will learn how to apply the scaling laws to distributing your model and dataset over multiple GPUs, remove bias, achieve high throughput, and build deployment pipelines. By the end of this book, you'll be well equipped to embark on your own project to pretrain and fine-tune the foundation models of the future. What you will learn Find the right use cases and datasets for pretraining and fine-tuning Prepare for large-scale training with custom accelerators and GPUs Configure environments on AWS and SageMaker to maximize performance Select hyperparameters based on your model and constraints Distribute your model and dataset using many types of parallelism Avoid pitfalls with job restarts, intermittent health checks, and more Evaluate your model with quantitative and qualitative insights Deploy your models with runtime improvements and monitoring pipelines Who this book is for If you're a machine learning researcher or enthusiast who wants to start a foundation modelling project, this book is for you. Applied scientists, data scientists, machine learning engineers, solution architects, product managers, and students will all benefit from this book. Intermediate Python is a must, along with introductory concepts of cloud computing. A strong understanding of deep learning fundamentals is needed, while advanced topics will be explained. The content covers advanced machine learning and cloud techniques, explaining them in an actionable, easy-to-understand way. 
505 0 |a Table of Contents An Introduction to Pretraining Foundation Models Dataset Preparation: Part One Model Preparation Containers and Accelerators on the Cloud Distribution Fundamentals Dataset Preparation: Part Two, the Data Loader Finding the Right Hyperparameters Large-Scale Training on SageMaker Advanced Training Concepts Fine-Tuning and Evaluating Detecting, Mitigating, and Monitoring Bias How to Deploy Your Model Prompt Engineering MLOps for Vision and Language Future Trends in Pretraining Foundation Models. 
590 |a O'Reilly  |b O'Reilly Online Learning: Academic/Public Library Edition 
610 2 0 |a Amazon Web Services (Firm) 
610 2 7 |a Amazon Web Services (Firm)  |2 fast  |0 (OCoLC)fst01974501 
650 0 |a Machine learning  |x Mathematical models. 
650 0 |a Cloud computing. 
650 7 |a Cloud computing.  |2 fast  |0 (OCoLC)fst01745899 
650 7 |a Machine learning  |x Mathematical models.  |2 fast  |0 (OCoLC)fst01004800 
700 1 |a Olgiati, Andrea. 
776 0 8 |i Print version:  |a Webber, Emily  |t Pretrain Vision and Large Language Models in Python  |d Birmingham : Packt Publishing, Limited,c2023  |z 9781804618257 
856 4 0 |u https://learning.oreilly.com/library/view/~/9781804618257/?ar  |z Texto completo (Requiere registro previo con correo institucional) 
938 |a ProQuest Ebook Central  |b EBLB  |n EBL30587008 
994 |a 92  |b IZTAP 

Ejemplares similares