Introducing MLOps
More than half of the analytics and machine learning (ML) models created by organizations today never make it into production. Instead, many of these ML models do nothing more than provide static insights in a slideshow. If they aren't truly operational, these models can't possibly do what...
Otros Autores: | |
---|---|
Formato: | Electrónico eBook |
Idioma: | Indeterminado |
Publicado: |
[S.l.] :
O'Reilly Media, Inc.,
2020.
|
Acceso en línea: | Texto completo (Requiere registro previo con correo institucional) |
Tabla de Contenidos:
- Cover
- Copyright
- Table of Contents
- Preface
- Who This Book Is For
- How This Book Is Organized
- Conventions Used in This Book
- O'Reilly Online Learning
- How to Contact Us
- Acknowledgments
- Part I. MLOps: What and Why
- Chapter 1. Why Now and Challenges
- Defining MLOps and Its Challenges
- MLOps to Mitigate Risk
- Risk Assessment
- Risk Mitigation
- MLOps for Responsible AI
- MLOps for Scale
- Closing Thoughts
- Chapter 2. People of MLOps
- Subject Matter Experts
- Data Scientists
- Data Engineers
- Software Engineers
- DevOps
- Model Risk Manager/Auditor
- Machine Learning Architect
- Closing Thoughts
- Chapter 3. Key MLOps Features
- A Primer on Machine Learning
- Model Development
- Establishing Business Objectives
- Data Sources and Exploratory Data Analysis
- Feature Engineering and Selection
- Training and Evaluation
- Reproducibility
- Responsible AI
- Productionalization and Deployment
- Model Deployment Types and Contents
- Model Deployment Requirements
- Monitoring
- DevOps Concerns
- Data Scientist Concerns
- Business Concerns
- Iteration and Life Cycle
- Iteration
- The Feedback Loop
- Governance
- Data Governance
- Process Governance
- Closing Thoughts
- Part II. MLOps: How
- Chapter 4. Developing Models
- What Is a Machine Learning Model?
- In Theory
- In Practice
- Required Components
- Different ML Algorithms, Different MLOps Challenges
- Data Exploration
- Feature Engineering and Selection
- Feature Engineering Techniques
- How Feature Selection Impacts MLOps Strategy
- Experimentation
- Evaluating and Comparing Models
- Choosing Evaluation Metrics
- Cross-Checking Model Behavior
- Impact of Responsible AI on Modeling
- Version Management and Reproducibility
- Closing Thoughts
- Chapter 5. Preparing for Production
- Runtime Environments
- Adaptation from Development to Production Environments
- Data Access Before Validation and Launch to Production
- Final Thoughts on Runtime Environments
- Model Risk Evaluation
- The Purpose of Model Validation
- The Origins of ML Model Risk
- Quality Assurance for Machine Learning
- Key Testing Considerations
- Reproducibility and Auditability
- Machine Learning Security
- Adversarial Attacks
- Other Vulnerabilities
- Model Risk Mitigation
- Changing Environments
- Interactions Between Models
- Model Misbehavior
- Closing Thoughts
- Chapter 6. Deploying to Production
- CI/CD Pipelines
- Building ML Artifacts
- What's in an ML Artifact?
- The Testing Pipeline
- Deployment Strategies
- Categories of Model Deployment
- Considerations When Sending Models to Production
- Maintenance in Production
- Containerization
- Scaling Deployments
- Requirements and Challenges
- Closing Thoughts
- Chapter 7. Monitoring and Feedback Loop
- How Often Should Models Be Retrained?
- Understanding Model Degradation
- Ground Truth Evaluation
- Input Drift Detection
- Drift Detection in Practice