Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to AI Inference with Docker
- Exploring the nature of AI inference workloads
- Advantages of using containers for inference
- Various deployment scenarios and their constraints
Creating AI Inference Containers
- Choosing appropriate base images and frameworks
- Packaging pre-trained models effectively
- Designing inference code for optimal container execution
Protecting Containerized AI Services
- Reducing the container attack surface
- Handling secrets and sensitive data securely
- Implementing safe networking and API exposure methods
Techniques for Portable Deployment
- Optimizing images for maximum portability
- Guaranteeing predictable runtime environments
- Managing dependencies across different platforms
Local Deployment and Testing
- Executing services locally using Docker
- Troubleshooting inference containers
- Evaluating performance and reliability
Deployment on Servers and Cloud VMs
- Adapting containers for remote environments
- Setting up secure access to servers
- Launching inference APIs on cloud virtual machines
Leveraging Docker Compose for Multi-Service AI Systems
- Coordinating inference with auxiliary components
- Managing environment variables and configurations
- Scaling microservices via Compose
Monitoring and Maintaining AI Inference Services
- Approaches to logging and observability
- Identifying failures within inference pipelines
- Managing model updates and versioning in production
Conclusion and Future Steps
Requirements
- A grasp of fundamental machine learning principles
- Experience with Python or backend development
- Basic familiarity with containerization concepts
Audience
- Developers
- Backend engineers
- Teams responsible for deploying AI services
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.