Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Establishing layers, boundaries, and separation of concerns.
  • Applying ports and adapters patterns to AI components.
  • Defining quality attribute scenarios for AI features.
  • Utilizing architecture decision records as governance tools.

Modernizing Existing Applications

  • Pursuing incremental modernization over complete rewrites.
  • Positioning AI services alongside existing monolithic architectures.
  • Implementing strangler and anti-corruption layer patterns.
  • Creating integration seams for existing APIs and data structures.

LLM Integration Architecture Patterns

  • Establishing the model gateway as an abstraction boundary.
  • Managing synchronous, asynchronous, and streaming integrations.
  • Implementing fallbacks, degradation strategies, and provider failover.
  • Treating prompt and model configurations as versioned assets.

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules.
  • Handling idempotency, retries, and rate limiting.
  • Setting latency budgets and orchestrating timeouts.
  • Considering cost per request as a key architectural constraint.

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines.
  • Managing index, retrieval, reranking, and generation stages.
  • Positioning retrieval relative to application services.
  • Analizing trade-offs and failure modes at each stage.

Vector Databases and Retrieval Design

  • Choosing between managed and self-hosted vector stores.
  • Implementing dense, sparse, and hybrid search techniques.
  • Applying metadata filtering and tenant isolation.
  • Developing re-embedding strategies for model changes.

Retrieval Quality, Grounding, and Evaluation

  • Constructing evaluation sets from real-world queries.
  • Measuring retrieval and answer quality metrics.
  • Ensuring citation accuracy, grounding, and hallucination containment.
  • Implementing feedback loops to update the index.

Agent Architectures

  • Understanding the agent loop and tool invocation.
  • Distinguishing between deterministic workflows and autonomous planners.
  • Identifying scenarios where an agent is not the appropriate solution.
  • Defining the scope of agent responsibilities and state management.

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies.
  • Establishing handoff protocols and message contracts.
  • Managing shared memory and context.
  • Comparing frameworks based on architectural merits.

Service Communication and Tool Protocols

  • Utilizing event-driven and queue-based coordination.
  • Exposing tools through standard protocols.
  • Implementing sagas, compensation, and long-running transactions.
  • Maintaining observability across service interactions.

Integrating AI Agents into Development Workflows

  • Embedding coding agents within the delivery pipeline.
  • Adopting spec-driven development and review gates.
  • Generating tests and enforcing automated quality checks.
  • Establishing guardrails to preserve architectural control.

Governance and Software Quality

  • Conducting design reviews for AI features.
  • Managing changes to models and prompts.
  • Incorporating regression evaluation as a pipeline stage.
  • Defining ownership, policy, and approval pathways.

Security, Privacy, and Data Governance

  • Mitigating prompt injection through defense in depth.
  • Managing secrets, access control, and least privilege.
  • Addressing data residency, personal data, and retention policies.
  • Ensuring auditability and human-in-the-loop controls.

Scalability, Cost, and Observability

  • Tracing workflows across agent chains.
  • Monitoring token usage and cost telemetry.
  • Optimizing caching and latency.
  • Defining service levels and incident response for AI services.

Capstone: Architecting an AI-Powered Solution

  • Developing context, component, and deployment views.
  • Designing retrieval and agent orchestration.
  • Creating a security, governance, and cost plan.
  • Conducting peer reviews, critiques, and migration roadmaps.

Requirements

  • Experience in designing and maintaining production software systems.
  • Proficiency in REST APIs and service integration.
  • Familiarity with relational databases and data modeling.
  • Basic exposure to LLM-based tools or APIs.

Target Audience

  • Software architects.
  • Technical leads and senior engineers.
  • Engineering managers responsible for architectural decisions.

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories