Get in Touch
 Duration 21 hours

Course Outline

Foundations of Architecture for AI Systems

  • Layers, boundaries, and separation of concerns
  • Applying ports and adapters to AI components
  • Defining quality attribute scenarios for AI features
  • Using architecture decision records for governance

Evolution of Existing Applications

  • Incremental modernisation strategies versus full rewrites
  • Positioning AI services alongside existing monoliths
  • Utilising Strangler and anti-corruption layer patterns
  • Creating integration seams for existing APIs and data structures

Patterns for LLM Integration Architecture

  • Model gateways as abstraction boundaries
  • Synchronous, asynchronous, and streaming integration methods
  • Implementing fallback, degradation, and provider failover mechanisms
  • Treating prompt and model configuration as versioned assets

Contracts, APIs, and Data Exchange

  • Structured output schemas and validation protocols
  • Managing idempotency, retries, and rate limiting
  • Orchestrating latency budgets and timeouts
  • Treating cost per request as an architectural constraint

End-to-End RAG Architecture

  • Ingestion, chunking, and embedding pipelines
  • Stages of indexing, retrieval, reranking, and generation
  • Placing retrieval relative to application services
  • Evaluating trade-offs and failure modes at each stage

Vector Databases and Retrieval Design

  • Comparison of managed versus self-hosted vector stores
  • Dense, sparse, and hybrid search techniques
  • Metadata filtering and tenant isolation strategies
  • Re-embedding strategies in response to model changes

Retrieval Quality, Grounding, and Evaluation

  • Building evaluation sets from real-world queries
  • Measuring retrieval and answer quality metrics
  • Managing citations, grounding, and hallucination containment
  • Establishing feedback loops to refine the index

Agent Architectures

  • The agent loop and tool invocation mechanics
  • Deterministic workflows versus autonomous planners
  • Identifying cases where agents are inappropriate
  • Scoping agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Supervisor and orchestrator topologies
  • Handoff protocols and message contracts
  • Shared memory and context management
  • Framework comparison based on architectural merits

Service Communication and Tool Protocols

  • Event-driven and queue-based coordination
  • Exposing tools via standard protocols
  • Sagas, compensation, and long-running transactions
  • Observability across multiple service hops

AI Agents in Development Workflows

  • Integrating coding agents into the delivery pipeline
  • Spec-driven development and review gates
  • Test generation and automated quality checks
  • Guardrails that maintain architectural control

Governance and Software Quality

  • Design reviews specifically for AI features
  • Change management for models and prompts
  • Incorporating regression evaluation as a pipeline stage
  • Defining ownership, policy, and approval paths

Security, Privacy, and Data Governance

  • Defending against prompt injection with depth-in-defence strategies
  • Managing secrets, access control, and least privilege principles
  • Data residency, personal data handling, and retention policies
  • Ensuring auditability and human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing across agent chains
  • Token and cost telemetry
  • Caching and latency optimisation techniques
  • Service levels and incident response for AI services

Capstone: Architecture for an AI-Powered Solution

  • Context, component, and deployment views
  • Design of retrieval and agent orchestration
  • Planning for security, governance, and cost
  • Peer review, critique, and migration roadmap

Requirements

  • Practical experience in designing and maintaining production-grade software systems
  • Working proficiency with REST APIs and service integration patterns
  • Understanding of relational databases and data modelling concepts
  • Familiarity with LLM-based tools or APIs

Target Audience

  • Software Architects
  • Technical Leads and Senior Engineers
  • Engineering Managers accountable for architectural decisions

Testimonials (1)

Upcoming Courses

Related Categories