Building Micro Agents as Production-Grade Microservices

Kotcherla Murali Krishna
Build production-grade AI agent systems using microservices. Covers FastAPI, gRPC, Kafka, Kubernetes, OpenTelemetry, and fault-tolerant orchestration patterns in Python. Table of Contents Introduction & Motivation Core Architecture Principles Agent Service Design The AgentRunner Loop Inter-Agent Communication Tool Registry Service Memory Architecture Context Window Management Orchestrator & Supervisor Pattern Security & Authorization Observability: Traces, Logs, Metrics Deployment on Kubernetes