AI systemsProblems
AI system design interview problems
Worked AI system design problems, each grown stage by stage from requirements, with the evals, cost and rollout deep dives interviewers now probe.
7 topics.
- 01SeniorReadDesign a ChatGPT-style assistantServe an LLM to millions: GPU fleets, batching, streaming and per-user token limits.
- 02SeniorReadDesign a RAG system for company docsPermission-aware retrieval over millions of documents that stays fresh and cites its sources.
- 03SeniorReadDesign a video recommendation feedCandidate generation, ranking and real-time signals for a TikTok-style feed.
- 04SeniorReadDesign a code completion assistantA suggestion in under 300 ms, built from the right slice of a large repo.
- 05SeniorReadDesign a customer support agentAn agent that issues refunds safely: tool permissions, budgets and human handoff.
- 06SeniorReadDesign a content moderation systemClassifiers, LLMs and human reviewers in one cascade, tuned for precision and recall.
- 07SeniorReadDesign a hosted agent platformRun thousands of agents for other companies: sandboxes, MCP, durable runs and tenant isolation.
More in AI systems
The designbeyondcode digest, every Saturday
New deep dives, interview tips and site news in one short email. Free. Leave with one click.
We never sell or share your email. We only use it to send this newsletter.