Generative AI & LLMs
GenAI System Design
8 practice questions. Free questions open a full answer guide; the rest unlock with Pro.
- Walk me through how you'd design a question-answering feature over our internal documents using an LLM. What are the main pieces?
- You're designing a knowledge-grounded assistant over a large, frequently-changing corpus of internal documents, and the team is split between stuffing everything into a long context window, building retrieval, and fine-tuning the model on the docs. How do you reason through that architecture, and how do you keep the answers grounded?Go Pro
- An LLM feature is getting popular and the API bill is climbing fast. How would you bring the cost down without obviously hurting quality?Go Pro
- A consumer LLM feature is gaining traction but the per-request model bill and latency are climbing faster than revenue. How would you redesign the system to bring cost and latency down while keeping answer quality acceptable?Go Pro
- You're designing the architecture for a production LLM feature that has to meet a latency SLA and stay within budget at scale. How would you structure the system around the model call?Go Pro
- Before launching an LLM-powered answer feature over our help-center content, how would you tell whether it's actually good enough to ship?Go Pro
- A prototype LLM feature works great in a notebook, and leadership wants it in production next quarter. As the senior engineer, how do you take it from a working demo to a reliable, operable production service?Go Pro
- Your product depends on a third-party LLM API. What happens to your feature when that provider is slow, rate-limits you, or goes down, and how would you design so users aren't stuck?Go Pro
Want questions matched to your role? Paste a job title, job description, or CV for a personalized set, or go Pro to unlock the full bank.