Books

The RAG Interview

Retrieval-augmented generation, derived end to end, for senior and staff interviews.

1,141 pages, 41 chapters, 123 practice questions.

• 1,141 pages, 41 chapters, 249 sections
• The full ranking progression: BM25, learning-to-rank, dense retrieval, ColBERT, reranking
• 7 end-to-end design drills, including a system that got worse for no obvious reason
• 123 practice questions at core, senior and staff tier, answers held separately
• Every number derived in front of you or attributed to a named source. Free updates for life.

LLM System Interview

Modern transformer design decisions, and the reasoning frontier-lab interviews expect.

• GPU and kernel fundamentals: roofline, arithmetic intensity, why prefill and decode bottleneck differently
• Distributed training: TP, PP, DP, and how to draw the parallelism diagram in 2 minutes
• Scaling laws: the Chinchilla ratio and when it breaks
• Inference systems: KV cache sizing, paged attention, speculative decoding
• 3 full end-to-end design drills, 45 minutes each, with annotated answers