How an LLM generates a response
Follow one prompt through request routing, prefill, and the decode loop. Watch the KV cache grow as the server streams the answer.
Independent builds & experiments
Things I’ve built to explore how AI systems work. Try the demos and see what happens one step at a time.
Follow one prompt through request routing, prefill, and the decode loop. Watch the KV cache grow as the server streams the answer.