Independent builds & experiments

Projects

Things I’ve built to explore how AI systems work. Try the demos and see what happens one step at a time.

Interactive explainer

How an LLM generates a response

Follow one prompt through request routing, prefill, and the decode loop. Watch the KV cache grow as the server streams the answer.

  • LLM serving
  • Inference