LLM Inference
2 essays tagged “LLM Inference”.
14 min read
What Makes an RDU Different from a GPU?
Understanding SambaNova's RDU took me back through FPGAs. Following that connection explains how a model runs on a GPU, what changes when we arrange its computation across the …
6 min readThe Case for Craft
Moving from writing the code to directing the people who write it does not cost you the craft. The craft was never the keyboard. It is the model you reason with, and it only decays …