“Hello, Athos here. Welcome to my course, Introduction to GPU Inference. I put this course together to share what I know about inference, and I added a few extras to make the experience more interactive.”
Hi HN!I've spent most of this year working on GPU inference, and I put together a short course to share what I've learned.It starts with the basics and works up to how inference is actually served, things like continuous batching, goodput, and disaggregated prefill and decode. I'll soon add a lesson that shows how to run adaptive disaggregated inference on a consumer GPU!The lessons are around 5-10min each, include interactive diagrams and are fully voice narrated.No signup or fees.I'd love to hear what you guys…
Are you the creator of athrael.net? Share your verified feature badge on your website, or export a custom 4:5 editorial social card for Instagram and X.
Generate a 1080×1350 vertical high-res feature card tailored for social sharing.
Instagram & X Feature Card
Export a polished, high-resolution 4:5 editorial graphic displaying your verified inclusion in the Storesso Discovery Index. Perfect for launch threads, founder updates, and newsletters.
Rendered at 1080×1350px (Retina ready) · No attribution watermark required.