http://programmer.ie/tags/gpt/ Recent content in Gpt on Programmer.ie: Modern AI programming Hugo en-us Sat, 08 Aug 2026 14:03:00 +0100 http://programmer.ie/post/pytorch-zero-to-hero-10/ Sat, 08 Aug 2026 14:03:00 +0100 http://programmer.ie/post/pytorch-zero-to-hero-10/ <h1 id="build-a-small-gpt-style-language-model-from-scratch-in-pytorch">Build a Small GPT-Style Language Model From Scratch in PyTorch</h1> <p>This is the final post in the <strong>PyTorch: Zero to Hero</strong> series.</p> <p>We have spent the previous posts learning the machinery underneath PyTorch:</p> <ul> <li>tensors and shapes;</li> <li>autograd;</li> <li>manual neural networks;</li> <li><code>nn.Module</code> and parameter registration;</li> <li>DataLoader performance;</li> <li>convolutional networks;</li> <li>attention and masks;</li> <li>training failures;</li> <li>CUDA performance and <code>torch.compile</code>.</li> </ul> <p>Now we put it together.</p> <p>The goal is not to download a pretrained model.</p>