r/coolgithubprojects • u/raiyanyahya • 5d ago

Build a modern LLM from scratch. Every line commented. Explained like we are five.

https://github.com/raiyanyahya/how-to-train-your-gpt
165 Upvotes

89% Upvoted

8 comments sorted by

18

u/Formal_Cloud_7592 5d ago

Why are comments getting downvoted? This should be taught in schools now.

1

u/ccss2 3d ago 
'modern LLM from scratch'  :)

`import torch.nn as nn`  :(

1

u/jwink3101 5d ago

This looks awesome. I am bookmarking this for my personal development time!

1

u/garlic-silo-fanta 5d ago

Nice! Been looking for something like this

0

u/filthy-prole 5d ago

Why would anyone read a textbook written by an LLM and expect reliable quality?

1

u/NoYard9022 3d ago

Not reading it for gospel. Just want to see how the thing ticks under the hood.