rasbt/

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter Notebookaiartificial-intelligenceattention-mechanismdeep-learningfinetuning+14 more

Stars

106.7k

+4 today+13 /wk+57 /mo

Forks

16.4k

Issues

Watchers

106.7k

Star History

LicenseNOASSERTION

CreatedJul 23, 2023

Last push10/2/2026