nanoGPT

nanoGPT keeps a GPT model and its training workflow in a relatively small codebase. That makes it interesting to read when you want to follow how the pieces of a training run connect. The important qualification is the maintainer's notice: this repository is old and deprecated, with nanochat identified as the newer project to investigate. I'd use nanoGPT for historical study or a deliberately constrained experiment, with its dependency and hardware requirements checked first. I would not choose it for a new production training system on the strength of an old benchmark. The clone command below retrieves the source; it does not install the environment or train a model.