Show HN: TurboGPT: train 22KiB transformer in 13s

13 points by lostmsu 2 hours ago | 1 comment

Inspired by minGPT for home experiments.

Requires CUDA 13.4; build script is Windows only.

jey 1 hour ago |

At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little

jey 1 hour ago |

At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little