Running a 28.9M parameter LLM on an $8 microcontroller | Dark Hacker News

Dark Hacker News

new|best|ask|show|jobs

Built with the HackerNews API. Developed by LJT.AI

Note: The HackerNews API provides up to 500 stories per category

Running a 28.9M parameter LLM on an $8 microcontroller | Dark Hacker News

Running a 28.9M parameter LLM on an $8 microcontroller(github.com)

38 points by boveyking 5 hours ago | 2 comments

althea_tx 26 minutes ago |

This is a really cool project. Thanks for sharing!

cr125rider 37 minutes ago |

9.7 tokens/sec actually seems like a lot! That’s fun!