3000 tokens/sec LLM playground

3000 tokens/sec LLM playground(playground.kog.ai)

6 points by rashkov 34 days ago | 3 comments

rashkov 34 days ago |

Actually getting to use this is different than just reading about it. Feels like a preview of the future.

Related discussion of their writeup: https://news.ycombinator.com/item?id=48321076

What am I missing? It can't even list countries in NATO correctly, chatjimmy.ai can do that and output 17000 tokens/sec on cheaper silicon.

rashkov 34 days ago | |

I don't think you're missing anything, the speed is the impressive thing but the model is limited. Perhaps Chatjimmy is more impressive in this respect. Most people haven't tried either