Nvidia Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context

Nvidia Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context(developer.nvidia.com)

14 points by frozenport 45 days ago | 1 comment

2001zhaozhao 45 days ago |

Gemma 31B dense at 3k TPS seems like a pretty big deal. Groq has always been more efficient than Cerebras at running very small models and this release seems to be no exception.

2001zhaozhao 45 days ago |

Gemma 31B dense at 3k TPS seems like a pretty big deal. Groq has always been more efficient than Cerebras at running very small models and this release seems to be no exception.