Nvidia Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context

13 pointsposted 6 hours ago
by frozenport

1 Comments

2001zhaozhao

4 hours ago

Gemma 31B dense at 3k TPS seems like a pretty big deal. Groq has always been more efficient than Cerebras at running very small models and this release seems to be no exception.