No Need for Speed: Why Batch LLM Inference Is Often the Smarter Choice(sutro.sh)4 points by cmogni1 336 days ago | 0 commentsNo comments yet