Defeating Nondeterminism in LLM Inference | Dark Hacker News

Dark Hacker News

new|best|ask|show|jobs

Built with the HackerNews API. Developed by LJT.AI

Note: The HackerNews API provides up to 500 stories per category

Defeating Nondeterminism in LLM Inference(thinkingmachines.ai)

345 points by jxmorris12 36 days ago | 130 comments

Defeating Nondeterminism in LLM Inference | Dark Hacker News