How do you run System One decision models locally?

How do you run System One decision models locally?(stackness.dev)

2 points by gosen 16 days ago | 1 comment

gosen 16 days ago |

To run a System One model locally you pick a runtime as well as a model. Ollaya serves ten open decision models behind a Jev-compatible API, laya-mlx runs Laya on Apple silicon, and llama.cpp needs a shim. Which numbers are measured, and when hosted Jev still wins.

gosen 16 days ago |

To run a System One model locally you pick a runtime as well as a model. Ollaya serves ten open decision models behind a Jev-compatible API, laya-mlx runs Laya on Apple silicon, and llama.cpp needs a shim. Which numbers are measured, and when hosted Jev still wins.