Strands Decider 2B: a small, open-source, decision model(strandsagents.com) |
Strands Decider 2B: a small, open-source, decision model(strandsagents.com) |
Meet Jerry- it's literally a guy named Jerry answering your questions.
Jerry, "The Decider" https://www.youtube.com/watch?v=r8VbzrZ9yHQ
It can technically be used for a lot of use cases, I'd like people to chime in on ideas on this?
{ "model": "strands-decider-2B-hobson-v19", "answers": { "is_urgent": { "type": "noul", "noul": 0.8287 } }, "usage": { "input_tokens": 86, "output_tokens": 1 }, "latency_ms": 1732.17 }
This is how I got it running - https://gist.github.com/2891eb0db9ea92c1a4e860d44f556292
There's a lot more to be done if we optimize for MLX & let it run on a Mac mini instead of the docker wrapper.
It is just the right mix of size, capability and speed to make it generally useful for adhoc bulk classification tasks.
For those wanting to run it in browser: https://huggingface.co/alxnahas/strands-decider-2B-webgpu