How to run LLMs locally on mobile devices (with Gemma and On-Device AI tools)

1 points by annjose 1 year ago | 1 comment

Any models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.

incomingpain 1 year ago |

Any models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.