Dark Hacker News
new
|
best
|
ask
|
show
|
jobs
App to Run LLMs on Android
(play.google.com)
1 points
by
ValleZ
2 years ago
| 3 comments
App to Run LLMs on Android | Dark Hacker News
ValleZ
2 years ago
|
next
[−]
One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
Zambyte
2 years ago
|
next
[−]
Cool project! Where is the source code for this?
ValleZ
2 years ago
|
parent
|
next
[−]
It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp