Phi-3 Technical a Highly Capable Language Model Locally on Your Phone

Phi-3 Technical a Highly Capable Language Model Locally on Your Phone(huggingface.co)

7 points by EveryPizza 2 years ago | 7 comments

tommy_axle 2 years ago |

Looks like HuggingFace is experiencing issues again (https://status.huggingface.co/) same 503 errors like yesterday morning.

pogue 2 years ago |

Anyone made or working on a UI for this for Android (or iPhone)?

sottol 2 years ago | |

I've been trying this app but haven't had any luck getting it to actually generate text yet:

https://github.com/Mobile-Artificial-Intelligence/maid

The UI looks nice and includes a native compilation of llama.cpp.

My main phone's screen broke so I'm on an old Pixel 4 until it's repaired but I've had no luck getting 2-3GB models to run so far.

pogue 2 years ago | | |

The APK doesn't include any of the models, so I'm not sure where you get them, where you're supposed to put them on the phone (same directory? Do they need to be compiled?)

When I ask it a question it doesn't respond & when you attempt to switch models it starts looking for nearby devices.

It also appears to be role play for some characters, so it's really not a GenAI chat bot, as far as I can tell. https://ibb.co/DRZhZcH

trao 2 years ago | |

Yeah, it’s on Private LLM.

https://privatellm.app/blog/phi-3-now-available-on-iphone-an...