Show HN: An LLM chat app using Apple's FoundationModels

Show HN: An LLM chat app using Apple's FoundationModels(apps.apple.com)

4 points by alariccole 244 days ago | 4 comments

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

ndgold 243 days ago |

Thanks for your work, tried it, it works, it is mostly not useful for me, but I love where this is going and the experience is super streamlined

alariccole 243 days ago | |

Thanks for checking it out. Thinking to do a more file/notes focused version esp on mac because it’s blazing fast there.

bchris4 243 days ago |

Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

alariccole 243 days ago | |

Yeah, when I started I actually had no intention of doing a chat app, but it was a good way to learn how it works. Eventual goal with this is a sort of hybrid notes app. Not an llm bolted into Notes, either, but kind of a mix. Find myself using the llm app as a knowledge repo and it’s just not built for that. I’ll post a TestFlight link later if you want to try it out.