Ask HN: Who else is self-hosting AI and apps at home/office?

11 points by jconley 1 year ago | 5 comments

I've been playing around with this the last couple years, slowly adding to my pile of hardware in the cabinet. Who else? I currently have a Synology NAS, a couple mini-pcs, a gaming rig with GPU.

- Running an ETH node

- Running my own DropBox

- Archiving emails

- Backing up photos

- Dual honed internet w/Starlink

- My own local AI assistant with access to all of it

Who's with me?

zoezoezoezoe 1 year ago |

100% I love self-hosting all my services, self-hosting means freedom. I'm using old parts from my PC, email, nextcloud, tor node, game servers, and, yes, even AI stuff with the gpu I threw in there.

jconley 1 year ago | |

awesome! how do you do email delivery? i still have to route things through an external service to get that to really work. oh yeah, i gave my son access and he hosts Rust and Minecraft servers.

i'm looking into doing security cam + AI. just canceled my Nest subscription.

monomial 1 year ago |

I self-host everything I can. Unfortunately email is a bit tough these days but I should start archiving it locally. What tools are you using for that?

I haven't done much experimenting with local AI models yet - probably need some newer hardware for that to be worthwhile.

jconley 1 year ago | |

I wrote some code with an IMAP lib. Wasn't too happy with out of the box things.

The smaller Deepseek models are most interesting for self hosting LLM's at the moment. Impressive! Many other ML Things need a lot less compute, though. Like facial recognition, spam filtering, etc.

mettamage 1 year ago |

How have you done the last one? I have stuff running on ollama but not with "access to all of it"