Ask HN: Why are desktop AI apps so heavy?

3 points by yconst 17 days ago | 2 comments

I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what's the deal?

bigyabai 17 days ago |

Static linking, basically: https://en.wikipedia.org/wiki/Static_build

othmanosx 17 days ago |

Virtualization missing, that's commonly a difficult task to nail on a messages list. another thing is mounting and unmounting complex elements efficiently, that was part of why switching threads or sessions felt heavy.

btw, native apps can feel heavy and janky too if not properly optimized for large lists. it's just a matter of shipping a good app that's battle tested with large data sets