Pocket LLM Server Just Like a Pocket WiFi Hey HN, If there is a pocket-sized compact hardware that hosts large-size open-source LLMs that you can connect offline, wouldn't it be helpful? The benefits: - You can use large-size open-source LLMs without using up your PC or smartphone's compute - You can protect your privacy - You can use high performance LLM offline |