Any feedback is welcome. I'll clean it up soon, but I decided to just publish it for now and see the response. Tomorrow there should be more than one giant Python file, and the ability to use files other than .txt.

I wonder if this would work with Alpaca too. I'm not a coder, but I did manage to get llama.cpp running with Alapaca.