Token efficient source code representation using virtual filesystem

Token efficient source code representation using virtual filesystem(github.com)

2 points by kirby88 78 days ago | 4 comments

kirby88 78 days ago |

Using a virtual filesystem to minify source code and let the LLM evolve in the minified space gives surprisingly good results and reduce tokens by 20 to 40% (depends on the language, python for instance)

muyuu 78 days ago |

sounds interesting and i don't want to sound negative, but i'm not going to install software of this nature that is closed source

kirby88 78 days ago | |

Claude code is closed source as well (at least before the leak). But point taken thank you.

muyuu 78 days ago | | |

I don't use Claude Code either in fairness, but when I buy tokens from them that's an exposure I already have. These days I use opencode and I work local first with the models, then remote models as fallback. GPT and Gemini have been giving me better results than Opus for a while.

Would you install someone else's binary blob to give it those much permissions and your API keys? The measures required to run that somewhat trustless complicate things a lot.