Show HN: Web Ingest – Convert websites to LLM-friendly text

Show HN: Web Ingest – Convert websites to LLM-friendly text(webingest.com)

8 points by chrisnolet 1 year ago | 2 comments

I really love Git Ingest, but I needed something more general. So I built this!

It crawls websites and converts each page to Markdown.

It’s great for developer documentation.

And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it!

lord-squirrel 1 year ago |

Is it open source?

chrisnolet 1 year ago | |

Thanks for trying it! It's not open source, but it is a single-page app. You could download the source and run it locally.

The web app is calling Jina Reader under the hood. If you needed something a little different, it wouldn't be too hard to write a CLI tool to call Jina and achieve similar results.

It's cheap to host, so I'll be leaving this up for the foreseeable future.