Hi, I’m a pretty experienced scraper/automator and I was thinking about sharing my knowledge. I originally thought about writing a blog, but I'm not sure that would be the best format to transmit everything I know. Maybe I'll do both.

There would first be a quick introduction to the legacy ways of scraping(i.e GET request+parser), why they’re often not enough today and when can they be still used.

Then I’d delve into more advanced techniques, I usually try to find the cheapest/free solutions to the problems I’m solving but I’ll also compare paid options:

-how to make your scrapers/bots as stealthy as possible

-everything you need to know about fingerprinting

-how to bypass datadome, cloudfare, captchas…

-how to scale to millions of requests

-how to make your own free rotating proxies

-how to do automation on mobile apps and desktops

-how to reverse engineer APIs on the web or mobile

-every tips and tricks I know to scrape better

I may add a section on GPT/LLM, either about how to fasten the development of a scrapers or about how to make self healing scrapers.

Is this a topic that would interest a lot of you?

Would some of you be ready to pay a small amount for an ebook/courses on those subjects?

Thanks