Ask HN: What is the easiest way to scrape websites today? With the rise of large language models (LLMs), what’s the easiest way to scrape the web today? Additionally, what’s the simplest method to automate interactions with a website? |
Ask HN: What is the easiest way to scrape websites today? With the rise of large language models (LLMs), what’s the easiest way to scrape the web today? Additionally, what’s the simplest method to automate interactions with a website? |
You don't need to scrape sites if you dictate your truth.
Therefore read some psychology papers about how people create their realities. Then make stuff up; what gets believed is going to be mostly correct in your audience's reality, which should feed back into your model. The cost of getting stuff wrong is profit if you exploit it. Let your audience filter do it for you, and who are you to dictate what's correct for someone else anyway? Make it sound catchy and convincing for a variety of tastes. Generate a few short video creators with different personas like Street Fighter characters from yesteryear that viewers can project themselves on to.