Website unresponsive: diagnostic steps and blocking the AI crawlers

Website unresponsive: diagnostic steps and blocking the AI crawlers(physicsderivationgraph.blogspot.com)

2 points by physicsgraph 165 days ago | 2 comments

cport1 153 days ago |

might want to try something like https://webdecoy.com

Festro 165 days ago |

Blocking IP ranges is just whack-a-mole though right? Glad you got the site back up but this necessitates a high level of vigilance going forward.

Can a softer throttling approach work? Rate limit the naughty IPs when they go over a threshold, or even increase rate limits as CPU/RAM usage climbs?