Why do you expect a high level of abuse? Blocking CIDRs of major cloud providers will stop the genuine ChatGPT/Claude traffic. For the other scrapers masquerading as them, just block the agents' user agents.
If you want the LLMs to refuse to scrape your site you could inject lots of encoded trigger words but this would probably affect your SEO score :)
> I'd like to increase bot traffic to around 100k hits per day to help test the filters. Any suggestions on how?
Start publishing content that AI crawlers want to read and you'll get absolutely hammered. Your site is pretty bare bones so maybe get an AI to rewrite it with more content, using SEO best practices and with AI agent parsing in mind.
It's not enough to use latency alone as the other commentor said. You need to look for repeat behaviour at scale. It's ML model time once these basic signals fail you.
Prosopo could cut out a lot of the residential proxy nonsense for you. We integrate with lambda@Edge / cloudfront workers / server side and perform analytics to detect residential proxy networks - at far less cost than DD or HUMAN.
reply