AI search engines crawling TidBITS Talk

A followup to how quickly this thread appeared in a generative AI database: iFixit, a DIY repair site that many here probably are familiar with, gets scanned by Anthropic a million times a day. That’s right, 1,000,000. And that’s just by one of the gAI companies.

The web scraper bot for Anthropic’s AI chatbot Claude hit iFixit’s website nearly a million times in a single day, despite the repair database having terms of service provisions that state “reproducing, copying or distributing any Content, materials or design elements on the Site for any other purpose, including training a machine learning or AI model, is strictly prohibited without the express prior written permission of iFixit.”

iFixit CEO Kyle Wiens tweeted Wednesday “Hey @AnthropicAI: I get you’re hungry for data. Claude is really smart! But do you really need to hit our servers a million times in 24 hours? You’re not only taking our content without paying, you’re tying up our devops resources. Not cool.”