TLDR Tech / Opinion
Bots Scraped Most of APIs.io Catalog in One Week
An analysis of bot activity on the APIs.io catalog over a week revealed that prominent model developers, search engines, and scrapers acquired nearly the entire dataset. Companies like Meta and Anthropic, along with an unidentified headless scraper, each retrieved over 80% of the catalog, including both human-readable content and technical specifications. The author observes that this automated data collection transforms web publishing into data distribution, with AI agents and resellers duplicating datasets weekly.
Read the full story