Meta AI Search Indexer Requests Surge 163% in Q2, Totaling 9.1 Billion

Meta's Meta-WebIndexer requests jumped 163% quarter-over-quarter, reaching 9.1 billion total in Q2. This aggressive crawling triggers server alarms for developers as Meta builds an independent search infrastructure to reduce reliance on competitors.

Woofun AI data shows that Meta Platforms' AI crawlers generated 9.1 billion requests during the second quarter of this year. The Meta-WebIndexer, tasked with building search indexes, experienced a 163% increase in activity over the quarter, surpassing training crawler volumes for the first time in June.

Independent developer Pieter Levels claims that frequent crawling triggered load alarms on his servers this week. While Meta has not officially confirmed reports that it aims to build a proprietary search engine to avoid sending data to Google and Bing, the indexing system is expanding rapidly without driving significant user traffic to crawled sites.