Cloudflare CEO Matthew Prince said AI bot traffic will surpass human traffic on the internet by 2027. He made the prediction during an interview at the SXSW conference in Austin. The surge comes from generative AI agents that need huge amounts of data and visit many more sites than a person would for the same job.
Prince gave a clear example. A person shopping for a digital camera might check five websites. An AI agent doing the same task could hit 5,000 sites. That creates real load on servers and networks everywhere. Before the generative AI boom bot traffic sat at about 20 percent of all internet activity with Google web crawler as the biggest player. Now the picture changes fast.
Why the growth feels different 🤖
Prince explained the difference from earlier spikes. During Covid video streaming traffic jumped hard in two weeks and then leveled off. AI bot growth builds more gradually but keeps climbing with no sign of a plateau. Cloudflare which handles traffic for one fifth of all websites already blocks plenty of unwanted AI bots while supporting legitimate needs. The company also experiments with cache designs that treat AI crawler patterns differently from human browsing to keep performance high for everyone.
Other reports back the trend. Automated traffic already passed 51 percent of web activity in 2024 according to security data and AI agent volume exploded nearly 8,000 percent in 2025. Googlebot alone accounts for a large share of verified bot requests while newer AI crawlers add their own pressure.
What infrastructure must change next 💻
Prince called AI a platform shift as big as the move from desktop to mobile. He wants systems where users can spin up temporary code sandboxes as easily as opening a new browser tab. These short lived environments could run AI agents for tasks like vacation planning and then disappear. Millions of such sandboxes might launch every second. Cloudflare works on cache strategies and other tools to handle the mixed traffic without slowing down real users.
Website owners already turn to solutions that let them present simplified content to known AI bots while protecting performance for people. The coming years will test how well the internet backbone scales to this new reality.
