AI agents surge as web traffic triples, prompting blocks from Amazon and Yelp
Personal AI apps like Meta’s Muse are driving a tripling of agentic web traffic, causing major sites to block automated access.
Key points
- Agentic web traffic tripled from August to September following the launch of personal AI agent apps.
- Meta’s Muse reached five million downloads in its first month, accelerating the shift toward automated web interactions.
- Major platforms including Amazon, Yelp, and Pizza Hut are blocking AI agents, citing security and business concerns.
Personal AI agents are rapidly altering internet traffic patterns, with agentic web visits tripling between August and September. This surge follows the widespread release of consumer-facing applications such as OpenAI’s Dots and Meta’s Muse, which allow users to delegate online tasks to automated software.
Meta’s Muse application was downloaded five million times during its first month of availability. These tools enable users to perform actions like booking flights or hotel rooms automatically. The rapid adoption has created a new category of web visitor that operates at machine speed but acts on behalf of individual humans.
View the original post on X
Context and background
The traditional distinction between human users and automated bots is breaking down. Websites were originally designed to prioritize human interaction, using mechanisms like captchas to verify identity. However, personal AI agents do not fit neatly into existing classification systems because they perform legitimate tasks for people but behave like bots in their execution speed and method.
Ethan Mollick, an associate professor at the Wharton School of the University of Pennsylvania, predicts these changes will soon affect the entire web. As demand for agents increases, internet infrastructure may be redesigned to accommodate them rather than humans. This shift challenges the long-standing model where bots were restricted to specific automated tasks while general browsing remained human-centric.
Who is affected
Many websites are currently blocking AI agents, creating friction for early adopters. TechCrunch reported that users encountered difficulties deploying agents on platforms ranging from Pizza Hut to Yelp. Yelp explicitly prohibits the use of AI for booking restaurant reservations, while other sites are implementing broader bans to manage the influx of automated traffic.
Amazon has blocked agents from Meta’s Muse and is engaged in a legal battle with AI startup Perplexity. Amazon filed an appeal after a judge ruled in favor of Perplexity, arguing that AI agents threaten its advertising business. The company contends that agents make it difficult to distinguish between ad impressions viewed by humans and those served to bots.
What should you do?
Security and technology professionals should monitor how their organizations handle automated web traffic. As the line between human and bot blurs, existing access control lists and rate-limiting strategies may need adjustment. Organizations relying on web scraping or automated booking systems should prepare for increased blocking by major platforms.
What to do and how to stay safe: Meta
- Review current bot management policies to determine if they distinguish between malicious bots and legitimate personal AI agents.
- Monitor access logs for unusual spikes in automated traffic that may indicate the use of new AI agent applications.
- Assess legal and business risks associated with blocking or allowing AI agents, particularly regarding advertising metrics and user privacy.
- Stay informed on ongoing legal cases involving AI agents and web access rights, as court rulings may influence industry standards.
Step-by-step guide: Prompt Injection Warning Signs: How to Spot AI Manipulation
General security guidance from the Threat Times newsroom. It is not confirmed advice from the organisations named in this story.
Frequently asked questions
Why are websites blocking AI agents?
Websites are blocking AI agents because they do not fit existing bot or human categories, and some platforms argue they threaten advertising revenue by obscuring human versus bot ad views.
Which apps are driving the increase in AI agent traffic?
Apps like OpenAI’s Dots and Meta’s Muse are driving the increase, with Muse reaching five million downloads in its first month.
How has web traffic changed recently?
Agentic web traffic tripled from August to September, marking a significant shift in how automated tools interact with websites designed for human users.
