Meta-ExternalAgent is a crawler operated by Meta. It collects web content used to train Meta's AI models and to power Meta AI features across the company's products, so it is a training-focused crawler rather than a search indexer.
The consequence of blocking is that your material is excluded from Meta's AI training going forward. Businesses that want their content reflected in Meta AI keep it allowed; those wary of AI training use the Disallow rule to opt out. Existing trained models are not retroactively changed by the block.
How to check and control it
To check, look in your robots.txt for a rule targeting this user-agent. To allow or block it:
User-agent: Meta-ExternalAgent
Disallow: / # blocks it — remove or set "Allow: /" to permit
For an instant check across your whole site, use SEO AEO Specialist's free AI crawler checker, and see the llms.txt & AI crawler guide.
FAQ
What is Meta-ExternalAgent used for?
Meta-ExternalAgent crawls the web to collect content that trains Meta's AI models and supports Meta AI features across Facebook, Instagram, and other Meta products. Allowing it keeps your content eligible for that training; blocking it opts you out while leaving your normal presence on Meta's platforms unchanged.
Does blocking Meta-ExternalAgent remove my Facebook page?
No. Meta-ExternalAgent is a crawler for AI training data, separate from the profiles and pages you publish inside Meta's apps. Blocking it opts your website out of Meta's AI data collection, but has no effect on any Facebook or Instagram presence you maintain directly.
See where you stand
SEO AEO Specialist runs a free AI-visibility audit and hands you the exact fixes. One-off report €9, unlimited €19/mo.
Run your free audit →