Stay ahead of AI search

The changes that move your rankings and AI citations — and the exact move to make — before they cost you. Free, three times a week.

GEO Beat · EVENT

Running a Facebook Page now counts as letting Meta crawl your business website — starting October 30

2026-10-16Credibility: High 中文版 →

Summary. Meta has moved the question of who lets its crawlers in. Under its updated Commercial Terms, effective October 30, 2026, a business authorises Meta "or any entity acting on our behalf" to use automated software to access, index, cache and crawl the domains, pages and URLs associated with its products or services. There is nothing to sign. Continued business use of Meta's products after that date counts as agreement, and that covers managing a Facebook Page as well as buying ads. Search Engine Journal reported the change on October 16, 2026. The terms do not mention robots.txt, and that gap is where Meta and the legal experts now disagree.

Credibility: HIGH. The clause and the October 30 effective date were read on Meta's own Commercial Terms preview page, and Search Engine Journal corroborates the wording. The date Meta first notified businesses was not visible on the page. How the clause interacts with robots.txt is the opinion of legal experts quoted by Search Engine Journal, not a Meta statement.

Facts

  • The clause: It sits under 'Licences and rights you provide Meta'. Businesses authorise Meta 'or any entity acting on our behalf' to use automated software to access, index, cache and crawl associated domains, and to pull updates periodically. Per Search Engine Journal, collected content may be used to train Meta's products, and Meta may create test credentials to reach pages.
  • Acceptance: Meta treats continued business use of its products after October 30, 2026 as agreement. The Self-Serve Ad Terms take the same crawl permission on the same date.
  • robots.txt: Neither set of terms mentions it. Meta spokesperson Andy Stone said the update is 'not about scraping news sites' and that publishers can still manage access with robots.txt.
  • Crawlers: Meta's documentation lists four. Meta-ExternalAgent handles training and product improvement. Meta-WebIndexer handles Meta AI search. Meta-ExternalFetcher and FacebookExternalHit may bypass robots.txt in some cases.

Sources

OPERATOR TAKE

For business owners and marketing leaders with a Facebook Page or Meta ad account: the real change is who says yes. Until now, whether Meta's bots read your website was a line in robots.txt, and the web team owned it. From October 30, 2026 it is also a contract term, accepted by whoever keeps managing the Page. Meta says robots.txt still works for publishers. The legal experts Search Engine Journal quoted think the clause may override it. Nobody is likely to settle that before the deadline, so the call belongs with whoever owns brand and legal risk. The web team should implement it, and should not be left to make it.

The useful detail is in Meta's own documentation. It separates the crawler that feeds Meta AI search (Meta-WebIndexer) from the one that collects for training (Meta-ExternalAgent), so a split policy is possible: stay findable in Meta AI and decide training on its own terms. Blocking everything is also a legitimate answer. Just make it on purpose, and remember that two of the four bots on Meta's list may bypass robots.txt in some cases, so the file was never the whole answer.

Actions before October 30

1. Ask legal counsel whether continued use of Meta's business products after October 30, 2026 conflicts with any existing robots.txt blocks or content licences, and record the decision.

2. Ask the web team to review the robots.txt lines for Meta-ExternalAgent and Meta-WebIndexer, and write down which are allowed and why.

3. Check server logs for the four Meta user agents over the past 30 days to see what already reaches the site.

4. Decide whether to keep the Facebook Page and ad account on the current terms, and note who approved it.

Sources

Meta: Commercial Terms preview, effective 30 October 2026 - https://www.facebook.com/legal/commercial_terms_preview

Meta: Web crawlers documentation - https://developers.facebook.com/documentation/sharing/webmasters/web-crawlers

Search Engine Journal: Meta's New Terms Expand Crawling Rights Beyond Advertisers, Matt G. Southern, 16 October 2026 - https://www.searchenginejournal.com/metas-new-terms-expand-crawling-rights-beyond-advertisers/593217/