Tag: scraping

  • Meta Pauses Commercial Terms Update That Would Expand Scraping Rights (2026)

    Meta Pauses Commercial Terms Update That Would Expand Scraping Rights (2026)

    Takeaway: Meta has indefinitely paused proposed updates to its Meta Commercial Terms, Product Catalog Terms, Self-Serve Ad Terms, and Ad Creative Generative AI Terms. The company says the updates will not take effect on November 20, 2026, and that existing terms remain in effect while it consults stakeholders. The pause follows publisher backlash, preliminary injunctions in Norway and Brazil, a UK Competition and Markets Authority probe, and bipartisan U.S. Senate letters — not a quiet product tweak.

    Reporting: Nieman Lab (Nov 5), Ars Technica (Nov 6), and Reporters Without Borders. Meta’s commercial-terms page remains the official document surface (facebook.com/legal/commercial_terms); Nieman Lab quotes Meta’s Business Help Center pause notice in full.

    What Meta paused — and what it does not mean

    According to Nieman Lab, Meta removed the preview of the proposed terms and published a Business Help Center update stating that the four term sets are “now paused and will not take effect on November 20, 2026,” that Meta is “continuing to consult with stakeholders,” and that “existing terms remain in effect.” A Meta spokesperson told Nieman Lab (and, per Ars Technica citing Reuters, also told Reuters): “We’re pausing the changes as we continue to engage with stakeholders and take our time to get this right.”

    Pause ≠ permanent withdrawal. Meta has not announced that the commercial-scraping language is dead forever. It has delayed implementation before (first target October 30, then November 20) and now parked the update indefinitely pending consultation. Publishers and SEOs should treat this as a live policy fight, not a closed case.

    What the proposed terms would have allowed

    Nieman’s October coverage (recapped in the Nov 5 piece) and Ars Technica’s analysis describe a design that tied Meta Business account access to broad rights over off-platform pages: domains and pages linked from Meta Business accounts — including, critics argued, paywalled material — for advertising and business products. Early drafts used language associated with AI model training (“train”); Meta later removed the word “train” and narrowed stated uses toward advertising and business products, but legal experts and publisher groups said the revised wording still granted sweeping collection rights.

    • No clean opt-out: Ars reports businesses (including news publishers already fighting unwanted AI scraping) had no meaningful way to refuse the crawl rights while keeping a business Facebook page.
    • Paywall concern: Critics said the terms even contemplated credentials so Meta bots could reliably access gated content — a flashpoint for subscription publishers.
    • robots.txt reminder (not a rewrite of the terms): Meta told page owners that crawling practices “remain unchanged” and that content owners can still signal preferences with robots.txt. Ars notes Meta still faced criticism for not putting specific robots.txt-respect language into the revised commercial terms themselves.

    That robots.txt tension sits next to wider crawl-policy fights we have covered for Google and AI training — see Google’s robots.txt / AI-training policy token moves and publisher-side Google AI contribution / generative controls.

    Timeline: from Oct 15 alarm to Nov 5 pause

    DateEventSource
    Oct 15, 2026Nieman Lab first reports commercial terms would allow scraping of news sitesNieman Lab
    Oct 16Meta removes “train”; limits stated use toward ads/business productsNieman Lab
    Oct 23Effective date pushed from Oct 30 → Nov 20Nieman Lab
    Oct 28Oslo District Court preliminary injunction (Norwegian publishers)RSF / Nieman
    Oct 28Andy Stone (Meta VP Comms): consultation; delay if past Nov 20Nieman / Ars
    Oct 30UK CMA opens formal investigation into exploitative termsRSF / Nieman
    Nov 3São Paulo court temporary suspension (ANJ / ANER / ABERT case)RSF
    Nov 5Preview down; Help Center: paused, no Nov 20 effective dateNieman Lab

    Courts, regulators, and political pressure

    RSF summarizes the Norway and Brazil injunctions: Norwegian media companies won a temporary stop on Oct 28; on Nov 3 a São Paulo court barred Meta from collecting/using members’ content without authorization under the disputed provisions, stressed explicit consent before AI training use, and ordered Meta not to retaliate by cutting accounts — with reported daily fines of 1 million Brazilian reais (about €163,000), capped at 100 million reais.

    In the UK, the CMA is examining whether Meta was “abusing a dominant position by imposing exploitative terms on publishers and advertisers” (Nieman Lab / RSF). RSF also notes the European Commission has received a complaint. In the U.S., Sens. Adam Schiff (D-Calif.) and Marsha Blackburn (R-Tenn.) sent letters asking Mark Zuckerberg to withdraw the terms.

    UK News Media Association CEO Theo Bamber’s line — “Does Meta think we can’t read?” — captured why removing “train” failed to calm the room: “develop” any business product still looked like the same AI pipeline risk (Ars Technica).

    The European angle rhymes with press-publisher AI fights we tracked around CJEU / Szpunar-style publisher AI pressure — different jurisdiction and instrument, same core dispute: platforms cannot treat news URLs as free training fuel just because publishers need distribution.

    Confirmed vs reported (label carefully)

    ClaimStatusNotes
    Updates paused; will not take effect Nov 20, 2026ConfirmedMeta Help Center text via Nieman Lab
    Existing commercial terms remain in effectConfirmedSame Help Center notice
    Indefinite pause while consulting stakeholdersConfirmedMeta spokesperson to Nieman Lab / Reuters
    Preview of proposed terms taken downConfirmedNieman Lab
    Norway + Brazil preliminary injunctionsConfirmedRSF; Nieman Lab
    UK CMA formal investigationConfirmedRSF / Nieman Lab
    Schiff + Blackburn letters to ZuckerbergConfirmedNieman Lab / Ars
    Meta permanently cancelled scraping rights foreverNot establishedPause + consultation only
    robots.txt language written into revised commercial termsNot establishedReminder to page owners; Ars: not in revised TOS text

    Why publishers and SEO teams should care

    Almost every serious news brand and many ecommerce/SaaS companies run Meta Business pages. A terms change that bundled page access with rights over linked websites would have compressed licensing leverage — the same structural squeeze publishers feel as AI answer engines grow (ChatGPT search-like volume already in the conversation around ~20% of Google query volume claims). Even with the pause:

    • Ad + catalog stack stays live under old terms — catalogs, self-serve ads, and generative ad creative still operate; only the disputed update is parked.
    • Policy can return after “consultation.” Track Meta Business Help Center and commercial_terms, not just headlines.
    • Courts bought time, not a global ban — injunctions are preliminary and jurisdiction-limited.
    • robots.txt remains necessary but not sufficient — Meta’s reminder helps optics; contract language is what publishers fought.

    Actionable checklist for publishers & SEOs

    1. Document current Meta Business account terms screenshots and effective dates now — baseline for any future update notice.
    2. Keep robots.txt / crawler blocks current for Meta / Facebook crawlers and AI bots; treat Meta’s reminder as a floor, not a guarantee (pair with robots.txt AI-training policy hygiene).
    3. Legal: track Norway/Brazil dockets and CMA — injunctions can be modified; CMA findings may reshape UK/EU leverage.
    4. Do not abandon Meta distribution blindly — the pause preserves the status quo; plan contingency (alternate traffic, email, search, AI citation) rather than panic-exit.
    5. Licensing posture: if you license content to AI firms elsewhere, keep Meta negotiations separate and written — “ads/business products” can still be AI-adjacent.
    6. Internal owners: assign one person to Meta Business Help Center + commercial_terms weekly until Meta issues a final update.

    FAQ

    Did Meta cancel the commercial terms scraping update permanently?

    No. Meta paused the updates indefinitely and said they will not take effect on November 20, 2026 while it consults stakeholders. Existing terms remain in effect. Nieman Lab and Ars Technica describe a delay and consultation, not a permanent withdrawal.

    Which Meta documents were supposed to change on Nov 20?

    Meta’s Business Help Center notice (quoted by Nieman Lab) names four: Meta Commercial Terms, Product Catalog Terms, Self-Serve Ad Terms, and Ad Creative Generative AI Terms.

    Why did courts in Norway and Brazil get involved?

    Publisher groups sued over terms that would have forced a choice between allowing Meta to collect website content (including, critics said, paywalled material) or losing platform access. Oslo District Court issued a preliminary injunction on October 28; a São Paulo court issued a temporary suspension on November 3 (RSF).

    Does Meta’s robots.txt reminder mean publishers are protected?

    Meta reminded page owners that crawling practices remain unchanged and that robots.txt signals still apply. Ars Technica notes critics still wanted that respect written into the commercial terms themselves. Treat robots.txt as necessary hygiene, not a substitute for contract clarity.

    What should SEO and GEO teams do while the pause holds?

    Maintain crawler controls, monitor Meta’s Help Center and commercial_terms page, track CMA and injunction outcomes, and keep alternate discovery channels healthy — including search and AI-answer visibility work covered in our ChatGPT vs Google volume and publisher AI-rights reporting.