Meta Pauses Plan to Scrape Websites Linked to Business Accounts

Meta has indefinitely suspended a controversial proposal that would have expanded its ability to crawl websites associated with businesses using its platforms. The decision follows weeks of criticism from news publishers, digital advertising groups, politicians and legal experts, who warned that the proposed commercial terms could give the technology company broad permission to collect content from external websites.

The company confirmed that the proposed changes to its commercial terms will not take effect on November 20, 2026, as previously planned. Meta says it is pausing the updates while it continues discussions with stakeholders. The move represents a significant setback for the proposal, although it does not mean that Meta has abandoned its broader web-crawling activities or resolved the concerns raised by publishers.

Meta Suspends Controversial Commercial Terms

Meta’s proposed changes covered several policy documents, including its Commercial Terms, Product Catalog Terms, Self-Serve Ad Terms and Ad Creative Generative AI Terms.

The revised language would have authorized Meta and companies working on its behalf to use automated tools, including web crawlers, bots and scrapers, to access, index, analyze, collect and retrieve information from websites associated with businesses and their products or services.

The proposal was particularly controversial because many publishers, retailers and other commercial organizations operate Facebook and Instagram business accounts. Critics argued that accepting the new terms could effectively grant Meta permission to collect information from their external websites, potentially without separate agreements or compensation.

Meta spokesperson told Nieman Lab that the company was pausing the changes while engaging with stakeholders and taking additional time to address the issues.

The company also updated its Business Help Center to confirm that the proposed changes would not take effect on November 20. Existing commercial terms will remain in force while consultations continue.

Why Meta’s Website-Scraping Proposal Faced Backlash

The controversy began in October, when publishers and legal experts examined the language in Meta’s updated commercial terms.

The original wording appeared to authorize Meta to use content collected from websites associated with business accounts to provide, develop, improve, research and train its products and services. This raised concerns that the company could collect material from news publishers and other businesses for purposes extending beyond advertising.

Publishers feared that content gathered from their websites could potentially be used to develop AI-powered products that compete with the organizations producing that material.

The proposal also raised questions about whether businesses could refuse permission while continuing to use Meta’s commercial platforms.

Meta revised the language but concerns remained

Following the initial criticism, Meta removed the word “train” from the proposed terms on October 16. It also narrowed the stated purposes for collecting website information to advertising and business products.

The company argued that the changes were intended to clarify its existing practices rather than introduce new permissions for scraping news websites.

Meta said the updated language would help it retrieve accurate information about products sold on third-party websites, supporting advertising and content recommendations across its platforms.

However, the revisions did not satisfy many legal experts. They argued that the language allowing Meta to develop and improve advertising and business products remained broad enough to create uncertainty about how collected content could be used.

The debate also involved website owners’ ability to restrict automated access through robots.txt files, which communicate instructions to web crawlers about which parts of a website should be accessed.

Publishers and Regulators Increased Pressure on Meta

Opposition to the proposal extended beyond individual publishers. Industry associations, politicians and competition regulators in several countries raised concerns about its potential impact on digital businesses and the media industry.

In Norway, a court granted a temporary injunction in response to a challenge brought by media organizations representing a substantial share of the country’s newspaper industry. The legal challenge argued that Meta’s proposed conditions were unreasonable and potentially exploitative.

The issue also attracted attention in the United Kingdom. The Competition and Markets Authority launched an investigation into whether requiring publishers and other businesses to accept the proposed terms could amount to unfair trading conditions.

In the United States, Senators Adam Schiff and Marsha Blackburn raised bipartisan concerns and wrote to Meta CEO Mark Zuckerberg, asking the company to withdraw the proposal.

The Association of American Publishers and other industry organizations also criticized the changes, arguing that businesses should not be compelled to grant broad access to their intellectual property simply because they use Meta’s advertising and social media services.

The European Commission also engaged with Meta over the proposal and welcomed the postponement, while emphasizing the need for digital platforms to comply with European competition rules.

What the Pause Means for Businesses and Publishers

The immediate consequence is that businesses using Meta Business accounts will not be required to accept the proposed commercial terms on November 20.

The existing terms remain in effect, giving publishers and other organizations more time before any potential changes to Meta’s website-access policies.

For news organizations, the decision reduces the immediate risk associated with the proposed contractual language. Publishers have been particularly concerned about technology companies collecting journalism and other copyrighted material without negotiating separate licensing agreements.

For retailers and advertisers, the dispute highlights a different issue: how much access a major advertising platform should have to information hosted on external business websites.

Meta’s advertising products depend on information about products, services and commercial offerings. Access to accurate website information can help platforms improve recommendations and advertising performance. However, businesses also want clarity about what information is collected, how long it is retained and which products can benefit from it.

The suspension does not establish new restrictions on Meta’s existing web crawlers. Nor does it resolve the wider debate about how technology companies can collect publicly accessible information from the internet.

The Bigger Picture: Growing Tension Between AI Companies and Content Owners

The dispute reflects a wider conflict between technology platforms and the publishers, creators and businesses whose information helps power digital services.

AI companies increasingly rely on large amounts of online material to develop products, improve search capabilities and deliver automated services. Publishers and other content owners, meanwhile, are seeking greater control over how their work is accessed and used.

The central question is not simply whether information is publicly available online. It is whether companies should be able to use contractual terms, automated collection systems or their market position to obtain broader access to content without negotiating directly with its owners.

Meta’s decision to pause the proposal demonstrates how quickly commercial policy changes can become a regulatory and reputational issue when they affect a large ecosystem of businesses.

It also highlights the importance of clearly defining the relationship between platform access, website ownership, copyright protection and permission for AI-related uses.

Looking Ahead

Meta has not announced a replacement date for the proposed commercial terms. The company says it will continue consulting publishers and other stakeholders before providing another update. Until then, the existing terms will remain applicable, and businesses will be waiting to see whether Meta introduces a narrower proposal with clearer limits on website crawling and content usage.

The outcome could have implications beyond Meta because other technology platforms are facing similar questions about access to online information. A future agreement that clearly separates product-information retrieval, advertising services and AI development could help establish more predictable expectations for businesses and publishers. For now, Meta’s indefinite pause gives critics a temporary victory, but the underlying debate over control of online content remains unresolved.