Yahoo Scout Will Pay Publishers Through the Internet Licensing Collective. We Checked Who Has Signed Up in robots.txt
The Internet Licensing Collective launched on Nov. 12 with Yahoo Scout as its first paying AI customer. Joining is free and uses a License line in robots.txt. We checked 59 well-known sites: 2 carry one.
The Internet Licensing Collective (ILC), formerly the RSL Collective, launched on Nov. 12, 2026 with Yahoo Scout as its first commercial licensee, paying publishers when their content is used in Scout answers.
The ILC says publishers join free, choose which licenses to join, keep the right to strike direct deals, and that at least 90% of revenue goes to rights holders because its costs are projected at or below 10%.
Joining means publishing an RSL license file and adding a License line to robots.txt for each website and subdomain, then enrolling the site.
In our Nov. 14, 2026 check of 59 well-known sites, only Medium and The Guardian had a License line in robots.txt; Yahoo, Reddit, the New York Times and the BBC had none.
No rates, minimum payments or countries were announced, and Yahoo Scout itself is a US beta, so expect little money soon for most sites.
Yahoo Scout, Yahoo's AI answer engine, will pay publishers when their content is used in its answers. The money flows through the Internet Licensing Collective (ILC), a publisher-led licensing group that launched on Nov. 12, 2026 with Yahoo as its first commercial customer. Any site can join free, and the sign-up starts with one line in robots.txt.
We read the announcement and the publisher guide, then checked the robots.txt files of 59 well-known sites to see who has signed on so far.
What is the Internet Licensing Collective?
The ILC is the group formerly called the RSL Collective. It co-wrote Really Simple Licensing (RSL), an open standard from 2025 that lets a site state, in a machine-readable file, the terms on which AI companies may use its content. The ILC now collects payment from AI companies under those terms and passes it on to the sites whose content was used.
According to the ILC's launch announcement:
More than 3,000 media brands, content owners and publishing platforms have joined.
Publishers join free and choose which licenses to take part in. They can still make direct deals with AI companies.
Payment depends on the value your content contributes, not on how much of it you have. The ILC's allocation rules weigh how content is used, the economic value of the AI product and how often a publisher's content is relied on.
The ILC projects its own operating costs at or below 10%, with the rest going to rights holders.
Doug Leeds, the ILC's co-founder, called it "real infrastructure for a thriving AI economy." Eric Feng, who runs Yahoo's research group, said "AI answers are only as good as the sources behind them."
How do I join the Internet Licensing Collective?
You publish a license file, point to it from robots.txt and enroll the site. The ILC's publisher guide lays out four steps:
Define the content you want to license, including anything you want to leave out.
Update robots.txt with one or more License lines. Each subdomain needs its own robots.txt.
Enroll your websites and subdomains through the ILC portal or a platform partner. You give the root URL, confirm you have the right to license the content, and list any AI systems you want excluded.
Work through the readiness checklist.
The License line is defined in the RSL 1.0 specification. It holds the full address of your RSL file, an XML document, and can sit outside any User-agent group to apply to every crawler:
License: https://example.com/license.xml
RSL also allows the same pointer in an HTTP header, Link: <https://example.com/license.xml>; rel="license"; type="application/rsl+xml", for sites that can't edit robots.txt.
A License line grants terms; it doesn't block anything. If you also want to keep some crawlers out, those Disallow rules still do that job.
Who has a License line? We checked 59 sites
On Nov. 14, 2026 we fetched /robots.txt from 59 well-known sites: big news publishers in the US, UK, Europe, India, Australia and Canada, large content sites such as Reddit, Wikipedia, Medium and Quora, the big recipe, health and tech publishers, and the main SEO news sites and tools. A short Node.js script read each file and listed every line starting with License:.
Result
Sites
License line found
2: Medium, The Guardian
robots.txt read, no License line
55
Our request blocked
2: Stack Overflow, Search Engine Land
The 55 without one include Yahoo itself, Reddit, Wikipedia, Quora, the New York Times, the Washington Post, the Wall Street Journal, Reuters, the AP, Bloomberg, the Financial Times, the BBC, the Times of India, the Hindustan Times, ABC Australia, the CBC, Der Spiegel, Le Monde and every SEO site and tool we tried.
Both License lines point to a /license.xml file. We couldn't read either file: both sites answered our request with a bot challenge page instead of the XML. So we can see that Medium and The Guardian declare RSL terms, not what those terms are or whether they name the ILC.
What this tells you: the ILC counts more than 3,000 members, but almost none of the largest sites we checked declare a license in robots.txt today. Members may be smaller sites, or may not have finished the robots.txt step yet; the ILC hasn't published a member list, so we can't say which.
Will it pay a small site anything?
Probably not much, at first. The ILC announced no rates, no minimum payout and no countries, and its rules pay by how much an AI product relies on your content. The only paying customer today is Yahoo Scout, which Yahoo launched on Jan. 27, 2026 as a beta for users in the US only, at scout.yahoo.com and in the Yahoo Search app. Yahoo hasn't said when it will reach other countries.
So a site in the UK, India or Australia can join, but the one AI product paying through the ILC isn't yet answering questions for people in those markets.
Our view: who should sign up now
Sites that publish original reporting, research or reference content that AI answers lean on: it costs nothing, the license is not exclusive, and you can still negotiate directly. The work is one XML file and one robots.txt line per domain.
Businesses whose site exists to win customers (local services, agencies, software): the money is not the point for you, being cited is. Nothing in the ILC's material says a license changes whether Scout cites you, so this is optional.
Anyone on WordPress or another platform: check whether your host or platform enrolls sites for you; the ILC says platform partners can do it.
Before you add the line, decide which AI crawlers you allow at all. The ILC says RSL works alongside blocking, so a License line doesn't replace your Disallow rules; check both say what you mean. Our llms.txt check and ChatGPT guide cover the crawler side.
What we don't know yet
What Yahoo pays, how often the ILC pays out, and the smallest payment it will send.
Whether Yahoo Scout reads License lines when it fetches pages, or only pays for sites enrolled through the portal.
Which other AI companies are talking to the ILC. The announcement names none.
Kiran runs Kihan Marketing, a web design, SEO and ads agency, and manages dozens of websites across real estate, home services and healthcare. He writes about SEO, AI search and paid ads news, and what it means for the people who run websites.