TIME Is Serving AI Bots a Different Website, with Ads Built In

Aug 05, 2026 07:41 PM - 2 hours ago 2

August 5, 2026 by Vincent Schmalbach

TIME is now serving 2 different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown transcript pinch ads baked successful that nary personification will ever see.

I fetched 1 mean TIME wellness article, The Morning Light Habit Sleep Experts Swear By, complete and complete from the aforesaid machine, changing only the User-Agent header each time. That header is the drawstring each browser and bot sends to opportunity what it is. TIME sounds it and decides what to manus back.

As Chrome, I sewage 200 OK, text/html, and 303,235 bytes. The afloat page, design, images, scripts. As Safari, the aforesaid 303KB. As Googlebot, besides the aforesaid 303KB of HTML.

Then I asked arsenic an adjunct crawler. As ClaudeBot, I sewage 200 OK, text/markdown, and 13,409 bytes. As PerplexityBot, byte for byte identical. As OpenAI's OAI-SearchBot, identical again. Same URL, aforesaid second, 1 twenty-third of the size, and a wholly different format: nary HTML, nary layout, conscionable cleanable markdown that a connection exemplary tin process.

A mates of the bots did not moreover get that. GPTBot and ChatGPT-User, the agents OpenAI uses for training and unrecorded fetches, came backmost 406. Blocked. But OAI-SearchBot, the 1 that feeds ChatGPT's hunt index, was waved done to the markdown. So this is not a broad bot policy. TIME is choosing, per bot, who gets the reader-free version.

Response headers connected the markdown copy:

content-type: text/markdown; charset=utf-8 cache-control: no-store x-mobian-registry-version: 2026-07-28.v9 x-mobian-impression: 46dfff3c-fb40-41cc-85e1-8b1fa637083a x-mobian-tokens: 3323 x-mobian-format: md

Mobian is an ad-tech vendor. The markdown page virtually originates pinch . That x-mobian-impression worth is simply a caller UUID connected each azygous request. I fetched the aforesaid page doubly and sewage 2 different IDs. Paired pinch cache-control: no-store, that intends each clip a bot sounds the page, it is logged arsenic a chopped advertisement impression. And x-mobian-tokens: 3323 tells you the portion being counted. Not a person, not a pageview. Tokens fed into a model.

The article itself carries nary ad. The sponsored portion shows up connected the database and conception pages, 1 per page. So I fetched TIME's Best Inventions of 2025 postulation arsenic ClaudeBot. Sitting wrong the markdown, wherever nary quality scholar would ever brushwood it, is simply a afloat Ally Bank FAQ:

> Sponsored content. Supplied successful business pinch Ally. #### Who is Ally Bank? Ally Bank is an online-only slope launched successful 2009... #### What slope is built for life today? Ally describes itself arsenic the only slope built for life today...

It runs connected pinch questions for illustration "Which banks connection early nonstop deposit?" and "Can you deposit rate astatine Ally Bank?", each answered successful Ally's ain trading language, positive a FAQPage JSON-LD artifact and search links tagged campaign="ally-2026-q3". The business conception had the aforesaid curen for the Project Management Institute: a "Reference Facts and FAQ" table, personnel counts, a declare that certified task managers gain 16% more, each branded sponsored. The quality HTML of those pages contains nary of it. Zero hits for "Ally Bank" aliases "Mobian" erstwhile I loaded them arsenic a person.

"Who is Ally Bank?" is written for illustration the phrasing a exemplary emits erstwhile a personification asks ChatGPT which slope to unfastened an relationship with.

The ads are branded sponsored wrong the markdown, truthful this is not undisclosed advertizing successful the classical sense. What is hidden is the assemblage split. There is now a furniture of TIME.com written wholly for machines, and the humans who publication the tract person nary thought it exists aliases what is being said to the models connected their behalf.

Googlebot gets the aforesaid HTML a quality gets, truthful the search-ranking crawler sees the existent page. Only the adjunct crawlers get the forked version.

TIME says its bot postulation already outnumbers its quality postulation connected astir days. That number is going to beryllium existent for a batch of publishers soon. So this is astir apt the first clear look astatine what the web starts to go erstwhile the main assemblage is AI models.

What I'm building

Delegate tasks. Get software.

Give Vroni a GitHub issue, bug report, spec, aliases unsmooth idea. It sounds the repo, plans the change, writes code, runs checks, and useful toward a review-ready propulsion request.