Google Lost Its Scraping Case – Now You Have To Pick A Side On The Open Web

Jul 29, 2026 12:30 AM - 1 hour ago 4

Here is simply a condemnation I did not deliberation I would write: I americium connected the broadside of a search-scraper that resells information to AI companies. Not because SerpApi is the bully guy. There is nary bully feline here. But a national judge successful California ruled against Google successful its conflict pinch them, and the rule underneath the ruling is the correct one, moreover if it showed up wearing the ugliest costume available. If it is connected the unfastened web, a instrumentality is allowed to publication it. And that has to see the instrumentality reference Google. You do not get to walk much than 2 decades building the richest room connected world by crawling everyone else’s pages, and past enactment appalled erstwhile personification intends a crawler astatine yours.

So either we really mean this open web thing, aliases we extremity saying it.

What The Court Actually Said

On July 20, Chief Judge Yvonne Gonzalez Rogers tossed Google’s DMCA claims against SerpApi, a institution whose full business is scraping Google’s hunt results and reselling them done an API, much and much of it to AI companies. Google’s mentation was that SerpApi collapsed the rule by getting astir SearchGuard, its anti-bot system. If you person not heard of SearchGuard, subordinate the club: It is the soul machinery Google uses to spot automated postulation and extremity it from scraping hunt results, the bouncer connected the doorway of Google’s results. Google’s declare was that beating that bouncer counts arsenic forbidden circumvention nether the DMCA, the aforesaid rule that makes it forbidden to ace the transcript protection connected a DVD. The judge was not convinced. Her reasoning: SearchGuard protects Google’s advertisement revenue, not a copyrighted work, and DMCA anti-circumvention is astir copyright. A wall astir your business exemplary is not a fastener connected a copyrighted file. She threw the declare retired pinch prejudice wherever nary copyrighted contented was involved, and gave Google 21 days to travel backmost pinch a constrictive type astir Knowledge Panel images. Good luck pinch that.

Let maine beryllium honorable astir the cast. SerpApi scrapes astatine business standard and resells the results, overmuch of it feeding the nonstop AI companies everyone is tense about, truthful no, not a sympathetic plaintiff. Google is simply a trillion-dollar institution that built itself by crawling the unfastened web and now wants copyright law to extremity others crawling it, which is not a sympathetic position either. This is 2 heavyweights fighting complete who gets to package the web, and the remainder of america are watching from the inexpensive seats. It is the worst-person-you-know-makes-a-great-point meme, successful legal-docket form.

The People Aren’t In This Fight

When the communicative gets told arsenic SerpApi versus Google, thing goes missing: The unfastened web was expected to beryllium by the group and for the people. Look astatine this conflict and effort to find a personification successful it. The users whose searches and pages and questions make the web worthy scraping successful the first spot are not a statement to anything. Two companies brawl complete the spoils, a judge draws a line, and everyone other sounds astir the result later.

But the statement she drew is the honorable one, and I will return an honorable statement moreover retired of an disfigured fight. If it is connected the web, it should beryllium reachable by immoderate wants to publication it. That is simply a beautiful rule erstwhile it is personification else’s wall coming down. It stings erstwhile you retrieve who owns the biggest crawler connected the planet. Google’s full beingness is the unfastened web turned into a product. Running that playbook for much than 2 decades and past declaring your ain results the 1 crawl-proof area of the net is not a ineligible position, it is nerve. Google is adjacent crippled too. That is the woody it signed the time it pointed its first crawler astatine personification else’s website.

And This Is The Whole Agentic Web, Not A Scraping Footnote

“On what position is an automated visitant allowed onto nationalist web content?” is the founding mobility of the agentic web, not immoderate niche scraping spat, and it does not extremity pinch SerpApi. A scraper reselling results, an reply motor reference your pages to mention you, a shopping agent turning up to bargain connected someone’s behalf, an adjunct pulling your specs to comparison you against a competitor. In the eyes of the law, those are 1 thing: an automated visitant connected nationalist content. SerpApi is the disfigured early trial case. Whatever bound the courts tie astir it is the bound for each of them.

And this is not a someday problem. A existent and increasing stock of what hits your website already is not human. The position for really overmuch opportunity you get complete those visitors are being written correct now, 1 suit astatine a time, successful fights you person nary spot in. Which is precisely why the 1 determination that is yours matters arsenic overmuch arsenic it does.

Where You Actually Sit

You are successful this too, and you are 2 things astatine the aforesaid time, and they do not get along.

You are 1 of the people. Your contented gets scraped, resold, and poured into models, and cipher sent you a shape to sign. The conflict is complete your web too, and your spot astatine the array is the aforesaid size arsenic the users’: none.

You are besides a mini Google. You would for illustration a opportunity complete who takes your contented and connected what terms, and possibly you would for illustration to get paid for it. This ruling trims the devices for that, because the precedent has thing to do pinch Google specifically. An anti-bot wall that guards your gross alternatively of a copyrighted activity is what astir websites are running, and the tribunal said that benignant of wall does not bargain you DMCA protection.

This is the aforesaid frontier the Amazon v. Perplexity case is testing from the other end. That 1 runs connected the CFAA and asks whether an AI agent counts arsenic an authorized visitant erstwhile it acts connected your website. This 1 runs connected the DMCA and asks whether your anti-bot wall counts arsenic copyright protection. Different statutes, aforesaid mobility underneath, and the toolkit for keeping machines retired keeps coming up shorter than the group counting connected it hoped.

Stop Waiting For Someone Else To Decide

The takeaway is not a checkbox to spell flip. It is wherever your caput should be.

You do not get to feast connected the unfastened web for discovery, each scrap of postulation you were ever found, cited, aliases classed for, and past clutch your pearls erstwhile that aforesaid openness lets a instrumentality you do not attraction for publication you too. It is 1 web, not two. The consistency runs some ways, whether you for illustration the guidance aliases not.

So make the telephone yourself. Decide what you want unfastened and what you want closed, per crawler, connected purpose, utilizing the AI crawler controls your host, aliases CDN already gives you, knowing the ineligible crushed nether “block them” is still moving and mightiness not hold. Do not outsource that determination to a tribunal refereeing a conflict you are not in, and do not outsource it to a plugin that flipped a default you ne'er read. Own it.

Fight for the unfastened web aliases extremity pretending. Whichever you pick, really prime it. Right now Google and a scraper you person ne'er heard of are making that telephone for you, and taking it backmost is the 1 move successful this full conflict that is yours.

More Resources: