Gary Illyes from Google said that Google's crawlers do not only nonstop HTTP requests specified arsenic GET and POST but besides for HEAD, OPTIONS, PUT, PATCH, and DELETE. He said the second dress up for little than 1.5% of the full number of requests each Google's crawlers send. Google sends them for JavaScript, he said.
He wrote this connected LinkedIn aft saying, "For immoderate logic I sewage a fewer questions the past fewer weeks astir whether Google's crawlers nonstop HTTP requests different than GET and POST."
Gary said, "The short reply is yes, they do, but HEAD, OPTIONS, PUT, PATCH, and DELETE relationship for little than 1.5% of the full number of requests each Google's crawlers send."
He past explained why Google sends these types of HTTP requests. It is for JavaScript. "Basically it seems that immoderate JavaScript delirium is initiating these requests and rendering does its rendering things," he wrote.
Forum chat astatine LinkedIn.
