Google whitethorn person a bug aliases rumor pinch utilizing the petition indexing aliases recrawling your robots.txt files wrong Google Search Console. Supposedly, the characteristic is not moving decently for each sites, but it is moving for immoderate sites arsenic well.
This was spotted by Jay Cooper who posted astir it connected Bluesky and wrote, "Is location a known rumor pinch the "request a recrawl" usability successful the robots.txt study astatine the moment? It throws an correction each clip for me, crossed respective properties. Wondering whether it's connected my extremity aliases a impermanent glitch."
Here is the screenshot:
You tin see, this is resulting successful an correction that says Re-crawl petition grounded and past says "Unknown error. Please hold a infinitesimal and effort again."
John Mueller from Google replied first saying it worked for his tract but past later posted connected Bluesky, ".. ah, I spot the correction connected immoderate of my different sites though. I'll flick around."
So if you are trying to usage this instrumentality connected your robots.txt and are having issues, you whitethorn not beryllium alone.
Here are those posts connected Bluesky:
Forum chat astatine Bluesky.
