New Google Site Verifier User Agent

Google has added a new Google crawler, a new user agent, to the Google spider list. Its name is Google Site Verifier User Agent. This user agent ignores robots.txt rules, by the way, and I assume it is used for verifying sites with Search Console and other Google tools and services.

Google posted the new user agent over here in the Google Crawlers help documentation.

The user agent token is: Google-Site-Verification

The full user agent string is: Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

And Google noted with a “caution” that the “Google Site Verifier ignores robots.txt rules.”

So keep an eye out for it in a very limited basis.

Forum discussion at Twitter.

Update: My assumption that this was for Search Console verification was correct but John Mueller of Google said the user agent is not new, the new part is that it was added to the docs:


Post Your Comment

Your email address will not be published.

Copyright © 2020 Maxxhost.net. All rights reserved.
<!--Start of Tawk.to Script--> <script type="text/javascript"> var Tawk_API=Tawk_API||{}, Tawk_LoadStart=new Date(); (function(){ var s1=document.createElement("script"),s0=document.getElementsByTagName("script")[0]; s1.async=true; s1.src='https://embed.tawk.to/5e4c036e298c395d1ce88e95/default'; s1.charset='UTF-8'; s1.setAttribute('crossorigin','*'); s0.parentNode.insertBefore(s1,s0); })(); </script> <!--End of Tawk.to Script-->
Register your Domain