Conflict with Googlebot and robots.txt?

twentiethcenturygamer · Member · May 2, 2019 at 9:49 pm
Copy link

Add topic to favorites
Hey there! My Google search console dashboard is showing “blocked by robots.txt” errors left and right for my site. I’m not much of a technical/coding person, so am unsure how to go about fixing that. Any help would be much appreciated.

Thanks!

The blog I need help with is: (visible only to logged in users)
staff-zinnia · Staff · May 3, 2019 at 12:37 pm
Copy link
Hi –

No worries, I’ll be glad to take a look. Is this happening for twentiethcenturygamer.wordpress.com or a different site?

Also, does it happen across multiple browsers or just in one?
twentiethcenturygamer · Member · May 3, 2019 at 4:58 pm
Copy link
That’s correct. The site is twentiethcenturygamer.wordpress.com.

The error looks like this:

https://imgur.com/a/6FLeKUl
twentiethcenturygamer · Member · May 3, 2019 at 5:27 pm
Copy link
Also, I’m looking at this in Chrome, but the Google dashboard says the same thing if I load it up in explorer.
supernovia · Staff · May 3, 2019 at 6:34 pm
Copy link
Ah! I see the issue. Google is telling you we’ve asked it not to dig through wp-admin. Which is totally fine — a search engine can’t access much of what’s there without being logged in, and folks who are looking for your site wouldn’t find much use for it anyway.

So Google is warning you. But if you had a directory you *did* want it to index in search results, and it was not indexing that, you’d want to address it. For wp-admin though and the other files and directories listed there, you can ignore this warning.

Let us know if you need more help!
twentiethcenturygamer · Member · May 3, 2019 at 6:37 pm
Copy link
Thanks so much!

No items found.