-
Posts
-
Hi Enfoldians,
I’d like to have a general discourse about robots.txt and, if you are up for it, a dive into SEO. First things first. Like many of you I am seeing Enfold folders show up on a Google search. The returns are usually .js. Okay. No real harm. I just don’t like it. Now to the point. Should we be excluding wp-content in robots? Or Enfold? Yes, I’ve read the threads on this forum. I’m not lazy. But they left it sort of open ended. Some really serious WP geeks say exclude, and some serious geeks say don’t (citing a Google article by the luminary Matt Cutts that says Google wants your site “innards”).
Care to dig in?
TIA, Frank
P.S. If you would like to dive in to All In One SEO and the NOINDEX, NOFOLLOW setting for Avia Framework, I’m interested in that too.
P.P.S To be on the safe side I unchecked the NOINDEX / NOFOLLOW in AIOSEO. Figure I can live with a few indexed .js pages rather than hurt my SEO. But I did add a disallow for wp-content in robots. Opinions?
Hey!
Thank you for using Enfold.
I think you will get more help if you consult SEO gurus like Yoast developer “Joost de Valk”. You can open a thread in the Yoast forum. He actually created a very short article about robot.txt and from there I will quote:
WordPress Robots.txt suggestions by YoastThe robots.txt file is a very powerful file if you’re working on a site’s SEO, but one that also has to be used with care. It allows you to deny search engines access to certain files and folders, but that’s very often not what you want to do. Over the years, especially Google changed a lot in how it crawls the web, so old best practices are no longer valid.
This is the link to the article: https://yoast.com/wordpress-robots-txt-example/
Cheers!
Ismael
- You must be logged in to reply to this topic.