Tagged: disallow, robots.txt
I received a crawling error 403 in my google webmastertools regarding the URL “/wp-content/themes/enfold/framework/”.
Can I exclude this via robots.txt? (disallow)
In General what can I exclude (disallow) of Enfold in the robots.txt and what not?
Hi petcar!
Yes, you can add that to your robots.txt file. What does the full error say? Can you send us a link to your site?
Be sure to deactivate all plugins while testing.
Cheers!
Elliott
Hi!
Use robot.txt to exclude these files. You can use something like this:
Disallow: /wp-content/themes/enfold/framework/
Cheers!
Ismael
Disallow: /wp-content/themes/enfold/framework/ will also suggest to Google (at al) that you don’t want the CSS, Images and JS folders to be indexed, which would then prevent them from pre-loading those elements from your page, and thus adding more time to the page download. Surely that’s not a good thing?
Hey!
Not sure if excluding the framwork folder would be a negative or positive thing for ranking and page speed etc, maybe it would be a better idea to ask the question here? https://productforums.google.com/forum/#!forum/webmasters
Best regards,
Rikard