Tagged: , ,

Viewing 8 posts - 1 through 8 (of 8 total)
  • Author
    Posts
  • September 12, 2015 at 6:03 pm #502143
    ploughon

    Have notice google has indexed a lot of irrelevant “avia framework” elements and links to framework directories listing files.

    I understand from reading around that I should not block resources from Google using robots.txt but I certainly don’t want these theme/framework pages appearing in search results.

    How can I prevent it – using enfold plus yoast WPSEO.

    Thanks

    September 13, 2015 at 3:02 pm #502315
    Elliott

    Hi ploughon!

    Can you send us a link to google search results where they are displaying?

    Best regards,
    Elliott

    September 13, 2015 at 4:32 pm #502348
    ploughon

    Below:

    September 14, 2015 at 3:58 pm #502863
    Elliott

    Hey!

    Try adding this to your .htaccess file in the sub directory.

    Options -Indexes

    Best regards,
    Elliott

    • This reply was modified 9 years, 2 months ago by Elliott.
    September 14, 2015 at 11:21 pm #503064
    ploughon

    Hi – as I have a pretty complex .htaccess file (I use Wordfence and have a few seo redirects) could you please clarify what this will do?

    I’m guessing this prevents the folders without an index file from displaying their contents – in that case how about php files that are getting indexed (/wp-admin/admin-ajax.php for example)?

    Many thanks.

    September 15, 2015 at 3:48 pm #503424
    Elliott

    Hey!

    I have never actually used it before but I think it will prevent search engines from indexing. I would try using it in a sub directory first.

    Here is another snippet that might work.

    Header set X-Robots-Tag "noindex, noarchive, nosnippet"

    I think it’s important to use them in the sub directories that you do not want indexed. It should not be placed in the .htaccess file of your root WordPress folder.

    Here is a good read for understanding it more, https://yoast.com/x-robots-tag-play/.

    Best regards,
    Elliott

    • This reply was modified 9 years, 2 months ago by Elliott.
    September 17, 2015 at 1:16 pm #504734
    ploughon

    I’ve reached out to Yoast for a view on seo approach as current advice is to let the bots in but surely it cannot be beneficial to be indexing a ton of framework files and presenting them in search results. I note that googling one of the Enfold files that have been indexed on my site yields 65k results suggesting that, whether they know it or not, this effects a lot of people using this theme.

    Still unsure of how to deal with it though and frankly a bit uncomfortable implementing “I have never actually used it before but I think” solutions for this as could have serious impact on serps.

    September 17, 2015 at 4:30 pm #504961
    Elliott

    Hi!

    Great, let us know what they say.

    Best regards,
    Elliott

  • Author
    Posts
Viewing 8 posts - 1 through 8 (of 8 total)
  • You must be logged in to reply to this topic.