Viewing 5 posts - 1 through 5 (of 5 total)
  • Author
    Posts
  • April 24, 2014 at 3:21 pm #255554
    mullemull

    Hello

    Googlebot indicates a server error when trying to load a page.

    April 24, 2014 at 3:28 pm #255557
    mullemull
    This reply has been marked as private.
    April 27, 2014 at 11:50 am #256772
    Dude

    Hey!

    Please use a robots.txt file to prevent search engines from indexing the theme directory. I recommend following rules:

    
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed

    Regards,
    Peter

    April 28, 2014 at 2:00 pm #257046
    mullemull

    Thanks, I will test this. Do you recommend this for all WP sites no matter what?

    April 29, 2014 at 9:22 am #257524
    Dude

    Hi!

    Yes, because the wp-includes, wp-content/themes, etc. folder does not contain any useful information for search engines.
    Best regards,
    Peter

  • Author
    Posts
Viewing 5 posts - 1 through 5 (of 5 total)
  • You must be logged in to reply to this topic.