I found this page on a google search –>
Hi!
In your robots.txt file (create it if you don’t have one) place:
Disallow: /category/allgemein/
Regards,
Josue
Ok, hi Josue, so i creat a robots.txt file with my editor. then i put this code inside:
Disallow: /category/allgemein/
And i place this text file in the root of my webserver? any other stuff i should add in this file. do i have any cons by adding such a file? for seo optimization i mean?
Hey!
Correct, at root, it should look exactly like this:
User-agent: *
Disallow: /category/allgemein/
More info on robots.txt:
http://www.robotstxt.org/robotstxt.html
Cheers!
Josue
:) Great. Thank you Josue. CLOSED.
You are welcome, glad to help :)
Also, refer to this article on how to ask Google to remove an URL:
https://support.google.com/webmasters/answer/1663419?hl=en
Regards,
Josue