-
AuthorPosts
-
April 13, 2018 at 2:20 pm #941509
We used Yoast to put the following into the “robots.txt” file:
User-Agent: *
Disallow: /wp-admin/
Disallow: /blog-orig/blog-multi-author/
Disallow: /blog-orig/blog-single-author-big/
Disallow: /blog-orig/blog-single-author-full/
Disallow: /blog-orig/blog-single-small/
Disallow: /blog-orig/masonry-blog/
Disallow: /pages/
Disallow: /pages/faq/
Disallow: /pages/help/
Disallow: /pages/landing-page/
Disallow: /pages/team/
Disallow: /pages/pricing/
Disallow: /pages/services/
Disallow: /projects/masonry-portfolio/
Disallow: /projects/mixed-fullwidth-portfolio/
Disallow: /projects/portfolio-2-column/
Disallow: /projects/portfolio-3-column/
Disallow: /projects/portfolio-ajax/
Disallow: /services/coming-soon/
Disallow: /services/maintenance-mode/
Disallow: /services-2/
Disallow: /shortcodes/
Disallow: /shortcodes/animated-image/
Disallow: /shortcodes/blog-element/
Disallow: /shortcodes/buttons/
Disallow: /shortcodes/columns/
Disallow: /shortcodes/contact-forms/
Disallow: /shortcodes/easy-slider/
Disallow: /shortcodes/gallery/
Disallow: /shortcodes/hr/
Disallow: /shortcodes/iconbox
Disallow: /shortcodes/iconlis/
Disallow: /shortcodes/images-with-hotspots/
Disallow: /shortcodes/layer-slider/
Disallow: /shortcodes/notificatio/
Disallow: /shortcodes/portfolio-shortcode/
Disallow: /shortcodes/post-slider/
Disallow: /shortcodes/pricing-and-data-tables/
Disallow: /shortcodes/progressbars/
Disallow: /shortcodes/promo-box/
Disallow: /shortcodes/tabs/
Disallow: /shortcodes/team/
Disallow: /shortcodes/testimonials/
Disallow: /shortcodes/video/
Disallow: /transparent-header/
Disallow: /wp-content/plugins/
Allow: /wp-content/uploads/Sitemap: https://continentalconstructionmanagement.com/sitemap_index.xml
Sitemap: https://continentalconstructionmanagement.com/post-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/page-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/portfolio-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/category-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/post_tag-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/portfolio_entries-sitemap.xml
Sitemap: https://continentalconstructionmanagement.com/author-sitemap.xml============
BUT, when I try to check that it is there ( https://continentalconstructionmanagement.com/robots.txt ) it shows this:
User-Agent: *
Disallow:I looked at the file with FTP, it is there and has everything we want in it, and it’s in the ‘root’ directory:
https://visualimpactsystems.com/CCM-RootScreenshot-RobotsFile.jpgWe also ‘submitted’ it in the Google Seach Console.
Any ideas why it is not showing up/working? (Google has already indexed some of the pages we disallowed in the robots file).
( site:continentalconstructionmanagement.com )Mark Besh
Visual Impact SystemsApril 13, 2018 at 8:59 pm #941667WE FIGURED THIS OUT!
FYI: If you are hosted on GoDaddy, be sure you “FLUSH CACHE” (in the WordPress Dashboard “title bar” across the top) after you upload a new robots.txt via FTP or after you make any changes with Yoast’s robots.txt editor!
ISSUE CLOSED.
Mark Besh
Visual Impact SystemsApril 14, 2018 at 5:34 am #941804 -
AuthorPosts
- The topic ‘Enfold Robots.txt’ is closed to new replies.