Indexing of website showing strange ulrs

Hey Anne,

Thank you for the inquiry.

You may need to create a robots.txt file to establish specific rules for search engines and determine whether certain files are allowed to be indexed or not.

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Noindex: /wp-content/
Noindex: /wp-includes/

Please check the links below for more info and examples:

// https://kriesi.at/support/topic/google-reporting-s-pages-in-gsc/#post-1170963
// https://kriesi.at/support/topic/broken-css-link-warning-in-ahrefs-crawl/#post-1418689

More info about robots.txt:

// https://moz.com/learn/seo/robotstxt

Best regards,
Ismael

Hi,

Thank you for the update.

This issue is not directly linked to the theme. It simply indicates that the server files are exposed to search engines. As mentioned earlier, it requires additional configuration in the robots.txt file.

Did you leave the Settings > Reading > Search engine visibility > Discourage search engines from indexing this site option disabled while editing the site? If this remains disabled, search engines can crawl the wp-content files and include them in the index. It’s recommended to enable this option while building the site.

For additional assistance with SEO-related tasks, you can contact our partner, Codeable.

// https://kriesi.at/contact/customization

In the meantime, please review this documentation for more info about robot.txt file:

// https://wordpress.org/documentation/article/search-engine-optimization/#robots-txt-optimization

Best regards,
Ismael

Hi,

You’re welcome! Please feel free to open another thread if you have more questions about the theme.

Have a nice day.

Best regards,
Ismael