
Tagged: Robot.txt recaptcha
-
AuthorPosts
-
March 3, 2025 at 9:02 pm #1478494
hi guys,
i have a huge amount of strange troubles with robot text ..
1 – i cant get the site indexed by google (i updated the sitemap on yoast it worked in the morning then, few hours later, pages disapeared fom google again)
2 – some pages are with lot of error like :
https://www.gstatic.com/recaptcha/api2/logo_48.png
https://embeds.beehiiv.com/37f59723-ff1a-4fe2-b395-a000706651fb (i erased the css code that was creating a newsletter subscription link into the footer) but the error persists)
ttps://fonts.googleapis.com/css?family=Lato:300,400,700%7COpen+Sans:400,600&display=auto
https://www.google.com/recaptcha/api.js?onload=av_recaptcha_main_api_loaded&render=6Lcw1tAqAAAAAMvo0–5FqGUcRsH4C702NhQylvE&hl=en
http://www.xyz.com/wp-content/themes/enfold/config-templatebuilder/avia-template-builder/assets/fonts/entypo-fontello.woff2+ lot of pictures error
i downloaded hummingbird but doesnt help much
do you guys know where i messed up ?
PS : JUST AFTER USING HUMMINGBIRD, MY SITE CRASHED, I HAD TO DELETE THE PLUGIN
-
This topic was modified 1 month ago by
hankboomer.
-
This topic was modified 1 month ago by
hankboomer.
March 4, 2025 at 4:52 am #1478519Hey Hank,
Thank you for the inquiry.
1.) The robots.txt file and the sitemap are accessible when we checked. The robots meta tag of the homepage is also set to index, follow. Have you tried requesting a recrawl in your Google Search Console?
2.) What are the errors? Your description is a bit unclear. Could you please clarify?
Best regards,
IsmaelMarch 4, 2025 at 9:03 am #1478545Hola Ismael
1/ yep i relaunched google consol inspection after i removed the beehiive newsletter CCS link, i also unchecked few option in enfold them that were unnecessary according to the thread i have read (query, css etc ..) in the performance page. It seems the beehiive error eventually disappeared after new test.
2/ errors are various , seems to concern an avia format (despite avia content is checked in yoast setting)
my contact page is the only one to have soft 404 error and google can’t access it. It has 3 errors
https://www.domain.ch/wp-content/themes/enfold/config-templatebuilder/avia-shortcodes/heading/heading.min.css?ver=6.0.9
https://www.domain.ch/wp-content/themes/enfold/config-templatebuilder/avia-shortcodes/icon_circles/icon_circles.min.css?ver=6.0.9+ the usual captcha icon robot text error i develop at the end of the message
for the rest of the pages , errors are. :
https://www.domain.ch/wp-content/themes/enfold/css/base.min.css?ver=6.0.9
https://www.domain.ch/wp-content/themes/enfold/css/grid.min.css?ver=6.0.9
————-
arecaptacha logo robot.txt :
googlebot is blocked by robot.txt file : https://www.gstatic.com/recaptcha/api2/logo_48.png
when you open robot text file you get this :
User-agent: *
Allow: /_/aihub_pod/
Allow: /_/alkali-learn/
Allow: /_/apps-viewer/
Allow: /_/atari/
Allow: /_/boq/
Allow: /_/boq-play/
Allow: /_/boutique/
Allow: /_/buganizer/
Allow: /_/compare-banking/
Allow: /_/compare-insurance/
Allow: /_/fi/
Allow: /_/fonts/
Allow: /_/mss/boq-bard-web/
Allow: /_/mss/boq-chrome-cloudcast/
Allow: /_/mss/boq-cloud-web3-portal/
Allow: /_/mss/boq-discover-labs/
Allow: /_/mss/boq-geo/
Allow: /_/mss/boq-makersuite/
Allow: /_/mss/boq-nbu-monetization/
Allow: /_/mss/boq-search/
Allow: /_/mss/boq-search-engagement-post/
Allow: /_/mss/boq-travel/
Allow: /_/mss/boq-identity/
Allow: /_/pantheon/
Allow: /_/pantheon-platform/
Allow: /_/play/
Allow: /_/pog/
Allow: /_/cloudsourcetools/
Allow: /_/devopsconsole/
Allow: /_/tfhub/
Allow: /_/transparencyreport/
Allow: /_/gstore/
Allow: /_/ain/_/js/
Allow: /ac/
Allow: /actions/news/rss/
Allow: /ads/learn/
Allow: /ads/local/
Allow: /ads/gpa/vidgen/
Allow: /ads/research/
Allow: /ads/ubaq/
Allow: /aihub/tfhub/
Allow: /alkali/
Allow: /amphtml/stamp/ucp/post-testing/
Allow: /android/market/
Allow: /android/market_images/
Allow: /atari/images/public/
Allow: /audio_news/
Allow: /bfe/apps/website/
Allow: /boutique/sitemaps/
Allow: /compare/
Allow: /chrome/crlset/
Allow: /chrome/webstore/images/
Allow: /cloud-launcher/sitemap/
Allow: /cloudsourcetools/images/
Allow: /commercesearch/images/
Allow: /communities/sitemap/
Allow: /copy-conductor/crawled/
Allow: /covid19/mobility/
Allow: /culturalinstitute/images/
Allow: /culturalinstitute/sitemaps/
Allow: /culturalinstitute/stella/
Allow: /ct/log_list/
Allow: /delight/
Allow: /devopsconsole/images/
Allow: /devrel-devsite/
Allow: /docs/forms/social/
Allow: /docs/socialmarkup/
Allow: /dictionary/static/sitemaps/
Allow: /droidguard/
Allow: /earth/social/
Allow: /enterprise-partner-search/sitemaps/
Allow: /external_hosted/
Allow: /flights/
Allow: /flutter-canvaskit/
Allow: /foodordering/
Allow: /frommers/
Allow: /gb/images/
Allow: /glass/images/commerce/
Allow: /gpay/social/
Allow: /growth-ime/
Allow: /gsx/
Allow: /gtp/stir/
Allow: /guidebooks/
Allow: /GoogleInternetAuthority/
Allow: /h5games_gamecenter/images/
Allow: /healthricherkp/illustrations/
Allow: /healthricherkp/cropped/
Allow: /hex/
Allow: /history/static/
Allow: /identity/accountsettingsactivityweb/
Allow: /identity/accountsettingssyaf/
Allow: /images
Allow: /inproduct_help/chatsupport/
Allow: /lamda/images/
Allow: /local/donut/
Allow: /mapspro/
Allow: /marketing-cms/
Allow: /moderator/static/ux/
Allow: /modern-formats-eng/ucp/framework_logging/
Allow: /modern-formats-eng/ucp/*/client/
Allow: /modern-formats-eng/ucp/*/csr/
Allow: /modern-formats-eng/ucp/*/dev/
Allow: /modern-formats-eng/ucp/static/framework_logging/
Allow: /modern-formats-eng/ucp/static/*/client/
Allow: /modern-formats-eng/ucp/static/*/csr/
Allow: /modern-formats-eng/ucp/static/*/dev/
Allow: /nbubumblebee/
Allow: /og/
Allow: /onebox/media/sports/logos/
Allow: /onebox/media/sports/photos/soccer/wc2018/
Allow: /onebox/sports/logos/
Allow: /onebox/sports/logos/sports_types/png/
Allow: /pagespeed/insights/ui/logo/
Allow: /pantheon/
Allow: /pantheon-platform/
Allow: /patent-search/frontend/
Allow: /pay/images/merchant_logos/
Allow: /pay/images/program_logos/
Allow: /paygo/
Allow: /play/store/web/
Allow: /play/surveys/serp/
Allow: /podcasts/test-podcast/rss/
Allow: /politics/e/sharing/
Allow: /prettyearth/assets/
Allow: /psb/udc/
Allow: /s2/sitemaps/
Allow: /search-ar-dev/
Allow: /search-console/scfe/
Allow: /shopping-content-api/product_images/
Allow: /shopping/shoppingpage/casa/
Allow: /shopstream/
Allow: /sites/
Allow: /sitemaps/
Allow: /social/photosui/images/
Allow: /social/photosui/sitemap/
Allow: /stadia/gamers/
Allow: /store/images/favicons/
Allow: /subscriptions/
Allow: /support/content/
Allow: /system1/images/
Allow: /travel-frontend/images/
Allow: /finance/favicon/
Allow: /travel-vacations/
Allow: /touringbird/
Allow: /trends/
Allow: /trends_tpt/
Allow: /trustedstores/images/
Allow: /trustedstores/js/
Allow: /tv/thumb/
Allow: /ui/
Allow: /vr/*
Allow: /vsi/*.pdf$
Allow: /wondermissive/interest/
Allow: /youtube/fonts/
Allow: /youtube/img/promos/
Allow: /icons/
Allow: /js/
Allow: /ss/
Allow: /*.js
Allow: /*.css
Allow: /*.svg
Allow: /buyside-e2e-monitor/the strange thing is i dont find this in my yoast robot manager
do you think Google captach might be a problem ?
March 5, 2025 at 5:36 am #1478617Hi,
Thank you for the info.
Did you check the robots.txt file we posted in the private field? It’s a lot different from the one you provided above. Where did you check this file? The page or path /buyside-e2e-monitor/ mentioned in the robots.txt doesn’t even exist — many of the rules there are probably invalid or unnecessary.
Please check if there’s an actual robots.txt file in the root directory of your installation. Verify its content, and if it matches the one you posted above, create a backup and then temporarily remove it. Also, check your .htaccess file — create a backup and temporarily remove any rules added by cache or security plugins. Share the contents here so we can review them.
Best regards,
IsmaelMarch 5, 2025 at 5:37 am #1478618Hi,
2 – some pages are with lot of error like :
Could you provide a screenshot of these errors?
Do you see your robots.txt file in your console?
— https://search.google.com/u/3/search-console/settings/robots-txt
Best regards,
IsmaelMarch 5, 2025 at 9:54 am #1478648hey ismael, yes i have the same robot.txt and sitemap you shares in private all good for my robot txt and sitemap
the robot text i am refering is the one attached to message error linked to the captcha error in some pages: https://www.gstatic.com/robots.txt
when you open this link you will find the long list i copy pasted in my previous post.
i share in private links to copy creen + links to error message links from the google console (i copied error from various pages, some are well indexed despite the errors, some are not indexed)
March 6, 2025 at 5:28 am #1478712Hi,
the robot text i am refering is the one attached to message error linked to the captcha error in some pages: https://www.gstatic.com/robots.txt
This is not the site’s robots.txt file. Could you clarify why you provided this info? Have you tried editing the content of the .htaccess file as suggested above?
Best regards,
IsmaelMarch 6, 2025 at 5:21 pm #1478781hola Ismael, i confirm my robot txt is working all good here
my problem is the conflit google consol has with recaptach, am i the only one who has an error with https://www.gstatic.com/recaptcha/api2/logo_48.png ?
best
March 7, 2025 at 5:38 am #1478820Hi,
Would you mind providing a screenshot of the issue with recaptcha/api2/logo_48.png image? You can use platforms like Savvyify, Imgur or Dropbox to upload and share the screenshot. Here are the steps to follow:
1.) Visit the website of your chosen platform, such as Savvyify, Imgur or Dropbox.
2.) Locate the option to upload a file or an image.
3.) Select the screenshot file from your computer or device and upload it to the platform.
4.) After the upload is complete, you will be provided with a shareable link or an embed code.
5.) Copy the link or code and include it in your message or response to provide us with the screenshot.Thank you for taking the time to share the screenshot. It will help us better understand the issue you’re facing and provide appropriate assistance.
Best regards,
IsmaelMarch 9, 2025 at 1:20 pm #1478926Sure Ismael
i am considering erasing the contact page with the google captcha invisible option and put the check just to see how it goes
March 9, 2025 at 1:32 pm #1478927hi ismal, i disabled the recaptacha in the enfold form security option and the bug is gone. Is there a known conflict between recaptcha and the forms ?
March 9, 2025 at 5:55 pm #1478959Hi,
There is not a known conflict with recaptcha and Enfold forms, I assume this is the form you mean.
But note that many web browsers block tracking (ie: FB) and Google including recaptcha by default, Safari, Chrome & Brave (perhaps others) have settings for “Ad-blocker”.
Perhaps this is your issue.
Your screenshot seems to show the error from the Google domain and not your site. I can not reproduce this on my site.Best regards,
Mike -
This topic was modified 1 month ago by
-
AuthorPosts
- You must be logged in to reply to this topic.