Robots.txt blocking twitter cards

  • Resolved leezanello

    (@leezanello)


    3 years ago

    I have spent the last three hours on chat with Bluehost trying to determine what is wrong and they cannot help me with this. My robots.txt file managed with All In One SEO (which I was unfamiliar with until today) seems to be showing that it will allow the twitter bot.

    User-agent: *

Allow: /wp-admin/admin-ajax.php

Disallow: /wp-admin/

User-agent: Twitterbot

Allow: /

Sitemap: https://leezanello.com/sitemap.xml

Sitemap: https://leezanello.com/sitemap.rss

    When I go to the twitter card validator I am still seeing this message:
    ERROR: Fetching the page failed because it’s denied by robots.txt.

    My most recent blog post is the link above but none of my twitter cards for old posts are validating either.

    Any help would be greatly appreciated – thank you!

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author arnaudbroes

    (@arnaudbroes)

    Hey @leezanello,

    I’m not getting that error – https://prnt.sc/KHF7cv9Gop_f. Did you change any other settings? In any case, your robots.txt looks fine and it should be working now.

    Thread Starter leezanello

    (@leezanello)

    Thank you for this! The only conclusion I can draw is that we did fix it with the host and it just took some time for the Twitterbot to rescrape or catch up to our fix. All is good now – thanks!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Robots.txt blocking twitter cards’ is closed to new replies.