robots.txt has blocked the URL sent

  • For weeks I have been trying to improve the positioning of my website, that is why I installed the “yoast seo” plugin and started editing entry by entry and category by category (page by page) so that google search gets the indexes. After doing a sitemaps and all google still blocking me 45 pages of my website, which are mostly already edited and in the yoast configuration I put them to be visible to the search engines (set it to “search apparance “by seo) and control it individually in the links that google tells me” robots.txt has blocked the URL sent “. What can I do to solve this?

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)
  • Moderator t-p

    (@t-p)

    I recommend asking at https://www.ads-software.com/support/plugin/wordpress-seo/ so the plugin’s developers and support community can help you with this.

    Maybe you could delete robots.txt! I think most of the search engine spiders see a missing robots.txt as permission to crawl. Internal links (menu items), a good sitemap, and working, well-fed RSS feeds help the discovery process.

    Of course, nothing over at the Search engines seems to happen ‘in a hurry’ so you should expect a message in the near future saying, ‘Hey, your robots.txt file has changed’… you can expect that message within the next decade or two.

    Seriously though. a little patience might relieve a good bit of stress over the SEO non-issue anyway.

    My take on SEO?

    Content is King!

    • This reply was modified 5 years, 4 months ago by JNashHawkins.
Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘robots.txt has blocked the URL sent’ is closed to new replies.