Why WordPress Did not Pick robots.txt ?

  • HI, WordPress Expert,

    I have setup robots.txt file for https://copybloggerthemes.com but, all my wordpress sites don’t pick the robots. Since i have blocked all the pagination in robots.txt, but when i goes to search in serp the same link, it appears. What should i do to make the robots.txt fetchable ? is there any recommended plugin to do the same work?

    The page I need help with: [log in to see the link]

Viewing 1 replies (of 1 total)

  • Robots.txt is more of a server-level mech…

    WordPress runs after Robots.txt has affected the fetch.

    Your SEO plugins can also place certain robots directives in your page headers but I leave all those machinations to the SEO experts who designed the one SEO plugin I use.

    It’s an area I avoid as I see the time spent on SEO minutia is better spent seeking or creating new content.

    Today’s bright and shiny SEO trick is usually an SEO penalty in the making.

    Content is King!!!

Viewing 1 replies (of 1 total)
  • The topic ‘Why WordPress Did not Pick robots.txt ?’ is closed to new replies.