robot.txt blocking URL

  • Resolved bruza005

    (@bruza005)


    7 years, 8 months ago

    Hi,

    i am needing a little help with blocking google from indexing a specific URL. I have tried to block the URL buy using the robot.tx file in the plugin. The URL that i do not want google bot to crawl and index is:

    https://cubixglobal.com.au/service-areas_0006_oil-and-gas/

    I have the following code:

    Agent googlebot
    Disallow: /service-areas_0006_oil-and-gas/

    can someone please help me and advise if i have this correct??.

Viewing 1 replies (of 1 total)
Viewing 1 replies (of 1 total)
  • The topic ‘robot.txt blocking URL’ is closed to new replies.