Majestic SEO – Returning 406 Error

  • Hi Guys,

    I’m using Majestic SEO as a tool but when I try and get it to crawl my site it’s returning a 406 error. I’m hosting my site with Bluehost and have spoken to their support team today who ensure me there are no bot or ip blocks in place on my server that would be causing this. I’ve also added the below to my .htaccess file:

    <IfModule mod_security.c>
    SecFilterEngine Off
    SecFilterScanPOST Off
    </IfModule>

    and my robots.txt looks like this:
    User-agent: *
    Disallow: /thank-you/
    Disallow: /category/uncategorized/
    Disallow: /?post_type=ml-slider&p=151
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Still the crawling error remains. I have installed wp fastest cache on my site, but not sure if this could be causing any issues? Does anyone have any other ideas about what might be causing this issue?

    Thanks,
    Nicky

Viewing 5 replies - 1 through 5 (of 5 total)

  • If you can post your URL I could try to check your headers, since 406 error related to “accept headers”. This can be caused by either something in the code or something on the server side. Hard to tell.

    Thread Starter nickymoo1

    (@nickymoo1)

    Hey Viktor,

    Thanks for getting back to me. My URL is

    https://tailoreddigitalsolutions.co.uk/

    Thanks,
    Nicky

    Not seeing any issues with your site on my end, but here’s what Majestic SEO says about this issue:

    So the short answer is that you need to ask your hosting company to allow MJ12Bot onto your site. Most web host will respond to a request like this.
    If they don’t or won’t you might seriously ask what else they are blocking and consider changing hosting companies.

    You can see full answer from Majestic SEO here.

    Thread Starter nickymoo1

    (@nickymoo1)

    Yes, I’ve seen this answer Viktor and raised it with my hosting company however they say there is nothing on my server that is preventing majestic from crawling. I’ll have to get back onto them.

    Thanks,
    Nicky

    Try scanning bluehost’s website, see if Majestic throws the same error.

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Majestic SEO – Returning 406 Error’ is closed to new replies.