Screaming Frog and 404s

  • Resolved qwik3r

    (@qwik3r)


    7 years, 3 months ago

    I am using Screaming Frog to crawl a list of URLs and most of them are coming up 404 despite having added the redirect properly through your plugin. When I actually go to the url it redirects fine (using regex) but with Screaming Frog it comes up 404. I’m on WP Engine and not using a CDN but purged the cache anyway and it still does it. Only when I add the redirect through WPEngine’s cpanel does screaming frog actually pick up on it having been 301 redirected. Can you shed some light on this please? Thanks.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author John Godley

    (@johnny5)

    Do you have an example of a URL that is not working as you expect?

    Thread Starter qwik3r

    (@qwik3r)

    Hi. I realize after further testing that I can’t use the Apache or Niginx capabilities to serve the redirects and using the WordPress method doesn’t register as 301 in some instances. I’ve decided the best method is simply to add the urls through WPEngine’s redirect panel.

    Thanks.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Screaming Frog and 404s’ is closed to new replies.

Tags