Thanks for the rapid reply!
Well, I do have securi (it is actually GoDaddy’s firewall.) Can you tell me where I would need to look to confirm? Also, I am trying out WPMU’s own security as well. Any known issues there?
Further, I will likely (because it speeds up the site) be adding CloudFlare as well… please let me know if there is any known issues there as well.
I imagine if any of these are blocking the crawl it would be the same issue for either but perhaps not!
Matt