google adsense not being served

This is bizarre.

now and then my rank math sitemap shows a page of my website rather than the sitemap — then it disappears and shows the sitemap again

it is triggering a “crawler: unknown error” in google adsense and is diminishing my earnings markedly — it has blocked ad serving on my front page bulldogottawa.com

how do i fix this

cheers and thank you

Ken Gray

Hello @kengray20,
?
Thank you for contacting Rank Math support.
?
Please note that the status?Discovered – currently not indexed?indicates Google has discovered the page, and even wants to crawl the page. But this was expected to cause an overload on the site, hence Google has rescheduled the crawl.
?
Also, the URL you have shared is already included in your post sitemap.
?
As a result, Google may delay this crawl for several days after it has been discovered, and the crawl status would remain empty until then.
?
Here’s a link for more information:
https://rankmath.com/kb/discovered-currently-not-indexed/
?
Lastly, we recommend using the default rules in your robots.txt so crawlers can access your site:
https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules
?
Looking forward to helping you.

Hello @kengray20,

We wanted to add that we’ve checked your sitemap and it is currently generated by other plugin:?https://bulldogottawa.com/sitemap.xml?and the affected page was already listed in the post sitemap:?https://i.rankmath.com/i/VgD9ZK

If this isn’t happening with Rank Math’s sitemap, Please follow the steps below:

1. Flush the Sitemap cache by following this video screencast:
   https://i.rankmath.com/pipRDp
2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
   https://rankmath.com/kb/exclude-sitemaps-from-caching/
3. Apply the following filter code to your site.
   add_filter( 'rank_math/sitemap/enable_caching', '__return_false');
4. Remove all your sitemaps from your GSC and resubmit only the primary one (https://bulldogottawa.com/sitemap_index.xml).

Hope that helps. Thank you.

I discovered when I called up my sitemaps that a page of the website showed, not the sitemap.

Google recorded that as a crawling error and now I have seven pages on my website that have restricted ad supply including the front page. That restriction is costing me 18 per cent of my revenue.

The reason that you see another plugin site map is that I had to drop the rank math plugin because it was causing the error. I’m using another plugin.

Now can you tell me how I get those pages off “crawler, unknown error” in adsense. Do I wait for another crawl which could take a week and hope that it can crawl the new plugin’s sitemap. My front page is one with a crawler error now due to the Rank Math sitemap. So is page 3.

I would like to use page rank. Much of my website which I’ve been using for 14 years is built around your feature in PR. My website is a shambles and I’ve spent a week trying to correct all this and I”m not through.

So what happened and can I trust Page Rank plugin again?

How do I correct this problem? Your plugin has created a great deal of damage. I’m rather hoping you will be able to fix it.

Ken Gray, editor of The Bulldog, bulldogottawa.com

Hello @kengray20,
?
Please note that Crawler Unknow Error is not related to the sitemap. It happens when AdSense crawler can’t crawl your site’s pages. You can check this guide to learn about possible reasons and their fixes: ?https://support.google.com/adsense/answer/2381908?sjid=8089605704215490007-AP
?
Also, our plugin’s sitemap can be accessed at?yourdomain.com/sitemap_index.xml. If it returns an error, you can follow the steps we shared in our previous reply to exclude it from cache and fix the issue.
?
Please do not hesitate to let us know if you need our assistance with anything else.