Prevent item type from being crawled?

  • Resolved jmhulb

    (@jmhulb)


    3 years, 10 months ago

    Is there a way to prevent certain item types from being crawled? For example, are media files included in the site index by default? If so, can we disable that? Thanks

Viewing 1 replies (of 1 total)
  • Plugin Author mokimoki

    (@mokimoki)

    Hi,

    currently the only way to prevent an item appearing in search results is to go to Open WordPress SEO -> Advanced (tab) -> Exclude items, and give the ids of the items that will be set to robots noindex, which tells the spiders to ignore the page.

    Image files are included in the “image-sitemap.xml” the plugin creates. So the search engines are aware of the pics, but other media is not included either in sitemap.xml not in image-sitemap.xml.

    This is something that we could look into on upcoming releases.

    Hope this helped you!

    BR,
    Moki-Moki

Viewing 1 replies (of 1 total)
  • The topic ‘Prevent item type from being crawled?’ is closed to new replies.