Reading Divi Content

Hey there @sambbaron

I just tested the in-page analysis and seems to work well, using Divi Builder.
https://monosnap.com/file/Jg4wbkooNrzXgzx1izVXeFQoOGd6wb

Are you using both Yoast and SmartCrawl? This could cause conflicts.

If not, then maybe a conflict test would reveal the source of this.
Deactivate all plugins and MU-plugins apart from SmartCrawl, activate a default theme like TwentySeventeen, clear all caches and check again if the issue is still there. If not, it means that something is conflicting, so start activating the remaining plugins and theme, one by one this time, checking every time for the reported issue, until you reproduce the issue, thus finding the conflicted combination. The following flow chart image can assist you during this test: https://premium.wpmudev.org/wp-content/uploads/2015/09/Support-Process-Support-Process.gif

Prior that, please do create a recent backup in case you lose any settings during the test and have to restore to a previous working state.

If this is a live website with traffic, I’d rather advice to create a staging environment, meaning a complete and exact copy of this installation into another location/folder in the same server, using a separate database, and perform the test in there instead without worrying about live site.

Warm regards,
Dimitris

Hi Dimitris,

Thank you so much for the detailed reply. I discovered the conflict. I am using the Password Protected plugin on my development site. When I have a password enabled, SmartCrawl is unable to crawl my site content. This was not an issue using Yoast.

Do you have any suggestions on how to proceed? Should I always have to disable password protection when using SmartCrawl? Or do you have a password protection plugin that works with SmartCrawl? This could be an interesting feature to add to Defender.

Thanks,
Sam

Hello there @sambbaron

This makes sense, as the actual scan is happening via SmartCrawl API externally, so if there’s no publicly available content on page, then SmartCrawl won’t be able to see it.
I’ve already shared this with our developers, in case they could think of a different workaround for similar cases.

Warm regards,
Dimitris ??

Many that external api testing feature is really cool! So many great features, just wish this was compatible with network set ups to individually be activated on a per site basis…very frustrating to see such a great plugin…and I can’t use it…argg.

Hello @jiggaman

Hope you’re doing well!

Yes, currently the plugin can only be Network Activated. This feature has already been requested and added to a feature development list ??

Have a good day and take care!

Cheers,
Nastia