Some pages are missing

  • Resolved Slavek

    (@jackoneill)


    4 years, 5 months ago

    Hi, I noticed that some pages are missing so I want to export them separately. How can I do it? Into the excluded URLs I entered / (just the slash) and into the included URLs I entered /page1 and /page2 (each on separate line). But with this settings, I’m getting “Failed during “Processing the crawled files”, please consult the Help tab for where to get assistance.”, so I guess I’m doing it wrong. Could you please help?

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Author Leon Stafford

    (@leonstafford)

    Hi @jackoneill,

    There’s a big release upcoming, which should fix your missing content:

    https://github.com/WP2Static/static-html-output-plugin/releases/tag/6.6.21

    DL link: https://github.com/WP2Static/static-html-output-plugin/files/4822705/static-html-output-plugin-6.6.21.zip

    Please deactivate current plugin and install this one and let me know if problem persists.

    Note: Plugin name changes to “Static HTML Output”, which is what it will be at release time (WP2Static name going to a different spin-off of plugin).

    Cheers,

    Leon

    Thread Starter Slavek

    (@jackoneill)

    Hi Leon, thanks for your reply. Unfortunately, this doesn’t work at all. I tried it three times.

    1st attempt: It took only about two minutes, no zip file was generated, neither the content in the /static-html-output folder.
    2nd attempt: It took 170 minutes (it took 45 minutes with the old plugin). There are two folders in /wp-content/uploads: /wp-static-html-output-1593028405 and /static-html-output, both are empty. When I click the Download ZIP button, the URL is 404 (/wp-content/uploads/static-html-output.zip?cacheBuster=1593084767017)
    The 1st and 2nd attempts were under these conditions: Coming soon mode was active, the access to the website was limited to a certain IP address.

    For the 3rd attempt, I disabled the Coming Soon mode and the IP restriction. So far, it has crawled only 8 URLs within one hour.

    I’m using the ZIP Archive method.

    Plugin Author Leon Stafford

    (@leonstafford)

    @jackoneill right in turning off “Coming soon mode”, plugin won’t work with that. Preferred way to restrict access to the site to keep private is http basic authentication, which plugin has fields input credentials to allow crawling.

    I’d try deleting all those previous working files in the wp-content/uploads dir and try again, then check server logs in case some permissions issues or such blocking either access to the site or failing to write to filesystem.

    Do you have any other security measures in place that may perceive the rapid crawling of the plugin as a threat and block requests? ie, a WP security plugin (not needed anymore if dev site is private) or some WAF?

    Cheers,

    Leon

    Thread Starter Slavek

    (@jackoneill)

    Thank you, I deleted security plugins and the coming soon plugin and it worked like a charm. Took about 17 minutes, so much faster than with WP2Static.

    Plugin Author Leon Stafford

    (@leonstafford)

    w00t! Glad to hear, @jackoneill!

    Please let me know if you encounter any issues with this version, as it’s not been widely distributed yet, but I think we’ve got most major issues sorted.

    Cheers,

    Leon

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Some pages are missing’ is closed to new replies.