Problem backing up to DigitalOcean S3

  • Resolved trenzterra

    (@trenzterra)


    6 years, 11 months ago

    Hi there,

    I am currently using UpdraftPlus to backup my WordPress installation to DigitalOcean spaces using the Generic S3 option.

    Everything generally works fine, except for image uploads. I am getting the following error (in bold) rather often:

    
1687.918 (1) S3generic chunked upload: 79.1 % uploaded (53, 0cdd627fa06a9eb2325ad46bfd8e5d4b)
1691.637 (1) S3generic chunked upload: 80.6 % uploaded (54, 82b302965c68a453f3808318a87a5a78)
1695.348 (1) S3generic chunked upload: 82.1 % uploaded (55, f9db889a4aefcc82e7bde77ce2d57633)
<strong>1708.869 (1) PHP event: code E_USER_WARNING: UpdraftPlus_S3::uploadPart(): [504] Unexpected HTTP status (line 294, wp-content/plugins/updraftplus/includes/S3.php)</strong>
1708.879 (1) S3 chunk 56: upload failed
1708.881 (1) An error condition has occurred for the first time during this job
1712.554 (1) S3generic chunked upload: 85.1 % uploaded (57, d03a80b27e93cea367532bce08892384)
1716.251 (1) S3generic chunked upload: 86.6 % uploaded (58, e759d7fc6c8e57a52c97c686aef75079)
1721.622 (1) S3generic chunked upload: 88.1 % uploaded (59, 38d2d4d26e38e4623a4531096aa1648f)
1725.164 (1) S3generic chunked upload: 89.6 % uploaded (60, c8c97f48d8566bc7e15250c340299312)
1738.529 (1) PHP event: code E_USER_WARNING: UpdraftPlus_S3::uploadPart(): [52] Empty reply from server (line 294, wp-content/plugins/updraftplus/includes/S3.php)
1738.532 (1) S3 chunk 61: upload failed
1742.493 (1) S3generic chunked upload: 92.5 % uploaded (62, 3122924c350b2785ea192525c42af3bc)
1746.194 (1) S3generic chunked upload: 94 % uploaded (63, f6b34a99cfef8c2e319f6bed929255ae)
1749.804 (1) S3generic chunked upload: 95.5 % uploaded (64, 28ca4490d7f14cbae44a8c89e2fe64f1)
1753.445 (1) S3generic chunked upload: 97 % uploaded (65, b643d0f326604a3d4916c468ec4a4355)
1757.594 (1) S3generic chunked upload: 98.5 % uploaded (66, 49d45d3fad01369af602fd19ca4f1a59)
1760.800 (1) S3generic chunked upload: 100 % uploaded (67, c9a150247861409d338caac8e94bf927)
1760.818 (1) S3 upload: upload was not completely successful on this run

    Eventually, UpdraftPlus tries and tries again until it succeeds. However, is there any setting I can do on my end to increase the success rate on the first try?

    Thank you.

Viewing 10 replies - 1 through 10 (of 10 total)
  • Plugin Contributor bcrodua

    (@bcrodua)

    Hi,

    Please could you send us a copy of the full backup log where this occurs? This can be found in the Existing Backups tab.

    The contents will be too long to post here directly, but you can use an online service such as Pastebin or Dropbox, and post the link here.

    Best Wishes,
    Bryle

    Thread Starter trenzterra

    (@trenzterra)

    Hi,

    Please see my pastebin link here: https://pastebin.com/NSKS8A6j

    Just a background, I am using a DigitalOcean droplet with Ubuntu 16.04, nginx and PHP-FPM. Timeouts have been set to about 3000s and above so that should not be an issue.

    The space I am backing up to is based in NYC whereas my server is in Singapore; not sure if the latency is causing this. When I backup to an Amazon S3 server based in Singapore, it proceeds just fine.

    Thread Starter trenzterra

    (@trenzterra)

    To update, I have also tried backing up with DO’s Amsterdam server, with the same issues (though the first time it went through successfully).

    https://pastebin.com/9ibufqqD

    Just wondering if the plugin has anything to do with this issue I am experiencing, or is it that DO Spaces is just unusable for large backups?

    Hello,

    i have a similar issue with use of Digital Oceans Spaces and S3

    Here ist he log: https://pastebin.com/KQqgPbQC

    Plugin Contributor DNutbourne

    (@dnutbourne)

    Hi @trenzterra,

    From the logs, it appears that there is an issue with the server that you are uploading to.
    UpdraftPlus is receiving 504 and 503 errors back, which indicates that the server is not available (Most commonly from a lack of resources).
    Please could you contact DO, and ask them if they can find a record of these errors on the server?

    Plugin Contributor DNutbourne

    (@dnutbourne)

    Hi @topicslp,

    From your log, UpdraftPlus is receiving a 403 error. This usually indicates that the connection from the site is being blocked.
    Please could you ask your server admin/hosts for the S3 server to check if this is the case, and unblock connections from your site?

    Plugin Contributor DNutbourne

    (@dnutbourne)

    Hi @trenzterra,

    Is this issue still occurring?

    Plugin Author David Anderson

    (@davidanderson)

    @trenzterra I’ve analysed the log file, and it appears that when one of the uploads is completed, an error comes from a proxy, but the upload actually succeeds. When UD re-tries, it gets an “error” from DO which effectively says “it’s already uploaded”. It’d be better if DO was returning a “success” code instead of an error – their API is meant to be compatible with Amazon S3, but Amazon S3 doesn’t do this. But no matter. I have tweaked our code to detect this particular “error”. So, in short: 1) You should not see this problem in our next release, and 2) The backup is actually there on DO; the only error is the false report of an error!

    Thread Starter trenzterra

    (@trenzterra)

    I have switched to s3 in the mean time (appears cheaper too given my usage pattern) and I have not had the time to troubleshoot it in further detail yet.

    May I know when the update is pushed out so I can try again? The other time I ended up with a corrupt uploads file though–i downloaded it but it refused to extract. So I’m not sure if the upload was indeed successful?

    Plugin Author David Anderson

    (@davidanderson)

    Hi,

    The 1.14.3 update contains the mentioned tweak.

    David

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘Problem backing up to DigitalOcean S3’ is closed to new replies.