View what is being PUT/DELETE to AWS S3

  • Resolved Will Stocks

    (@willstockstech)


    5 years, 9 months ago

    hi guys,

    Is there any way for me to view what is being PUT/POST’ed via W3TC into my S3 bucket recently?

    I’ve just had my highest AWS bill ever through, where I had a total of over 5.5 MILLION PUT, COPY, POST or LIST requests. The only thing that has changed in the last month – I setup a single, small folder on my server to upload to S3 via W3TC.

    I would have expected this volume of requests for GET, but for PUT… I’ve not uploaded anything in the last month to validate this! I have one folder set to send content up to S3, which contains a grand total of 146 files (approximately only 15 have changed two separate times in the last month).

    The _only_ thing I can think is that for some reason, for every cron job that runs, W3TC is nuking whatever exists in S3 already (cdn purging?) and then re-uploading _every single time_? Or force overwriting every single time?

    Amazon Simple Storage Service EUW2-Requests-Tier1
    PUT, COPY, POST, or LIST requests 4,199,049 Requests

    Amazon Simple Storage Service EUW2-Requests-Tier2
    GET and all other requests 1,479,058 Requests

    I have public listing disabled, I haven’t copied content, I haven’t uploaded any content (and even if I did, it would’ve been a couple of images via WP Offload)

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Contributor Marko Vasiljevic

    (@vmarko)

    Hello @willstockstech,

    W3 Total Cache tracks updates of attachments and reuploads them to CDN.
    Some plugins or themes update assets all the time so the number of such operations may become noticeable on some systems which are especially important for AWS – the only CDN charging for purge request.
    You may see activity if enable cdn debug mode – log file is created with ops performed.

    Only “purge CDN manually” option may help in that case.

    Thread Starter Will Stocks

    (@willstockstech)

    I have turned off CDN functionality for now. I will spin up my dev server and will enable the debug mode, to see what is happening exactly.
    The folder I was uploading would update once a day maximum (it would update only if I changed my Gravatar!) for approx 10-15 images (different sizes), and had my font files in there, which I have not updated in over 6 months.

    Leave it with me – I will take a look at some debug logs and if I find anything weird I will let you know – thanks @vmarko!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘View what is being PUT/DELETE to AWS S3’ is closed to new replies.