• W3TC 0.9.2.3

    I’m having trouble with the way that W3 Total Cahce auto-uploads files to my Rackspace CDN and I’d like to see some debugging added so I can see what it’s doing please.

    It’s been working perfectly for a long time now…

    I think my problem started when I removed some Apache modules that (I thought) were not being used. I then saw a few errors showing up in the “Upload Queue” on a few different occasions. I cleared the errors and thought everything was OK.
    Since then, my site has been uploading over 60GB per day to my CDN (my whole /uploads/ directory is around 2.5GB and has not changed at all for a long time) so I think the auto-uploader is getting very confused and uploading everything over and over again continuously.
    I’d like to see some debugging output to see how it’s determining that the files need to be re-uploaded, so I can get to the root of the problem and fix it.

    Thanks very much,
    -Dan

Viewing 15 replies - 1 through 15 (of 19 total)
  • Grecy,
    Not sure about your problem though I do know you can enable log files on the Rackspace side so maybe that’ll help to see what’s going on?

    I have a question for you however. With auto upload, do you have it setup to auto-upload files in your custom list? If so, have you gotten it to work successfully using Rackspace CDN? It’s been a problem I’ve had for month and have never been able to figure out why.

    THanks and good luck with your issue!

    Thread Starter Grecy

    (@grecy)

    jfenico,

    I just enabled the logs on CloudFiles, so I’m going to watch them closely once I re-enable auto-upload (I turned it off to stop the massive data transfers)
    As for settings, I have “Host Custom Files” and “Export Changed Files Automatically” selected, which have been working well for many months (until my recent problems.)

    -Dan

    Just out of curiosity, what kind of custom files are you hosting (and how is it written under the custom file list).

    I’m trying to get Next Gen gallery (wp-content/gallery/* to work and whenever I make a new gallery it doesn’t auto upload. I can however click on upload custom files and it’ll go through, but the folder is almost 1GB big so doing that after each new gallery added seems a little excessive ??

    Thread Starter Grecy

    (@grecy)

    My custom files list says:
    favicon.ico
    wp-content/gallery/*
    wp-content/uploads/*

    I honestly don’t know if wp-content/gallery/* works, I don’t have anything there.

    When you manually upload a new gallery, does it re-upload all the old ones as well? I thought it would be smart enough to see the files exist and not move them again.

    -Dan

    Ya if you click on upload custom files it’ll re-upload everything in that folder. Right now I’m at the mercy of using the built in wordpress gallery which doesn’t always look right on our site.
    Sad times USA.

    Thread Starter Grecy

    (@grecy)

    I was just thinking of a workaround, depending on the structure of your /gallery/ folder you could try something like this…

    lets say you have /gallery/1/ and gallery/2/ which you’ve previously manually uploaded. Now you add /gallery/3/ and want to manually upload it too. Make sure you’re custom files list does not show /1 /2 only /3 and try the manual upload.
    Maybe it will only upload the new gallery for you and leave the others as they are? Worth a shot.

    -Dan

    Ya I’m sure if you kept changing the custom list that would work.
    I also have a workaround where I add the gallery from Next-Gen, then manually upload them to my CDN using Cyberduck. But those both take 2x the work/effort. So, it yea, there are ways..just wondering if WT3C has legit way of doing it.

    Thread Starter Grecy

    (@grecy)

    I’m tempted to dig into the WT3C code and put a whole log of logging around how it decides to upload what files to the CDN… I think that would also help your problem.
    Maybe a dev will comment here sooner or later.

    -Dan

    Frederick actually contacted me and tried helping a little, but we didn’t get anywhere unfortunately. But if you end up taking a look, I wish you luck! Let us know what you find.

    Plugin Contributor Frederick Townes

    (@fredericktownes)

    Anyone still having this issue?

    Thread Starter Grecy

    (@grecy)

    Yes.

    Running WordPress 3.3.1 and WwTC 0.9.2.4, I still constantly have the problem I described in the first post.
    W3TC uploaded over a million files to my CDN in the first few days of Feb when I only have 4000 files in my uploads directory.

    I still have no idea why it does this, or what I can do to permanently fix it. For now, I’ve un-selected “auto-upload” which stops it, but also makes the CDN feature of W3TC not so useful.

    Thanks,
    -Dan

    Plugin Contributor Frederick Townes

    (@fredericktownes)

    Do you have “Force over-writing of existing files” enabled?

    Thread Starter Grecy

    (@grecy)

    No. I turned that off in an attempt to stop this happening, nothing changed.

    Plugin Contributor Frederick Townes

    (@fredericktownes)

    Ok, will investigate.

    Plugin Contributor Frederick Townes

    (@fredericktownes)

    This will be improved in the next release.

Viewing 15 replies - 1 through 15 (of 19 total)
  • The topic ‘[Plugin: W3 Total Cache] Debugging for CDN auto upload please’ is closed to new replies.