I have the same problem and it is not related to W3TC, in fact I activated W3TC to see if that would fix the “slow server response” Google page speed reports.
Now it reports it inconsistently, but still my birst bytes killing me.
With me i first noticed it when I changed to dedicated IP
But once again I am 100% it is not W3TC related.