Sync is not completed most of times, is not incremental and lack of status

Hello,

We have migrated our site to GKE with an NFS to manage the uploads folder. Our goal is to remove the NFS, and here is where this plugin comes to action.

The problem is that we have several sites with a lot of images (about 5k each), and then the process is very slow. In the meantime, pods can be created/destroyed and even the developers can deploy new code restarting all the pods, and then the progress stops.

I don’t know how the code is made, so the problem can be:

• Lack of checkpoints to continue the process when the pods restarts.
• Locked upload process by the unexpected restarts and then doesn’t continue uploading.
• There is no mechanism to continue if the main process restarts (for example using cronjobs).

I have waited several minutes to see if maybe it continues, but nothing happens. It still in the same image and there are no logs about the images upload.

Another thing that I missed is the possibility of skip the already uploaded files, so every time the process is stopped I have to restart it from the begining, never ending the uploads. If the file link is already related to the storage, I don’t see a reason to reupload the file again. The only reason is an storage change, but in this case the link is different. Would be nice to have a checkbox to skip the images that already contains the destination domain.

The last thing I think is missed, is the upload status. I have got some problems when the upload process starts and suddenly stops after some images upload. The lack of status of the upload process doesn’t allow me to know if there was an error or the process was complete, it just shows the start button and you have to check if the images were uploaded (something hard when there are 5k of images). I have to be there checking the upload progress time to time to ensure that continues and all was OK. Maybe there are logs in the PHP logging, but they are sometimes hard to locate.

Best regards.