Best practice for large site (3million urls)

  • Resolved workload

    (@workload)


    2 years, 10 months ago

    We purchased MPG and are struggling with how to get our 3m rows of data to work with it.

    I’ve already tried uploading large .csv files of 500k rows but the system runs extremely slow.

    We’ve broken our files down into 50k rows, which loads a bit faster, but now we have 150 .csv files to upload.

    What do you recommend for this?

    The page I need help with: [log in to see the link]

Viewing 2 replies - 1 through 2 (of 2 total)

  • Don’t bother bing just released new algorithms that ban sites using automated landing pages I had all my links removed and now my website is banned because of plug-in I contacted mpg porthas and they are no longer answering my emails

    Mat

    (@mateithemeisle)

    Hello @workload and @raylopezjr ,

    Thank you for reaching out and apologies for the delayed reply here!

    We have already solutioned your inquiry on the PRO users dedicated channel, but since @raylopezjr might be interested, we decided to share the answer here too in case somebody else is encountering the same issue.

    Indeed your file seems to be of immense size which we know can cause trouble in uploading it. We have opened a discussion internally for such cases, unfortunately, it seems like at the moment, we didn't find a working solution for these cases. Our only suggestion right now is to try and increase the memory_limit, post_max_size, upload_max_filesize size in the php.ini file and see if that works better.

    Also, at this moment unfortunately there is still no viable solution for such a heavy file but we are actively working on finding one.

    As for the information provided by @raylopezjr , would you mind sharing more information on that topic, please?

    Thank you all for collaborating and have an amazing weekend!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Best practice for large site (3million urls)’ is closed to new replies.