actionfactory

Nevermind. This was never an issue. User error.

Yes, I had issues with it timing out as well. You have to change your PHP max size in your .htaccess file.

Make the files 5000 rows each.

@dean re:301 Our links were not indexed yet, so we didn’t have to deal with that.

I would try the “redirection” plugin.

@dean – no it will not remove it as you will have to delete them manually. This just gives you a way to sort through them easier for the manual deletion.

Also, you can use this plugin for reference as well.

@dean.

I’ve found a way around this.

I downloaded https://www.sequelpro.com and sorted through the database “containing” “post_name” -2

“-2” is the incremental post name value for duplicates.

I deleted by hand.

Hope that helps.

Best,

Ling

Hey Julian,

I’m having the same issue. I have a site https://musicblvd.com

That has over 200,000+ post and roughly 4,300 are duplicates. It finds them, but it doesn’t process the request when I try to remove them. The plugin dies at scale.

Any updates on a fix for this?

Best,

Ling

@hector – Thanks for the response. We ended up disabling the plugin before your response.

It seems that it is querying the database everytime there is a page load. Perhaps some kind of caching system would help this?

Currently, I don’t think WPP is optimized for large data sets.

Hey Arne,

We update to the beta version and it is crashing for this month’s sitemap creation.

What do you suggest we do?

Best,

Ling

Well, they aren’t dates per se.

It’s classic content like music lyrics, so there are no dates.

The site is https://musicblvd.com

Hi Arne,

Thanks for the reply.

We have uploaded the beta of Google Sitemap Generator, but unfortunately we just imported a 215,000 rows content database into a WordPress database from an independent CSV file. They are all in the same month!

How would you suggest we approach this?

Best,

Ling

I take that back.

I have only successfully uploaded a 1000 row CSV file.

I’m uploading this file now. It ended up being 300mb.

It started to get very slow at 33%

So best to have the .csv files in 100mb files for optimal upload.

Found this issue.

When saving the CSV file, make sure you select “microsoft comma separated” instead of the standard CSV saving format in Excel.