Tips for Big Files

My PHP version is 5.5.38

@anefarious1

So how many entries in total in the CSV file?

@anefarious1

Related post.

https://www.ads-software.com/support/topic/row-number-limit/

What do you mean by entries? 40,000 rows X 2 columns = 80,000 entries? Not sure if that’s right.

I see what you mean now. There are 40,258 entries

Hi,

thanks for your post, and sorry for the trouble.

It’s usually not the file size that is limiting this, but the PHP that is used up when the internal data structures are filled. This can easily reach the server’ PHP memory limit.
This will probably happen more often with the XLSX format than with the CSV format.

Can you please try again after increasing the value of the WP_MEMORY_LIMIT constant to e.g. 256M in the wp-config.php file on your server, by following the instructions from https://codex.www.ads-software.com/Editing_wp-config.php#Increasing_memory_allocated_to_PHP ?

You should also consider updating the PHP version on the server, to 5.6 or even PHP 7. Those will need considerably less memory.

Note that even if the import succeeds, your table’s “Edit” screen will probably be very slow or unusable. You would then have to maintain/edit the table in Excel and re-import it after making changes, choosing to replace the current version.

Regards,
Tobias

Is there any possibility to have server-side processing with TablePress?

Hi,

no, sorry, this is not possible. It is on my list of ideas, but has a very low priority.
Depending on your needs, you might therefore want to consider a direct mySQL/PHP solution for your data.

Regards,
Tobias

When you say direct mySQL/PHP solution… can you recommend any names? Is there a product or specific software? thanks

Hi,

if you also want to use DataTables, you could take a look at the commercial https://wpdatatables.com/ (I’m not connected to them in any way and have not used the product myself).
Otherwise, the DataTables library’s website also contains some PHP code examples that might be helpful.

Regards,
Tobias