[jhob]

So the pagination library works great for working with smaller data sets. However I need to paginate a table of 500,000 records and the pagination is dogshit slow with some queries taking upwards of 30s to run.

I've been reading about it recently and am interested in implementing a more efficient pagination. Couple of articles here:

https://www.xarg.org/2011/10/optimized-p...ing-mysql/
https://www.eversql.com/faster-paginatio...t-is-slow/

Has anyone already implemented a faster pagination library for CodeIgniter before I embark on doing similar myself?

[qury]

I think it is not CI's pagination library that you have issue with, but the speed of your database query for pagination

[InsiteFX]

Those optimizations are fine for an existing database, but every database is different
and needs different optimizations. There is no one way to optimize them.

It's up to you to setup the right index keys and normalization of the database.

[jhob]

But even with an index pagination with that many records can be painfully slow. The alternative methods I mentioned all used the Id of the first/last items on the current page.

Anyway, by sounds of it there is no alternative pagination library already written so I will roll my own.

[InsiteFX]

If your going to roll your own then I would make it an Ajax Pagination Library.

[php_rocs]

@jhob

Something is wrong if you have 500K records and your queries are taking at least 30 seconds. You might want to think about doing a database analysis to see what can be done to speed up your queries.

[php_rocs]

@jhob,

I forgot to ask...what version of MySQL are you using? How are you connecting to the database ( MySQLi extension [the "i" stands for improved] or PDO [PHP Data Objects] )? Do you have a example query that takes more than 30 secs to execute.