Hi, i'm trying to build queue worker service under codeigniter.
i've searched and try any libs google provide but no luck
also try a lib using gearman but return some error also
i tried this lib
github.com/yidas/codeigniter-queue-worker]https://github.com/yidas/codeigniter-queue-worker
but when i wanna load the library it's return error "Can't find the class" or something.
and im trying to use
github.com/appleboy/CodeIgniter-Gearman-Library]https://github.com/appleboy/CodeIgniter-Gearman-Library
it's return error when i try to start with "gearman -d"
gearmand: Could not open log file "/usr/local/var/log/gearmand.log", from "/var/www/html/lists/services", switching to stderr. (No such file or directory)
my case is something like this
1. I have 1 Big Database contains millions data let's call "Database A"
2. I need to grab data form "Database A" and result new list of data and save it to a new database let's call "Database B"
in process of grabbing big data "more than 1 million" it cant be done just by a single query (in this case most problem i face is memory limit) i can't upgrade the memory (server use nginx with 2vCpu and 4GB of RAM). i've set up php.ini into maximum memory and connection time out.
so i need to build a worker and grab the data slowly but consistence. maybe 1 million data divide into 10 or 11 workers and saving them into the new database (no matter if the process take minutes or hour).
that's why im trying to find any lib and services i can use in codeigniter.
please help me to solve this proble.
any help is appreciate. thanks in advance.
