I'm developing a system in CodeIgniter 4 in which each establishment that is registered will record about 5 thousand products (up to 30 thousand in some cases) daily. The initial idea was that these establishments would upload this information through CSV files, but the solutions I found on the internet run a loop with each CSV line generating an insert in MySQL, this already takes a long time on my local computer, imagine in a server with several establishments uploading information and more users performing queries.
I've just come to the conclusion that it won't be possible to implement this way, so I'll have to think of another solution. I thought about uploading only csv or json files and trying to do the necessary queries on those files, but it doesn't seem efficient (or even viable). So I'd like to know if there is a betterĀ alternativeĀ to upload these large volumes of information to the server, if there is a solution using MySQL it is even better, but if there are other solutions, they will also be very useful.