Welcome Guest, Not a member yet? Register   Sign In
running a separate process to run reports
#1
Wink 
(This post was last modified: 09-14-2022, 10:16 AM by richb201.)

I have just about finished my app after years of effort. But in load testing I have found a significant problem. I can't afford the vcpu's needed to have a reasonable service. I am using RDS and with the type of dbase instance I can afford, I can run a single user session, at a time. This just won't work on a business level.

Of course I can run many users who are doing data entry, but the creation of the report is a severe bottleneck and the report is the final output of the system ie the reason users will use it. My ultimate goal was to allow 25 users to run reports at the same time. There is no way I can afford a large enough dbase server to do that (the project is freemimum) it would require a dbase server with at least 32 vcpu's. 

So I am considering alternatives. My current thought is to separate the report generation section and set it up via something like AWS SQS which will queue requests to run a report. To do this I will need to take my report code and stick it in a separate process, and have the process just wait for a report request. Once the report is done I can stick the report in a non SQL  datastore such as S3 so the user can get it the next day. 

At first I was thinking to use Lambda which is AWS's non server based procedure, but I use Koolreport  heavily which is a php tool plus php is not supported on Lambda. 

Is there any type of 3rd party app that will allow me to queue a request and run a separate process in php? I am still running CI3. Any guidance is appreciated.
proof that an old dog can learn new tricks
Reply


Messages In This Thread
running a separate process to run reports - by richb201 - 09-14-2022, 05:08 AM



Theme © iAndrew 2016 - Forum software by © MyBB