[eluser]mikegioia[/eluser]
Hey guys -
I was wondering if anyone had any experience fetching large amounts of data through a web based API. I'm going to be hitting last.fm's API pretty hard for each user (i.e. fetching all of their track data). The problem is, this could be anywhere from 10-100 api calls (returning pages of 50 tracks).
I was looking into using pcntl_fork for creating workers to do this but I have no experience in that at all. By best guess was to run a cron every 5 seconds or so to create a new child process.
I'd really appreciate any help on the topic, thanks!
Mike
