How to grab content of website automaticly? - Printable Version +- CodeIgniter Forums (https://forum.codeigniter.com) +-- Forum: Using CodeIgniter (https://forum.codeigniter.com/forumdisplay.php?fid=5) +--- Forum: General Help (https://forum.codeigniter.com/forumdisplay.php?fid=24) +--- Thread: How to grab content of website automaticly? (/showthread.php?tid=571) |
How to grab content of website automaticly? - paju89 - 12-21-2014 I am bulding a website as news aggregator. When i add new url to my website i grab content of it and show users in a frame within my website. I need logic of news aggregator website which does all process automaticly. For example if i once add url example.com to my base it grabs automaticly content of latest post of that site and and grab its content. Digg.com is a great example of it. RE: How to grab content of website automaticly? - Rufnex - 12-22-2014 You can check this lib for your project: https://github.com/Lukeas14/codeigniter_crawler RE: How to grab content of website automaticly? - paju89 - 12-22-2014 (12-22-2014, 12:55 AM)Rufnex Wrote: You can check this lib for your project: https://github.com/Lukeas14/codeigniter_crawler Thank you Rufnex for your answer. But i have already built function grab websites. But what i need is to do this automaticly . Simply if i enter once url mashable.com it always grab new post of that site. RE: How to grab content of website automaticly? - Rufnex - 12-23-2014 Why not use a cronjob for that kind of task? RE: How to grab content of website automaticly? - paju89 - 12-25-2014 (12-23-2014, 01:14 PM)Rufnex Wrote: Why not use a cronjob for that kind of task?cronjob is next step of grabbing. i meant before cronjob needed someway to get last news of any website which i inserted my database. I found a solution if someone needed Codeigniter-RSSParser . using this library allow me to get any websites last inserted news. |