CodeIgniter Forums
Large Data Import - Printable Version

+- CodeIgniter Forums (https://forum.codeigniter.com)
+-- Forum: Archived Discussions (https://forum.codeigniter.com/forumdisplay.php?fid=20)
+--- Forum: Archived Development & Programming (https://forum.codeigniter.com/forumdisplay.php?fid=23)
+--- Thread: Large Data Import (/showthread.php?tid=33561)



Large Data Import - El Forum - 08-31-2010

[eluser]Unknown[/eluser]
Hey Guys,
I am working on a script that needs to loop through a 1GB XML file and import about 9 million records into a mySQL database. I'm using XML Reader to get through the file and CI gets through it at a good pace, I know my bottleneck is with the SQL inserts and queries. Does anyone have any PHP advice to speed up the script? Is CI a bad idea in this case, should I just be using straight PHP?

Thanks!


Large Data Import - El Forum - 08-31-2010

[eluser]n0xie[/eluser]
Maybe this will help?

http://dev.mysql.com/tech-resources/articles/xml-in-mysql5.1-6.0.html#xml-5.1-importing