Welcome Guest, Not a member yet? Register   Sign In
Insert 1 milion record
#13

I second the use of mysql's load data infile. I worked on a project once where they with dealing with millions of rows of data reqularly, with data normalization, etc. We handled that by using load data to load the CSV to a temporary table at which point we could removed duplicates, normalize, etc. before merging into the rest of the working data. Worked pretty well.
Reply


Messages In This Thread
Insert 1 milion record - by omid_student - 09-29-2017, 01:15 PM
RE: Insert 1 milion record - by ciadvantage - 09-29-2017, 01:25 PM
RE: Insert 1 milion record - by omid_student - 09-29-2017, 01:31 PM
RE: Insert 1 milion record - by ciadvantage - 09-29-2017, 02:17 PM
RE: Insert 1 milion record - by omid_student - 09-30-2017, 11:17 AM
RE: Insert 1 milion record - by omid_student - 11-07-2017, 08:42 AM
RE: Insert 1 milion record - by Narf - 11-07-2017, 08:54 AM
RE: Insert 1 milion record - by omid_student - 11-07-2017, 11:53 AM
RE: Insert 1 milion record - by fenzy - 11-12-2017, 04:07 AM
RE: Insert 1 milion record - by ciadvantage - 09-30-2017, 02:20 PM
RE: Insert 1 milion record - by omid_student - 10-01-2017, 02:16 AM
RE: Insert 1 milion record - by agus - 11-12-2017, 02:11 AM
RE: Insert 1 milion record - by kilishan - 11-12-2017, 09:49 PM



Theme © iAndrew 2016 - Forum software by © MyBB