I am running SQL Server 2008 R2 on Windows Server 2008 R2. I have a large server HP DL580 with 4 processors, each has 6 cores and 256gig of memory. We have a weekly ingestion process and that load about 14MM documents into a database stagging table. After the weekend process is complete I need to migrate the data into the production tables. I am using BCP to create an output file that is ~70gig of data and then using Bulk Insert to load the production table. However this still takes over an hour. I have done all the normal stuff like put the database in simple recovery mode, dropped all the indexes, and I am using native format. The table consist of 4 fields, bigint, int and the last two are text fields where we hold the document text. I am currently looking at partitioning the table but I don't have multiple mount points on the server. Any ideas on how to make this run faster?
↧