MySQL Forums
Forum List  »  Partitioning

how to speed up for List partitioning table
Posted by: jongse park
Date: December 28, 2014 07:59PM


I have some list partitiong tables.
I have two process load data infile ... and insert into ... select.

My Process like below;
1. I have a hundred partitioning tables. eache partitioning table is loaded data every 15 minutes. 4 times for 1 hour. (load data infile query runs). the data file of loaded is about 2GB. 2GB * 4 time = total 8GB an one hour.
each partitioning table has about 100 list partitions.
2. after load data job have finished. insert data other tables with insert into data from those partitioning tables for 1 hour.
3. "insert into" execute with concurently load data infile running to other partition on the same partitioning tables.
4. above process is rotating.

as a result, Load data infile process is getting delayed. so insert into process is affected and is getting delayed.

How can I tune the this process.
Is there any material or ducuments for I can refer to?

Options: ReplyQuote

Written By
how to speed up for List partitioning table
December 28, 2014 07:59PM

