Bulk ingest into Redis <p>I'm trying to load a large piece of data into Redis as fast as possible.</p> <p>My data looks like:</p> <pre><code>771240491921 SOME;STRING;ABOUT;THIS;LENGTH 345928354912 SOME;STRING;ABOUT;THIS;LENGTH </code></pre> <p>There is a ~12 digit number on the left and a variable length string on the right. The key is going to be the number on the left and the data is going to be the string on the right.</p> <p>In my Redis instance that I just installed out of the box and with an uncompressed plain text file with this data, I can get about a million records into it a minute. I need to do about 45 million, which would take about 45 minutes. 45 minutes is too long.</p> <p>Are there some standard performance tweaks that exist for me to do this type of optimization? Would I get better performance by sharding across separate instances?</p>