What is meta? ×

I want to use the Stack Overflow database for a data classification project. How do I dump the Stack Overflow database?

share|improve this question

migrated from stackoverflow.com Oct 20 '09 at 7:05

This question came from our site for professional and enthusiast programmers.

add comment

4 Answers

You can download the data dump (produced monthly) at: http://blog.stackoverflow.com/category/cc-wiki-dump/

You will need a 7zip decompressor, XML parsing code, and probably a database to load the data into.

You may also be interested in http://data.stackexchange.com/ which has already done all this for you.

share|improve this answer
There is an RSS feed here: feed://www.clearbits.net/feeds/creator/146-stack-overflow-data-dump.rss –  Ameer Deen Jun 14 '11 at 5:12
Stackql.net is no longer available. Do you know another site that provides this functionality? –  Marcel Korpel Nov 15 '12 at 16:26
@Marcel: SE now runs a regularly-updated interactive query thingamajig here: data.stackexchange.com –  Shog9 Dec 30 '12 at 3:38
@Shog9 thanks! the thingamajig is awesome! Is the (code.google.com/p/stack-exchange-data-explorer) also up-to-date? maybe we should link to that as well. –  d-_-b Dec 30 '12 at 4:56
add comment

Just tell her you think you should see other people, but that you still want to be friends. (Don't actually call, though)

share|improve this answer
It's MySQL Server isn't it? You've been seeing that hussy haven't you? –  random Oct 20 '09 at 8:36
Actually, I would call. Her number is 646-826-3879 and try and be sensitive. –  Tom Ritter Oct 20 '09 at 11:52
Have you discussed who will get Access? –  Danyal Aytekin Oct 11 '10 at 12:16
add comment

If you are using MySQL I have a schema and a script written in ruby that will load the data. Just grab the latest data dump, create a database, load this schema, modify this loader script to point to your database and then run the script. It only takes a few minutes to load all the data.

share|improve this answer
Your script and schema worked like a charm. –  Snehal Nov 5 '12 at 2:27
add comment

I just made a slow Python script to import the dump to a SQLite3 database.

It's designed to run on my RAMless netbook, so it doesn't make a single COMMIT for all INSERTs, but rather COMMITs every INSERT. I'll make a fast RAM sucker version tomorrow.

share|improve this answer
add comment

You must log in to answer this question.