{"action":"created","issue":{"url":"https://api.github.com/repos/attardi/wikiextractor/issues/84","repository_url":"https://api.github.com/repos/attardi/wikiextractor","labels_url":"https://api.github.com/repos/attardi/wikiextractor/issues/84/labels{/name}","comments_url":"https://api.github.com/repos/attardi/wikiextractor/issues/84/comments","events_url":"https://api.github.com/repos/attardi/wikiextractor/issues/84/events","html_url":"https://github.com/attardi/wikiextractor/issues/84","id":181771632,"number":84,"title":"Documentation","user":{"login":"christofs","id":2589168,"avatar_url":"https://avatars.githubusercontent.com/u/2589168?v=3","gravatar_id":"","url":"https://api.github.com/users/christofs","html_url":"https://github.com/christofs","followers_url":"https://api.github.com/users/christofs/followers","following_url":"https://api.github.com/users/christofs/following{/other_user}","gists_url":"https://api.github.com/users/christofs/gists{/gist_id}","starred_url":"https://api.github.com/users/christofs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/christofs/subscriptions","organizations_url":"https://api.github.com/users/christofs/orgs","repos_url":"https://api.github.com/users/christofs/repos","events_url":"https://api.github.com/users/christofs/events{/privacy}","received_events_url":"https://api.github.com/users/christofs/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-10-07T21:29:29Z","updated_at":"2016-10-08T12:30:57Z","closed_at":"2016-10-08T02:19:50Z","body":"Hi there, great tool! It appears there is an error or lack of detail in the documentation here: http://medialab.di.unipi.it/wiki/Wikipedia_Extractor . Or maybe this is OS-specific (I'm on Ubuntu 16.04 LTS) or depends on the language version of the wiki (although it really shouldn't). \r\nI have used the line similar to the one shown there, on the command line: \r\n```\r\nWikiExtractor.py -cb 250K -o extracted itwiki-latest-pages-articles.xml.bz2\r\n```\r\nIf I do this, I get the following error message:\r\n```\r\nWikiExtractor.py: command not found\r\n```\r\nI then did this, adding \"python\" at the beginning, but still using the \"*.xml.bz2\" file as input file (just with the frwiki dump):\r\n```\r\npython WikiExtractor.py frwiki-latest-pages-articles.xml.bz2\r\n```\r\n\r\nWith this, I get the following error message:\r\n```\r\nINFO: Loaded 0 templates in 0.0s\r\nINFO: Starting page extraction from frwiki-20160920-pages-articles-multistream.xml.bz2.\r\nINFO: Using 3 extract processes.\r\nINFO: Finished 3-process extraction of 0 articles in 0.0s (0.0 art/s)\r\n\r\n```\r\nA folder \"text\" is created but then nothing happens. \r\nIf I try to use python 3, I get another error message: \r\n```\r\nTraceback (most recent call last):\r\n  File \"WikiExtractor.py\", line 60, in <module>\r\n    from cStringIO import StringIO\r\nImportError: No module named 'cStringIO'\r\n```\r\nHowever, then I used python 2.7, first extracted the \"bz2\" archive (using bzip2) and then used the \"*.xml\" file as input, like this: \r\n```\r\npython WikiExtractor.py frwiki-latest-pages-articles.xml\r\n```\r\nWith this, all works just fine.\r\nIt may be worth telling people this. It drove me mad for a while because I could not figure out what I was doing wrong. Partly, this may just be because I was calling this thing from the command line. But the extraction bit should not depend on this.\r\n\r\nThanks! "},"comment":{"url":"https://api.github.com/repos/attardi/wikiextractor/issues/comments/252422146","html_url":"https://github.com/attardi/wikiextractor/issues/84#issuecomment-252422146","issue_url":"https://api.github.com/repos/attardi/wikiextractor/issues/84","id":252422146,"user":{"login":"christofs","id":2589168,"avatar_url":"https://avatars.githubusercontent.com/u/2589168?v=3","gravatar_id":"","url":"https://api.github.com/users/christofs","html_url":"https://github.com/christofs","followers_url":"https://api.github.com/users/christofs/followers","following_url":"https://api.github.com/users/christofs/following{/other_user}","gists_url":"https://api.github.com/users/christofs/gists{/gist_id}","starred_url":"https://api.github.com/users/christofs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/christofs/subscriptions","organizations_url":"https://api.github.com/users/christofs/orgs","repos_url":"https://api.github.com/users/christofs/repos","events_url":"https://api.github.com/users/christofs/events{/privacy}","received_events_url":"https://api.github.com/users/christofs/received_events","type":"User","site_admin":false},"created_at":"2016-10-08T12:30:57Z","updated_at":"2016-10-08T12:30:57Z","body":"Thanks. My examples were indeed imprecise. But my point is that it appears necessary to extract the bz2 archive (\"frwiki-20160920-pages-articles-multistream.xml.bz2\", in my case) before calling WikiExtractor on the extracted file (\"frwiki-20160920-pages-articles-multistream.xml\", in my case). This step is not mentioned in the documentation. "}}
{"actor":{"display_login":"christofs"}}