{"action":"created","issue":{"url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/13","repository_url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering","labels_url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/13/labels{/name}","comments_url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/13/comments","events_url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/13/events","html_url":"https://github.com/batflyer/FanFiction-Collaborative-Filtering/issues/13","id":324727114,"number":13,"title":"CLI Redesign","user":{"login":"batflyer","id":11916674,"avatar_url":"https://avatars3.githubusercontent.com/u/11916674?v=4","gravatar_id":"","url":"https://api.github.com/users/batflyer","html_url":"https://github.com/batflyer","followers_url":"https://api.github.com/users/batflyer/followers","following_url":"https://api.github.com/users/batflyer/following{/other_user}","gists_url":"https://api.github.com/users/batflyer/gists{/gist_id}","starred_url":"https://api.github.com/users/batflyer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/batflyer/subscriptions","organizations_url":"https://api.github.com/users/batflyer/orgs","repos_url":"https://api.github.com/users/batflyer/repos","events_url":"https://api.github.com/users/batflyer/events{/privacy}","received_events_url":"https://api.github.com/users/batflyer/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"batflyer","id":11916674,"avatar_url":"https://avatars3.githubusercontent.com/u/11916674?v=4","gravatar_id":"","url":"https://api.github.com/users/batflyer","html_url":"https://github.com/batflyer","followers_url":"https://api.github.com/users/batflyer/followers","following_url":"https://api.github.com/users/batflyer/following{/other_user}","gists_url":"https://api.github.com/users/batflyer/gists{/gist_id}","starred_url":"https://api.github.com/users/batflyer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/batflyer/subscriptions","organizations_url":"https://api.github.com/users/batflyer/orgs","repos_url":"https://api.github.com/users/batflyer/repos","events_url":"https://api.github.com/users/batflyer/events{/privacy}","received_events_url":"https://api.github.com/users/batflyer/received_events","type":"User","site_admin":false},"assignees":[{"login":"batflyer","id":11916674,"avatar_url":"https://avatars3.githubusercontent.com/u/11916674?v=4","gravatar_id":"","url":"https://api.github.com/users/batflyer","html_url":"https://github.com/batflyer","followers_url":"https://api.github.com/users/batflyer/followers","following_url":"https://api.github.com/users/batflyer/following{/other_user}","gists_url":"https://api.github.com/users/batflyer/gists{/gist_id}","starred_url":"https://api.github.com/users/batflyer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/batflyer/subscriptions","organizations_url":"https://api.github.com/users/batflyer/orgs","repos_url":"https://api.github.com/users/batflyer/repos","events_url":"https://api.github.com/users/batflyer/events{/privacy}","received_events_url":"https://api.github.com/users/batflyer/received_events","type":"User","site_admin":false}],"milestone":null,"comments":0,"created_at":"2018-05-20T17:42:39Z","updated_at":"2018-05-28T22:32:38Z","closed_at":null,"author_association":"OWNER","body":"The design of `ffscraper/__main__.py` is starting to show some flaws, and its current state will become more difficult to maintain as more features are added.\r\n\r\n* [ ] Crash-proofing: pickle intermediate outputs, trigger certain actions based on the contents of the log file.\r\n* [ ] Outputs need to be rethought; currently there are special functions (`schemaString` and `Utils.PredicateLogicBuilder`) for converting values to a representation that is written to files. A more powerful design would involve a standard internal representation of the data that would be converted to the necessary format before being written to disk, regardless of whether that output format was BoostSRL, Cytoscape, JSON, or SQL.\r\n* [x] Replace the `progress` module with something like [tqdm](https://github.com/tqdm/tqdm), perhaps with a flag for silencing the progress bar (if the process is sent to the background, for instance).\r\n* [ ] Three \"phases\" exist for scraping stories, ordering them with respect to time, and scraping users. These phases should be split into functions, or written in a way that makes it more obvious what information is needed in which phase. For instance: Phase I needs a list of story-ids, Phase III needs a list of user-ids, etc."},"comment":{"url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/comments/392612194","html_url":"https://github.com/batflyer/FanFiction-Collaborative-Filtering/issues/13#issuecomment-392612194","issue_url":"https://api.github.com/repos/batflyer/FanFiction-Collaborative-Filtering/issues/13","id":392612194,"user":{"login":"batflyer","id":11916674,"avatar_url":"https://avatars3.githubusercontent.com/u/11916674?v=4","gravatar_id":"","url":"https://api.github.com/users/batflyer","html_url":"https://github.com/batflyer","followers_url":"https://api.github.com/users/batflyer/followers","following_url":"https://api.github.com/users/batflyer/following{/other_user}","gists_url":"https://api.github.com/users/batflyer/gists{/gist_id}","starred_url":"https://api.github.com/users/batflyer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/batflyer/subscriptions","organizations_url":"https://api.github.com/users/batflyer/orgs","repos_url":"https://api.github.com/users/batflyer/repos","events_url":"https://api.github.com/users/batflyer/events{/privacy}","received_events_url":"https://api.github.com/users/batflyer/received_events","type":"User","site_admin":false},"created_at":"2018-05-28T22:32:38Z","updated_at":"2018-05-28T22:32:38Z","author_association":"OWNER","body":"`JSON` may be more appropriate than `pickle` for some portions. Readability, working well with JavaScript, caching metadata to avoid redownloading."}}
{"actor":{"display_login":"batflyer"}}