{"action":"created","issue":{"url":"https://api.github.com/repos/WorldBrain/cortex/issues/46","repository_url":"https://api.github.com/repos/WorldBrain/cortex","labels_url":"https://api.github.com/repos/WorldBrain/cortex/issues/46/labels{/name}","comments_url":"https://api.github.com/repos/WorldBrain/cortex/issues/46/comments","events_url":"https://api.github.com/repos/WorldBrain/cortex/issues/46/events","html_url":"https://github.com/WorldBrain/cortex/issues/46","id":176321195,"number":46,"title":"Add column \"indexed\" to articles_db","user":{"login":"oliversauter","id":7870039,"avatar_url":"https://avatars.githubusercontent.com/u/7870039?v=3","gravatar_id":"","url":"https://api.github.com/users/oliversauter","html_url":"https://github.com/oliversauter","followers_url":"https://api.github.com/users/oliversauter/followers","following_url":"https://api.github.com/users/oliversauter/following{/other_user}","gists_url":"https://api.github.com/users/oliversauter/gists{/gist_id}","starred_url":"https://api.github.com/users/oliversauter/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/oliversauter/subscriptions","organizations_url":"https://api.github.com/users/oliversauter/orgs","repos_url":"https://api.github.com/users/oliversauter/repos","events_url":"https://api.github.com/users/oliversauter/events{/privacy}","received_events_url":"https://api.github.com/users/oliversauter/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"hoshomoh","id":5657993,"avatar_url":"https://avatars.githubusercontent.com/u/5657993?v=3","gravatar_id":"","url":"https://api.github.com/users/hoshomoh","html_url":"https://github.com/hoshomoh","followers_url":"https://api.github.com/users/hoshomoh/followers","following_url":"https://api.github.com/users/hoshomoh/following{/other_user}","gists_url":"https://api.github.com/users/hoshomoh/gists{/gist_id}","starred_url":"https://api.github.com/users/hoshomoh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hoshomoh/subscriptions","organizations_url":"https://api.github.com/users/hoshomoh/orgs","repos_url":"https://api.github.com/users/hoshomoh/repos","events_url":"https://api.github.com/users/hoshomoh/events{/privacy}","received_events_url":"https://api.github.com/users/hoshomoh/received_events","type":"User","site_admin":false},"assignees":[{"login":"hoshomoh","id":5657993,"avatar_url":"https://avatars.githubusercontent.com/u/5657993?v=3","gravatar_id":"","url":"https://api.github.com/users/hoshomoh","html_url":"https://github.com/hoshomoh","followers_url":"https://api.github.com/users/hoshomoh/followers","following_url":"https://api.github.com/users/hoshomoh/following{/other_user}","gists_url":"https://api.github.com/users/hoshomoh/gists{/gist_id}","starred_url":"https://api.github.com/users/hoshomoh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hoshomoh/subscriptions","organizations_url":"https://api.github.com/users/hoshomoh/orgs","repos_url":"https://api.github.com/users/hoshomoh/repos","events_url":"https://api.github.com/users/hoshomoh/events{/privacy}","received_events_url":"https://api.github.com/users/hoshomoh/received_events","type":"User","site_admin":false}],"milestone":null,"comments":2,"created_at":"2016-09-12T08:34:57Z","updated_at":"2016-09-15T09:49:40Z","closed_at":null,"body":"We need a status for an article, that it has been running through all the steps of being parsed. \n\nI would suggest using a time stamp, since this would help us later to decide for recrawling of the page."},"comment":{"url":"https://api.github.com/repos/WorldBrain/cortex/issues/comments/247284905","html_url":"https://github.com/WorldBrain/cortex/issues/46#issuecomment-247284905","issue_url":"https://api.github.com/repos/WorldBrain/cortex/issues/46","id":247284905,"user":{"login":"oliversauter","id":7870039,"avatar_url":"https://avatars.githubusercontent.com/u/7870039?v=3","gravatar_id":"","url":"https://api.github.com/users/oliversauter","html_url":"https://github.com/oliversauter","followers_url":"https://api.github.com/users/oliversauter/followers","following_url":"https://api.github.com/users/oliversauter/following{/other_user}","gists_url":"https://api.github.com/users/oliversauter/gists{/gist_id}","starred_url":"https://api.github.com/users/oliversauter/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/oliversauter/subscriptions","organizations_url":"https://api.github.com/users/oliversauter/orgs","repos_url":"https://api.github.com/users/oliversauter/repos","events_url":"https://api.github.com/users/oliversauter/events{/privacy}","received_events_url":"https://api.github.com/users/oliversauter/received_events","type":"User","site_admin":false},"created_at":"2016-09-15T09:49:40Z","updated_at":"2016-09-15T09:49:40Z","body":"Resolution from convo in #40:\r\n\r\n**Changes in `sources` table:**\r\n- Adding last time crawled\r\n- adding last error message to domain (for now the last one is ok, later on we add a log file to each domain)\r\n- Adding 2 states:\r\n  - `CONTENT_COMPLETE` =content extraction complete and URLs of domain ready for being indexed\r\n  - `INDEXED` = it is indexed in elastic search \r\n\r\n**Changes in `all_urls` table**\r\nAdding 3 states:\r\n-  change `PROCESSED` to `PARSED` (processed content extractor)\r\n-  `FAILED`  \r\n-  `INDEXED` (indexed by elastic search)"}}
{"actor":{"display_login":"oliversauter"}}