{"action":"created","issue":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/563","repository_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver","labels_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/563/labels{/name}","comments_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/563/comments","events_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/563/events","html_url":"https://github.com/spark-jobserver/spark-jobserver/pull/563","id":170295342,"number":563,"title":"cassandra support","user":{"login":"f1yegor","id":1815205,"avatar_url":"https://avatars.githubusercontent.com/u/1815205?v=3","gravatar_id":"","url":"https://api.github.com/users/f1yegor","html_url":"https://github.com/f1yegor","followers_url":"https://api.github.com/users/f1yegor/followers","following_url":"https://api.github.com/users/f1yegor/following{/other_user}","gists_url":"https://api.github.com/users/f1yegor/gists{/gist_id}","starred_url":"https://api.github.com/users/f1yegor/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/f1yegor/subscriptions","organizations_url":"https://api.github.com/users/f1yegor/orgs","repos_url":"https://api.github.com/users/f1yegor/repos","events_url":"https://api.github.com/users/f1yegor/events{/privacy}","received_events_url":"https://api.github.com/users/f1yegor/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-08-09T23:32:16Z","updated_at":"2016-08-27T15:27:21Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/pulls/563","html_url":"https://github.com/spark-jobserver/spark-jobserver/pull/563","diff_url":"https://github.com/spark-jobserver/spark-jobserver/pull/563.diff","patch_url":"https://github.com/spark-jobserver/spark-jobserver/pull/563.patch"},"body":"Support for cassandra datastorage backend. We discussed this with @velvia at gitter.\r\nImplemented for cassandra 2.* \r\n\r\nSome details still need to be improved:\r\n1. wontfix?: filter in cassandra, instead of application (by job status)\r\n2. fixed: have problems with upload of jar files > 16mb.\r\ncommitlog_segment_size_in_mb = 32 (default)\r\nNice explanation here http://dba.stackexchange.com/questions/145069/cassandra-operation-timed-out-received-only-0-responses-during-write\r\nI personally wouldn't like to change this settings, so might be chunk jar?\r\n\r\nSchema: \r\n`\r\nCREATE TABLE spark_jobserver.jobs (\r\n    job_id uuid PRIMARY KEY,\r\n    app_name text,\r\n    classpath text,\r\n    context_name text,\r\n    end_time timestamp,\r\n    error text,\r\n    job_config text,\r\n    start_date date,\r\n    start_time timestamp,\r\n    upload_time timestamp\r\n) \r\n\r\nCREATE TABLE spark_jobserver.jobs_chronological (\r\n    start_date date,\r\n    start_time timestamp,\r\n    job_id uuid,\r\n    app_name text,\r\n    classpath text,\r\n    context_name text,\r\n    end_time timestamp,\r\n    error text,\r\n    job_config text,\r\n    upload_time timestamp,\r\n    PRIMARY KEY (start_date, start_time, job_id)\r\n) \r\n\r\nCREATE TABLE spark_jobserver.jars (\r\n    app_name text,\r\n    upload_time timestamp,\r\n    jar blob,\r\n    PRIMARY KEY ((app_name, upload_time))\r\n) \r\n\r\nCREATE TABLE spark_jobserver.jars_chronological (\r\n    app_name text PRIMARY KEY,\r\n    upload_time timestamp\r\n) \r\n`"},"comment":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/comments/242923502","html_url":"https://github.com/spark-jobserver/spark-jobserver/pull/563#issuecomment-242923502","issue_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/563","id":242923502,"user":{"login":"f1yegor","id":1815205,"avatar_url":"https://avatars.githubusercontent.com/u/1815205?v=3","gravatar_id":"","url":"https://api.github.com/users/f1yegor","html_url":"https://github.com/f1yegor","followers_url":"https://api.github.com/users/f1yegor/followers","following_url":"https://api.github.com/users/f1yegor/following{/other_user}","gists_url":"https://api.github.com/users/f1yegor/gists{/gist_id}","starred_url":"https://api.github.com/users/f1yegor/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/f1yegor/subscriptions","organizations_url":"https://api.github.com/users/f1yegor/orgs","repos_url":"https://api.github.com/users/f1yegor/repos","events_url":"https://api.github.com/users/f1yegor/events{/privacy}","received_events_url":"https://api.github.com/users/f1yegor/received_events","type":"User","site_admin":false},"created_at":"2016-08-27T15:27:21Z","updated_at":"2016-08-27T15:27:21Z","body":"yes, actually github should have a feature \"notify me when pull requst needs re-merge\""}}
{"actor":{"display_login":"f1yegor"}}