{"action":"created","issue":{"url":"https://api.github.com/repos/dask/dask-jobqueue/issues/48","repository_url":"https://api.github.com/repos/dask/dask-jobqueue","labels_url":"https://api.github.com/repos/dask/dask-jobqueue/issues/48/labels{/name}","comments_url":"https://api.github.com/repos/dask/dask-jobqueue/issues/48/comments","events_url":"https://api.github.com/repos/dask/dask-jobqueue/issues/48/events","html_url":"https://github.com/dask/dask-jobqueue/pull/48","id":318937364,"number":48,"title":"Add configuration file","user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars3.githubusercontent.com/u/306380?v=4","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2018-04-30T15:44:09Z","updated_at":"2018-05-08T00:14:02Z","closed_at":null,"author_association":"OWNER","pull_request":{"url":"https://api.github.com/repos/dask/dask-jobqueue/pulls/48","html_url":"https://github.com/dask/dask-jobqueue/pull/48","diff_url":"https://github.com/dask/dask-jobqueue/pull/48.diff","patch_url":"https://github.com/dask/dask-jobqueue/pull/48.patch"},"body":"In https://github.com/dask/dask/pull/3432 we're considering centralizing configuration in Dask projects.  This PR is a proof of concept for what that would mean within a project like dask-jobqueue.  This could use feedback both from dask/dask-jobqueue maintainers on what would be most comfortable for this user community, and also from dask/dask maintainers on how this constrains central development.\r\n\r\nThis adds a new jobqueue.yaml config file that allows users to specify\r\nconfiguration in a file and have that be used across all of their use of the\r\ndask-jobqueue project.  This is also something that might allow IT to help\r\nstandardize configuration options for a given cluster."},"comment":{"url":"https://api.github.com/repos/dask/dask-jobqueue/issues/comments/387244645","html_url":"https://github.com/dask/dask-jobqueue/pull/48#issuecomment-387244645","issue_url":"https://api.github.com/repos/dask/dask-jobqueue/issues/48","id":387244645,"user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars3.githubusercontent.com/u/306380?v=4","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"created_at":"2018-05-08T00:14:02Z","updated_at":"2018-05-08T00:14:02Z","author_association":"OWNER","body":"Yes, I think that you would want to drop the subset of the configuration that made sense for all users into `/etc/dask`\r\n\r\n```yaml\r\n# /etc/dask\r\njobqueue:\r\n  name: dask-worker\r\n  threads: 8\r\n  processes: 4\r\n  memory: 192GB  # should we change this to be for the full job?\r\n  interface: ib0\r\n  local-directory: /local/scratch/$USER  # should we support environment variables?\r\n  queue: standard\r\n  sge:\r\n    resource-spec: ...\r\n```\r\n\r\nThen they can leave the other parts for users, or users can overwrite elements if they wish (user directories are given more precedence).  The `dask.config` module will handle merging things.\r\n\r\n```yaml\r\n# ~/.config/dask/jobqueue.yaml\r\njobqueue:\r\n  queue: priority\r\n  project: PB382938\r\n```"}}
{"actor":{"display_login":"mrocklin"}}