{"action":"created","issue":{"url":"https://api.github.com/repos/dask/distributed/issues/519","repository_url":"https://api.github.com/repos/dask/distributed","labels_url":"https://api.github.com/repos/dask/distributed/issues/519/labels{/name}","comments_url":"https://api.github.com/repos/dask/distributed/issues/519/comments","events_url":"https://api.github.com/repos/dask/distributed/issues/519/events","html_url":"https://github.com/dask/distributed/issues/519","id":176462061,"number":519,"title":"Switch to using subprocesses slows down Client() use","user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars.githubusercontent.com/u/306380?v=3","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-09-12T19:25:44Z","updated_at":"2016-09-13T12:38:01Z","closed_at":null,"body":"Creating a local cluster is a common case\r\n\r\n```python\r\nfrom distributed import Client\r\nc = Client()\r\n```\r\n\r\nRecently we switched from using fork/multiprocessing to using subprocess so that we could deploy workers in other Python executables.  This is a fairly uncommon case.  It is unfortunate that the common case suffers from the uncommon case.\r\n\r\nIt might be worth letting Nanny's create workers with both mechanisms, only using `subprocess` if the executable is different from the nanny's executable."},"comment":{"url":"https://api.github.com/repos/dask/distributed/issues/comments/246667605","html_url":"https://github.com/dask/distributed/issues/519#issuecomment-246667605","issue_url":"https://api.github.com/repos/dask/distributed/issues/519","id":246667605,"user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars.githubusercontent.com/u/306380?v=3","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"created_at":"2016-09-13T12:38:01Z","updated_at":"2016-09-13T12:38:01Z","body":"Fork is also just cleaner in lots of ways.  I ran into a few problems with the subprocessing solution not cleaning up properly.  These issues were fixed, but still I'll feel more comfortable relying on fork for the immediate future.  Switching to subprocess for the sake of https://github.com/dask/distributed/issues/300 was probably premature"}}
{"actor":{"display_login":"mrocklin"}}