{"action":"created","issue":{"url":"https://api.github.com/repos/dask/distributed/issues/338","repository_url":"https://api.github.com/repos/dask/distributed","labels_url":"https://api.github.com/repos/dask/distributed/issues/338/labels{/name}","comments_url":"https://api.github.com/repos/dask/distributed/issues/338/comments","events_url":"https://api.github.com/repos/dask/distributed/issues/338/events","html_url":"https://github.com/dask/distributed/issues/338","id":160562621,"number":338,"title":"Unstable cluster after calling e.restart()","user":{"login":"hussainsultan","id":3936122,"avatar_url":"https://avatars.githubusercontent.com/u/3936122?v=3","gravatar_id":"","url":"https://api.github.com/users/hussainsultan","html_url":"https://github.com/hussainsultan","followers_url":"https://api.github.com/users/hussainsultan/followers","following_url":"https://api.github.com/users/hussainsultan/following{/other_user}","gists_url":"https://api.github.com/users/hussainsultan/gists{/gist_id}","starred_url":"https://api.github.com/users/hussainsultan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hussainsultan/subscriptions","organizations_url":"https://api.github.com/users/hussainsultan/orgs","repos_url":"https://api.github.com/users/hussainsultan/repos","events_url":"https://api.github.com/users/hussainsultan/events{/privacy}","received_events_url":"https://api.github.com/users/hussainsultan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2016-06-16T02:07:03Z","updated_at":"2016-06-16T03:01:58Z","closed_at":null,"body":"After doing some work, i often clear the state of the executor by calling `restart` method. After the state clears and i resume the work with dataframes, and often times a call that should return immediately doesnt return. \r\n\r\nexample:\r\n\r\n```python\r\ne.restart()\r\n\r\ndf = dd.read_csv('s3://...')\r\ndf = e.persist(df) # bokeh web UI shows that the df gets read correctly\r\ndf.head() #hangs forever\r\n```\r\nI am trying to figure out what is the best way to debug this, the scheduler logs do not show anything unusual. However, the bokeh web ui (/status end point), shows many tiny `head` tasks forever. "},"comment":{"url":"https://api.github.com/repos/dask/distributed/issues/comments/226376606","html_url":"https://github.com/dask/distributed/issues/338#issuecomment-226376606","issue_url":"https://api.github.com/repos/dask/distributed/issues/338","id":226376606,"user":{"login":"hussainsultan","id":3936122,"avatar_url":"https://avatars.githubusercontent.com/u/3936122?v=3","gravatar_id":"","url":"https://api.github.com/users/hussainsultan","html_url":"https://github.com/hussainsultan","followers_url":"https://api.github.com/users/hussainsultan/followers","following_url":"https://api.github.com/users/hussainsultan/following{/other_user}","gists_url":"https://api.github.com/users/hussainsultan/gists{/gist_id}","starred_url":"https://api.github.com/users/hussainsultan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hussainsultan/subscriptions","organizations_url":"https://api.github.com/users/hussainsultan/orgs","repos_url":"https://api.github.com/users/hussainsultan/repos","events_url":"https://api.github.com/users/hussainsultan/events{/privacy}","received_events_url":"https://api.github.com/users/hussainsultan/received_events","type":"User","site_admin":false},"created_at":"2016-06-16T03:01:58Z","updated_at":"2016-06-16T03:01:58Z","body":"in my case,  i see this happen after successful `e.persist(df)` that i can confirm from the bokeh web ui that all tasks completed successfuly and the subsequent head() just goes wonky"}}
{"actor":{"display_login":"hussainsultan"}}