{"action":"created","issue":{"url":"https://api.github.com/repos/radical-cybertools/htbac/issues/18","repository_url":"https://api.github.com/repos/radical-cybertools/htbac","labels_url":"https://api.github.com/repos/radical-cybertools/htbac/issues/18/labels{/name}","comments_url":"https://api.github.com/repos/radical-cybertools/htbac/issues/18/comments","events_url":"https://api.github.com/repos/radical-cybertools/htbac/issues/18/events","html_url":"https://github.com/radical-cybertools/htbac/issues/18","id":362328653,"node_id":"MDU6SXNzdWUzNjIzMjg2NTM=","number":18,"title":"ssh tunnel disconnection on Blue Waters ","user":{"login":"jdakka","id":17818114,"node_id":"MDQ6VXNlcjE3ODE4MTE0","avatar_url":"https://avatars3.githubusercontent.com/u/17818114?v=4","gravatar_id":"","url":"https://api.github.com/users/jdakka","html_url":"https://github.com/jdakka","followers_url":"https://api.github.com/users/jdakka/followers","following_url":"https://api.github.com/users/jdakka/following{/other_user}","gists_url":"https://api.github.com/users/jdakka/gists{/gist_id}","starred_url":"https://api.github.com/users/jdakka/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jdakka/subscriptions","organizations_url":"https://api.github.com/users/jdakka/orgs","repos_url":"https://api.github.com/users/jdakka/repos","events_url":"https://api.github.com/users/jdakka/events{/privacy}","received_events_url":"https://api.github.com/users/jdakka/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"andre-merzky","id":1319674,"node_id":"MDQ6VXNlcjEzMTk2NzQ=","avatar_url":"https://avatars2.githubusercontent.com/u/1319674?v=4","gravatar_id":"","url":"https://api.github.com/users/andre-merzky","html_url":"https://github.com/andre-merzky","followers_url":"https://api.github.com/users/andre-merzky/followers","following_url":"https://api.github.com/users/andre-merzky/following{/other_user}","gists_url":"https://api.github.com/users/andre-merzky/gists{/gist_id}","starred_url":"https://api.github.com/users/andre-merzky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andre-merzky/subscriptions","organizations_url":"https://api.github.com/users/andre-merzky/orgs","repos_url":"https://api.github.com/users/andre-merzky/repos","events_url":"https://api.github.com/users/andre-merzky/events{/privacy}","received_events_url":"https://api.github.com/users/andre-merzky/received_events","type":"User","site_admin":false},"assignees":[{"login":"andre-merzky","id":1319674,"node_id":"MDQ6VXNlcjEzMTk2NzQ=","avatar_url":"https://avatars2.githubusercontent.com/u/1319674?v=4","gravatar_id":"","url":"https://api.github.com/users/andre-merzky","html_url":"https://github.com/andre-merzky","followers_url":"https://api.github.com/users/andre-merzky/followers","following_url":"https://api.github.com/users/andre-merzky/following{/other_user}","gists_url":"https://api.github.com/users/andre-merzky/gists{/gist_id}","starred_url":"https://api.github.com/users/andre-merzky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andre-merzky/subscriptions","organizations_url":"https://api.github.com/users/andre-merzky/orgs","repos_url":"https://api.github.com/users/andre-merzky/repos","events_url":"https://api.github.com/users/andre-merzky/events{/privacy}","received_events_url":"https://api.github.com/users/andre-merzky/received_events","type":"User","site_admin":false}],"milestone":null,"comments":2,"created_at":"2018-09-20T19:21:03Z","updated_at":"2018-09-21T20:36:47Z","closed_at":null,"author_association":"COLLABORATOR","body":"Request/issue: \"Long queue times, typically at least a day - previous experience suggests frequent RCT disconnects\" \r\n\r\n* There are 3 events that need to be considered:\r\n1. ssh connection during job submission\r\n2. ssh connection while job is in the queue\r\n3. ssh connection while the job is running \r\n\r\n1. RADICAL-SAGA is the RCT layer responsible for acquiring an ssh prompt to the login node of Blue Waters. Make sure to enable the following environment variable before submitting: `export SAGA_PTY_SSH_TIMEOUT=2000` \r\n\r\n2. While the job is in the queue, SAGA will periodically check on the job. @andre-merzky, what possible sources of ssh disconnection exist at this stage? \r\n\r\n3. Once the pilot is active, there can be issues where the client loses connection to the agent. @andre-merzky-- is this still a possible issue? \r\n\r\n** Note if the job is killed via keyboard interrupt, make sure to hit `ctrl-C` only once. Doing `ctrl-C` multiple times will kill the process that is attempting to terminate the job properly. "},"comment":{"url":"https://api.github.com/repos/radical-cybertools/htbac/issues/comments/423663389","html_url":"https://github.com/radical-cybertools/htbac/issues/18#issuecomment-423663389","issue_url":"https://api.github.com/repos/radical-cybertools/htbac/issues/18","id":423663389,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMzY2MzM4OQ==","user":{"login":"jdakka","id":17818114,"node_id":"MDQ6VXNlcjE3ODE4MTE0","avatar_url":"https://avatars3.githubusercontent.com/u/17818114?v=4","gravatar_id":"","url":"https://api.github.com/users/jdakka","html_url":"https://github.com/jdakka","followers_url":"https://api.github.com/users/jdakka/followers","following_url":"https://api.github.com/users/jdakka/following{/other_user}","gists_url":"https://api.github.com/users/jdakka/gists{/gist_id}","starred_url":"https://api.github.com/users/jdakka/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jdakka/subscriptions","organizations_url":"https://api.github.com/users/jdakka/orgs","repos_url":"https://api.github.com/users/jdakka/repos","events_url":"https://api.github.com/users/jdakka/events{/privacy}","received_events_url":"https://api.github.com/users/jdakka/received_events","type":"User","site_admin":false},"created_at":"2018-09-21T20:36:47Z","updated_at":"2018-09-21T20:36:47Z","author_association":"COLLABORATOR","body":"* Submit RCT jobs from the head node on BW \r\n* Spin up (non-network) daemon (persistent process) on head node (without kneeling the machine) to allow reconnection between client and agent\r\n* Guarantee RMQ and MongoDB ports for users"}}
{"actor":{"display_login":"jdakka"}}