{"action":"created","issue":{"url":"https://api.github.com/repos/cBio/cbio-cluster/issues/396","repository_url":"https://api.github.com/repos/cBio/cbio-cluster","labels_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/396/labels{/name}","comments_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/396/comments","events_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/396/events","html_url":"https://github.com/cBio/cbio-cluster/issues/396","id":144114953,"number":396,"title":"GTX titan nodes out of service?","user":{"login":"lzamparo","id":1569186,"avatar_url":"https://avatars.githubusercontent.com/u/1569186?v=3","gravatar_id":"","url":"https://api.github.com/users/lzamparo","html_url":"https://github.com/lzamparo","followers_url":"https://api.github.com/users/lzamparo/followers","following_url":"https://api.github.com/users/lzamparo/following{/other_user}","gists_url":"https://api.github.com/users/lzamparo/gists{/gist_id}","starred_url":"https://api.github.com/users/lzamparo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lzamparo/subscriptions","organizations_url":"https://api.github.com/users/lzamparo/orgs","repos_url":"https://api.github.com/users/lzamparo/repos","events_url":"https://api.github.com/users/lzamparo/events{/privacy}","received_events_url":"https://api.github.com/users/lzamparo/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":12,"created_at":"2016-03-29T00:00:55Z","updated_at":"2016-03-29T00:18:20Z","closed_at":null,"body":"Hey,\r\n\r\nI've had a job in the active queue that requires a GTX titan device (1 node, 1 core, 1 gtxtitan GPU) enqueued all day.  Running `qstat -f | grep gtxtitan -A10 -B 10 | less` to manually track down which gpu nodes are in use shows 7 of 10 gtxtitan nodes are currently exclusively reserved for jobs in the gpu queue.\r\n\r\nThis should still leave 3 nodes and 12 GTX Titan GPUs for the rest of us, yet `showstart` claims I won't get in until Wednesday at 3am: \r\n$ showstart 7057672\r\njob 7057672 requires 1 proc for 3:00:00\r\n\r\nEstimated Rsv based start in              1:07:10:11 on Wed Mar 30 03:02:11\r\nEstimated Rsv based completion in         1:10:10:11 on Wed Mar 30 06:02:11```\r\n\r\nAre there GTX titan nodes that are not in service?  Or am I just really unlucky now, and of the 11 jobs running in the gpu queue all are using GTX titan nodes?"},"comment":{"url":"https://api.github.com/repos/cBio/cbio-cluster/issues/comments/202638017","html_url":"https://github.com/cBio/cbio-cluster/issues/396#issuecomment-202638017","issue_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/396","id":202638017,"user":{"login":"jchodera","id":3656088,"avatar_url":"https://avatars.githubusercontent.com/u/3656088?v=3","gravatar_id":"","url":"https://api.github.com/users/jchodera","html_url":"https://github.com/jchodera","followers_url":"https://api.github.com/users/jchodera/followers","following_url":"https://api.github.com/users/jchodera/following{/other_user}","gists_url":"https://api.github.com/users/jchodera/gists{/gist_id}","starred_url":"https://api.github.com/users/jchodera/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jchodera/subscriptions","organizations_url":"https://api.github.com/users/jchodera/orgs","repos_url":"https://api.github.com/users/jchodera/repos","events_url":"https://api.github.com/users/jchodera/events{/privacy}","received_events_url":"https://api.github.com/users/jchodera/received_events","type":"User","site_admin":false},"created_at":"2016-03-29T00:18:20Z","updated_at":"2016-03-29T00:18:20Z","body":"Thanks, @tatarsky: Added your suggestions to the [FAQ](https://github.com/cBio/cbio-cluster/wiki/FAQ#why-is-my-job-not-running) since I realized we didn't have `checkjob` up there anywhere."}}