{"action":"created","issue":{"url":"https://api.github.com/repos/adaptivecomputing/torque/issues/341","repository_url":"https://api.github.com/repos/adaptivecomputing/torque","labels_url":"https://api.github.com/repos/adaptivecomputing/torque/issues/341/labels{/name}","comments_url":"https://api.github.com/repos/adaptivecomputing/torque/issues/341/comments","events_url":"https://api.github.com/repos/adaptivecomputing/torque/issues/341/events","html_url":"https://github.com/adaptivecomputing/torque/issues/341","id":118036169,"number":341,"title":"failed to create cgroups ","user":{"login":"wpoely86","id":424570,"avatar_url":"https://avatars.githubusercontent.com/u/424570?v=3","gravatar_id":"","url":"https://api.github.com/users/wpoely86","html_url":"https://github.com/wpoely86","followers_url":"https://api.github.com/users/wpoely86/followers","following_url":"https://api.github.com/users/wpoely86/following{/other_user}","gists_url":"https://api.github.com/users/wpoely86/gists{/gist_id}","starred_url":"https://api.github.com/users/wpoely86/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wpoely86/subscriptions","organizations_url":"https://api.github.com/users/wpoely86/orgs","repos_url":"https://api.github.com/users/wpoely86/repos","events_url":"https://api.github.com/users/wpoely86/events{/privacy}","received_events_url":"https://api.github.com/users/wpoely86/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2015-11-20T12:54:24Z","updated_at":"2016-06-24T11:05:34Z","closed_at":null,"body":"We have an issue with the cgroup creation. This was done on 37ae8750b2e\r\nThe jobscript is\r\n```bash\r\n#!/bin/bash\r\n\r\n#PBS -q long\r\n#PBS -l walltime=11:59:00\r\n#PBS -l nodes=4:ppn=1\r\n\r\nsleep 72h\r\n```\r\nThe job will start but return immediately with code -3 (`JOB_EXEC_RETRY`) and will keep on retrying. This is caused by a failure to create the cgroups. In the node logs we find:\r\n```\r\n11/20/2015 12:07:14.472;01;   pbs_mom.1480;Svr;pbs_mom;LOG_DEBUG::init_groups, pre-sigprocmask\r\n11/20/2015 12:07:14.473;01;   pbs_mom.1480;Svr;pbs_mom;LOG_DEBUG::init_groups, post-initgroups\r\n11/20/2015 12:07:14.476;01;   pbs_mom.1480;Svr;pbs_mom;LOG_ERROR::trq_cg_create_task_cgroups, Failed to get allocation for task_index 2: error 15004\r\n11/20/2015 12:07:14.476;01;   pbs_mom.1480;Svr;pbs_mom;LOG_ERROR::trq_cg_create_cgroup, failed to create task cgroups: 15004\r\n```\r\nWe can find this error in all nodes that are used for the job. The OS is CentOS 7. A single node job works without issue.\r\n\r\ncc @stdweird "},"comment":{"url":"https://api.github.com/repos/adaptivecomputing/torque/issues/comments/228318242","html_url":"https://github.com/adaptivecomputing/torque/issues/341#issuecomment-228318242","issue_url":"https://api.github.com/repos/adaptivecomputing/torque/issues/341","id":228318242,"user":{"login":"itkovian","id":196619,"avatar_url":"https://avatars.githubusercontent.com/u/196619?v=3","gravatar_id":"","url":"https://api.github.com/users/itkovian","html_url":"https://github.com/itkovian","followers_url":"https://api.github.com/users/itkovian/followers","following_url":"https://api.github.com/users/itkovian/following{/other_user}","gists_url":"https://api.github.com/users/itkovian/gists{/gist_id}","starred_url":"https://api.github.com/users/itkovian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/itkovian/subscriptions","organizations_url":"https://api.github.com/users/itkovian/orgs","repos_url":"https://api.github.com/users/itkovian/repos","events_url":"https://api.github.com/users/itkovian/events{/privacy}","received_events_url":"https://api.github.com/users/itkovian/received_events","type":"User","site_admin":false},"created_at":"2016-06-24T11:05:34Z","updated_at":"2016-06-24T11:05:34Z","body":"See #372, both memory.memsw.limit_in_bytes and memory.limit_in_bytes are set to the expected value under legacy_vmem=true using #378."}}
{"actor":{"display_login":"itkovian"}}