{"action":"created","issue":{"url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/29","repository_url":"https://api.github.com/repos/kubeflow/mpi-operator","labels_url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/29/labels{/name}","comments_url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/29/comments","events_url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/29/events","html_url":"https://github.com/kubeflow/mpi-operator/issues/29","id":350031196,"node_id":"MDU6SXNzdWUzNTAwMzExOTY=","number":29,"title":"slots in hostfile need to be configurable","user":{"login":"cheyang","id":3724388,"node_id":"MDQ6VXNlcjM3MjQzODg=","avatar_url":"https://avatars2.githubusercontent.com/u/3724388?v=4","gravatar_id":"","url":"https://api.github.com/users/cheyang","html_url":"https://github.com/cheyang","followers_url":"https://api.github.com/users/cheyang/followers","following_url":"https://api.github.com/users/cheyang/following{/other_user}","gists_url":"https://api.github.com/users/cheyang/gists{/gist_id}","starred_url":"https://api.github.com/users/cheyang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cheyang/subscriptions","organizations_url":"https://api.github.com/users/cheyang/orgs","repos_url":"https://api.github.com/users/cheyang/repos","events_url":"https://api.github.com/users/cheyang/events{/privacy}","received_events_url":"https://api.github.com/users/cheyang/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"rongou","id":497101,"node_id":"MDQ6VXNlcjQ5NzEwMQ==","avatar_url":"https://avatars3.githubusercontent.com/u/497101?v=4","gravatar_id":"","url":"https://api.github.com/users/rongou","html_url":"https://github.com/rongou","followers_url":"https://api.github.com/users/rongou/followers","following_url":"https://api.github.com/users/rongou/following{/other_user}","gists_url":"https://api.github.com/users/rongou/gists{/gist_id}","starred_url":"https://api.github.com/users/rongou/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rongou/subscriptions","organizations_url":"https://api.github.com/users/rongou/orgs","repos_url":"https://api.github.com/users/rongou/repos","events_url":"https://api.github.com/users/rongou/events{/privacy}","received_events_url":"https://api.github.com/users/rongou/received_events","type":"User","site_admin":false},"assignees":[{"login":"rongou","id":497101,"node_id":"MDQ6VXNlcjQ5NzEwMQ==","avatar_url":"https://avatars3.githubusercontent.com/u/497101?v=4","gravatar_id":"","url":"https://api.github.com/users/rongou","html_url":"https://github.com/rongou","followers_url":"https://api.github.com/users/rongou/followers","following_url":"https://api.github.com/users/rongou/following{/other_user}","gists_url":"https://api.github.com/users/rongou/gists{/gist_id}","starred_url":"https://api.github.com/users/rongou/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rongou/subscriptions","organizations_url":"https://api.github.com/users/rongou/orgs","repos_url":"https://api.github.com/users/rongou/repos","events_url":"https://api.github.com/users/rongou/events{/privacy}","received_events_url":"https://api.github.com/users/rongou/received_events","type":"User","site_admin":false},{"login":"everpeace","id":608782,"node_id":"MDQ6VXNlcjYwODc4Mg==","avatar_url":"https://avatars2.githubusercontent.com/u/608782?v=4","gravatar_id":"","url":"https://api.github.com/users/everpeace","html_url":"https://github.com/everpeace","followers_url":"https://api.github.com/users/everpeace/followers","following_url":"https://api.github.com/users/everpeace/following{/other_user}","gists_url":"https://api.github.com/users/everpeace/gists{/gist_id}","starred_url":"https://api.github.com/users/everpeace/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/everpeace/subscriptions","organizations_url":"https://api.github.com/users/everpeace/orgs","repos_url":"https://api.github.com/users/everpeace/repos","events_url":"https://api.github.com/users/everpeace/events{/privacy}","received_events_url":"https://api.github.com/users/everpeace/received_events","type":"User","site_admin":false}],"milestone":null,"comments":5,"created_at":"2018-08-13T13:32:12Z","updated_at":"2018-08-14T06:00:48Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"The slots of the mpi-operator is not configurable. The current implementation is https://github.com/kubeflow/mpi-operator/blob/master/pkg/controllers/mpi_job_controller.go#L753-#L761.  And the sample output is\r\n\r\n```\r\ncat /etc/mpi/hostfile\r\ncaffe-wd-mpijob-worker-0 slots=8 max_slots=8\r\ncaffe-wd-mpijob-worker-1 slots=8 max_slots=8\r\n```\r\n\r\nPlease check `slots` and `max_slots` in https://www.ibm.com/support/knowledgecenter/en/SSZTET_10.1.0/smpi02/smpi02_host_list.html. I think we may have two choices:\r\n\r\n1. Make slots configurable. Default setting are what we have.\r\n\r\n2. Don't specify `slots` and `max_slots` in hostfile. Just leave it as `slots`  is 1 and `max_slots` as infinite. \r\n\r\n@rongou what's your thought?"},"comment":{"url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/comments/412763371","html_url":"https://github.com/kubeflow/mpi-operator/issues/29#issuecomment-412763371","issue_url":"https://api.github.com/repos/kubeflow/mpi-operator/issues/29","id":412763371,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMjc2MzM3MQ==","user":{"login":"rongou","id":497101,"node_id":"MDQ6VXNlcjQ5NzEwMQ==","avatar_url":"https://avatars3.githubusercontent.com/u/497101?v=4","gravatar_id":"","url":"https://api.github.com/users/rongou","html_url":"https://github.com/rongou","followers_url":"https://api.github.com/users/rongou/followers","following_url":"https://api.github.com/users/rongou/following{/other_user}","gists_url":"https://api.github.com/users/rongou/gists{/gist_id}","starred_url":"https://api.github.com/users/rongou/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rongou/subscriptions","organizations_url":"https://api.github.com/users/rongou/orgs","repos_url":"https://api.github.com/users/rongou/repos","events_url":"https://api.github.com/users/rongou/events{/privacy}","received_events_url":"https://api.github.com/users/rongou/received_events","type":"User","site_admin":false},"created_at":"2018-08-14T06:00:48Z","updated_at":"2018-08-14T06:00:48Z","author_association":"MEMBER","body":"The number of slots need to match the number of GPUs (or CPU cores if we want to support that), and then you can oversubscribe to launch more processes. See https://www.open-mpi.org/faq/?category=running#oversubscribing.\r\n\r\nWe can potentially not specify `max_slots` to allow oversubscribing, but messing with `slots` is not a good idea."}}
{"actor":{"display_login":"rongou"}}