{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/24637","repository_url":"https://api.github.com/repos/docker/docker","labels_url":"https://api.github.com/repos/docker/docker/issues/24637/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/24637/comments","events_url":"https://api.github.com/repos/docker/docker/issues/24637/events","html_url":"https://github.com/docker/docker/issues/24637","id":165575397,"number":24637,"title":"Cannot start Apache Spark on multi-host in Swarm mode","user":{"login":"chanwit","id":10666,"avatar_url":"https://avatars.githubusercontent.com/u/10666?v=3","gravatar_id":"","url":"https://api.github.com/users/chanwit","html_url":"https://github.com/chanwit","followers_url":"https://api.github.com/users/chanwit/followers","following_url":"https://api.github.com/users/chanwit/following{/other_user}","gists_url":"https://api.github.com/users/chanwit/gists{/gist_id}","starred_url":"https://api.github.com/users/chanwit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chanwit/subscriptions","organizations_url":"https://api.github.com/users/chanwit/orgs","repos_url":"https://api.github.com/users/chanwit/repos","events_url":"https://api.github.com/users/chanwit/events{/privacy}","received_events_url":"https://api.github.com/users/chanwit/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/docker/docker/labels/area/swarm","name":"area/swarm","color":"fbca04"},{"url":"https://api.github.com/repos/docker/docker/labels/group/networking","name":"group/networking","color":"F6FBFF"},{"url":"https://api.github.com/repos/docker/docker/labels/priority/P3","name":"priority/P3","color":"fef2c0"},{"url":"https://api.github.com/repos/docker/docker/labels/version/1.12","name":"version/1.12","color":"ededed"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/docker/docker/milestones/53","html_url":"https://github.com/docker/docker/milestones/1.12.0","labels_url":"https://api.github.com/repos/docker/docker/milestones/53/labels","id":1657301,"number":53,"title":"1.12.0","description":"feature/code freeze: June 14th, 2016","creator":{"login":"thaJeztah","id":1804568,"avatar_url":"https://avatars.githubusercontent.com/u/1804568?v=3","gravatar_id":"","url":"https://api.github.com/users/thaJeztah","html_url":"https://github.com/thaJeztah","followers_url":"https://api.github.com/users/thaJeztah/followers","following_url":"https://api.github.com/users/thaJeztah/following{/other_user}","gists_url":"https://api.github.com/users/thaJeztah/gists{/gist_id}","starred_url":"https://api.github.com/users/thaJeztah/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thaJeztah/subscriptions","organizations_url":"https://api.github.com/users/thaJeztah/orgs","repos_url":"https://api.github.com/users/thaJeztah/repos","events_url":"https://api.github.com/users/thaJeztah/events{/privacy}","received_events_url":"https://api.github.com/users/thaJeztah/received_events","type":"User","site_admin":false},"open_issues":132,"closed_issues":636,"state":"open","created_at":"2016-03-21T13:47:53Z","updated_at":"2016-07-14T17:43:21Z","due_on":"2016-07-28T07:00:00Z","closed_at":null},"comments":8,"created_at":"2016-07-14T14:28:38Z","updated_at":"2016-07-14T17:54:27Z","closed_at":null,"body":"I simply cannot schedule instances of Apache Spark over the multi-host network in Swarm mode.\r\n\r\n**Output of `docker version`:**\r\n\r\n```\r\nClient:\r\n Version:      1.12.0-rc4\r\n API version:  1.24\r\n Go version:   go1.6.2\r\n Git commit:   e4a0dbc\r\n Built:        Wed Jul 13 04:15:13 2016\r\n OS/Arch:      linux/amd64\r\n Experimental: true\r\n\r\nServer:\r\n Version:      1.12.0-rc4\r\n API version:  1.24\r\n Go version:   go1.6.2\r\n Git commit:   e4a0dbc\r\n Built:        Wed Jul 13 04:15:13 2016\r\n OS/Arch:      linux/amd64\r\n Experimental: true\r\n```\r\n\r\n\r\n**Output of `docker info`:**\r\n\r\n```\r\nContainers: 3\r\n Running: 3\r\n Paused: 0\r\n Stopped: 0\r\nImages: 1\r\nServer Version: 1.12.0-rc4\r\nStorage Driver: aufs\r\n Root Dir: /var/lib/docker/aufs\r\n Backing Filesystem: extfs\r\n Dirs: 12\r\n Dirperm1 Supported: true\r\nLogging Driver: json-file\r\nCgroup Driver: cgroupfs\r\nPlugins:\r\n Volume: local\r\n Network: host bridge overlay null\r\nSwarm: active\r\n NodeID: 452huztay9dzxtehh50mzgf9o\r\n IsManager: Yes\r\n Managers: 1\r\n Nodes: 2\r\n CACertHash: sha256:2445358bb26a09d3b7cf67e0324b187fc6c0c4f71f0ae1413bd7b0838b26594f\r\nRuntimes: runc\r\nDefault Runtime: runc\r\nSecurity Options: apparmor seccomp\r\nKernel Version: 4.4.0-28-generic\r\nOperating System: Ubuntu 16.04 LTS\r\nOSType: linux\r\nArchitecture: x86_64\r\nCPUs: 4\r\nTotal Memory: 7.797 GiB\r\nName: master\r\nID: QEVB:ADKU:BJFR:U7PB:NG2T:SBQH:B5NN:ZTNT:BLED:PE57:OY32:NXZQ\r\nDocker Root Dir: /var/lib/docker\r\nDebug Mode (client): false\r\nDebug Mode (server): false\r\nRegistry: https://index.docker.io/v1/\r\nExperimental: true\r\nInsecure Registries:\r\n 127.0.0.0/8\r\nWARNING: No swap limit support\r\n```\r\n\r\n**Additional environment details (AWS, VirtualBox, physical, etc.):**\r\nDigitalOcean\r\n\r\n\r\n**Steps to reproduce the issue:**\r\n1. Create 2 nodes `master` and `node1`. Do `docker swarm init` & `docker swarm join`\r\n2. Create an overlay network, in my case: `docker network create --driver overlay spark`\r\n3. Run `docker service create --name master --network spark gettyimages/spark:1.6.2-hadoop-2.6 bin/spark-class org.apache.spark.deploy.master.Master`\r\n4. Run `docker service create --name worker --network spark gettyimages/spark:1.6.2-hadoop-2.6 bin/spark-class org.apache.spark.deploy.worker.Worker spark://master:7077`\r\n5. Scale worker to 2. You'll see it's trying to schedule a container on `node1` then failed and all 2 workers will be on master.\r\n\r\n**Describe the results you received:**\r\nApache Spark instances were scheduled only on master nodes.\r\n\r\n**Describe the results you expected:**\r\nApache Spark instances should be scheduled on both master and node1.\r\nIt is likely that containers on `node1` cannot resolve name `master` or cannot connect to the `master` IP correctly.\r\n\r\ncc @mavenugo "},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/232741569","html_url":"https://github.com/docker/docker/issues/24637#issuecomment-232741569","issue_url":"https://api.github.com/repos/docker/docker/issues/24637","id":232741569,"user":{"login":"mavenugo","id":5056191,"avatar_url":"https://avatars.githubusercontent.com/u/5056191?v=3","gravatar_id":"","url":"https://api.github.com/users/mavenugo","html_url":"https://github.com/mavenugo","followers_url":"https://api.github.com/users/mavenugo/followers","following_url":"https://api.github.com/users/mavenugo/following{/other_user}","gists_url":"https://api.github.com/users/mavenugo/gists{/gist_id}","starred_url":"https://api.github.com/users/mavenugo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mavenugo/subscriptions","organizations_url":"https://api.github.com/users/mavenugo/orgs","repos_url":"https://api.github.com/users/mavenugo/repos","events_url":"https://api.github.com/users/mavenugo/events{/privacy}","received_events_url":"https://api.github.com/users/mavenugo/received_events","type":"User","site_admin":false},"created_at":"2016-07-14T17:54:27Z","updated_at":"2016-07-14T17:54:27Z","body":"@chanwit can you please update the actual command that you are using in the description ?\r\nI dont see `-p x:y` in the description and hence it was not clear if you are using the ingress network or not. Also, are you publishing the port only on `master` service or also the `worker` service ?\r\nIf it is only on the `master` service, then the `worker` should NOT be part of the `ingress` network. If you have `worker` also exposing the service, should it ?\r\n\r\nAlso, as I requested before, pls get me the outputs of all the commands + `docker network inspect ingress`"}}
{"actor":{"display_login":"mavenugo"}}