{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/27513","repository_url":"https://api.github.com/repos/docker/docker","labels_url":"https://api.github.com/repos/docker/docker/issues/27513/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/27513/comments","events_url":"https://api.github.com/repos/docker/docker/issues/27513/events","html_url":"https://github.com/docker/docker/issues/27513","id":183811017,"number":27513,"title":"network XYZ not found | Swarm 1.12.2","user":{"login":"pascalandy","id":6694151,"avatar_url":"https://avatars.githubusercontent.com/u/6694151?v=3","gravatar_id":"","url":"https://api.github.com/users/pascalandy","html_url":"https://github.com/pascalandy","followers_url":"https://api.github.com/users/pascalandy/followers","following_url":"https://api.github.com/users/pascalandy/following{/other_user}","gists_url":"https://api.github.com/users/pascalandy/gists{/gist_id}","starred_url":"https://api.github.com/users/pascalandy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pascalandy/subscriptions","organizations_url":"https://api.github.com/users/pascalandy/orgs","repos_url":"https://api.github.com/users/pascalandy/repos","events_url":"https://api.github.com/users/pascalandy/events{/privacy}","received_events_url":"https://api.github.com/users/pascalandy/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/docker/docker/labels/area/networking","name":"area/networking","color":"fbca04"},{"url":"https://api.github.com/repos/docker/docker/labels/area/swarm","name":"area/swarm","color":"fbca04"},{"url":"https://api.github.com/repos/docker/docker/labels/kind/bug","name":"kind/bug","color":"FF8C94"},{"url":"https://api.github.com/repos/docker/docker/labels/version/1.12","name":"version/1.12","color":"ededed"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-10-18T21:42:53Z","updated_at":"2016-10-19T18:12:14Z","closed_at":null,"body":"### Description\r\n\r\nOverlay network randomly disappear. I had the network `sql_net` for 5 days now and I start to get this error. `\"network sql_net not found\"`\r\n\r\nI deleted it and tried with a different name ... Same story. I had the same issue with previous Swarm setup as well.\r\n\r\n### Steps to reproduce the issue:\r\n\r\n```\r\ndocker network create --driver overlay percona_net\r\n\r\ndocker service create \\\r\n\t--name $CTN_NAME \\\r\n\t--constraint node.labels.type==db \\\r\n\t--mount\ttype=bind,src=/var/lib/mysql,dst=/var/lib/mysql \\\r\n\t--network percona_net \\\r\n\t--publish 3306 \\\r\n\t--restart-condition any \\\r\n\t-e MYSQL_ROOT_PASSWORD=$MYSQL_ROOT_PASSWORD \\\r\n\t-e MYSQL_DATABASE=$MYSQL_DATABASE \\\r\n\t-e MYSQL_USER=$MYSQL_USER \\\r\n\t-e MYSQL_PASSWORD=$MYSQL_PASSWORD \\\r\n\t$ENV_DOCKER_IMAGE\r\n```\r\n\r\n### Describe the results you received:**\r\n\r\n```\r\nroot@swm-aa:~/deploy-setup# docker network ls\r\nNETWORK ID          NAME                DRIVER              SCOPE\r\ne87ba909e780        bridge              bridge              local\r\nc8f22dde7607        docker_gwbridge     bridge              local\r\necr8r7o8y7n4        front101            overlay             swarm\r\n235f5fda0270        host                host                local\r\n5yq6mrg8sqv5        ingress             overlay             swarm\r\n5g7vkq8oey5m        logentries_net      overlay             swarm\r\n1ba2ae3618c8        none                null                local\r\n5l4a1lze8r8i        percona_net         overlay             swarm\r\n590obyq253of        router-management   overlay             swarm\r\ndhtu1p5vg7dg        sema_net            overlay             swarm\r\n```\r\n\r\n```\r\ndocker service ps percona\r\n\r\nID                         NAME           IMAGE           NODE    DESIRED STATE  CURRENT STATE            ERROR\r\n1ghc5lowz5oerpuo4d40m3epn  percona.1      percona:5.7.14  swm-db  Ready          Rejected 1 seconds ago   \"network percona_net not found\"\r\nb87zzyet9h8p7su8jjm3slrfh   \\_ percona.1  percona:5.7.14  swm-db  Shutdown       Rejected 6 seconds ago   \"network percona_net not found\"\r\nc068bbeuxyghza57fljygmcm2   \\_ percona.1  percona:5.7.14  swm-db  Shutdown       Rejected 11 seconds ago  \"network percona_net not found\"\r\n6h9idsch7kgbcstvgqq96m0uo   \\_ percona.1  percona:5.7.14  swm-db  Shutdown       Rejected 16 seconds ago  \"network percona_net not found\"\r\n9ouq0e9lfs904yn4ngb5ctrtl   \\_ percona.1  percona:5.7.14  swm-db  Shutdown       Rejected 21 seconds ago  \"network percona_net not found\"\r\n\r\n```\r\n\r\n### Describe the results you expected:**\r\ncommon sense\r\n\r\n### Additional information you deem important (e.g. issue happens only occasionally):**\r\nIt's random\r\n\r\n### Output of `docker version`:**\r\n\r\n```\r\nroot@swm-aa:~/deploy-setup# docker version\r\nClient:\r\n Version:      1.12.2\r\n API version:  1.24\r\n Go version:   go1.6.3\r\n Git commit:   bb80604\r\n Built:        Tue Oct 11 18:29:41 2016\r\n OS/Arch:      linux/amd64\r\n\r\nServer:\r\n Version:      1.12.2\r\n API version:  1.24\r\n Go version:   go1.6.3\r\n Git commit:   bb80604\r\n Built:        Tue Oct 11 18:29:41 2016\r\n OS/Arch:      linux/amd64\r\n```\r\n\r\n## Output of `docker info`:**\r\n\r\n```\r\nroot@swm-aa:~/deploy-setup# docker info\r\nContainers: 12\r\n Running: 4\r\n Paused: 0\r\n Stopped: 8\r\nImages: 10\r\nServer Version: 1.12.2\r\nStorage Driver: devicemapper\r\n Pool Name: docker-253:1-1047149-pool\r\n Pool Blocksize: 65.54 kB\r\n Base Device Size: 10.74 GB\r\n Backing Filesystem: xfs\r\n Data file: /dev/loop0\r\n Metadata file: /dev/loop1\r\n Data Space Used: 2.266 GB\r\n Data Space Total: 107.4 GB\r\n Data Space Available: 14.97 GB\r\n Metadata Space Used: 3.854 MB\r\n Metadata Space Total: 2.147 GB\r\n Metadata Space Available: 2.144 GB\r\n Thin Pool Minimum Free Space: 10.74 GB\r\n Udev Sync Supported: true\r\n Deferred Removal Enabled: false\r\n Deferred Deletion Enabled: false\r\n Deferred Deleted Device Count: 0\r\n Data loop file: /var/lib/docker/devicemapper/devicemapper/data\r\n WARNING: Usage of loopback devices is strongly discouraged for production use. Use `--storage-opt dm.thinpooldev` to specify a custom block storage device.\r\n Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata\r\n Library Version: 1.02.110 (2015-10-30)\r\nLogging Driver: json-file\r\nCgroup Driver: cgroupfs\r\nPlugins:\r\n Volume: local\r\n Network: overlay null host bridge\r\nSwarm: active\r\n NodeID: 3btni1tzvoyjwufyqbiea45hq\r\n Is Manager: true\r\n ClusterID: ey0d2zl6oydps6c4qntzb06v1\r\n Managers: 1\r\n Nodes: 5\r\n Orchestration:\r\n  Task History Retention Limit: 5\r\n Raft:\r\n  Snapshot Interval: 10000\r\n  Heartbeat Tick: 1\r\n  Election Tick: 3\r\n Dispatcher:\r\n  Heartbeat Period: 5 seconds\r\n CA Configuration:\r\n  Expiry Duration: 3 months\r\n Node Address: 123.123.123.123\r\nRuntimes: runc\r\nDefault Runtime: runc\r\nSecurity Options: apparmor seccomp\r\nKernel Version: 4.4.0-42-generic\r\nOperating System: Ubuntu 16.04.1 LTS\r\nOSType: linux\r\nArchitecture: x86_64\r\nCPUs: 1\r\nTotal Memory: 488.5 MiB\r\nName: swm-aa\r\nID: WPYK:WT4B:FCSO:WPYU:6N67:MCB7:XTSQ:6DOS:3MN4:I4WU:OW6N:RPZM\r\nDocker Root Dir: /var/lib/docker\r\nDebug Mode (client): false\r\nDebug Mode (server): false\r\nRegistry: https://index.docker.io/v1/\r\nWARNING: No swap limit support\r\nInsecure Registries:\r\n 127.0.0.0/8\r\n```\r\n\r\n## Output of `Docker Bench for Security v1.1.0`:**\r\n\r\n```\r\n[INFO] 1 - Host Configuration\r\n[WARN] 1.1  - Create a separate partition for containers\r\n[PASS] 1.2  - Use an updated Linux Kernel\r\n[WARN] 1.4  - Remove all non-essential services from the host - Network\r\n[WARN]      * Host listening on: 6 ports\r\n[PASS] 1.5  - Keep Docker up to date\r\n[INFO]       * Using 1.12.2 which is current as of 2016-10-06\r\n[INFO]       * Check with your operating system vendor for support and security maintenance for docker\r\n[INFO] 1.6  - Only allow trusted users to control Docker daemon\r\n[INFO]      * docker:x:999\r\n[WARN] 1.7  - Failed to inspect: auditctl command not found.\r\n[WARN] 1.8  - Failed to inspect: auditctl command not found.\r\n[WARN] 1.9  - Failed to inspect: auditctl command not found.\r\n[INFO] 1.10 - Audit Docker files and directories - docker.service\r\n[INFO]      * File not found\r\n[INFO] 1.11 - Audit Docker files and directories - docker.socket\r\n[INFO]      * File not found\r\n[WARN] 1.12 - Failed to inspect: auditctl command not found.\r\n[INFO] 1.13 - Audit Docker files and directories - /etc/docker/daemon.json\r\n[INFO]      * File not found\r\n[INFO] 1.14 - Audit Docker files and directories - /usr/bin/docker-containerd\r\n[INFO]      * File not found\r\n[INFO] 1.15 - Audit Docker files and directories - /usr/bin/docker-runc\r\n[INFO]      * File not found\r\n\r\n\r\n[INFO] 2 - Docker Daemon Configuration\r\n[WARN] 2.1  - Restrict network traffic between containers\r\n[WARN] 2.2  - Set the logging level\r\n[PASS] 2.3  - Allow Docker to make changes to iptables\r\n[PASS] 2.4  - Do not use insecure registries\r\n[PASS] 2.5  - Do not use the aufs storage driver\r\n[INFO] 2.6  - Configure TLS authentication for Docker daemon\r\n[INFO]      * Docker daemon not listening on TCP\r\n[INFO] 2.7 - Set default ulimit as appropriate\r\n[INFO]      * Default ulimit doesn't appear to be set\r\n[WARN] 2.8  - Enable user namespace support\r\n[PASS] 2.9  - Confirm default cgroup usage\r\n[PASS] 2.10 - Do not change base device size until needed\r\n[WARN] 2.11 - Use authorization plugin\r\n[WARN] 2.12 - Configure centralized and remote logging\r\n[WARN] 2.13 - Disable operations on legacy registry (v1)\r\n\r\n\r\n[INFO] 3 - Docker Daemon Configuration Files\r\n[INFO] 3.1  - Verify that docker.service file ownership is set to root:root\r\n[INFO]      * File not found\r\n[INFO] 3.2  - Verify that docker.service file permissions are set to 644\r\n[INFO]      * File not found\r\n[INFO] 3.3  - Verify that docker.socket file ownership is set to root:root\r\n[INFO]      * File not found\r\n[INFO] 3.4  - Verify that docker.socket file permissions are set to 644\r\n[INFO]      * File not found\r\n[PASS] 3.5  - Verify that /etc/docker directory ownership is set to root:root\r\n[PASS] 3.6  - Verify that /etc/docker directory permissions are set to 755\r\n[INFO] 3.7  - Verify that registry certificate file ownership is set to root:root\r\n[INFO]      * Directory not found\r\n[INFO] 3.8  - Verify that registry certificate file permissions are set to 444\r\n[INFO]      * Directory not found\r\n[INFO] 3.9  - Verify that TLS CA certificate file ownership is set to root:root\r\n[INFO]      * No TLS CA certificate found\r\n[INFO] 3.10 - Verify that TLS CA certificate file permissions are set to 444\r\n[INFO]      * No TLS CA certificate found\r\n[INFO] 3.11 - Verify that Docker server certificate file ownership is set to root:root\r\n[INFO]      * No TLS Server certificate found\r\n[INFO] 3.12 - Verify that Docker server certificate file permissions are set to 444\r\n[INFO]      * No TLS Server certificate found\r\n[INFO] 3.13 - Verify that Docker server key file ownership is set to root:root\r\n[INFO]      * No TLS Key found\r\n[INFO] 3.14 - Verify that Docker server key file permissions are set to 400\r\n[INFO]      * No TLS Key found\r\n[PASS] 3.15 - Verify that Docker socket file ownership is set to root:docker\r\n[PASS] 3.16 - Verify that Docker socket file permissions are set to 660\r\n[INFO] 3.17 - Verify that daemon.json file ownership is set to root:root\r\n[INFO]      * File not found\r\n[INFO] 3.18 - Verify that daemon.json file permissions are set to 644\r\n[INFO]      * File not found\r\n[PASS] 3.19 - Verify that /etc/default/docker file ownership is set to root:root\r\n[PASS] 3.20 - Verify that /etc/default/docker file permissions are set to 644\r\n\r\n\r\n[INFO] 4 - Container Images and Build Files\r\n[WARN] 4.1  - Create a user for the container\r\n[WARN]      * Running as root: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * Running as root: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * Running as root: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * Running as root: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[WARN] 4.5  - Enable Content trust for Docker\r\n\r\n\r\n[INFO] 5  - Container Runtime\r\n[WARN] 5.1  - Verify AppArmor Profile, if applicable\r\n[WARN]      * No AppArmorProfile Found: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * No AppArmorProfile Found: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * No AppArmorProfile Found: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * No AppArmorProfile Found: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[WARN] 5.2  - Verify SELinux security options, if applicable\r\n[WARN]      * No SecurityOptions Found: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * No SecurityOptions Found: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * No SecurityOptions Found: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * No SecurityOptions Found: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[PASS] 5.3  - Restrict Linux Kernel Capabilities within containers\r\n[PASS] 5.4  - Do not use privileged containers\r\n[PASS] 5.5  - Do not mount sensitive host system directories on containers\r\n[PASS] 5.6  - Do not run ssh within containers\r\n[PASS] 5.7  - Do not map privileged ports within containers\r\n[PASS] 5.9 - Do not share the host's network namespace\r\n[WARN] 5.10 - Limit memory usage for container\r\n[WARN]      * Container running without memory restrictions: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * Container running without memory restrictions: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * Container running without memory restrictions: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * Container running without memory restrictions: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[WARN] 5.11 - Set container CPU priority appropriately\r\n[WARN]      * Container running without CPU restrictions: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * Container running without CPU restrictions: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * Container running without CPU restrictions: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * Container running without CPU restrictions: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[WARN] 5.12 - Mount container's root filesystem as read only\r\n[WARN]      * Container running with root FS mounted R/W: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * Container running with root FS mounted R/W: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * Container running with root FS mounted R/W: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * Container running with root FS mounted R/W: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[PASS] 5.13 - Bind incoming container traffic to a specific host interface\r\n[WARN] 5.14 - Set the 'on-failure' container restart policy to 5\r\n[WARN]      * MaximumRetryCount is not set to 5: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * MaximumRetryCount is not set to 5: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * MaximumRetryCount is not set to 5: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * MaximumRetryCount is not set to 5: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[PASS] 5.15 - Do not share the host's process namespace\r\n[PASS] 5.16 - Do not share the host's IPC namespace\r\n[PASS] 5.17 - Do not directly expose host devices to containers\r\n[INFO] 5.18 - Override default ulimit at runtime only if needed\r\n[INFO]      * Container no default ulimit override: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[INFO]      * Container no default ulimit override: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[INFO]      * Container no default ulimit override: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[INFO]      * Container no default ulimit override: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n[PASS] 5.19 - Do not set mount propagation mode to shared\r\n[PASS] 5.20 - Do not share the host's UTS namespace\r\n[PASS] 5.21 - Do not disable default seccomp profile\r\n[PASS] 5.24 - Confirm cgroup usage\r\n[WARN] 5.25 - Restrict container from acquiring additional privileges\r\n[WARN]      * Privileges not restricted: logentries.0.ev84fq8gswjb7zy8s1mama5ah\r\n[WARN]      * Privileges not restricted: router.0.3auya7kd42o0vhv9s4ms07lcc\r\n[WARN]      * Privileges not restricted: router-backend.1.3aslakd616evw0aw80o222fm7\r\n[WARN]      * Privileges not restricted: router-storage.1.4l2csgqh4opyn6hoq2nnb6sbr\r\n\r\n\r\n[INFO] 6  - Docker Security Operations\r\n[INFO] 6.4 - Avoid image sprawl\r\n[INFO]      * There are currently: 11 images\r\n[INFO] 6.5 - Avoid container sprawl\r\n[INFO]      * There are currently a total of 13 containers, with 5 of them currently running\r\n```\r\n\r\n### Cluster setup\r\n\r\n5 nodes (1 manager, 4 nodes)\r\n\r\nThose labels are applied:\r\n```\r\n\tdocker node update --label-add region=do_nyc3 swm-aa\r\n\tdocker node update --label-add type=elected swm-aa\r\n\tdocker node update --label-add ram=512m swm-aa\r\n\t\r\n\tdocker node update --label-add region=do_nyc3 swm-db\r\n\tdocker node update --label-add type=db swm-db\r\n\tdocker node update --label-add ram=1g swm-db\r\n\t\r\n\tdocker node update --label-add region=do_nyc3 swm-01\r\n\tdocker node update --label-add type=apps swm-01\r\n\tdocker node update --label-add ram=512m swm-01\r\n\t\r\n\tdocker node update --label-add region=do_nyc3 swm-02\r\n\tdocker node update --label-add type=apps swm-02\r\n\tdocker node update --label-add ram=512m swm-02\r\n\t\r\n\tdocker node update --label-add region=do_nyc3 swm-03\r\n\tdocker node update --label-add type=apps swm-03\r\n\tdocker node update --label-add ram=512m swm-03\r\n```\r\n\r\n### Datacenter\r\n\r\nDigital Ocean\r\nUbuntu 16.04\r\n\r\n### "},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/254895468","html_url":"https://github.com/docker/docker/issues/27513#issuecomment-254895468","issue_url":"https://api.github.com/repos/docker/docker/issues/27513","id":254895468,"user":{"login":"pascalandy","id":6694151,"avatar_url":"https://avatars.githubusercontent.com/u/6694151?v=3","gravatar_id":"","url":"https://api.github.com/users/pascalandy","html_url":"https://github.com/pascalandy","followers_url":"https://api.github.com/users/pascalandy/followers","following_url":"https://api.github.com/users/pascalandy/following{/other_user}","gists_url":"https://api.github.com/users/pascalandy/gists{/gist_id}","starred_url":"https://api.github.com/users/pascalandy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pascalandy/subscriptions","organizations_url":"https://api.github.com/users/pascalandy/orgs","repos_url":"https://api.github.com/users/pascalandy/repos","events_url":"https://api.github.com/users/pascalandy/events{/privacy}","received_events_url":"https://api.github.com/users/pascalandy/received_events","type":"User","site_admin":false},"created_at":"2016-10-19T18:12:14Z","updated_at":"2016-10-19T18:12:14Z","body":"Arrgh .. I scrapped and restarted my cluster because of this. Please keep this open. I'll document if I see this issue again. Cheers!"}}
{"actor":{"display_login":"pascalandy"}}