{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/21555","repository_url":"https://api.github.com/repos/docker/docker","labels_url":"https://api.github.com/repos/docker/docker/issues/21555/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/21555/comments","events_url":"https://api.github.com/repos/docker/docker/issues/21555/events","html_url":"https://github.com/docker/docker/issues/21555","id":143792245,"number":21555,"title":"Image layer contents are unstable","user":{"login":"RomanSaveljev","id":2023288,"avatar_url":"https://avatars.githubusercontent.com/u/2023288?v=3","gravatar_id":"","url":"https://api.github.com/users/RomanSaveljev","html_url":"https://github.com/RomanSaveljev","followers_url":"https://api.github.com/users/RomanSaveljev/followers","following_url":"https://api.github.com/users/RomanSaveljev/following{/other_user}","gists_url":"https://api.github.com/users/RomanSaveljev/gists{/gist_id}","starred_url":"https://api.github.com/users/RomanSaveljev/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/RomanSaveljev/subscriptions","organizations_url":"https://api.github.com/users/RomanSaveljev/orgs","repos_url":"https://api.github.com/users/RomanSaveljev/repos","events_url":"https://api.github.com/users/RomanSaveljev/events{/privacy}","received_events_url":"https://api.github.com/users/RomanSaveljev/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/docker/docker/milestones/49","html_url":"https://github.com/docker/docker/milestones/1.11.0","labels_url":"https://api.github.com/repos/docker/docker/milestones/49/labels","id":1529231,"number":49,"title":"1.11.0","description":"Code freeze / feature freeze 22 March 2016\r\nPlanned release: 12 April 2016\r\n\r\nhttps://github.com/docker/docker/wiki/Engine-1.11.0","creator":{"login":"thaJeztah","id":1804568,"avatar_url":"https://avatars.githubusercontent.com/u/1804568?v=3","gravatar_id":"","url":"https://api.github.com/users/thaJeztah","html_url":"https://github.com/thaJeztah","followers_url":"https://api.github.com/users/thaJeztah/followers","following_url":"https://api.github.com/users/thaJeztah/following{/other_user}","gists_url":"https://api.github.com/users/thaJeztah/gists{/gist_id}","starred_url":"https://api.github.com/users/thaJeztah/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thaJeztah/subscriptions","organizations_url":"https://api.github.com/users/thaJeztah/orgs","repos_url":"https://api.github.com/users/thaJeztah/repos","events_url":"https://api.github.com/users/thaJeztah/events{/privacy}","received_events_url":"https://api.github.com/users/thaJeztah/received_events","type":"User","site_admin":false},"open_issues":18,"closed_issues":177,"state":"open","created_at":"2016-01-21T01:33:46Z","updated_at":"2016-03-29T02:25:22Z","due_on":"2016-04-12T07:00:00Z","closed_at":null},"comments":5,"created_at":"2016-03-27T09:40:06Z","updated_at":"2016-03-29T04:02:08Z","closed_at":null,"body":"<!--\r\nIf you are reporting a new issue, make sure that we do not have any duplicates\r\nalready open. You can ensure this by searching the issue list for this\r\nrepository. If there is a duplicate, please close your issue and add a comment\r\nto the existing issue instead.\r\n\r\nIf you suspect your issue is a bug, please edit your issue description to\r\ninclude the BUG REPORT INFORMATION shown below. If you fail to provide this\r\ninformation within 7 days, we cannot debug your issue and will close it. We\r\nwill, however, reopen it if you later provide the information.\r\n\r\nFor more information about reporting issues, see\r\nhttps://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues\r\n\r\n---------------------------------------------------\r\nBUG REPORT INFORMATION\r\n---------------------------------------------------\r\nUse the commands below to provide key information from your environment:\r\nYou do NOT have to include this information if this is a FEATURE REQUEST\r\n-->\r\n\r\n**Output of `docker version`:**\r\n\r\n```\r\nClient:\r\n Version:      1.10.3\r\n API version:  1.22\r\n Go version:   go1.5.3\r\n Git commit:   20f81dd\r\n Built:        Sat Mar 12 19:18:57 2016\r\n OS/Arch:      linux/amd64\r\n\r\nServer:\r\n Version:      1.10.3\r\n API version:  1.22\r\n Go version:   go1.5.3\r\n Git commit:   20f81dd\r\n Built:        Sat Mar 12 19:18:57 2016\r\n OS/Arch:      linux/amd64\r\n```\r\n\r\n\r\n**Output of `docker info`:**\r\n\r\n```\r\nContainers: 0\r\n Running: 0\r\n Paused: 0\r\n Stopped: 0\r\nImages: 34\r\nServer Version: 1.10.3\r\nStorage Driver: overlay\r\n Backing Filesystem: extfs\r\nExecution Driver: native-0.2\r\nLogging Driver: json-file\r\nPlugins: \r\n Volume: local\r\n Network: host bridge null\r\nKernel Version: 4.4.5-1-ARCH\r\nOperating System: Arch Linux\r\nOSType: linux\r\nArchitecture: x86_64\r\nCPUs: 4\r\nTotal Memory: 7.533 GiB\r\nName: arch-t530\r\nID: 4JN7:HILV:O7E4:VSQX:6T67:BSMT:GQEA:G27K:67TD:UIAF:ZRO5:QUBQ\r\nUsername: romansaveljev\r\nRegistry: https://index.docker.io/v1/\r\n```\r\n\r\n**Additional environment details (AWS, VirtualBox, physical, etc.):**\r\n\r\n* physical\r\n* Additional files are in https://gist.github.com/RomanSaveljev/55b81155531803d68c52\r\n\r\n**Steps to reproduce the issue:**\r\n1. Grab `file-missing.bats` from the gist (see above for the link)\r\n2. Install [bats](https://github.com/sstephenson/bats) (I had it through npm)\r\n3. `yes test/file-missing.bats | head -n 100 | xargs node_modules/.bin/bats | tee test.log`\r\n4. Study the log\r\n\r\n**Describe the results you received:**\r\nTest failed 24/100 times (see `test.log`). The reason is that `echo 456 >/a` in the last layer does not create any modifications to `layer.tar`. As we can see this is some sort of flakiness in the image builder.\r\n\r\nThe issue does not manifest, when I split the troubled command into two, like so:\r\n\r\n```\r\nRUN echo 456 >/a\r\nRUN echo def >>/b\r\n```\r\n\r\n100 rounds of the same testcase went fine (see `split.log`).\r\n\r\nI have attached one faulty image (based on `alpine`) to the same gist for you to examine.\r\n\r\n**Describe the results you expected:**\r\n\r\nBoth `a` and `b` entries exist in the top layer and `a` contents are `456`.\r\n\r\n**Additional information you deem important (e.g. issue happens only occasionally):**\r\n\r\nHappens 24/100"},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/202699164","html_url":"https://github.com/docker/docker/issues/21555#issuecomment-202699164","issue_url":"https://api.github.com/repos/docker/docker/issues/21555","id":202699164,"user":{"login":"AkihiroSuda","id":9248427,"avatar_url":"https://avatars.githubusercontent.com/u/9248427?v=3","gravatar_id":"","url":"https://api.github.com/users/AkihiroSuda","html_url":"https://github.com/AkihiroSuda","followers_url":"https://api.github.com/users/AkihiroSuda/followers","following_url":"https://api.github.com/users/AkihiroSuda/following{/other_user}","gists_url":"https://api.github.com/users/AkihiroSuda/gists{/gist_id}","starred_url":"https://api.github.com/users/AkihiroSuda/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AkihiroSuda/subscriptions","organizations_url":"https://api.github.com/users/AkihiroSuda/orgs","repos_url":"https://api.github.com/users/AkihiroSuda/repos","events_url":"https://api.github.com/users/AkihiroSuda/events{/privacy}","received_events_url":"https://api.github.com/users/AkihiroSuda/received_events","type":"User","site_admin":false},"created_at":"2016-03-29T04:02:08Z","updated_at":"2016-03-29T04:02:08Z","body":"| #Experiments | #Reproduced | Storage | Daemon | Kernel | Environment |\r\n| ------------ | ----------- | ------- | ------ | ------ | ----------- |\r\n| 1,000        | 5           | Overlay |1.11.0-dev(79edcc5)| 3.10.0-327.10.1.el7.x86_64 (CentOS 7) | AWS t2.medium |\r\n| 100          | 0           | DM      | ditto | ditto | ditto |\r\n| 1,000         | 0           | Overlay |1.10.3|4.2.0-34-generic (Ubuntu 15.10) | Physical 4-CPU machine |\r\n| 500         | 0           | AUFS    | ditto|ditto | ditto |\r\n\r\nIt seems to be an overlay bug, but I could not hit on Ubuntu kernel.\r\n"}}