{"action":"created","issue":{"url":"https://api.github.com/repos/docker/distribution/issues/1673","repository_url":"https://api.github.com/repos/docker/distribution","labels_url":"https://api.github.com/repos/docker/distribution/issues/1673/labels{/name}","comments_url":"https://api.github.com/repos/docker/distribution/issues/1673/comments","events_url":"https://api.github.com/repos/docker/distribution/issues/1673/events","html_url":"https://github.com/docker/distribution/issues/1673","id":151157115,"number":1673,"title":"[SWIFT][ceph] error pushing to the registry, unable to parse time error","user":{"login":"gschukin","id":1642745,"avatar_url":"https://avatars.githubusercontent.com/u/1642745?v=3","gravatar_id":"","url":"https://api.github.com/users/gschukin","html_url":"https://github.com/gschukin","followers_url":"https://api.github.com/users/gschukin/followers","following_url":"https://api.github.com/users/gschukin/following{/other_user}","gists_url":"https://api.github.com/users/gschukin/gists{/gist_id}","starred_url":"https://api.github.com/users/gschukin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gschukin/subscriptions","organizations_url":"https://api.github.com/users/gschukin/orgs","repos_url":"https://api.github.com/users/gschukin/repos","events_url":"https://api.github.com/users/gschukin/events{/privacy}","received_events_url":"https://api.github.com/users/gschukin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":11,"created_at":"2016-04-26T14:55:37Z","updated_at":"2016-04-28T00:28:31Z","closed_at":null,"body":"I'm tring to setup latest release (also tried master) with ceph Firefly as storage backend and swift driver. Unfortuantely i'm facing this error in registry logs with failed push.\r\n```\r\ntime=\"2016-04-26T14:39:46.782197286Z\" level=debug msg=\"swift.Writer(\\\"/docker/registry/v2/repositories/redis/_uploads/47066a4f-d75d-4718-954a-aa4b9f0f4516/data\\\", true)\" environment=development go.version=go1.6.1 http.request.host=\"localhost:5000\" http.request.id=1e3ec34b-fbb1-4c65-8ec2-29c0bcc22923 http.request.method=PATCH http.request.remoteaddr=\"172.17.42.1:43162\" http.request.uri=\"/v2/redis/blobs/uploads/47066a4f-d75d-4718-954a-aa4b9f0f4516?_state=bJkXKAxxvr0H0CH3TS_XmSwunVUeY_cClIaw_7qS_6F7Ik5hbWUiOiJyZWRpcyIsIlVVSUQiOiI0NzA2NmE0Zi1kNzVkLTQ3MTgtOTU0YS1hYTRiOWYwZjQ1MTYiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMTYtMDQtMjZUMTQ6Mzk6NDUuODk0OTQ1NDI1WiJ9\" http.request.useragent=\"docker/1.11.1-rc1 go/go1.5.4 git-commit/c90c70c kernel/3.16.0-38-generic os/linux arch/amd64 UpstreamClient(Docker-Client/1.11.1-rc1 \\\\(linux\\\\))\" instance.id=b095a5bd-fb6a-4c3b-b921-b9f819ac2219 service=registry trace.duration=89.284371ms trace.file=\"/go/src/github.com/docker/distribution/registry/storage/driver/base/base.go\" trace.func=\"github.com/docker/distribution/registry/storage/driver/base.(*Base).Writer\" trace.id=bfe65d69-86b6-45c2-be44-778c4d6700d9 trace.line=124 vars.name=redis vars.uuid=47066a4f-d75d-4718-954a-aa4b9f0f4516 version=v2.4.0 \r\ntime=\"2016-04-26T14:39:46.782280848Z\" level=error msg=\"error resolving upload: swift: parsing time \\\"\\\" as \\\"Mon, 02 Jan 2006 15:04:05 GMT\\\": cannot parse \\\"\\\" as \\\"Mon\\\"\" environment=development go.version=go1.6.1 http.request.host=\"localhost:5000\" http.request.id=1e3ec34b-fbb1-4c65-8ec2-29c0bcc22923 http.request.method=PATCH http.request.remoteaddr=\"172.17.42.1:43162\" http.request.uri=\"/v2/redis/blobs/uploads/47066a4f-d75d-4718-954a-aa4b9f0f4516?_state=bJkXKAxxvr0H0CH3TS_XmSwunVUeY_cClIaw_7qS_6F7Ik5hbWUiOiJyZWRpcyIsIlVVSUQiOiI0NzA2NmE0Zi1kNzVkLTQ3MTgtOTU0YS1hYTRiOWYwZjQ1MTYiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMTYtMDQtMjZUMTQ6Mzk6NDUuODk0OTQ1NDI1WiJ9\" http.request.useragent=\"docker/1.11.1-rc1 go/go1.5.4 git-commit/c90c70c kernel/3.16.0-38-generic os/linux arch/amd64 UpstreamClient(Docker-Client/1.11.1-rc1 \\\\(linux\\\\))\" instance.id=b095a5bd-fb6a-4c3b-b921-b9f819ac2219 service=registry vars.name=redis vars.uuid=47066a4f-d75d-4718-954a-aa4b9f0f4516 version=v2.4.0 \r\ntime=\"2016-04-26T14:39:46.782363118Z\" level=error msg=\"response completed with error\" environment=development err.code=unknown err.detail=\"swift: parsing time \\\"\\\" as \\\"Mon, 02 Jan 2006 15:04:05 GMT\\\": cannot parse \\\"\\\" as \\\"Mon\\\"\" err.message=\"unknown error\" go.version=go1.6.1 http.request.host=\"localhost:5000\" http.request.id=1e3ec34b-fbb1-4c65-8ec2-29c0bcc22923 http.request.method=PATCH http.request.remoteaddr=\"172.17.42.1:43162\" http.request.uri=\"/v2/redis/blobs/uploads/47066a4f-d75d-4718-954a-aa4b9f0f4516?_state=bJkXKAxxvr0H0CH3TS_XmSwunVUeY_cClIaw_7qS_6F7Ik5hbWUiOiJyZWRpcyIsIlVVSUQiOiI0NzA2NmE0Zi1kNzVkLTQ3MTgtOTU0YS1hYTRiOWYwZjQ1MTYiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMTYtMDQtMjZUMTQ6Mzk6NDUuODk0OTQ1NDI1WiJ9\" http.request.useragent=\"docker/1.11.1-rc1 go/go1.5.4 git-commit/c90c70c kernel/3.16.0-38-generic os/linux arch/amd64 UpstreamClient(Docker-Client/1.11.1-rc1 \\\\(linux\\\\))\" http.response.contenttype=\"application/json; charset=utf-8\" http.response.duration=180.236063ms http.response.status=500 http.response.written=202 instance.id=b095a5bd-fb6a-4c3b-b921-b9f819ac2219 service=registry vars.name=redis vars.uuid=47066a4f-d75d-4718-954a-aa4b9f0f4516 version=v2.4.0 \r\n172.17.42.1 - - [26/Apr/2016:14:39:46 +0000] \"PATCH /v2/redis/blobs/uploads/47066a4f-d75d-4718-954a-aa4b9f0f4516?_state=bJkXKAxxvr0H0CH3TS_XmSwunVUeY_cClIaw_7qS_6F7Ik5hbWUiOiJyZWRpcyIsIlVVSUQiOiI0NzA2NmE0Zi1kNzVkLTQ3MTgtOTU0YS1hYTRiOWYwZjQ1MTYiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMTYtMDQtMjZUMTQ6Mzk6NDUuODk0OTQ1NDI1WiJ9 HTTP/1.1\" 500 202 \"\" \"docker/1.11.1-rc1 go/go1.5.4 git-commit/c90c70c kernel/3.16.0-38-generic os/linux arch/amd64 UpstreamClient(Docker-Client/1.11.1-rc1 \\\\(linux\\\\))\"\r\ntime=\"2016-04-26T14:39:46.786419096Z\" level=debug msg=\"authorizing request\" environment=development go.version=go1.6.1 http.request.host=\"localhost:5000\" http.request.id=5a53f9ff-ce45-40cb-aa2f-6e3663e1117b http.request.method=HEAD http.request.remoteaddr=\"172.17.42.1:43178\" http.request.uri=\"/v2/redis/blobs/sha256:3526e56c913b13dd4173467dac44138d98fca5c50d0dbeff28657112035c89ec\" http.request.useragent=\"docker/1.11.1-rc1 go/go1.5.4 git-commit/c90c70c kernel/3.16.0-38-generic os/linux arch/amd64 UpstreamClient(Docker-Client/1.11.1-rc1 \\\\(linux\\\\))\" instance.id=b095a5bd-fb6a-4c3b-b921-b9f819ac2219 service=registry vars.digest=\"sha256:3526e56c913b13dd4173467dac44138d98fca5c50d0dbeff28657112035c89ec\" vars.name=redis version=v2.4.0 \r\n```\r\n\r\n```\r\ndocker version\r\nClient:\r\n Version:      1.11.1-rc1\r\n API version:  1.23\r\n Go version:   go1.5.4\r\n Git commit:   c90c70c\r\n Built:        Tue Apr 26 04:55:03 2016\r\n OS/Arch:      linux/amd64\r\n\r\nServer:\r\n Version:      1.11.1-rc1\r\n API version:  1.23\r\n Go version:   go1.5.4\r\n Git commit:   c90c70c\r\n Built:        Tue Apr 26 04:55:03 2016\r\n OS/Arch:      linux/amd64\r\n```\r\n```\r\ndocker info\r\nContainers: 1\r\n Running: 1\r\n Paused: 0\r\n Stopped: 0\r\nImages: 3\r\nServer Version: 1.11.1-rc1\r\nStorage Driver: aufs\r\n Root Dir: /var/lib/docker/aufs\r\n Backing Filesystem: extfs\r\n Dirs: 28\r\n Dirperm1 Supported: true\r\nLogging Driver: json-file\r\nCgroup Driver: cgroupfs\r\nPlugins: \r\n Volume: local\r\n Network: null host bridge\r\nKernel Version: 3.16.0-38-generic\r\nOperating System: Ubuntu 14.04.2 LTS\r\nOSType: linux\r\nArchitecture: x86_64\r\nCPUs: 2\r\nTotal Memory: 7.785 GiB\r\nName: gleb-virtual-machine\r\nID: 6LNL:2GXT:LRXG:UG32:ZXAL:WGYR:OZ2B:XIOK:WGJF:AOG2:RH5S:3GFR\r\nDocker Root Dir: /var/lib/docker\r\nDebug mode (client): false\r\nDebug mode (server): false\r\nRegistry: https://index.docker.io/v1/\r\nWARNING: No swap limit support\r\n```\r\n\r\nI also tried different versions of Docker but the issue still exists.\r\n\r\nRegistry config\r\n```\r\nversion: 0.1\r\nlog:\r\n  level: debug\r\n  fields:\r\n    service: registry\r\n    environment: development\r\nstorage:\r\n  swift:\r\n    username: REMOVED\r\n    password: REMOVED\r\n    authurl: REMOVED\r\n    tenantid: REMOVED\r\n    insecureskipverify: false\r\n    container: DockerDistribution\r\n    rootdirectory: /registry\r\n  delete:\r\n    enabled: true\r\n  cache:\r\n    blobdescriptor: redis\r\n  maintenance:\r\n    uploadpurging:\r\n      enabled: true\r\n      age: 168h\r\n      interval: 24h\r\n      dryrun: false\r\n  redirect:\r\n    disable: false\r\nhttp:\r\n    addr: :5000\r\n    secret: 530cceaef4af43b989405690f067d7ae\r\n    headers:\r\n        X-Content-Type-Options: [nosniff]\r\nredis:\r\n  addr: 10.16.208.6:6379\r\n  pool:\r\n    maxidle: 16\r\n    maxactive: 64\r\n    idletimeout: 300s\r\n  dialtimeout: 10ms\r\n  readtimeout: 10ms\r\n  writetimeout: 10ms\r\n```"},"comment":{"url":"https://api.github.com/repos/docker/distribution/issues/comments/215272335","html_url":"https://github.com/docker/distribution/issues/1673#issuecomment-215272335","issue_url":"https://api.github.com/repos/docker/distribution/issues/1673","id":215272335,"user":{"login":"RichardScothern","id":922018,"avatar_url":"https://avatars.githubusercontent.com/u/922018?v=3","gravatar_id":"","url":"https://api.github.com/users/RichardScothern","html_url":"https://github.com/RichardScothern","followers_url":"https://api.github.com/users/RichardScothern/followers","following_url":"https://api.github.com/users/RichardScothern/following{/other_user}","gists_url":"https://api.github.com/users/RichardScothern/gists{/gist_id}","starred_url":"https://api.github.com/users/RichardScothern/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/RichardScothern/subscriptions","organizations_url":"https://api.github.com/users/RichardScothern/orgs","repos_url":"https://api.github.com/users/RichardScothern/repos","events_url":"https://api.github.com/users/RichardScothern/events{/privacy}","received_events_url":"https://api.github.com/users/RichardScothern/received_events","type":"User","site_admin":false},"created_at":"2016-04-28T00:28:31Z","updated_at":"2016-04-28T00:28:31Z","body":"interesting @gschukin \r\n\r\nCan you grab the memory statistics from `http://localhost:5001/debug/pprof/heap` (with your host and debug server port)."}}