{"action":"created","issue":{"url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/64","repository_url":"https://api.github.com/repos/peter-wangxu/persist-queue","labels_url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/64/labels{/name}","comments_url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/64/comments","events_url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/64/events","html_url":"https://github.com/peter-wangxu/persist-queue/issues/64","id":362486547,"node_id":"MDU6SXNzdWUzNjI0ODY1NDc=","number":64,"title":"Failed to persist data when specifying a path on a different device","user":{"login":"Murray-LIANG","id":13897261,"node_id":"MDQ6VXNlcjEzODk3MjYx","avatar_url":"https://avatars0.githubusercontent.com/u/13897261?v=4","gravatar_id":"","url":"https://api.github.com/users/Murray-LIANG","html_url":"https://github.com/Murray-LIANG","followers_url":"https://api.github.com/users/Murray-LIANG/followers","following_url":"https://api.github.com/users/Murray-LIANG/following{/other_user}","gists_url":"https://api.github.com/users/Murray-LIANG/gists{/gist_id}","starred_url":"https://api.github.com/users/Murray-LIANG/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Murray-LIANG/subscriptions","organizations_url":"https://api.github.com/users/Murray-LIANG/orgs","repos_url":"https://api.github.com/users/Murray-LIANG/repos","events_url":"https://api.github.com/users/Murray-LIANG/events{/privacy}","received_events_url":"https://api.github.com/users/Murray-LIANG/received_events","type":"User","site_admin":false},"labels":[{"id":488538713,"node_id":"MDU6TGFiZWw0ODg1Mzg3MTM=","url":"https://api.github.com/repos/peter-wangxu/persist-queue/labels/enhancement","name":"enhancement","color":"84b6eb","default":true},{"id":1066592849,"node_id":"MDU6TGFiZWwxMDY2NTkyODQ5","url":"https://api.github.com/repos/peter-wangxu/persist-queue/labels/file","name":"file","color":"0e9122","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-09-21T07:18:44Z","updated_at":"2018-10-29T12:17:04Z","closed_at":"2018-10-29T12:17:04Z","author_association":"COLLABORATOR","body":"We found some failure in OpenStack tests. In our environment, the Cinder service is running inside a docker container.\r\n \r\n```bash\r\n[root@samctl0 test]# tempest run --regex VolumesSnapshotTestJSON\r\n......\r\n{0} tearDownClass (tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON) [0.000000s] ...\r\nFAILED\r\n\r\nCaptured traceback:\r\n~~~~~~~~~~~~~~~~~~~\r\n    Traceback (most recent call last):\r\n      File \"/usr/lib/python2.7/site-packages/tempest/test.py\", line 224, in tearDownClass\r\n        six.reraise(etype, value, trace)\r\n      File \"/usr/lib/python2.7/site-packages/tempest/test.py\", line 196, in tearDownClass\r\n        teardown()\r\n      File \"/usr/lib/python2.7/site-packages/tempest/test.py\", line 562, in resource_cleanup\r\n        raise testtools.MultipleExceptions(*cleanup_errors)\r\n    testtools.runtest.MultipleExceptions: (<class 'tempest.lib.exceptions.DeleteErrorException'>, Resource 9ea09b32-6189-4701-823d-1dd392c10f87 failed to delete and is in ERROR status, <traceback object at 0x7f4c712114d0>)\r\n```\r\nCinder logs showed : \r\n```bash\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/cinder/volume/drivers/dell_emc/vnx/client.py\", line 170, in delay_delete_lun\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     self.queue.put(self.vnx.delete_lun, name=name)\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/storops/lib/tasks.py\", line 47, in put\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     self._q.put_nowait(item)\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/persistqueue/queue.py\", line 124, in put_nowait\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     return self.put(item, False)\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/persistqueue/queue.py\", line 103, in put\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     self._put(item)\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/persistqueue/queue.py\", line 121, in _put\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     self._saveinfo()\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server   File \"/usr/lib/python2.7/site-packages/persistqueue/queue.py\", line 216, in _saveinfo\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server     os.rename(tmpfn, self._infopath())\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server OSError: [Errno 18] Invalid cross-device link\r\n2018-09-21 01:56:51.396 31 ERROR oslo_messaging.rpc.server \r\n```\r\nFrom above log, `tmpfn` and `self._infopath()` passed to `os.rename` are two files on two devices.\r\nIn this case, `tmpfn` = `/tmp/xxxxx`, and `self._infopath()` = `/var/lib/cinder/xxxxx`\r\n\r\nInside docker, `/tmp` is an overlay filesystem, and `/var/lib/cinder` is on device `/dev/sda2`.\r\n"},"comment":{"url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/comments/433888719","html_url":"https://github.com/peter-wangxu/persist-queue/issues/64#issuecomment-433888719","issue_url":"https://api.github.com/repos/peter-wangxu/persist-queue/issues/64","id":433888719,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMzg4ODcxOQ==","user":{"login":"peter-wangxu","id":3829504,"node_id":"MDQ6VXNlcjM4Mjk1MDQ=","avatar_url":"https://avatars0.githubusercontent.com/u/3829504?v=4","gravatar_id":"","url":"https://api.github.com/users/peter-wangxu","html_url":"https://github.com/peter-wangxu","followers_url":"https://api.github.com/users/peter-wangxu/followers","following_url":"https://api.github.com/users/peter-wangxu/following{/other_user}","gists_url":"https://api.github.com/users/peter-wangxu/gists{/gist_id}","starred_url":"https://api.github.com/users/peter-wangxu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/peter-wangxu/subscriptions","organizations_url":"https://api.github.com/users/peter-wangxu/orgs","repos_url":"https://api.github.com/users/peter-wangxu/repos","events_url":"https://api.github.com/users/peter-wangxu/events{/privacy}","received_events_url":"https://api.github.com/users/peter-wangxu/received_events","type":"User","site_admin":false},"created_at":"2018-10-29T12:17:04Z","updated_at":"2018-10-29T12:17:04Z","author_association":"OWNER","body":"Closed by https://github.com/peter-wangxu/persist-queue/pull/69"}}
{"actor":{"display_login":"peter-wangxu"}}