{"action":"created","issue":{"url":"https://api.github.com/repos/spdk/spdk/issues/298","repository_url":"https://api.github.com/repos/spdk/spdk","labels_url":"https://api.github.com/repos/spdk/spdk/issues/298/labels{/name}","comments_url":"https://api.github.com/repos/spdk/spdk/issues/298/comments","events_url":"https://api.github.com/repos/spdk/spdk/issues/298/events","html_url":"https://github.com/spdk/spdk/issues/298","id":322676375,"node_id":"MDU6SXNzdWUzMjI2NzYzNzU=","number":298,"title":"\"Work Request Flushed Error\" occurred when disconnect NVMe-OF target with X722 iWARP RDMA.","user":{"login":"WenqianZong","id":35021568,"node_id":"MDQ6VXNlcjM1MDIxNTY4","avatar_url":"https://avatars1.githubusercontent.com/u/35021568?v=4","gravatar_id":"","url":"https://api.github.com/users/WenqianZong","html_url":"https://github.com/WenqianZong","followers_url":"https://api.github.com/users/WenqianZong/followers","following_url":"https://api.github.com/users/WenqianZong/following{/other_user}","gists_url":"https://api.github.com/users/WenqianZong/gists{/gist_id}","starred_url":"https://api.github.com/users/WenqianZong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WenqianZong/subscriptions","organizations_url":"https://api.github.com/users/WenqianZong/orgs","repos_url":"https://api.github.com/users/WenqianZong/repos","events_url":"https://api.github.com/users/WenqianZong/events{/privacy}","received_events_url":"https://api.github.com/users/WenqianZong/received_events","type":"User","site_admin":false},"labels":[{"id":235898962,"node_id":"MDU6TGFiZWwyMzU4OTg5NjI=","url":"https://api.github.com/repos/spdk/spdk/labels/bug","name":"bug","color":"fc2929","default":true},{"id":906786801,"node_id":"MDU6TGFiZWw5MDY3ODY4MDE=","url":"https://api.github.com/repos/spdk/spdk/labels/high-priority","name":"high-priority","color":"ffee5b","default":false}],"state":"open","locked":false,"assignee":{"login":"changpe1","id":14796941,"node_id":"MDQ6VXNlcjE0Nzk2OTQx","avatar_url":"https://avatars1.githubusercontent.com/u/14796941?v=4","gravatar_id":"","url":"https://api.github.com/users/changpe1","html_url":"https://github.com/changpe1","followers_url":"https://api.github.com/users/changpe1/followers","following_url":"https://api.github.com/users/changpe1/following{/other_user}","gists_url":"https://api.github.com/users/changpe1/gists{/gist_id}","starred_url":"https://api.github.com/users/changpe1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/changpe1/subscriptions","organizations_url":"https://api.github.com/users/changpe1/orgs","repos_url":"https://api.github.com/users/changpe1/repos","events_url":"https://api.github.com/users/changpe1/events{/privacy}","received_events_url":"https://api.github.com/users/changpe1/received_events","type":"User","site_admin":false},"assignees":[{"login":"changpe1","id":14796941,"node_id":"MDQ6VXNlcjE0Nzk2OTQx","avatar_url":"https://avatars1.githubusercontent.com/u/14796941?v=4","gravatar_id":"","url":"https://api.github.com/users/changpe1","html_url":"https://github.com/changpe1","followers_url":"https://api.github.com/users/changpe1/followers","following_url":"https://api.github.com/users/changpe1/following{/other_user}","gists_url":"https://api.github.com/users/changpe1/gists{/gist_id}","starred_url":"https://api.github.com/users/changpe1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/changpe1/subscriptions","organizations_url":"https://api.github.com/users/changpe1/orgs","repos_url":"https://api.github.com/users/changpe1/repos","events_url":"https://api.github.com/users/changpe1/events{/privacy}","received_events_url":"https://api.github.com/users/changpe1/received_events","type":"User","site_admin":false},{"login":"liang2yan","id":29114155,"node_id":"MDQ6VXNlcjI5MTE0MTU1","avatar_url":"https://avatars2.githubusercontent.com/u/29114155?v=4","gravatar_id":"","url":"https://api.github.com/users/liang2yan","html_url":"https://github.com/liang2yan","followers_url":"https://api.github.com/users/liang2yan/followers","following_url":"https://api.github.com/users/liang2yan/following{/other_user}","gists_url":"https://api.github.com/users/liang2yan/gists{/gist_id}","starred_url":"https://api.github.com/users/liang2yan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liang2yan/subscriptions","organizations_url":"https://api.github.com/users/liang2yan/orgs","repos_url":"https://api.github.com/users/liang2yan/repos","events_url":"https://api.github.com/users/liang2yan/events{/privacy}","received_events_url":"https://api.github.com/users/liang2yan/received_events","type":"User","site_admin":false},{"login":"WenqianZong","id":35021568,"node_id":"MDQ6VXNlcjM1MDIxNTY4","avatar_url":"https://avatars1.githubusercontent.com/u/35021568?v=4","gravatar_id":"","url":"https://api.github.com/users/WenqianZong","html_url":"https://github.com/WenqianZong","followers_url":"https://api.github.com/users/WenqianZong/followers","following_url":"https://api.github.com/users/WenqianZong/following{/other_user}","gists_url":"https://api.github.com/users/WenqianZong/gists{/gist_id}","starred_url":"https://api.github.com/users/WenqianZong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WenqianZong/subscriptions","organizations_url":"https://api.github.com/users/WenqianZong/orgs","repos_url":"https://api.github.com/users/WenqianZong/repos","events_url":"https://api.github.com/users/WenqianZong/events{/privacy}","received_events_url":"https://api.github.com/users/WenqianZong/received_events","type":"User","site_admin":false}],"milestone":null,"comments":12,"created_at":"2018-05-14T05:24:26Z","updated_at":"2018-07-27T01:20:27Z","closed_at":null,"author_association":"NONE","body":"# Problem Statement\r\nWhen disconnect  NVMe-OF target with **X722 iWARP RDMA**, target machine reported \"Work Request Flushed Error\" ,following is log:\r\n```\r\nStarting SPDK v18.07-pre / DPDK 18.02.0 initialization...\r\n[ DPDK EAL parameters: nvmf -c 0x1 --file-prefix=spdk_pid4557 ]\r\nEAL: Detected 112 lcore(s)\r\nEAL: No free hugepages reported in hugepages-1048576kB\r\nEAL: Multi-process socket /var/run/.spdk_pid4557_unix\r\nEAL: Probing VFIO support...\r\napp.c: 521:spdk_app_start: *NOTICE*: Total cores available: 1\r\nreactor.c: 669:spdk_reactors_init: *NOTICE*: Occupied cpu socket mask is 0x1\r\nreactor.c: 453:_spdk_reactor_run: *NOTICE*: Reactor started on core 0 on socket 0\r\nEAL: PCI device 0000:00:04.0 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.1 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.2 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.3 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.4 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.5 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.6 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:00:04.7 on NUMA socket 0\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.0 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.1 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.2 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.3 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.4 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.5 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.6 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:80:04.7 on NUMA socket 1\r\nEAL:   probe driver: 8086:2021 spdk_ioat\r\nEAL: PCI device 0000:d8:00.0 on NUMA socket 1\r\nEAL:   probe driver: 8086:953 spdk_nvme\r\nEAL: PCI device 0000:d9:00.0 on NUMA socket 1\r\nEAL:   probe driver: 8086:953 spdk_nvme\r\nrdma.c:1533:spdk_nvmf_rdma_poll_group_create: *NOTICE*: Skipping unused RDMA device when creating poll group.\r\nrdma.c:1533:spdk_nvmf_rdma_poll_group_create: *NOTICE*: Skipping unused RDMA device when creating poll group.\r\nrdma.c:1533:spdk_nvmf_rdma_poll_group_create: *NOTICE*: Skipping unused RDMA device when creating poll group.\r\nrdma.c:1533:spdk_nvmf_rdma_poll_group_create: *NOTICE*: Skipping unused RDMA device when creating poll group.\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137424 (5): Work Request Flushed Error\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137520 (5): Work Request Flushed Error\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137616 (5): Work Request Flushed Error\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137712 (5): Work Request Flushed Error\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137808 (5): Work Request Flushed Error\r\nrdma.c:1813:spdk_nvmf_rdma_poller_poll: *ERROR*: CQ error on CQ 0x1841220, Request 0x26137904 (5): Work Request Flushed Error\r\n```\r\n\r\n# Reproduce Step\r\n1.run Nvmf tgt on target machine:\r\n./app/nvmf_tgt/nvmf_tgt -c ../nvme.conf\r\n2.connect on initator machine:\r\nnvme connect -n nqn.2016-06.io.spdk:cnode1 -t rdma -a 10.67.110.50 -s 4420\r\n3.disconnect on initator machine:\r\nnvme disconnect -n nqn.2016-06.io.spdk:cnode1\r\n4. check target machine\r\n\r\n\r\n# Context (Environment )\r\nSPDK : SPDK v18.07-pre / DPDK 18.02.0\r\nNIC: i40iw \r\nmotherboard:wolfpass S2600wf"},"comment":{"url":"https://api.github.com/repos/spdk/spdk/issues/comments/408282537","html_url":"https://github.com/spdk/spdk/issues/298#issuecomment-408282537","issue_url":"https://api.github.com/repos/spdk/spdk/issues/298","id":408282537,"node_id":"MDEyOklzc3VlQ29tbWVudDQwODI4MjUzNw==","user":{"login":"WenqianZong","id":35021568,"node_id":"MDQ6VXNlcjM1MDIxNTY4","avatar_url":"https://avatars1.githubusercontent.com/u/35021568?v=4","gravatar_id":"","url":"https://api.github.com/users/WenqianZong","html_url":"https://github.com/WenqianZong","followers_url":"https://api.github.com/users/WenqianZong/followers","following_url":"https://api.github.com/users/WenqianZong/following{/other_user}","gists_url":"https://api.github.com/users/WenqianZong/gists{/gist_id}","starred_url":"https://api.github.com/users/WenqianZong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WenqianZong/subscriptions","organizations_url":"https://api.github.com/users/WenqianZong/orgs","repos_url":"https://api.github.com/users/WenqianZong/repos","events_url":"https://api.github.com/users/WenqianZong/events{/privacy}","received_events_url":"https://api.github.com/users/WenqianZong/received_events","type":"User","site_admin":false},"created_at":"2018-07-27T01:20:27Z","updated_at":"2018-07-27T01:20:27Z","author_association":"NONE","body":"I use latest spdk version （7/27）to verified this issue passed with X722 iWARP RDMA. I will test on Chelsio nic."}}
{"actor":{"display_login":"WenqianZong"}}