{"action":"created","issue":{"url":"https://api.github.com/repos/spdk/spdk/issues/429","repository_url":"https://api.github.com/repos/spdk/spdk","labels_url":"https://api.github.com/repos/spdk/spdk/issues/429/labels{/name}","comments_url":"https://api.github.com/repos/spdk/spdk/issues/429/comments","events_url":"https://api.github.com/repos/spdk/spdk/issues/429/events","html_url":"https://github.com/spdk/spdk/issues/429","id":357873050,"node_id":"MDU6SXNzdWUzNTc4NzMwNTA=","number":429,"title":"SPDK iSCSI write performance is below expectation","user":{"login":"alantu02","id":43045032,"node_id":"MDQ6VXNlcjQzMDQ1MDMy","avatar_url":"https://avatars0.githubusercontent.com/u/43045032?v=4","gravatar_id":"","url":"https://api.github.com/users/alantu02","html_url":"https://github.com/alantu02","followers_url":"https://api.github.com/users/alantu02/followers","following_url":"https://api.github.com/users/alantu02/following{/other_user}","gists_url":"https://api.github.com/users/alantu02/gists{/gist_id}","starred_url":"https://api.github.com/users/alantu02/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alantu02/subscriptions","organizations_url":"https://api.github.com/users/alantu02/orgs","repos_url":"https://api.github.com/users/alantu02/repos","events_url":"https://api.github.com/users/alantu02/events{/privacy}","received_events_url":"https://api.github.com/users/alantu02/received_events","type":"User","site_admin":false},"labels":[{"id":235898962,"node_id":"MDU6TGFiZWwyMzU4OTg5NjI=","url":"https://api.github.com/repos/spdk/spdk/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":{"login":"liang2yan","id":29114155,"node_id":"MDQ6VXNlcjI5MTE0MTU1","avatar_url":"https://avatars2.githubusercontent.com/u/29114155?v=4","gravatar_id":"","url":"https://api.github.com/users/liang2yan","html_url":"https://github.com/liang2yan","followers_url":"https://api.github.com/users/liang2yan/followers","following_url":"https://api.github.com/users/liang2yan/following{/other_user}","gists_url":"https://api.github.com/users/liang2yan/gists{/gist_id}","starred_url":"https://api.github.com/users/liang2yan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liang2yan/subscriptions","organizations_url":"https://api.github.com/users/liang2yan/orgs","repos_url":"https://api.github.com/users/liang2yan/repos","events_url":"https://api.github.com/users/liang2yan/events{/privacy}","received_events_url":"https://api.github.com/users/liang2yan/received_events","type":"User","site_admin":false},"assignees":[{"login":"liang2yan","id":29114155,"node_id":"MDQ6VXNlcjI5MTE0MTU1","avatar_url":"https://avatars2.githubusercontent.com/u/29114155?v=4","gravatar_id":"","url":"https://api.github.com/users/liang2yan","html_url":"https://github.com/liang2yan","followers_url":"https://api.github.com/users/liang2yan/followers","following_url":"https://api.github.com/users/liang2yan/following{/other_user}","gists_url":"https://api.github.com/users/liang2yan/gists{/gist_id}","starred_url":"https://api.github.com/users/liang2yan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liang2yan/subscriptions","organizations_url":"https://api.github.com/users/liang2yan/orgs","repos_url":"https://api.github.com/users/liang2yan/repos","events_url":"https://api.github.com/users/liang2yan/events{/privacy}","received_events_url":"https://api.github.com/users/liang2yan/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2018-09-07T00:07:44Z","updated_at":"2018-09-14T22:15:11Z","closed_at":null,"author_association":"NONE","body":"Please use the issue tracker only for reporting suspected issues.\r\n\r\nSee [The SPDK Community Page](http://www.spdk.io/community/) for other SPDK communications channels.\r\n\r\nThe configuration is as such:\r\n                SPDK v18.07\r\n                16 Optane drives with 8 partitions each on the target\r\n                2 Mellanox ConnectX-4 50GbE dual ported NIC\r\n                2 initiators targeting 64 LUNs each\r\n                64 iSCSI connections per initiator\r\n \r\nWorkload is:\r\n                4K random, 64K sequential, rd/wr/mix, Q32, 1 thread per mount point\r\n\r\nSmall and large block 100% write workloads via FIO are below expected performance, and that attainable using LIO iSCSI.\r\n\r\n## Expected Behavior\r\n4K random rd/wr/mix with LIO is 2.5M/**1.7M**/2.0M IOPS.\r\n64K sequential rd/wr/mix with LIO is 10.9/**10.8**/**20.3** GB/s.\r\n\r\nExpectation is to get at least the same performance using SPDK.\r\n\r\n## Current Behavior\r\n4K random rd/wr/mix with SPDK iSCSI is 2.8M/**800K**/2.0M IOPS.\r\n64K sequential rd/wr/mix with SPDK iSCSI is 11.1/**2.0**/**3.8** GB/s.\r\n\r\n\r\n## Possible Solution\r\n<!--- Not obligatory, but suggest a fix/reason for the bug, -->\r\n\r\n## Steps to Reproduce\r\n1. Start iscsi_tgt\r\n2. iSCSI discovery on initiator\r\n3. Start FIO workload on initiator\r\n4. Monitor performance throughput of FIO\r\n\r\n## Context (Environment including OS version, SPDK version, etc.)\r\nUbuntu 17.10\r\nkernel 4.13.0-16-generic\r\nSPDK v18.07\r\nfio-3.3-22-g702b"},"comment":{"url":"https://api.github.com/repos/spdk/spdk/issues/comments/421498232","html_url":"https://github.com/spdk/spdk/issues/429#issuecomment-421498232","issue_url":"https://api.github.com/repos/spdk/spdk/issues/429","id":421498232,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMTQ5ODIzMg==","user":{"login":"alantu02","id":43045032,"node_id":"MDQ6VXNlcjQzMDQ1MDMy","avatar_url":"https://avatars0.githubusercontent.com/u/43045032?v=4","gravatar_id":"","url":"https://api.github.com/users/alantu02","html_url":"https://github.com/alantu02","followers_url":"https://api.github.com/users/alantu02/followers","following_url":"https://api.github.com/users/alantu02/following{/other_user}","gists_url":"https://api.github.com/users/alantu02/gists{/gist_id}","starred_url":"https://api.github.com/users/alantu02/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alantu02/subscriptions","organizations_url":"https://api.github.com/users/alantu02/orgs","repos_url":"https://api.github.com/users/alantu02/repos","events_url":"https://api.github.com/users/alantu02/events{/privacy}","received_events_url":"https://api.github.com/users/alantu02/received_events","type":"User","site_admin":false},"created_at":"2018-09-14T22:15:11Z","updated_at":"2018-09-14T22:15:11Z","author_association":"NONE","body":"> @alantu02 For the write performance, it may be affected by r2t value. The default value locate in lib/iscsi/iscsi.h is :\r\n> #define DEFAULT_MAXR2T 4\r\n> \r\n> Could we increase this value to conduct some tests?\r\n\r\n@optimistyzy I have tried with increased value at 8 and at 16 with no change. 4K writes are still ~800K IOPS.\r\n\r\n@jimharris I have configured with same number of null bdevs and 4K writes are still ~800K IOPS.\r\n\r\nSome good news, previously when testing a bug fix for #428, large block was working, but writes were also low. Since pulling the patch, large block writes are within expectation, but small block writes are still low.\r\n\r\nCurrent perf with latest patch:\r\n4K random rd/wr/mix with SPDK iSCSI is 2.8M/800K/2.0M IOPS.\r\n64K sequential rd/wr/mix with SPDK iSCSI is 10.8/11.1/18.7 GB/s."}}
{"actor":{"display_login":"alantu02"}}