{"action":"created","issue":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/1831","repository_url":"https://api.github.com/repos/open-mpi/ompi","labels_url":"https://api.github.com/repos/open-mpi/ompi/issues/1831/labels{/name}","comments_url":"https://api.github.com/repos/open-mpi/ompi/issues/1831/comments","events_url":"https://api.github.com/repos/open-mpi/ompi/issues/1831/events","html_url":"https://github.com/open-mpi/ompi/issues/1831","id":162991661,"number":1831,"title":"Significant degradation in message rates observed on Master. ","user":{"login":"jladd-mlnx","id":8029820,"avatar_url":"https://avatars.githubusercontent.com/u/8029820?v=3","gravatar_id":"","url":"https://api.github.com/users/jladd-mlnx","html_url":"https://github.com/jladd-mlnx","followers_url":"https://api.github.com/users/jladd-mlnx/followers","following_url":"https://api.github.com/users/jladd-mlnx/following{/other_user}","gists_url":"https://api.github.com/users/jladd-mlnx/gists{/gist_id}","starred_url":"https://api.github.com/users/jladd-mlnx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jladd-mlnx/subscriptions","organizations_url":"https://api.github.com/users/jladd-mlnx/orgs","repos_url":"https://api.github.com/users/jladd-mlnx/repos","events_url":"https://api.github.com/users/jladd-mlnx/events{/privacy}","received_events_url":"https://api.github.com/users/jladd-mlnx/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"artpol84","id":7534910,"avatar_url":"https://avatars.githubusercontent.com/u/7534910?v=3","gravatar_id":"","url":"https://api.github.com/users/artpol84","html_url":"https://github.com/artpol84","followers_url":"https://api.github.com/users/artpol84/followers","following_url":"https://api.github.com/users/artpol84/following{/other_user}","gists_url":"https://api.github.com/users/artpol84/gists{/gist_id}","starred_url":"https://api.github.com/users/artpol84/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/artpol84/subscriptions","organizations_url":"https://api.github.com/users/artpol84/orgs","repos_url":"https://api.github.com/users/artpol84/repos","events_url":"https://api.github.com/users/artpol84/events{/privacy}","received_events_url":"https://api.github.com/users/artpol84/received_events","type":"User","site_admin":false},"assignees":[{"login":"artpol84","id":7534910,"avatar_url":"https://avatars.githubusercontent.com/u/7534910?v=3","gravatar_id":"","url":"https://api.github.com/users/artpol84","html_url":"https://github.com/artpol84","followers_url":"https://api.github.com/users/artpol84/followers","following_url":"https://api.github.com/users/artpol84/following{/other_user}","gists_url":"https://api.github.com/users/artpol84/gists{/gist_id}","starred_url":"https://api.github.com/users/artpol84/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/artpol84/subscriptions","organizations_url":"https://api.github.com/users/artpol84/orgs","repos_url":"https://api.github.com/users/artpol84/repos","events_url":"https://api.github.com/users/artpol84/events{/privacy}","received_events_url":"https://api.github.com/users/artpol84/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/open-mpi/ompi/milestones/17","html_url":"https://github.com/open-mpi/ompi/milestones/v3.0.0","labels_url":"https://api.github.com/repos/open-mpi/ompi/milestones/17/labels","id":1604178,"number":17,"title":"v3.0.0","description":"","creator":{"login":"jsquyres","id":617316,"avatar_url":"https://avatars.githubusercontent.com/u/617316?v=3","gravatar_id":"","url":"https://api.github.com/users/jsquyres","html_url":"https://github.com/jsquyres","followers_url":"https://api.github.com/users/jsquyres/followers","following_url":"https://api.github.com/users/jsquyres/following{/other_user}","gists_url":"https://api.github.com/users/jsquyres/gists{/gist_id}","starred_url":"https://api.github.com/users/jsquyres/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jsquyres/subscriptions","organizations_url":"https://api.github.com/users/jsquyres/orgs","repos_url":"https://api.github.com/users/jsquyres/repos","events_url":"https://api.github.com/users/jsquyres/events{/privacy}","received_events_url":"https://api.github.com/users/jsquyres/received_events","type":"User","site_admin":false},"open_issues":3,"closed_issues":4,"state":"open","created_at":"2016-02-24T23:58:35Z","updated_at":"2016-06-30T15:12:09Z","due_on":null,"closed_at":null},"comments":39,"created_at":"2016-06-29T18:14:13Z","updated_at":"2016-08-31T03:51:03Z","closed_at":null,"body":"Opening this issue for tracking purposes. Measured with Master nightly build against 1.10.3. Possible fix on master. \r\n\r\n@hjelmn or @bosilca please comment. \r\n\r\n```\r\nPML - Yalla\r\nOMPI – 1.10.3\r\n$mpirun -np 2 --map-by node --bind-to core -mca pml yalla -x MXM_RDMA_PORTS=mlx5_0:1  -mca btl_openib_if_include mlx5_0:1 /hpc/local/benchmarks/hpc-stack-gcc/install/ompi-v1.10/tests/osu-micro-benchmarks-5.2/osu_mbw_mr\r\n# OSU MPI Multiple Bandwidth / Message Rate Test v5.2\r\n# [ pairs: 1 ] [ window size: 64 ]\r\n# Size                  MB/s        Messages/s\r\n1                       4.01        4005006.11\r\n2                       8.24        4121056.15\r\n4                      16.39        4097311.09\r\n8                      32.45        4055766.73\r\n16                     64.16        4010025.24\r\n32                    127.13        3972687.66\r\n64                    237.04        3703703.70\r\n128                   455.11        3555555.62\r\n256                   860.96        3363110.99\r\n512                  1592.23        3109815.42\r\n1024                 2811.50        2745602.68\r\n2048                 4972.38        2427921.16\r\n4096                 5430.79        1325875.29\r\n8192                 5933.54         724309.64\r\n16384                6155.42         375697.10\r\n32768                6328.16         193120.10\r\n65536                6398.15          97627.95\r\n131072               6433.23          49081.64\r\n262144               5161.27          19688.67\r\n524288               5731.10          10931.20\r\n1048576              6046.06           5765.97\r\n2097152              6215.12           2963.60\r\n4194304              6306.30           1503.54\r\n \r\n \r\n---------------------\r\nPML – Yalla\r\nOMPI – Master\r\n$mpirun -np 2 --map-by node --bind-to core -mca pml yalla -x MXM_RDMA_PORTS=mlx5_0:1  -mca btl_openib_if_include mlx5_0:1 /hpc/local/benchmarks/hpc-stack-gcc/install/ompi-master/tests/osu-micro-benchmarks-5.2/osu_mbw_mr\r\n# OSU MPI Multiple Bandwidth / Message Rate Test v5.2\r\n# [ pairs: 1 ] [ window size: 64 ]\r\n# Size                  MB/s        Messages/s\r\n1                       1.89        1887305.40\r\n2                       3.80        1898890.08\r\n4                       7.56        1889678.24\r\n8                      15.31        1914346.13\r\n16                     30.41        1900517.95\r\n32                     60.30        1884510.12\r\n64                    119.99        1874796.93\r\n128                   227.47        1777098.03\r\n256                   454.66        1776025.43\r\n512                   870.71        1700598.93\r\n1024                 1599.39        1561900.54\r\n2048                 3228.97        1576645.16\r\n4096                 4453.33        1087237.56\r\n8192                 5822.02         710695.44\r\n16384                6213.84         379262.51\r\n32768                6336.49         193374.24\r\n65536                6403.37          97707.72\r\n131072               6438.18          49119.44\r\n262144               5126.38          19555.59\r\n524288               5708.48          10888.06\r\n1048576              6033.43           5753.92\r\n2097152              6208.48           2960.43\r\n4194304              6303.32           1502.83\r\n \r\n \r\n-----------------------------\r\nPML - OB1\r\nOMPI – 1.10.3\r\n$mpirun -np 2 --map-by node --bind-to core -mca pml ob1 -x MXM_RDMA_PORTS=mlx5_0:1  -mca btl_openib_if_include mlx5_0:1 /hpc/local/benchmarks/hpc-stack-gcc/install/ompi-v1.10/tests/osu-micro-benchmarks-5.2/osu_mbw_mr\r\n# OSU MPI Multiple Bandwidth / Message Rate Test v5.2\r\n# [ pairs: 1 ] [ window size: 64 ]\r\n# Size                  MB/s        Messages/s\r\n1                       3.20        3204807.28\r\n2                       6.91        3453858.56\r\n4                      13.82        3453858.78\r\n8                      27.41        3426124.16\r\n16                     54.12        3382663.90\r\n32                    105.73        3304078.53\r\n64                    208.55        3258655.72\r\n128                   402.16        3141875.26\r\n256                   780.19        3047618.99\r\n512                  1324.49        2586903.70\r\n1024                 2392.70        2336619.29\r\n2048                 4147.85        2025316.48\r\n4096                 5411.73        1321222.14\r\n8192                 5900.16         720234.07\r\n16384                6083.99         371337.40\r\n32768                6329.11         193149.24\r\n65536                6427.56          98076.78\r\n131072               6478.69          49428.48\r\n262144               6503.55          24809.09\r\n524288               6517.20          12430.56\r\n1048576              6523.66           6221.44\r\n2097152              6526.58           3112.11\r\n4194304              6528.46           1556.51\r\n----------------------------------\r\nPML – OB1\r\nOMPI - Master\r\n$mpirun -np 2 --map-by node -mca pml ob1 -mca btl_openib_if_include mlx5_0:1 /hpc/local/benchmarks/hpc-stack-gcc/install/ompi-master/tests/osu-micro-benchmarks-5.2/osu_mbw_mr\r\n# OSU MPI Multiple Bandwidth / Message Rate Test v5.2\r\n# [ pairs: 1 ] [ window size: 64 ]\r\n# Size                  MB/s        Messages/s\r\n1                       1.64        1636174.22\r\n2                       4.79        2392507.23\r\n4                       9.69        2423259.37\r\n8                      19.08        2384926.46\r\n16                     38.57        2410744.90\r\n32                     75.80        2368681.59\r\n64                    149.17        2330745.92\r\n128                   281.28        2197461.83\r\n256                   539.24        2106415.38\r\n512                  1065.10        2080264.37\r\n1024                 1807.65        1765284.91\r\n2048                 3429.21        1674421.30\r\n4096                 5233.04        1277597.35\r\n8192                 5634.88         687851.71\r\n16384                5303.44         323696.21\r\n32768                6091.79         185906.65\r\n65536                6392.29          97538.57\r\n131072               6459.20          49279.78\r\n262144               6494.59          24774.90\r\n524288               6512.32          12421.26\r\n1048576              6521.32           6219.21\r\n2097152              6525.70           3111.70\r\n4194304              6526.97           1556.15\r\n```"},"comment":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/comments/243651192","html_url":"https://github.com/open-mpi/ompi/issues/1831#issuecomment-243651192","issue_url":"https://api.github.com/repos/open-mpi/ompi/issues/1831","id":243651192,"user":{"login":"artpol84","id":7534910,"avatar_url":"https://avatars.githubusercontent.com/u/7534910?v=3","gravatar_id":"","url":"https://api.github.com/users/artpol84","html_url":"https://github.com/artpol84","followers_url":"https://api.github.com/users/artpol84/followers","following_url":"https://api.github.com/users/artpol84/following{/other_user}","gists_url":"https://api.github.com/users/artpol84/gists{/gist_id}","starred_url":"https://api.github.com/users/artpol84/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/artpol84/subscriptions","organizations_url":"https://api.github.com/users/artpol84/orgs","repos_url":"https://api.github.com/users/artpol84/repos","events_url":"https://api.github.com/users/artpol84/events{/privacy}","received_events_url":"https://api.github.com/users/artpol84/received_events","type":"User","site_admin":false},"created_at":"2016-08-31T03:51:03Z","updated_at":"2016-08-31T03:51:03Z","body":"I also checked https://www.open-mpi.org/software/ompi/v2.0/downloads/openmpi-2.0.1rc2.tar.bz2 and I don't understand how could you apply mentioned fixes to this codebase."}}
{"actor":{"display_login":"artpol84"}}