{"action":"created","issue":{"url":"https://api.github.com/repos/openucx/ucx/issues/3062","repository_url":"https://api.github.com/repos/openucx/ucx","labels_url":"https://api.github.com/repos/openucx/ucx/issues/3062/labels{/name}","comments_url":"https://api.github.com/repos/openucx/ucx/issues/3062/comments","events_url":"https://api.github.com/repos/openucx/ucx/issues/3062/events","html_url":"https://github.com/openucx/ucx/pull/3062","id":384481412,"node_id":"MDExOlB1bGxSZXF1ZXN0MjMzNjc0MDQ1","number":3062,"title":"UCT/IB/CUDA: Penalizing HCAs farther away from GPU for better affinity","user":{"login":"Akshay-Venkatesh","id":3201794,"node_id":"MDQ6VXNlcjMyMDE3OTQ=","avatar_url":"https://avatars3.githubusercontent.com/u/3201794?v=4","gravatar_id":"","url":"https://api.github.com/users/Akshay-Venkatesh","html_url":"https://github.com/Akshay-Venkatesh","followers_url":"https://api.github.com/users/Akshay-Venkatesh/followers","following_url":"https://api.github.com/users/Akshay-Venkatesh/following{/other_user}","gists_url":"https://api.github.com/users/Akshay-Venkatesh/gists{/gist_id}","starred_url":"https://api.github.com/users/Akshay-Venkatesh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Akshay-Venkatesh/subscriptions","organizations_url":"https://api.github.com/users/Akshay-Venkatesh/orgs","repos_url":"https://api.github.com/users/Akshay-Venkatesh/repos","events_url":"https://api.github.com/users/Akshay-Venkatesh/events{/privacy}","received_events_url":"https://api.github.com/users/Akshay-Venkatesh/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":18,"created_at":"2018-11-26T19:42:16Z","updated_at":"2018-12-27T15:41:57Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/openucx/ucx/pulls/3062","html_url":"https://github.com/openucx/ucx/pull/3062","diff_url":"https://github.com/openucx/ucx/pull/3062.diff","patch_url":"https://github.com/openucx/ucx/pull/3062.patch"},"body":"## What \r\n- Adds a function to penalize HCAs farther from CUDA device selected. \r\n- To decide distance between HCA and CUDA device, helper functions have been added temporarily\r\n   - long-term goal is to make these temporary functions generic\r\n \r\n\r\n## Why ?\r\nThis patch will ensure better bandwidth in multi-rail scenarios when the build is configured to enable CUDA features. By preferring closer HCA, PCI bandwidth bottlenecks are avoided when possible. \r\n\r\n## How ?\r\n- the new function `uct_ib_iface_get_cuda_latency` adds to latency overhead of the HCA chosen relative to the cuda device the process is using (if one is detected). The overhead is proportional to the distance between the HCA and CUDA device. This way when two HCAs have nearly equal capabilities (latency/bandwidth) from host memory perspective, `uct_ib_iface_get_cuda_latency` breaks the tie for potential CUDA-related transfers.\r\n\r\n@yosefe @bureddy @shamisp "},"comment":{"url":"https://api.github.com/repos/openucx/ucx/issues/comments/450174834","html_url":"https://github.com/openucx/ucx/pull/3062#issuecomment-450174834","issue_url":"https://api.github.com/repos/openucx/ucx/issues/3062","id":450174834,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MDE3NDgzNA==","user":{"login":"Akshay-Venkatesh","id":3201794,"node_id":"MDQ6VXNlcjMyMDE3OTQ=","avatar_url":"https://avatars3.githubusercontent.com/u/3201794?v=4","gravatar_id":"","url":"https://api.github.com/users/Akshay-Venkatesh","html_url":"https://github.com/Akshay-Venkatesh","followers_url":"https://api.github.com/users/Akshay-Venkatesh/followers","following_url":"https://api.github.com/users/Akshay-Venkatesh/following{/other_user}","gists_url":"https://api.github.com/users/Akshay-Venkatesh/gists{/gist_id}","starred_url":"https://api.github.com/users/Akshay-Venkatesh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Akshay-Venkatesh/subscriptions","organizations_url":"https://api.github.com/users/Akshay-Venkatesh/orgs","repos_url":"https://api.github.com/users/Akshay-Venkatesh/repos","events_url":"https://api.github.com/users/Akshay-Venkatesh/events{/privacy}","received_events_url":"https://api.github.com/users/Akshay-Venkatesh/received_events","type":"User","site_admin":false},"created_at":"2018-12-27T15:41:57Z","updated_at":"2018-12-27T15:41:57Z","author_association":"CONTRIBUTOR","body":"@brminich Sorry I've missed your feedback. I've made changes now. \r\n@yosefe Shall we go with this for the current release?"}}
{"actor":{"display_login":"Akshay-Venkatesh"}}