{"action":"created","issue":{"url":"https://api.github.com/repos/openucx/ucx/issues/1012","repository_url":"https://api.github.com/repos/openucx/ucx","labels_url":"https://api.github.com/repos/openucx/ucx/issues/1012/labels{/name}","comments_url":"https://api.github.com/repos/openucx/ucx/issues/1012/comments","events_url":"https://api.github.com/repos/openucx/ucx/issues/1012/events","html_url":"https://github.com/openucx/ucx/issues/1012","id":179515639,"number":1012,"title":"UCX hangs while ucp_worker_destroy (async case)","user":{"login":"vkocheganov","id":4533444,"avatar_url":"https://avatars.githubusercontent.com/u/4533444?v=3","gravatar_id":"","url":"https://api.github.com/users/vkocheganov","html_url":"https://github.com/vkocheganov","followers_url":"https://api.github.com/users/vkocheganov/followers","following_url":"https://api.github.com/users/vkocheganov/following{/other_user}","gists_url":"https://api.github.com/users/vkocheganov/gists{/gist_id}","starred_url":"https://api.github.com/users/vkocheganov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vkocheganov/subscriptions","organizations_url":"https://api.github.com/users/vkocheganov/orgs","repos_url":"https://api.github.com/users/vkocheganov/repos","events_url":"https://api.github.com/users/vkocheganov/events{/privacy}","received_events_url":"https://api.github.com/users/vkocheganov/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-09-27T14:50:07Z","updated_at":"2016-09-27T18:26:41Z","closed_at":null,"body":"Affected UCX version: \r\n```\r\ncommit 69545a167b0e98f96d40f455450499d7d9c3056f\r\nDate:   Wed Sep 21 11:27:40 2016 +0300\r\n```\r\nReferencing code: ucp_hello_world_sync.c --- little modified ucp_hello_world.c\r\nCompilation line:\r\n`gcc -I../../install/include -L../../install/lib -lucp -lucs ./ucp_hello_world.c`\r\nLaunch line:\r\n```\r\n[server] UCX_NET_DEVICES=mlx4_0:1 UCX_LOG_LEVEL=trace LD_LIBRARY_PATH=../../install/lib ./a.out   -f\r\n[client] UCX_NET_DEVICES=mlx4_0:1 UCX_LOG_LEVEL=trace LD_LIBRARY_PATH=../../install/lib ./a.out -n vegas26 -f\r\n```\r\nOutput (last lines):\r\n```\r\n...\r\n[1474987385.670369] [vegas25:20557:0]     ucp_worker.c:80   UCX  DEBUG worker 0x610080: remove active message handlers\r\n[1474987385.670404] [vegas25:20557:0]     ucp_worker.c:519  UCX  DEBUG worker 0x610080: destroy all endpoints\r\n[1474987385.670410] [vegas25:20557:0]         ucp_ep.c:385  UCX  DEBUG destroy ep 0x652800 from worker destroy\r\n[1474987385.670414] [vegas25:20557:0]         ucp_ep.c:394  UCX  DEBUG destroy ep 0x652800 lane[0]=0x6495e0\r\n[1474987385.677426] [vegas25:20557:0]      callbackq.c:75   UCX  TRACE cbq 0x649da8: remove 0x649e88 (arg=0x624080) [start:0x649e58 end:0x649eb8]\r\n[1474987385.677440] [vegas25:20557:0]          rc_ep.c:177  UCX  DEBUG destroy rc ep 0x6495e0\r\n[1474987385.677817] [vegas25:20557:0]          mpool.c:122  UCX  DEBUG mpool rc_verbs_short_desc destroyed\r\n[1474987385.679681] [vegas25:20557:0]          mpool.c:122  UCX  DEBUG mpool rc_send_desc destroyed\r\n[1474987385.682832] [vegas25:20557:0]          mpool.c:122  UCX  DEBUG mpool rc_recv_desc destroyed\r\n\r\n```\r\nThe issue has two manifestations:\r\n\r\n1.  Given original ucp_hello_world.c code, exclude barrier routine and stuck.\r\n2.  Given attached file kill client (send it SIGINT signal) right after server outputs `\"sleeping before ep destroying\"` (after server done all the work). This is artificial barrier with the one difference from original ucp_hello_world.c: it cleans up all the UCX stuff in signal handler. You will get stuck.\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/openucx/ucx/issues/comments/249953921","html_url":"https://github.com/openucx/ucx/issues/1012#issuecomment-249953921","issue_url":"https://api.github.com/repos/openucx/ucx/issues/1012","id":249953921,"user":{"login":"yosefe","id":2255631,"avatar_url":"https://avatars.githubusercontent.com/u/2255631?v=3","gravatar_id":"","url":"https://api.github.com/users/yosefe","html_url":"https://github.com/yosefe","followers_url":"https://api.github.com/users/yosefe/followers","following_url":"https://api.github.com/users/yosefe/following{/other_user}","gists_url":"https://api.github.com/users/yosefe/gists{/gist_id}","starred_url":"https://api.github.com/users/yosefe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yosefe/subscriptions","organizations_url":"https://api.github.com/users/yosefe/orgs","repos_url":"https://api.github.com/users/yosefe/repos","events_url":"https://api.github.com/users/yosefe/events{/privacy}","received_events_url":"https://api.github.com/users/yosefe/received_events","type":"User","site_admin":false},"created_at":"2016-09-27T18:26:40Z","updated_at":"2016-09-27T18:26:40Z","body":"@vkocheganov can you please attach the source code of ucp_hello_world_sync.c?"}}
{"actor":{"display_login":"yosefe"}}