{"action":"created","issue":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/1585","repository_url":"https://api.github.com/repos/open-mpi/ompi","labels_url":"https://api.github.com/repos/open-mpi/ompi/issues/1585/labels{/name}","comments_url":"https://api.github.com/repos/open-mpi/ompi/issues/1585/comments","events_url":"https://api.github.com/repos/open-mpi/ompi/issues/1585/events","html_url":"https://github.com/open-mpi/ompi/issues/1585","id":151179785,"number":1585,"title":"IPv6-only cluster support in oob_tcp","user":{"login":"ajtulloch","id":1121581,"avatar_url":"https://avatars.githubusercontent.com/u/1121581?v=3","gravatar_id":"","url":"https://api.github.com/users/ajtulloch","html_url":"https://github.com/ajtulloch","followers_url":"https://api.github.com/users/ajtulloch/followers","following_url":"https://api.github.com/users/ajtulloch/following{/other_user}","gists_url":"https://api.github.com/users/ajtulloch/gists{/gist_id}","starred_url":"https://api.github.com/users/ajtulloch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ajtulloch/subscriptions","organizations_url":"https://api.github.com/users/ajtulloch/orgs","repos_url":"https://api.github.com/users/ajtulloch/repos","events_url":"https://api.github.com/users/ajtulloch/events{/privacy}","received_events_url":"https://api.github.com/users/ajtulloch/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-04-26T16:27:16Z","updated_at":"2016-04-26T20:54:04Z","closed_at":null,"body":"It seems like this block:\r\n\r\nhttps://github.com/open-mpi/ompi/blob/a3fea58d1ce6caca4b7a466c6844dfe66a16309a/orte/mca/oob/tcp/oob_tcp.c#L272-L276\r\n\r\n```\r\n    if (AF_INET != pop->af_family) {\r\n            opal_output_verbose(20, orte_oob_base_framework.framework_output,\r\n                            \"%s NOT AF_INET\", ORTE_NAME_PRINT(ORTE_PROC_MY_NAME));\r\n        goto cleanup;\r\n    }\r\n```\r\n\r\nand a few others lead to a failure to setup Open MPI on clusters with IPv6-only addresses, leading to errors like:\r\n\r\n```\r\n[<hostname>:631961] [[28414,1],0]:tcp set addr for peer [[28414,0],0]\r\n[<hostname>:631961] [[28414,1],0]: peer [[28414,0],0] is reachable via component tcp\r\n[<hostname>:631961] [[28414,1],0] OOB_SEND: rml_oob_send.c:199\r\n[<hostname>:631961] [[28414,1],0]:tcp:processing set_peer cmd\r\n[<hostname>:631961] [[28414,1],0] NOT AF_INET\r\n[<hostname>:631961] [[28414,1],0] oob:base:send to target [[28414,0],0]\r\n[<hostname>:631961] [[28414,1],0] oob:tcp:send_nb to peer [[28414,0],0]:1\r\n[<hostname>:631961] [[28414,1],0] tcp:send_nb to peer [[28414,0],0]\r\n[<hostname>:631961] [[28414,1],0]:[oob_tcp.c:478] post send to [[28414,0],0]\r\n[<hostname>:631961] [[28414,1],0]:[oob_tcp.c:415] processing send to peer [[28414,0],0]:1\r\n[<hostname>:631961] [[28414,1],0]:[oob_tcp.c:430] hop [[28414,0],0] unknown\r\n[<hostname>:631961] [[28414,1],0]:[oob_tcp.c:432] post no route to [[28414,0],0]\r\n[<hostname>:631961] [[28414,1],0] tcp:no route called for peer [[28414,0],0]\r\n[<hostname>:631958] [[28414,0],0] TCP SHUTDOWN\r\n```\r\n\r\nI'd be happy to contribute to fixing this if someone could help identify what needs to be done. Naively removing the AF_INET check leads to some immediate buffer overflows."},"comment":{"url":"https://api.github.com/repos/open-mpi/ompi/issues/comments/214882830","html_url":"https://github.com/open-mpi/ompi/issues/1585#issuecomment-214882830","issue_url":"https://api.github.com/repos/open-mpi/ompi/issues/1585","id":214882830,"user":{"login":"rhc54","id":2440928,"avatar_url":"https://avatars.githubusercontent.com/u/2440928?v=3","gravatar_id":"","url":"https://api.github.com/users/rhc54","html_url":"https://github.com/rhc54","followers_url":"https://api.github.com/users/rhc54/followers","following_url":"https://api.github.com/users/rhc54/following{/other_user}","gists_url":"https://api.github.com/users/rhc54/gists{/gist_id}","starred_url":"https://api.github.com/users/rhc54/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rhc54/subscriptions","organizations_url":"https://api.github.com/users/rhc54/orgs","repos_url":"https://api.github.com/users/rhc54/repos","events_url":"https://api.github.com/users/rhc54/events{/privacy}","received_events_url":"https://api.github.com/users/rhc54/received_events","type":"User","site_admin":false},"created_at":"2016-04-26T20:54:04Z","updated_at":"2016-04-26T20:54:04Z","body":"We used to have the IPv6 code working, but we honestly don't have someone able to regularly test it, and so it fell into bit-rot. It would be great to see it restored!\r\n\r\nLet me take a gander at what is there again and provide some advice.\r\n"}}