{"action":"created","issue":{"url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/623","repository_url":"https://api.github.com/repos/raffenet/mpich-migrate-test","labels_url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/623/labels{/name}","comments_url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/623/comments","events_url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/623/events","html_url":"https://github.com/raffenet/mpich-migrate-test/issues/623","id":168446664,"number":623,"title":"Nemesis on windows fails in MPI_Allreduce() for (32+ cores and 128+ procs)","user":{"login":"raffenet","id":1410792,"avatar_url":"https://avatars.githubusercontent.com/u/1410792?v=3","gravatar_id":"","url":"https://api.github.com/users/raffenet","html_url":"https://github.com/raffenet","followers_url":"https://api.github.com/users/raffenet/followers","following_url":"https://api.github.com/users/raffenet/following{/other_user}","gists_url":"https://api.github.com/users/raffenet/gists{/gist_id}","starred_url":"https://api.github.com/users/raffenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raffenet/subscriptions","organizations_url":"https://api.github.com/users/raffenet/orgs","repos_url":"https://api.github.com/users/raffenet/repos","events_url":"https://api.github.com/users/raffenet/events{/privacy}","received_events_url":"https://api.github.com/users/raffenet/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"raffenet","id":1410792,"avatar_url":"https://avatars.githubusercontent.com/u/1410792?v=3","gravatar_id":"","url":"https://api.github.com/users/raffenet","html_url":"https://github.com/raffenet","followers_url":"https://api.github.com/users/raffenet/followers","following_url":"https://api.github.com/users/raffenet/following{/other_user}","gists_url":"https://api.github.com/users/raffenet/gists{/gist_id}","starred_url":"https://api.github.com/users/raffenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raffenet/subscriptions","organizations_url":"https://api.github.com/users/raffenet/orgs","repos_url":"https://api.github.com/users/raffenet/repos","events_url":"https://api.github.com/users/raffenet/events{/privacy}","received_events_url":"https://api.github.com/users/raffenet/received_events","type":"User","site_admin":false},"assignees":[{"login":"raffenet","id":1410792,"avatar_url":"https://avatars.githubusercontent.com/u/1410792?v=3","gravatar_id":"","url":"https://api.github.com/users/raffenet","html_url":"https://github.com/raffenet","followers_url":"https://api.github.com/users/raffenet/followers","following_url":"https://api.github.com/users/raffenet/following{/other_user}","gists_url":"https://api.github.com/users/raffenet/gists{/gist_id}","starred_url":"https://api.github.com/users/raffenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raffenet/subscriptions","organizations_url":"https://api.github.com/users/raffenet/orgs","repos_url":"https://api.github.com/users/raffenet/repos","events_url":"https://api.github.com/users/raffenet/events{/privacy}","received_events_url":"https://api.github.com/users/raffenet/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/raffenet/mpich-migrate-test/milestones/8","html_url":"https://github.com/raffenet/mpich-migrate-test/milestones/mpich2-1.3","labels_url":"https://api.github.com/repos/raffenet/mpich-migrate-test/milestones/8/labels","id":1911838,"number":8,"title":"mpich2-1.3","description":"'''Milestone Major Goals:'''\n\n * ~~'''Asynchronous progress support''' [status: complete]~~\n\n * ~~'''Fault Tolerance''' [status: complete]~~\n   - ~~BLCR checkpointing support [status: complete]~~\n   - ~~FTB integration [status: complete]~~\n   - ~~Error returns on failures for TCP netmod [status: complete]~~\n\n * '''Hydra to replace MPD as the default process manager'''\n   - ~~Support for dynamic processes [status: complete]~~\n   - ~~PMI tunneling [status: complete]~~\n   - ~~Totalview support [status: complete]~~\n   - ~~Use hwloc as the default process binding mechanism [status: complete]~~\n   - Support for pbs, lsf, loadleveler, sge [status: pbs work to be completed; everything else is in place]\n   - Padb support [status: to be done]\n   - Windows support [status: to be done]\n\n * '''Fine-grained threading support''' [status: preliminary support available]\n","creator":{"login":"raffenet","id":1410792,"avatar_url":"https://avatars.githubusercontent.com/u/1410792?v=3","gravatar_id":"","url":"https://api.github.com/users/raffenet","html_url":"https://github.com/raffenet","followers_url":"https://api.github.com/users/raffenet/followers","following_url":"https://api.github.com/users/raffenet/following{/other_user}","gists_url":"https://api.github.com/users/raffenet/gists{/gist_id}","starred_url":"https://api.github.com/users/raffenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raffenet/subscriptions","organizations_url":"https://api.github.com/users/raffenet/orgs","repos_url":"https://api.github.com/users/raffenet/repos","events_url":"https://api.github.com/users/raffenet/events{/privacy}","received_events_url":"https://api.github.com/users/raffenet/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":10,"state":"closed","created_at":"2016-07-29T14:57:29Z","updated_at":"2016-07-30T03:32:33Z","due_on":"2010-09-30T05:00:00Z","closed_at":"2016-07-29T14:57:29Z"},"comments":4,"created_at":"2016-07-30T03:32:31Z","updated_at":"2016-07-30T03:32:33Z","closed_at":null,"body":"**Originally by _jayesh_ on 2009-05-29 14:21:02 -0500**\n\n___\nThis bug was reported by Jeff Baxter@MS.\n\n=================================================\nThanks Jayesh,\n The nemesis stuff seems cool, and i am seeing significant improvements on small message all reduces for example at 128 core ( 16 node ) scale. \n I don’t seem to be seeing much improvements on bcast for either small or large messages, and i was wondering whether there were particular areas you had concentrated on, and which i should look at first?\n One thing i do seem to get consistently is a crash at high message sizes for allreduce - this is the output from a 4MB allreduce across 128 cores, not sure if it is a known issue?\n\n```\nC:\\mpich2drop>.\\mpiexec -channel nemesis -machinefile \\\\marlinhn01\\c$\\mpich2drop\\nodes.txt -n 128 c:\\mpich2drop\\colltestmpich2.exe allreduce 4000000 10\n\nFatal error in MPI_Allreduce: Other MPI error, error stack:\n\nMPI_Allreduce(773)....................: MPI_Allreduce(sbuf=00000000065B0040, rbuf=0000000024E00040, count=4000000, MPI_CHAR, MPI_SUM, MPI_COMM_WORLD) failed\n\nMPIR_Reduce(759)......................:\n\nMPIR_Reduce_redscat_gather(485).......:\n\nMPIC_Sendrecv(161)....................:\n\nMPIC_Wait(405)........................:\n\nMPIDI_CH3I_Progress(207)..............:\n\nMPID_nem_handle_pkt(489)..............:\n\npkt_RTS_handler(238)..................:\n\ndo_cts(498)...........................:\n\nMPID_nem_lmt_shm_start_recv(173)......:\n\nMPID_nem_allocate_shm_region(824).....:\n\nMPIU_SHMW_Seg_create_and_attach(933)..:\n\nMPIU_SHMW_Seg_create_attach_templ(786): unable to allocate shared memory - CreateFileMapping Cannot create a file when that file already exists.\n```\n\nCheers\nJeff\n================================================="},"comment":{"url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/comments/236338287","html_url":"https://github.com/raffenet/mpich-migrate-test/issues/623#issuecomment-236338287","issue_url":"https://api.github.com/repos/raffenet/mpich-migrate-test/issues/623","id":236338287,"user":{"login":"raffenet","id":1410792,"avatar_url":"https://avatars.githubusercontent.com/u/1410792?v=3","gravatar_id":"","url":"https://api.github.com/users/raffenet","html_url":"https://github.com/raffenet","followers_url":"https://api.github.com/users/raffenet/followers","following_url":"https://api.github.com/users/raffenet/following{/other_user}","gists_url":"https://api.github.com/users/raffenet/gists{/gist_id}","starred_url":"https://api.github.com/users/raffenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raffenet/subscriptions","organizations_url":"https://api.github.com/users/raffenet/orgs","repos_url":"https://api.github.com/users/raffenet/repos","events_url":"https://api.github.com/users/raffenet/events{/privacy}","received_events_url":"https://api.github.com/users/raffenet/received_events","type":"User","site_admin":false},"created_at":"2016-07-30T03:32:32Z","updated_at":"2016-07-30T03:32:32Z","body":"**Originally by _jayesh_ on 2009-05-29 14:23:14 -0500**\n\n___\nJeff,\n  I am not able to recreate the problem here (I am running an MPI_Allreduce() with 2bytes-6MB range with 120 procs on 8 cores... As you mentioned in your email I probably need ~32 cores to reproduce the problem) at our lab. However, I think I know where the problem lies. We name the shared mem segments on windows using the lower part of the query perf cnt values, this might be causing conflicts in the segment names for shm segments used for large message transfers in nemesis.\n Thanks for reporting the bug. I have created a ticket for this bug (https://trac.mcs.anl.gov/projects/mpich2/ticket/623) & will provide you a custom build with a fix for the problem over the weekend and you can use that build for your testing.\n \nRegards,\nJayesh"}}
{"actor":{"display_login":"raffenet"}}