{"action":"created","issue":{"url":"https://api.github.com/repos/trilinos/Trilinos/issues/2650","repository_url":"https://api.github.com/repos/trilinos/Trilinos","labels_url":"https://api.github.com/repos/trilinos/Trilinos/issues/2650/labels{/name}","comments_url":"https://api.github.com/repos/trilinos/Trilinos/issues/2650/comments","events_url":"https://api.github.com/repos/trilinos/Trilinos/issues/2650/events","html_url":"https://github.com/trilinos/Trilinos/issues/2650","id":318386768,"number":2650,"title":"SEACAS tests failing in ATDM CUDA builds starting 4/26/2018","user":{"login":"bartlettroscoe","id":1959736,"avatar_url":"https://avatars1.githubusercontent.com/u/1959736?v=4","gravatar_id":"","url":"https://api.github.com/users/bartlettroscoe","html_url":"https://github.com/bartlettroscoe","followers_url":"https://api.github.com/users/bartlettroscoe/followers","following_url":"https://api.github.com/users/bartlettroscoe/following{/other_user}","gists_url":"https://api.github.com/users/bartlettroscoe/gists{/gist_id}","starred_url":"https://api.github.com/users/bartlettroscoe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartlettroscoe/subscriptions","organizations_url":"https://api.github.com/users/bartlettroscoe/orgs","repos_url":"https://api.github.com/users/bartlettroscoe/repos","events_url":"https://api.github.com/users/bartlettroscoe/events{/privacy}","received_events_url":"https://api.github.com/users/bartlettroscoe/received_events","type":"User","site_admin":false},"labels":[{"id":816763194,"url":"https://api.github.com/repos/trilinos/Trilinos/labels/ATDM","name":"ATDM","color":"ea88a5","default":false},{"id":287520103,"url":"https://api.github.com/repos/trilinos/Trilinos/labels/bug","name":"bug","color":"fc2929","default":true},{"id":324811871,"url":"https://api.github.com/repos/trilinos/Trilinos/labels/seacas","name":"seacas","color":"5319e7","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/trilinos/Trilinos/milestones/47","html_url":"https://github.com/trilinos/Trilinos/milestone/47","labels_url":"https://api.github.com/repos/trilinos/Trilinos/milestones/47/labels","id":3131248,"number":47,"title":"Keep promoted \"ATDM\" builds of Trilinos clean","description":"This milestone/epic is to aggregate Issues for new failures in builds with the name \"Trilinos-atdm-XXX\" being posted to the \"ATDM\" CDash Track/Group that is sending out CDash error emails after these builds have been promoted.  These failures have to be fixed in short order.\r\n\r\nThere is no end-date for this milestone/epic.  As new failures are reported, new issues will be added.\r\n","creator":{"login":"bartlettroscoe","id":1959736,"avatar_url":"https://avatars1.githubusercontent.com/u/1959736?v=4","gravatar_id":"","url":"https://api.github.com/users/bartlettroscoe","html_url":"https://github.com/bartlettroscoe","followers_url":"https://api.github.com/users/bartlettroscoe/followers","following_url":"https://api.github.com/users/bartlettroscoe/following{/other_user}","gists_url":"https://api.github.com/users/bartlettroscoe/gists{/gist_id}","starred_url":"https://api.github.com/users/bartlettroscoe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartlettroscoe/subscriptions","organizations_url":"https://api.github.com/users/bartlettroscoe/orgs","repos_url":"https://api.github.com/users/bartlettroscoe/repos","events_url":"https://api.github.com/users/bartlettroscoe/events{/privacy}","received_events_url":"https://api.github.com/users/bartlettroscoe/received_events","type":"User","site_admin":false},"open_issues":6,"closed_issues":6,"state":"open","created_at":"2018-02-20T22:30:27Z","updated_at":"2018-04-27T12:13:05Z","due_on":null,"closed_at":null},"comments":34,"created_at":"2018-04-27T12:13:04Z","updated_at":"2018-04-27T15:37:55Z","closed_at":null,"author_association":"MEMBER","body":"**CC:** @trilinos/seacas, @gsjaardema, @fryeguy52 \r\n\r\n## Next Action Status\r\n\r\nUpdated SEACAS is also causing mesh reading problems on non-CUDA builds for larger numbers of MPI ranks:  Next: back out merge commit until @gsjaardema can fix this offline ...\r\n\r\n## Description\r\n\r\nAs shown in the query:\r\n\r\n* https://testing-vm.sandia.gov/cdash/queryTests.php?project=Trilinos&date=2018-04-26&filtercombine=and&filtercombine=and&filtercombine=and&filtercount=4&showfilters=1&filtercombine=and&field1=buildname&compare1=65&value1=Trilinos-atdm-&field2=status&compare2=62&value2=passed&field3=status&compare3=62&value3=notrun&field4=testname&compare4=65&value4=SEACAS\r\n\r\nThe SEACAS tests:\r\n\r\n* `SEACASIoss_exodus32_to_exodus32`\r\n* `SEACASIoss_exodus32_to_exodus32_pnetcd`\r\n* `SEACASIoss_exodus32_to_exodus64`\r\n\r\nare failling in all of the current [ATDM Trilinos](https://snl-wiki.sandia.gov/display/CoodinatedDevOpsATDM/ATDM+Builds+of+Trilinos) CUDA builds:\r\n\r\n* `Trilinos-atdm-hansen-shiller-cuda-debug`\r\n* `Trilinos-atdm-hansen-shiller-cuda-opt`\r\n* `Trilinos-atdm-white-ride-cuda-debug`\r\n* `Trilinos-atdm-white-ride-cuda-opt`\r\n\r\nThis was likely due to the update of SEACAS into Trilinos in the commit 89d48adf7ff7f919fefaf035f228a01947c9a5aa merged in the PR #2625 .\r\n\r\n## Steps to Reproduce\r\n\r\nOne should be able to reproduce these failing tests on the machines `white` (SON), `ride` (SRN), `hansen` (SON), or `shiller` (SRN) as described in:\r\n\r\n* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md\r\n\r\nFor example, on `white` one should be able to reproduce these failing tests with:\r\n\r\n```\r\n$ cd <some_build_dir>/\r\n\r\n$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh cuda-debug\r\n\r\n$ cmake \\\r\n  -GNinja \\\r\n  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \\\r\n  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_SEACAS=ON \\\r\n  $TRILINOS_DIR\r\n\r\n$ make NP=16\r\n\r\n$ bsub -x -Is -q rhel7F -n 16 ctest -j16\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/trilinos/Trilinos/issues/comments/385008196","html_url":"https://github.com/trilinos/Trilinos/issues/2650#issuecomment-385008196","issue_url":"https://api.github.com/repos/trilinos/Trilinos/issues/2650","id":385008196,"user":{"login":"bartlettroscoe","id":1959736,"avatar_url":"https://avatars1.githubusercontent.com/u/1959736?v=4","gravatar_id":"","url":"https://api.github.com/users/bartlettroscoe","html_url":"https://github.com/bartlettroscoe","followers_url":"https://api.github.com/users/bartlettroscoe/followers","following_url":"https://api.github.com/users/bartlettroscoe/following{/other_user}","gists_url":"https://api.github.com/users/bartlettroscoe/gists{/gist_id}","starred_url":"https://api.github.com/users/bartlettroscoe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartlettroscoe/subscriptions","organizations_url":"https://api.github.com/users/bartlettroscoe/orgs","repos_url":"https://api.github.com/users/bartlettroscoe/repos","events_url":"https://api.github.com/users/bartlettroscoe/events{/privacy}","received_events_url":"https://api.github.com/users/bartlettroscoe/received_events","type":"User","site_admin":false},"created_at":"2018-04-27T15:37:55Z","updated_at":"2018-04-27T15:37:55Z","author_association":"MEMBER","body":"> Alternatively, I will see if I can determine the settings down in the SEACAS CMake-related code at configure time which may be more robust than relying on manual settings...\r\n\r\n@gsjaardema, let me know if you have any difficulty reproducing any of these ATDM builds.  I tried to make it as easy as I could think to make it.  Just source a single script with the build name that you want and run raw cmake passingin a single `*.cmake` file and enable any package you want."}}
{"actor":{"display_login":"bartlettroscoe"}}