{"action":"created","issue":{"url":"https://api.github.com/repos/trilinos/Trilinos/issues/3438","repository_url":"https://api.github.com/repos/trilinos/Trilinos","labels_url":"https://api.github.com/repos/trilinos/Trilinos/issues/3438/labels{/name}","comments_url":"https://api.github.com/repos/trilinos/Trilinos/issues/3438/comments","events_url":"https://api.github.com/repos/trilinos/Trilinos/issues/3438/events","html_url":"https://github.com/trilinos/Trilinos/issues/3438","id":359986191,"node_id":"MDU6SXNzdWUzNTk5ODYxOTE=","number":3438,"title":"KokkosKernals_sparse_* tests are failing on ATDM cuda builds","user":{"login":"fryeguy52","id":14793461,"node_id":"MDQ6VXNlcjE0NzkzNDYx","avatar_url":"https://avatars2.githubusercontent.com/u/14793461?v=4","gravatar_id":"","url":"https://api.github.com/users/fryeguy52","html_url":"https://github.com/fryeguy52","followers_url":"https://api.github.com/users/fryeguy52/followers","following_url":"https://api.github.com/users/fryeguy52/following{/other_user}","gists_url":"https://api.github.com/users/fryeguy52/gists{/gist_id}","starred_url":"https://api.github.com/users/fryeguy52/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fryeguy52/subscriptions","organizations_url":"https://api.github.com/users/fryeguy52/orgs","repos_url":"https://api.github.com/users/fryeguy52/repos","events_url":"https://api.github.com/users/fryeguy52/events{/privacy}","received_events_url":"https://api.github.com/users/fryeguy52/received_events","type":"User","site_admin":false},"labels":[{"id":816763194,"node_id":"MDU6TGFiZWw4MTY3NjMxOTQ=","url":"https://api.github.com/repos/trilinos/Trilinos/labels/ATDM","name":"ATDM","color":"ea88a5","default":false},{"id":338192363,"node_id":"MDU6TGFiZWwzMzgxOTIzNjM=","url":"https://api.github.com/repos/trilinos/Trilinos/labels/KokkosKernels","name":"KokkosKernels","color":"eb6420","default":false},{"id":287520103,"node_id":"MDU6TGFiZWwyODc1MjAxMDM=","url":"https://api.github.com/repos/trilinos/Trilinos/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":{"login":"kyungjoo-kim","id":6992602,"node_id":"MDQ6VXNlcjY5OTI2MDI=","avatar_url":"https://avatars2.githubusercontent.com/u/6992602?v=4","gravatar_id":"","url":"https://api.github.com/users/kyungjoo-kim","html_url":"https://github.com/kyungjoo-kim","followers_url":"https://api.github.com/users/kyungjoo-kim/followers","following_url":"https://api.github.com/users/kyungjoo-kim/following{/other_user}","gists_url":"https://api.github.com/users/kyungjoo-kim/gists{/gist_id}","starred_url":"https://api.github.com/users/kyungjoo-kim/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kyungjoo-kim/subscriptions","organizations_url":"https://api.github.com/users/kyungjoo-kim/orgs","repos_url":"https://api.github.com/users/kyungjoo-kim/repos","events_url":"https://api.github.com/users/kyungjoo-kim/events{/privacy}","received_events_url":"https://api.github.com/users/kyungjoo-kim/received_events","type":"User","site_admin":false},"assignees":[{"login":"kyungjoo-kim","id":6992602,"node_id":"MDQ6VXNlcjY5OTI2MDI=","avatar_url":"https://avatars2.githubusercontent.com/u/6992602?v=4","gravatar_id":"","url":"https://api.github.com/users/kyungjoo-kim","html_url":"https://github.com/kyungjoo-kim","followers_url":"https://api.github.com/users/kyungjoo-kim/followers","following_url":"https://api.github.com/users/kyungjoo-kim/following{/other_user}","gists_url":"https://api.github.com/users/kyungjoo-kim/gists{/gist_id}","starred_url":"https://api.github.com/users/kyungjoo-kim/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kyungjoo-kim/subscriptions","organizations_url":"https://api.github.com/users/kyungjoo-kim/orgs","repos_url":"https://api.github.com/users/kyungjoo-kim/repos","events_url":"https://api.github.com/users/kyungjoo-kim/events{/privacy}","received_events_url":"https://api.github.com/users/kyungjoo-kim/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/trilinos/Trilinos/milestones/47","html_url":"https://github.com/trilinos/Trilinos/milestone/47","labels_url":"https://api.github.com/repos/trilinos/Trilinos/milestones/47/labels","id":3131248,"node_id":"MDk6TWlsZXN0b25lMzEzMTI0OA==","number":47,"title":"Keep promoted \"ATDM\" builds of Trilinos clean","description":"This milestone/epic is to aggregate Issues for new failures in builds with the name \"Trilinos-atdm-XXX\" being posted to the \"ATDM\" CDash Track/Group that is sending out CDash error emails after these builds have been promoted.  These failures have to be fixed in short order.\r\n\r\nThere is no end-date for this milestone/epic.  As new failures are reported, new issues will be added.\r\n","creator":{"login":"bartlettroscoe","id":1959736,"node_id":"MDQ6VXNlcjE5NTk3MzY=","avatar_url":"https://avatars1.githubusercontent.com/u/1959736?v=4","gravatar_id":"","url":"https://api.github.com/users/bartlettroscoe","html_url":"https://github.com/bartlettroscoe","followers_url":"https://api.github.com/users/bartlettroscoe/followers","following_url":"https://api.github.com/users/bartlettroscoe/following{/other_user}","gists_url":"https://api.github.com/users/bartlettroscoe/gists{/gist_id}","starred_url":"https://api.github.com/users/bartlettroscoe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bartlettroscoe/subscriptions","organizations_url":"https://api.github.com/users/bartlettroscoe/orgs","repos_url":"https://api.github.com/users/bartlettroscoe/repos","events_url":"https://api.github.com/users/bartlettroscoe/events{/privacy}","received_events_url":"https://api.github.com/users/bartlettroscoe/received_events","type":"User","site_admin":false},"open_issues":14,"closed_issues":48,"state":"open","created_at":"2018-02-20T22:30:27Z","updated_at":"2018-09-13T17:12:44Z","due_on":null,"closed_at":null},"comments":5,"created_at":"2018-09-13T17:12:06Z","updated_at":"2018-09-13T19:34:13Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"CC: @trilinos/kokkos-kernels , @kddevin  (Trilinos Data Services Product Lead)\r\n \r\n## Next Action Status\r\n\r\n## Description\r\nAs shown in [this query](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&date=2018-09-12&filtercombine=and&filtercombine=and&filtercount=3&showfilters=1&filtercombine=and&field1=buildname&compare1=63&value1=Trilinos-atdm-&field2=testname&compare2=63&value2=KokkosKernels_sparse_&field3=status&compare3=62&value3=Passed) the tests:\r\n* KokkosKernels_sparse_serial_MPI_1 \r\n* KokkosKernels_sparse_cuda_MPI_1 \r\n\r\nare failing in all the cuda builds on white, ride, hansen, and waterman:\r\n\r\n* Trilinos-atdm-waterman-gnu-debug-openmp\r\n* Trilinos-atdm-waterman-cuda-9.2-debug\r\n* Trilinos-atdm-waterman-cuda-9.2-opt\r\n* Trilinos-atdm-white-ride-cuda-9.2-opt\r\n* Trilinos-atdm-white-ride-cuda-9.2-debug-pt\r\n* Trilinos-atdm-white-ride-cuda-9.2-debug\r\n* Trilinos-atdm-hansen-shiller-cuda-8.0-opt\r\n* Trilinos-atdm-hansen-shiller-cuda-9.0-debug\r\n* Trilinos-atdm-hansen-shiller-cuda-9.0-opt\r\n\r\n\r\n[Here](https://testing.sandia.gov/cdash/queryTests.php?project=Trilinos&date=2018-09-04&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercount=7&showfilters=1&filtercombine=and&field1=buildname&compare1=63&value1=Trilinos-atdm-&field2=buildname&compare2=63&value2=cuda&field3=buildname&compare3=64&value3=hansen&field4=buildname&compare4=64&value4=waterman&field5=testname&compare5=63&value5=KokkosKernels_sparse_cuda&field6=buildstarttime&compare6=84&value6=2018-09-13&field7=buildstarttime&compare7=83&value7=2018-09-05) you can see that these tests started failing on 9/7/2018\r\n\r\nat the bottom of [this page](https://testing.sandia.gov/cdash/viewNotes.php?buildid=3912160) is a list of commits that were new on that day.\r\n\r\n## Steps to Reproduce\r\n\r\nOne should be able to reproduce this failure as described in:\r\n* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md\r\nMore specifically, the commands given for the system white are provided at:\r\n* https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#ridewhite\r\nThe exact commands to reproduce this issue should be:\r\n```\r\n$ cd <some_build_dir>/\r\n\r\n$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh cuda-debug\r\n\r\n$ cmake \\\r\n  -GNinja \\\r\n  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \\\r\n  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_KokkosKernals=ON \\\r\n  $TRILINOS_DIR\r\n\r\n$ make NP=16\r\n\r\n$ bsub -x -Is -q rhel7F -n 16 ctest -j16\r\n```"},"comment":{"url":"https://api.github.com/repos/trilinos/Trilinos/issues/comments/421126070","html_url":"https://github.com/trilinos/Trilinos/issues/3438#issuecomment-421126070","issue_url":"https://api.github.com/repos/trilinos/Trilinos/issues/3438","id":421126070,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMTEyNjA3MA==","user":{"login":"kyungjoo-kim","id":6992602,"node_id":"MDQ6VXNlcjY5OTI2MDI=","avatar_url":"https://avatars2.githubusercontent.com/u/6992602?v=4","gravatar_id":"","url":"https://api.github.com/users/kyungjoo-kim","html_url":"https://github.com/kyungjoo-kim","followers_url":"https://api.github.com/users/kyungjoo-kim/followers","following_url":"https://api.github.com/users/kyungjoo-kim/following{/other_user}","gists_url":"https://api.github.com/users/kyungjoo-kim/gists{/gist_id}","starred_url":"https://api.github.com/users/kyungjoo-kim/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kyungjoo-kim/subscriptions","organizations_url":"https://api.github.com/users/kyungjoo-kim/orgs","repos_url":"https://api.github.com/users/kyungjoo-kim/repos","events_url":"https://api.github.com/users/kyungjoo-kim/events{/privacy}","received_events_url":"https://api.github.com/users/kyungjoo-kim/received_events","type":"User","site_admin":false},"created_at":"2018-09-13T19:34:13Z","updated_at":"2018-09-13T19:34:13Z","author_association":"CONTRIBUTOR","body":"Look at the error message with serial build with gcc compilers. It has the same error described in kokkos/kokkos-kernels#289. The corresponding PR patch should be applied. If it is already applied, then we have another edge case. "}}
{"actor":{"display_login":"kyungjoo-kim"}}