{"action":"created","issue":{"url":"https://api.github.com/repos/SeisSol/SeisSol/issues/17","repository_url":"https://api.github.com/repos/SeisSol/SeisSol","labels_url":"https://api.github.com/repos/SeisSol/SeisSol/issues/17/labels{/name}","comments_url":"https://api.github.com/repos/SeisSol/SeisSol/issues/17/comments","events_url":"https://api.github.com/repos/SeisSol/SeisSol/issues/17/events","html_url":"https://github.com/SeisSol/SeisSol/issues/17","id":150315778,"number":17,"title":"TVP33 fails with an assert or a segfault ","user":{"login":"schauveau","id":14061306,"avatar_url":"https://avatars.githubusercontent.com/u/14061306?v=3","gravatar_id":"","url":"https://api.github.com/users/schauveau","html_url":"https://github.com/schauveau","followers_url":"https://api.github.com/users/schauveau/followers","following_url":"https://api.github.com/users/schauveau/following{/other_user}","gists_url":"https://api.github.com/users/schauveau/gists{/gist_id}","starred_url":"https://api.github.com/users/schauveau/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schauveau/subscriptions","organizations_url":"https://api.github.com/users/schauveau/orgs","repos_url":"https://api.github.com/users/schauveau/repos","events_url":"https://api.github.com/users/schauveau/events{/privacy}","received_events_url":"https://api.github.com/users/schauveau/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2016-04-22T09:11:28Z","updated_at":"2016-04-22T11:31:19Z","closed_at":null,"body":"The TPV33 test described in https://github.com/SeisSol/SeisSol/wiki/First-run fails with either a segfault (in release mode) or an  assert (in debug mode). \r\n\r\n```\r\n# mpirun -n 8 ../build/SeisSol_debug_generatedKernels_snoarch_mpi_none_9_3 parameters.par\r\n...\r\nRank:        0 | Info    | Reading basis functions of order            1\r\nRank:        0 | Info    | Reading mass matrices   of order            1\r\nRank:        5 | Error   | initialization Gauss wise\r\nRank:        6 | Error   | initialization Gauss wise\r\nRank:        1 | Error   | initialization Gauss wise\r\nRank:        7 | Error   | initialization Gauss wise\r\nRank:        2 | Error   | initialization Gauss wise\r\nRank:        3 | Error   | initialization Gauss wise\r\nRank:        0 | Error   | initialization Gauss wise\r\nRank:        4 | Error   | initialization Gauss wise\r\nRank:        0 | Info    | Tetrahedral Elements \r\n...\r\nFri Apr 22 00:30:03, Info:  Performed a total of 0 reductions for maximum difference in 139777 cells. \r\nFri Apr 22 00:30:03, Info:  Performed a total of 0 reductions for maximum difference in 139777 cells. \r\nFri Apr 22 00:30:03, Info:  Performed a total of 0 reductions for maximum difference in 139777 cells. \r\nFri Apr 22 00:30:03, Info:  maximum theoretical speedup (compared to GTS): 1.31244 per cell LTS, 1 with the used clustering. \r\nSeisSol_debug_generatedKernels_snoarch_hybrid_none_9_2: src/Initializer/MemoryManager.cpp:927: void seissol::initializers::MemoryManager::initial\r\nizeFaceNeighbors(): Assertion `m_internalState.faceNeighbors[l_cell][l_face] != __null' failed.\r\n[hsw215:46020] *** Process received signal ***\r\n[hsw215:46020] Signal: Aborted (6)\r\n[hsw215:46020] Signal code:  (-6)\r\n```\r\n\r\nThe only suspicious thing in the output before the assert is the 'initialization Gauss wise'. I don't know if that is really significant.\r\n\r\nI am using the current git master (b4464acd2eaf1868d097b5c8b1a891772a228dea) \r\n\r\nI followed the procedure currently described in https://github.com/SeisSol/SeisSol/wiki/First-run \r\n\r\nHere are the md5 of the data files I am using.\r\n\r\n```\r\n80ea388e641fa512c42aac5eb1115a64  createFR.py\r\n45341023037a416e5a9123381e4c0659  matrices_10.xml\r\n2eeacbc250fe99036d845e61c325944d  matrices_20.xml\r\n98b6f1e80076f4899405f1c8b6eaee96  matrices_35.xml\r\n0e1ffdefa426ba1785415815e147cd2b  matrices_4.xml\r\n50daa56f5667127b2f580b12df86c9ae  matrices_56.xml\r\n6e24c535eb6ff5690db52d16dae61c8e  matrices_84.xml\r\n2604fa9c88f114b6296161357b85123b  parameters.par  (edited as requested so md5 may differ)\r\n33f51e3b61c0d4892d1517ce41e9b0ec  parameters.template\r\nebe1531fe7b7e7f831d5d47ec4fa8ec6  tpv33_faultreceivers.dat\r\ne033d78f191c0c2adbf6df4a08ce9469  tpv33_gmsh.met.epart.16\r\n362a5004db2f92307963c6fd1ce601ac  tpv33_gmsh.met.epart.32\r\n6e57cf766bfeb1949cb012951e5c7234  tpv33_gmsh.met.epart.8\r\nb7903c555fa69d250c1506afe7add022  tpv33_gmsh.neu\r\nf657c0265dd722f5c3393484668e7429  tpv33_receivers.dat\r\n```\r\n\r\nI tried various build variants (mpi/hybrid, snoarch/shsw, order 2/3/4, ...) and they all fail the same way.\r\n\r\nMy typical build command looks like that \r\n```\r\nscons  buildVariablesFile=build/options/supermuc_mac_cluster.py compileMode=debug parallelization=mpi arch=snoarch numberOfTemporalIntegrationPoints=1 order=3 generatedKernels=yes netcdf=yes netcdfDir=$NETCDF_C hdf5Dir=$HDF5 -j 4\r\n```\r\nI followed the build instructions except that I used pre-compiled versions of netcdf and  hdf5 which, as far as I know, are working fine. Here is an overview of my environment:\r\n\r\n```\r\nCurrently Loaded Modulefiles:\r\n  1) slurm/14.11.11                    5) hwloc/1.11.2                      9) hdf5/1.10.0\r\n  2) PrgEnv/Intel+OpenMPI/2016-03-21   6) openmpi/1.10.2                   10) pnetcdf/1.7.0\r\n  3) intel/15.0                        7) szip/2.1                         11) netcdf-c/4.4.0\r\n  4) gdk/352.55                        8) zlib/1.2.8\r\n```\r\n\r\n  \r\n"},"comment":{"url":"https://api.github.com/repos/SeisSol/SeisSol/issues/comments/213387314","html_url":"https://github.com/SeisSol/SeisSol/issues/17#issuecomment-213387314","issue_url":"https://api.github.com/repos/SeisSol/SeisSol/issues/17","id":213387314,"user":{"login":"schauveau","id":14061306,"avatar_url":"https://avatars.githubusercontent.com/u/14061306?v=3","gravatar_id":"","url":"https://api.github.com/users/schauveau","html_url":"https://github.com/schauveau","followers_url":"https://api.github.com/users/schauveau/followers","following_url":"https://api.github.com/users/schauveau/following{/other_user}","gists_url":"https://api.github.com/users/schauveau/gists{/gist_id}","starred_url":"https://api.github.com/users/schauveau/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schauveau/subscriptions","organizations_url":"https://api.github.com/users/schauveau/orgs","repos_url":"https://api.github.com/users/schauveau/repos","events_url":"https://api.github.com/users/schauveau/events{/privacy}","received_events_url":"https://api.github.com/users/schauveau/received_events","type":"User","site_admin":false},"created_at":"2016-04-22T11:31:19Z","updated_at":"2016-04-22T11:31:19Z","body":"It took a while at order 6 but I eventually got the same assert.\r\n\r\nDo you think that this could be related to netcfd or hdf5? \r\nI could try to compile them myself instead of using the system versions.\r\n"}}