{"action":"created","issue":{"url":"https://api.github.com/repos/apache/arrow/issues/1889","repository_url":"https://api.github.com/repos/apache/arrow","labels_url":"https://api.github.com/repos/apache/arrow/issues/1889/labels{/name}","comments_url":"https://api.github.com/repos/apache/arrow/issues/1889/comments","events_url":"https://api.github.com/repos/apache/arrow/issues/1889/events","html_url":"https://github.com/apache/arrow/pull/1889","id":314027754,"node_id":"MDExOlB1bGxSZXF1ZXN0MTgxNDI4MTkx","number":1889,"title":"ARROW-2300: [C++/Python] Integration test for HDFS","user":{"login":"kszucs","id":961747,"node_id":"MDQ6VXNlcjk2MTc0Nw==","avatar_url":"https://avatars1.githubusercontent.com/u/961747?v=4","gravatar_id":"","url":"https://api.github.com/users/kszucs","html_url":"https://github.com/kszucs","followers_url":"https://api.github.com/users/kszucs/followers","following_url":"https://api.github.com/users/kszucs/following{/other_user}","gists_url":"https://api.github.com/users/kszucs/gists{/gist_id}","starred_url":"https://api.github.com/users/kszucs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kszucs/subscriptions","organizations_url":"https://api.github.com/users/kszucs/orgs","repos_url":"https://api.github.com/users/kszucs/repos","events_url":"https://api.github.com/users/kszucs/events{/privacy}","received_events_url":"https://api.github.com/users/kszucs/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-04-13T09:10:16Z","updated_at":"2018-07-05T22:47:07Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/arrow/pulls/1889","html_url":"https://github.com/apache/arrow/pull/1889","diff_url":"https://github.com/apache/arrow/pull/1889.diff","patch_url":"https://github.com/apache/arrow/pull/1889.patch"},"body":"Don't merge yet, the tests are running, but test case fails with a segfault:\r\n\r\n```\r\n...\r\n[       OK ] TestHadoopFileSystem/1.AppendToFile (102 ms)\r\n[ RUN      ] TestHadoopFileSystem/1.ListDirectory\r\n2018-04-13 10:42:07.815260, p4732, th139976980866944, WARNING the number of nodes in pipeline is 1 [6a75d180502e(172.18.0.3)], is less than the expected number of replica 3 for block [block pool ID: BP-565321869-172.17.0.3-1481502352273 b\r\nlock ID 1073741905_1099] file /tmp/arrow-hdfs/scratch-1325/test-file-1\r\n2018-04-13 10:42:07.832038, p4732, th139976980866944, WARNING the number of nodes in pipeline is 1 [6a75d180502e(172.18.0.3)], is less than the expected number of replica 3 for block [block pool ID: BP-565321869-172.17.0.3-1481502352273 b\r\nlock ID 1073741906_1100] file /tmp/arrow-hdfs/scratch-1325/test-file-2\r\narrow/dev/hdfs_integration/hdfs_integration.sh: line 76:  4732 Segmentation fault      arrow/cpp/build/debug/io-hdfs-test\r\n```\r\n\r\nCore dump\r\n\r\n```\r\nProgram terminated with signal SIGSEGV, Segmentation fault.\r\n#0  0x00007f6c79048cec in length (__s=<optimized out>)\r\n    at /home/msarahan/miniconda2/conda-bld/compilers_linux-64_1507259624353/work/.build/x86_64-conda_cos6-linux-gnu/build/build-cc-gcc-final/x86_64-conda_cos6-linux-gnu/libstdc++-v3/include/bits/char_traits.h:269\r\n269     /home/msarahan/miniconda2/conda-bld/compilers_linux-64_1507259624353/work/.build/x86_64-conda_cos6-linux-gnu/build/build-cc-gcc-final/x86_64-conda_cos6-linux-gnu/libstdc++-v3/include/bits/char_traits.h: No such file or directory.\r\n(gdb) bt\r\n#0  0x00007f6c79048cec in length (__s=<optimized out>)\r\n    at /home/msarahan/miniconda2/conda-bld/compilers_linux-64_1507259624353/work/.build/x86_64-conda_cos6-linux-gnu/build/build-cc-gcc-final/x86_64-conda_cos6-linux-gnu/libstdc++-v3/include/bits/char_traits.h:269\r\n#1  std::basic_string<char, std::char_traits<char>, std::allocator<char> >::basic_string (this=0x7ffc82ee5260, __s=0x46 <error: Cannot access memory at address 0x46>, __a=...)\r\n    at /home/msarahan/miniconda2/conda-bld/compilers_linux-64_1507259624353/work/.build/x86_64-conda_cos6-linux-gnu/build/build-cc-gcc-final/x86_64-conda_cos6-linux-gnu/libstdc++-v3/include/bits/basic_string.tcc:664\r\n#2  0x0000000000657b46 in arrow::io::SetPathInfo (input=0x18c7dd0, out=0x18c77c0) at /apache-arrow/arrow/cpp/src/arrow/io/hdfs.cc:300\r\n#3  0x000000000065aa16 in arrow::io::HadoopFileSystem::HadoopFileSystemImpl::ListDirectory (this=0x18af890, path=..., listing=0x7ffc82ee5610) at /apache-arrow/arrow/cpp/src/arrow/io/hdfs.cc:444\r\n#4  0x000000000065820b in arrow::io::HadoopFileSystem::ListDirectory (this=0x189ed80, path=..., listing=0x7ffc82ee5610) at /apache-arrow/arrow/cpp/src/arrow/io/hdfs.cc:582\r\n#5  0x00000000005cc5cc in arrow::io::TestHadoopFileSystem_ListDirectory_Test<arrow::io::PivotalDriver>::TestBody (this=0x18a2990) at /apache-arrow/arrow/cpp/src/arrow/io/io-hdfs-test.cc:295\r\n#6  0x000000000068ab70 in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void> (object=0x18a2990, method=&virtual testing::Test::TestBody(), location=0x6a1833 \"the test body\")\r\n    at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2402\r\n#7  0x0000000000684c2e in testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void> (object=0x18a2990, method=&virtual testing::Test::TestBody(), location=0x6a1833 \"the test body\")\r\n    at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2438\r\n#8  0x000000000066b0a5 in testing::Test::Run (this=0x18a2990) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2475\r\n#9  0x000000000066b94c in testing::TestInfo::Run (this=0x18a0ee0) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2656\r\n#10 0x000000000066c010 in testing::TestCase::Run (this=0x189f6f0) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2774\r\n#11 0x00000000006729e0 in testing::internal::UnitTestImpl::RunAllTests (this=0x189ef90) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:4649\r\n#12 0x000000000068be92 in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0x189ef90,\r\n    method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl * const)) 0x672748 <testing::internal::UnitTestImpl::RunAllTests()>, location=0x6a20b8 \"auxiliary test code (environments or event listeners)\")\r\n    at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2402\r\n#13 0x0000000000685960 in testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0x189ef90,\r\n    method=(bool (testing::internal::UnitTestImpl::*)(testing::internal::UnitTestImpl * const)) 0x672748 <testing::internal::UnitTestImpl::RunAllTests()>, location=0x6a20b8 \"auxiliary test code (environments or event listeners)\")\r\n    at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:2438\r\n#14 0x0000000000671606 in testing::UnitTest::Run (this=0x9171c0 <testing::UnitTest::GetInstance()::instance>) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest.cc:4260\r\n#15 0x0000000000696dbd in RUN_ALL_TESTS () at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/include/gtest/gtest.h:2233\r\n#16 0x0000000000696d4d in main (argc=1, argv=0x7ffc82ee5aa8) at /apache-arrow/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/googletest/src/gtest_main.cc:37\r\n```\r\n\r\nI've tried with different compiler versions, but without any luck. Suggestions how should I fix it?\r\n"},"comment":{"url":"https://api.github.com/repos/apache/arrow/issues/comments/402874166","html_url":"https://github.com/apache/arrow/pull/1889#issuecomment-402874166","issue_url":"https://api.github.com/repos/apache/arrow/issues/1889","id":402874166,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMjg3NDE2Ng==","user":{"login":"kszucs","id":961747,"node_id":"MDQ6VXNlcjk2MTc0Nw==","avatar_url":"https://avatars1.githubusercontent.com/u/961747?v=4","gravatar_id":"","url":"https://api.github.com/users/kszucs","html_url":"https://github.com/kszucs","followers_url":"https://api.github.com/users/kszucs/followers","following_url":"https://api.github.com/users/kszucs/following{/other_user}","gists_url":"https://api.github.com/users/kszucs/gists{/gist_id}","starred_url":"https://api.github.com/users/kszucs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kszucs/subscriptions","organizations_url":"https://api.github.com/users/kszucs/orgs","repos_url":"https://api.github.com/users/kszucs/repos","events_url":"https://api.github.com/users/kszucs/events{/privacy}","received_events_url":"https://api.github.com/users/kszucs/received_events","type":"User","site_admin":false},"created_at":"2018-07-05T22:47:07Z","updated_at":"2018-07-05T22:47:07Z","author_association":"CONTRIBUTOR","body":"Hmm, sooo these are the symptoms of ABI incompatibility. Pinning it, thanks!"}}
{"actor":{"display_login":"kszucs"}}