{"action":"created","issue":{"url":"https://api.github.com/repos/rapidsai/cudf/issues/415","repository_url":"https://api.github.com/repos/rapidsai/cudf","labels_url":"https://api.github.com/repos/rapidsai/cudf/issues/415/labels{/name}","comments_url":"https://api.github.com/repos/rapidsai/cudf/issues/415/comments","events_url":"https://api.github.com/repos/rapidsai/cudf/issues/415/events","html_url":"https://github.com/rapidsai/cudf/issues/415","id":385441321,"node_id":"MDU6SXNzdWUzODU0NDEzMjE=","number":415,"title":"segfault in construct_join_output_df","user":{"login":"DrTodd13","id":2584128,"node_id":"MDQ6VXNlcjI1ODQxMjg=","avatar_url":"https://avatars2.githubusercontent.com/u/2584128?v=4","gravatar_id":"","url":"https://api.github.com/users/DrTodd13","html_url":"https://github.com/DrTodd13","followers_url":"https://api.github.com/users/DrTodd13/followers","following_url":"https://api.github.com/users/DrTodd13/following{/other_user}","gists_url":"https://api.github.com/users/DrTodd13/gists{/gist_id}","starred_url":"https://api.github.com/users/DrTodd13/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DrTodd13/subscriptions","organizations_url":"https://api.github.com/users/DrTodd13/orgs","repos_url":"https://api.github.com/users/DrTodd13/repos","events_url":"https://api.github.com/users/DrTodd13/events{/privacy}","received_events_url":"https://api.github.com/users/DrTodd13/received_events","type":"User","site_admin":false},"labels":[{"id":1016138296,"node_id":"MDU6TGFiZWwxMDE2MTM4Mjk2","url":"https://api.github.com/repos/rapidsai/cudf/labels/?%20-%20Needs%20Triage","name":"? - Needs Triage","color":"e99695","default":false},{"id":1139740666,"node_id":"MDU6TGFiZWwxMTM5NzQwNjY2","url":"https://api.github.com/repos/rapidsai/cudf/labels/libcudf%20(C++/CUDA)","name":"libcudf (C++/CUDA)","color":"c5def5","default":false}],"state":"open","locked":false,"assignee":{"login":"jrhemstad","id":15221289,"node_id":"MDQ6VXNlcjE1MjIxMjg5","avatar_url":"https://avatars1.githubusercontent.com/u/15221289?v=4","gravatar_id":"","url":"https://api.github.com/users/jrhemstad","html_url":"https://github.com/jrhemstad","followers_url":"https://api.github.com/users/jrhemstad/followers","following_url":"https://api.github.com/users/jrhemstad/following{/other_user}","gists_url":"https://api.github.com/users/jrhemstad/gists{/gist_id}","starred_url":"https://api.github.com/users/jrhemstad/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jrhemstad/subscriptions","organizations_url":"https://api.github.com/users/jrhemstad/orgs","repos_url":"https://api.github.com/users/jrhemstad/repos","events_url":"https://api.github.com/users/jrhemstad/events{/privacy}","received_events_url":"https://api.github.com/users/jrhemstad/received_events","type":"User","site_admin":false},"assignees":[{"login":"jrhemstad","id":15221289,"node_id":"MDQ6VXNlcjE1MjIxMjg5","avatar_url":"https://avatars1.githubusercontent.com/u/15221289?v=4","gravatar_id":"","url":"https://api.github.com/users/jrhemstad","html_url":"https://github.com/jrhemstad","followers_url":"https://api.github.com/users/jrhemstad/followers","following_url":"https://api.github.com/users/jrhemstad/following{/other_user}","gists_url":"https://api.github.com/users/jrhemstad/gists{/gist_id}","starred_url":"https://api.github.com/users/jrhemstad/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jrhemstad/subscriptions","organizations_url":"https://api.github.com/users/jrhemstad/orgs","repos_url":"https://api.github.com/users/jrhemstad/repos","events_url":"https://api.github.com/users/jrhemstad/events{/privacy}","received_events_url":"https://api.github.com/users/jrhemstad/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2018-11-28T20:22:17Z","updated_at":"2018-11-28T22:15:22Z","closed_at":null,"author_association":"NONE","body":"```\r\nStarting program: /nfs_home/username/miniconda3/envs/rapids2/bin/python straight_ETL.py\r\n[Thread debugging using libthread_db enabled]\r\nUsing host libthread_db library \"/usr/lib64/libthread_db.so.1\".\r\nMissing separate debuginfo for /nfs_home/username/miniconda3/envs/rapids2/lib/python3.5/site-packages/numpy/../../../libiomp5.so\r\nTry: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/50/126f8244a53ed88a1531546fcaa8dedc4bc85c.debug\r\nDetaching after fork from child process 216222.\r\nDetaching after fork from child process 216225.\r\n/nfs_home/username/miniconda3/envs/rapids2/lib/python3.5/importlib/_bootstrap.py:222: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88\r\n  return f(*args, **kwds)\r\ndata_directory /nfs_home/username/rapids/mortgage/perf/\r\nWorking on file /nfs_home/username/rapids/mortgage/perf/Performance_2001Q4.txt_1\r\ngpu_load_names /nfs_home/username/rapids/mortgage/names.csv\r\n[New Thread 0x2aaade1c5700 (LWP 216238)]\r\n[New Thread 0x2aaade3c6700 (LWP 216239)]\r\n/nfs_home/username/rapids/mortgage/acq/Acquisition_2001Q4.txt\r\n1:int64\r\n1:int32\r\n1:float64\r\n1:int64\r\n1:int64\r\nAttributeError: 'str' object has no attribute 'type'\r\nException ignored in: 'cudf.bindings.cudf_cpp.column_view_from_column'\r\nAttributeError: 'str' object has no attribute 'type'\r\n1:datetime64[ms]\r\nAttributeError: 'str' object has no attribute 'type'\r\nException ignored in: 'cudf.bindings.cudf_cpp.column_view_from_NDArrays'\r\nAttributeError: 'str' object has no attribute 'type'\r\nAttributeError: 'str' object has no attribute 'type'\r\nException ignored in: 'cudf.bindings.cudf_cpp.column_view_from_column'\r\nAttributeError: 'str' object has no attribute 'type'\r\n1:datetime64[ms]\r\nAttributeError: 'str' object has no attribute 'type'\r\nException ignored in: 'cudf.bindings.cudf_cpp.column_view_from_NDArrays'\r\nAttributeError: 'str' object has no attribute 'type'\r\n1:float64\r\n1:float64\r\n1:float64\r\n1:float64\r\n1:float64\r\n1:int32\r\n1:int32\r\n1:int32\r\n1:int64\r\n1:int32\r\n1:int32\r\n1:int64\r\n1:float64\r\n1:int32\r\n1:float64\r\n1:float64\r\n1:int32\r\n2:int32\r\n3:int32\r\n\r\nProgram received signal SIGSEGV, Segmentation fault.\r\n0x00002aaad35f7214 in gdf_error construct_join_output_df<(JoinType)1, long, int>(std::vector<gdf_column_*, std::allocator<gdf_column_*> >&, std::vector<gdf_column_*, std::allocator<gdf_column_*> >&, gdf_column_**, int, int*, gdf_column_**, int, int*, int, int, gdf_column_**, gdf_column_*, gdf_column_*) () from /nfs_home/username/miniconda3/envs/rapids2/lib/python3.5/site-packages/../../libcudf.so\r\nMissing separate debuginfos, use: debuginfo-install glibc-2.17-222.el7.x86_64 libuuid-2.23.2-52.el7.x86_64\r\n(gdb) bt\r\n#0  0x00002aaad35f7214 in gdf_error construct_join_output_df<(JoinType)1, long, int>(std::vector<gdf_column_*, std::allocator<gdf_column_*> >&, std::vector<gdf_column_*, std::allocator<gdf_column_*> >&, gdf_column_**, int, int*, gdf_column_**, int, int*, int, int, gdf_column_**, gdf_column_*, gdf_column_*) () from /nfs_home/username/miniconda3/envs/rapids2/lib/python3.5/site-packages/../../libcudf.so\r\n#1  0x00002aaad35f7ce2 in gdf_error join_call_compute_df<(JoinType)1, long, int>(gdf_column_**, int, int*, gdf_column_**, int, int*, int, int, gdf_column_**, gdf_column_*, gdf_column_*, gdf_context_*) ()\r\n   from /nfs_home/username/miniconda3/envs/rapids2/lib/python3.5/site-packages/../../libcudf.so\r\n#2  0x00002aaad7dbde55 in __pyx_f_4cudf_8bindings_4join_join (__pyx_v_col_lhs=<optimized out>, __pyx_v_col_rhs=<optimized out>, __pyx_v_on=<optimized out>, __pyx_v_how=<optimized out>, __pyx_optional_args=<optimized out>, __pyx_skip_dispatch=0)\r\n    at cudf/bindings/join.cpp:2856\r\n#3  0x00002aaad7dc10e3 in __pyx_pf_4cudf_8bindings_4join_join (__pyx_self=<optimized out>, __pyx_v_method=<optimized out>, __pyx_v_how=<optimized out>, __pyx_v_on=<optimized out>, __pyx_v_col_rhs=<optimized out>, __pyx_v_col_lhs=<optimized out>)\r\n    at cudf/bindings/join.cpp:3664\r\n#4  __pyx_pw_4cudf_8bindings_4join_1join (__pyx_self=<optimized out>, __pyx_args=<optimized out>, __pyx_kwds=<optimized out>) at cudf/bindings/join.cpp:3648\r\n#5  0x00002aaaaad92199 in PyCFunction_Call (func=func@entry=0x2aaad2d08750, args=args@entry=0x2aaad2d1d4a8, kwds=kwds@entry=0x2aaad2d32048) at Objects/methodobject.c:98\r\n#6  0x00002aaaaae2d3f9 in do_call (nk=<optimized out>, na=<optimized out>, pp_stack=0x7fffffffc380, func=<optimized out>) at Python/ceval.c:4986\r\n#7  call_function (oparg=<optimized out>, pp_stack=0x7fffffffc380) at Python/ceval.c:4785\r\n#8  PyEval_EvalFrameEx (f=f@entry=0x63b03c8, throwflag=throwflag@entry=0) at Python/ceval.c:3289\r\n#9  0x00002aaaaae2f4b6 in _PyEval_EvalCodeWithName (_co=0x2aaac9a2ec00, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=2, kws=0x63b0e30, kwcount=2, defs=0x2aaad2cfef00, defcount=6, kwdefs=kwdefs@entry=0x0, closure=0x0,\r\n    name=name@entry=0x2aaaaac618b8, qualname=0x2aaac9a32170) at Python/ceval.c:4071\r\n#10 0x00002aaaaae2c5b5 in fast_function (nk=<optimized out>, na=<optimized out>, n=6, pp_stack=0x7fffffffc5b0, func=<optimized out>) at Python/ceval.c:4866\r\n#11 call_function (oparg=<optimized out>, pp_stack=0x7fffffffc5b0) at Python/ceval.c:4783\r\n#12 PyEval_EvalFrameEx (f=f@entry=0x63b0c38, throwflag=throwflag@entry=0) at Python/ceval.c:3289\r\n#13 0x00002aaaaae2f4b6 in _PyEval_EvalCodeWithName (_co=0x2aaaaac4d270, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=0, kws=0x2aaaaab7b9c0, kwcount=4, defs=0x2aaad2d17f60, defcount=4, kwdefs=kwdefs@entry=0x0, closure=0x0,\r\n    name=name@entry=0x2aaaaac5c7c8, qualname=0x2aaaaac5c7c8) at Python/ceval.c:4071\r\n#14 0x00002aaaaae2c5b5 in fast_function (nk=<optimized out>, na=<optimized out>, n=8, pp_stack=0x7fffffffc7e0, func=<optimized out>) at Python/ceval.c:4866\r\n#15 call_function (oparg=<optimized out>, pp_stack=0x7fffffffc7e0) at Python/ceval.c:4783\r\n#16 PyEval_EvalFrameEx (f=f@entry=0x2aaaaab7b828, throwflag=throwflag@entry=0) at Python/ceval.c:3289\r\n#17 0x00002aaaaae2f4b6 in _PyEval_EvalCodeWithName (_co=_co@entry=0x2aaaaac4da50, globals=globals@entry=0x2aaaaabb0408, locals=locals@entry=0x2aaaaabb0408, args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0,\r\n    defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0, name=name@entry=0x0, qualname=qualname@entry=0x0) at Python/ceval.c:4071\r\n#18 0x00002aaaaae2f5a8 in PyEval_EvalCodeEx (_co=_co@entry=0x2aaaaac4da50, globals=globals@entry=0x2aaaaabb0408, locals=locals@entry=0x2aaaaabb0408, args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0,\r\n    defcount=defcount@entry=0, kwdefs=kwdefs@entry=0x0, closure=closure@entry=0x0) at Python/ceval.c:4092\r\n#19 0x00002aaaaae2f5eb in PyEval_EvalCode (co=co@entry=0x2aaaaac4da50, globals=globals@entry=0x2aaaaabb0408, locals=locals@entry=0x2aaaaabb0408) at Python/ceval.c:777\r\n#20 0x00002aaaaae5fa02 in run_mod (arena=0x6555d0, flags=0x7fffffffcac0, locals=0x2aaaaabb0408, globals=0x2aaaaabb0408, filename=0x2aaaaac652b0, mod=0x6f49c0) at Python/pythonrun.c:991\r\n#21 PyRun_FileExFlags (fp=fp@entry=0x6c0240, filename_str=filename_str@entry=0x2aaaaaba6500 \"straight_ETL.py\", start=start@entry=257, globals=globals@entry=0x2aaaaabb0408, locals=locals@entry=0x2aaaaabb0408, closeit=closeit@entry=1, flags=flags@entry=0x7fffffffcac0)\r\n    at Python/pythonrun.c:944\r\n#22 0x00002aaaaae5fb67 in PyRun_SimpleFileExFlags (fp=fp@entry=0x6c0240, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fffffffcac0) at Python/pythonrun.c:411\r\n#23 0x00002aaaaae60023 in PyRun_AnyFileExFlags (fp=fp@entry=0x6c0240, filename=<optimized out>, closeit=closeit@entry=1, flags=flags@entry=0x7fffffffcac0) at Python/pythonrun.c:80\r\n#24 0x00002aaaaae7cd2c in run_file (p_cf=0x7fffffffcac0, filename=0x603310 L\"straight_ETL.py\", fp=0x6c0240) at Modules/main.c:333\r\n#25 Py_Main (argc=argc@entry=2, argv=argv@entry=0x602010) at Modules/main.c:794\r\n#26 0x0000000000400b54 in main (argc=2, argv=<optimized out>) at ./Programs/python.c:65\r\n```\r\n\r\nThe error occurs on line \"acq_gdf.merge\" in run_gpu_workflow in the docker example although run in a straight Python file outside of Jupyter.\r\n\r\n\r\n- Using the latest version of cuDF, freshly built today.\r\n- commit 44952a3b98aa0b332f9bf83c9caf420fec737627\r\n- CentOS Linux relate 7.5.1804 (Core)\r\n- Kernel version => v3.10.0-862.el7.x86_64\r\n\r\n```\r\n+-----------------------------------------------------------------------------+\r\n| NVIDIA-SMI 396.37                 Driver Version: 396.37                    |\r\n|-------------------------------+----------------------+----------------------+\r\n| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\r\n| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\r\n|===============================+======================+======================|\r\n|   0  Tesla V100-PCIE...  Off  | 00000000:86:00.0 Off |                    0 |\r\n| N/A   44C    P0    40W / 250W |      0MiB / 16160MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n|   1  Tesla V100-PCIE...  Off  | 00000000:AF:00.0 Off |                    0 |\r\n| N/A   43C    P0    39W / 250W |      0MiB / 16160MiB |      3%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n\r\nIn conda environment.  Here's conda list:\r\narrow-cpp                 0.10.0           py35h70250a7_0    conda-forge\r\natomicwrites              1.2.1                    py35_0\r\nattrs                     18.2.0           py35h28b3542_0\r\nbinutils_impl_linux-64    2.31.1               h6176602_1    anaconda\r\nbinutils_linux-64         2.31.1               h6176602_3    anaconda\r\nblas                      1.0                         mkl\r\nboost-cpp                 1.67.0               h3a22d5f_0    conda-forge\r\nbzip2                     1.0.6                h470a237_2    conda-forge\r\nca-certificates           2018.10.15           ha4d7672_0    conda-forge\r\ncertifi                   2018.8.24             py35_1001    conda-forge\r\ncffi                      1.11.5           py35h5e8e0c9_1    conda-forge\r\ncudf                      0.3.0+65.g44952a3           <pip>\r\ncython                    0.28.5           py35hfc679d8_0    conda-forge\r\ngcc-6                     6.1.0                         2    omgarcia\r\ngcc_impl_linux-64         7.3.0                habb00fd_1    anaconda\r\ngcc_linux-64              7.3.0                h553295d_3    anaconda\r\ngfortran_impl_linux-64    7.3.0                hdf63c60_1    anaconda\r\ngfortran_linux-64         7.3.0                h553295d_3    anaconda\r\ngmp                       6.1.0                         1    omgarcia\r\ngxx_impl_linux-64         7.3.0                hdf63c60_1    anaconda\r\ngxx_linux-64              7.3.0                h553295d_3    anaconda\r\nicu                       58.2                 hfc679d8_0    conda-forge\r\nintel-openmp              2019.1                      144\r\nisl                       0.17.1                        0    omgarcia\r\nlibcudf                   0.3.0                 cuda9.2_3    rapidsai\r\nlibcudf_cffi              0.3.0            cuda9.2_py35_3    rapidsai\r\nlibffi                    3.2.1                hfc679d8_5    conda-forge\r\nlibgcc-ng                 8.2.0                hdf63c60_1    anaconda\r\nlibgdf                    0.2.0               cuda9.2_169    rapidsai\r\nlibgdf_cffi               0.2.0           cuda9.2_py35_169    rapidsai\r\nlibgfortran               3.0.0                         1    conda-forge\r\nlibgfortran-ng            7.3.0                hdf63c60_0    anaconda\r\nlibstdcxx-ng              8.2.0                hdf63c60_1    anaconda\r\nllvmlite                  0.25.0dev0      py35hf484d3e_20    numba\r\nmkl                       2018.0.3                      1\r\nmkl_fft                   1.0.6                    py35_0    conda-forge\r\nmkl_random                1.0.1                    py35_0    conda-forge\r\nmore-itertools            4.3.0                    py35_0\r\nmpc                       1.0.1                         0    omgarcia\r\nmpfr                      3.1.2                         0    omgarcia\r\nncurses                   6.1                  hfc679d8_1    conda-forge\r\nnumba                     0.40.0dev0      np115py35hf484d3e_254    numba\r\nnumpy                     1.15.0           py35h1b885b7_0\r\nnumpy-base                1.15.0           py35h3dfced4_0\r\nnvstrings                 0.0.3            cuda9.2_py35_0    nvidia\r\nopenblas                  0.2.20                        8    conda-forge\r\nopenssl                   1.0.2p               h470a237_1    conda-forge\r\npandas                    0.20.3                   py35_1    conda-forge\r\nparquet-cpp               1.5.0.pre            h83d4a3d_0    conda-forge\r\npathlib2                  2.3.2                    py35_0\r\npip                       18.0                  py35_1001    conda-forge\r\npluggy                    0.7.1            py35h28b3542_0\r\npy                        1.6.0                    py35_0\r\npyarrow                   0.10.0           py35hfc679d8_0    conda-forge\r\npycparser                 2.19                       py_0    conda-forge\r\npytest                    3.8.1                    py35_0\r\npython                    3.5.5                h5001a0f_2    conda-forge\r\npython-dateutil           2.7.5                      py_0    conda-forge\r\npytz                      2018.7                     py_0    conda-forge\r\nreadline                  7.0                  haf1bffa_1    conda-forge\r\nsetuptools                40.4.3                   py35_0    conda-forge\r\nsix                       1.11.0                   py35_1    conda-forge\r\nsqlite                    3.25.3               hb1c47c0_0    conda-forge\r\ntk                        8.6.9                ha92aebf_0    conda-forge\r\nwheel                     0.32.0                py35_1000    conda-forge\r\nxz                        5.2.4                h470a237_1    conda-forge\r\nzlib                      1.2.11               h470a237_3    conda-forge\r\n```\r\nCuda 9.2\r\nGCC 6.1.0\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/rapidsai/cudf/issues/comments/442625622","html_url":"https://github.com/rapidsai/cudf/issues/415#issuecomment-442625622","issue_url":"https://api.github.com/repos/rapidsai/cudf/issues/415","id":442625622,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0MjYyNTYyMg==","user":{"login":"kkraus14","id":3665167,"node_id":"MDQ6VXNlcjM2NjUxNjc=","avatar_url":"https://avatars2.githubusercontent.com/u/3665167?v=4","gravatar_id":"","url":"https://api.github.com/users/kkraus14","html_url":"https://github.com/kkraus14","followers_url":"https://api.github.com/users/kkraus14/followers","following_url":"https://api.github.com/users/kkraus14/following{/other_user}","gists_url":"https://api.github.com/users/kkraus14/gists{/gist_id}","starred_url":"https://api.github.com/users/kkraus14/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kkraus14/subscriptions","organizations_url":"https://api.github.com/users/kkraus14/orgs","repos_url":"https://api.github.com/users/kkraus14/repos","events_url":"https://api.github.com/users/kkraus14/events{/privacy}","received_events_url":"https://api.github.com/users/kkraus14/received_events","type":"User","site_admin":false},"created_at":"2018-11-28T22:15:22Z","updated_at":"2018-11-28T22:15:22Z","author_association":"MEMBER","body":"From the looks of it you installed only the cudf python library from source but are still using libcudf and libcudf_cffi from conda. I'd suggest just installing all 3 from conda to ensure they're properly in sync. This looks to be an environment issue based on the error from pytests above."}}
{"actor":{"display_login":"kkraus14"}}