{"action":"created","issue":{"url":"https://api.github.com/repos/allenai/allennlp/issues/937","repository_url":"https://api.github.com/repos/allenai/allennlp","labels_url":"https://api.github.com/repos/allenai/allennlp/issues/937/labels{/name}","comments_url":"https://api.github.com/repos/allenai/allennlp/issues/937/comments","events_url":"https://api.github.com/repos/allenai/allennlp/issues/937/events","html_url":"https://github.com/allenai/allennlp/issues/937","id":301215125,"number":937,"title":"Issue with training crf tagger on Power8 system","user":{"login":"jateeq","id":959885,"avatar_url":"https://avatars3.githubusercontent.com/u/959885?v=4","gravatar_id":"","url":"https://api.github.com/users/jateeq","html_url":"https://github.com/jateeq","followers_url":"https://api.github.com/users/jateeq/followers","following_url":"https://api.github.com/users/jateeq/following{/other_user}","gists_url":"https://api.github.com/users/jateeq/gists{/gist_id}","starred_url":"https://api.github.com/users/jateeq/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jateeq/subscriptions","organizations_url":"https://api.github.com/users/jateeq/orgs","repos_url":"https://api.github.com/users/jateeq/repos","events_url":"https://api.github.com/users/jateeq/events{/privacy}","received_events_url":"https://api.github.com/users/jateeq/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-02-28T22:53:01Z","updated_at":"2018-03-01T17:22:02Z","closed_at":"2018-03-01T01:05:01Z","author_association":"NONE","body":"I've been able to install AllenNLP on an x86 system and train the available crf tagger without issues. Moving to a Power8 system I've been able to install AllenNLP but on training I get the following ImportError. \r\n\r\n```\r\n$ python -m allennlp.run train crf_tagger.json -s test\r\n/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.\r\n  from ._conv import register_converters as _register_converters\r\nTraceback (most recent call last):\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/runpy.py\", line 193, in _run_module_as_main\r\n    \"__main__\", mod_spec)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/runpy.py\", line 85, in _run_code\r\n    exec(code, run_globals)\r\n  File \"/home/jawad/dev/allennlp/allennlp/run.py\", line 15, in <module>\r\n    from allennlp.commands import main  # pylint: disable=wrong-import-position\r\n  File \"/home/jawad/dev/allennlp/allennlp/commands/__init__.py\", line 6, in <module>\r\n    from allennlp.commands.elmo import Elmo\r\n  File \"/home/jawad/dev/allennlp/allennlp/commands/elmo.py\", line 59, in <module>\r\n    from allennlp.modules.elmo import _ElmoBiLm\r\n  File \"/home/jawad/dev/allennlp/allennlp/modules/__init__.py\", line 14, in <module>\r\n    from allennlp.modules.seq2seq_encoders import Seq2SeqEncoder\r\n  File \"/home/jawad/dev/allennlp/allennlp/modules/seq2seq_encoders/__init__.py\", line 89, in <module>\r\n    from allennlp.modules.alternating_highway_lstm import AlternatingHighwayLSTM\r\n  File \"/home/jawad/dev/allennlp/allennlp/modules/alternating_highway_lstm.py\", line 10, in <module>\r\n    from allennlp.custom_extensions._ext import highway_lstm_layer\r\n  File \"/home/jawad/dev/allennlp/allennlp/custom_extensions/_ext/highway_lstm_layer/__init__.py\", line 3, in <module>\r\n    from ._highway_lstm_layer import lib as _lib, ffi as _ffi\r\nImportError: /home/jawad/dev/allennlp/allennlp/custom_extensions/_ext/highway_lstm_layer/_highway_lstm_layer.so: cannot open shared object file: No such file or directory\r\n```\r\n\r\nMy Environment:\r\n- Operating System: Ubuntu 16.04.3 LTS on Power8 (little endian)\r\n- Python Version Used: Python 3.6.2 |Anaconda, Inc.|\r\n- AllenNLP Version Used: Master from 02/28/2018 (commit starting with dcd648)\r\n\r\nDo I need to build differently for ppc64le? "},"comment":{"url":"https://api.github.com/repos/allenai/allennlp/issues/comments/369664495","html_url":"https://github.com/allenai/allennlp/issues/937#issuecomment-369664495","issue_url":"https://api.github.com/repos/allenai/allennlp/issues/937","id":369664495,"user":{"login":"jateeq","id":959885,"avatar_url":"https://avatars3.githubusercontent.com/u/959885?v=4","gravatar_id":"","url":"https://api.github.com/users/jateeq","html_url":"https://github.com/jateeq","followers_url":"https://api.github.com/users/jateeq/followers","following_url":"https://api.github.com/users/jateeq/following{/other_user}","gists_url":"https://api.github.com/users/jateeq/gists{/gist_id}","starred_url":"https://api.github.com/users/jateeq/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jateeq/subscriptions","organizations_url":"https://api.github.com/users/jateeq/orgs","repos_url":"https://api.github.com/users/jateeq/repos","events_url":"https://api.github.com/users/jateeq/events{/privacy}","received_events_url":"https://api.github.com/users/jateeq/received_events","type":"User","site_admin":false},"created_at":"2018-03-01T17:22:02Z","updated_at":"2018-03-01T17:22:02Z","author_association":"NONE","body":"@DeNeutoy \r\nI commented out the try except block for now and it works. Thanks!\r\n\r\nI tried building the highway lstm but I got the following error, so went with method above.\r\n\r\n```\r\nBuilding kernel for following target architectures:\r\n-gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_37,code=sm_37 -gencode arch=compute_50,code=sm_50 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_60,code=sm_60 -gencode arch=compute_61,code=sm_61\r\nCompiling kernel\r\nmake.sh: line 40: /usr/local/cuda/bin/nvcc: No such file or directory\r\ngenerating /tmp/tmpbk_a51g0/_highway_lstm_layer.c\r\nsetting the current directory to '/tmp/tmpbk_a51g0'\r\nrunning build_ext\r\nbuilding '_highway_lstm_layer' extension\r\ncreating home\r\ncreating home/jawad\r\ncreating home/jawad/dev\r\ncreating home/jawad/dev/allennlp\r\ncreating home/jawad/dev/allennlp/allennlp\r\ncreating home/jawad/dev/allennlp/allennlp/custom_extensions\r\ncreating home/jawad/dev/allennlp/allennlp/custom_extensions/src\r\ngcc -pthread -B /home/jawad/anaconda3_minsky/envs/allennlp/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include -I/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/jawad/anaconda3_minsky/envs/allennlp/include/python3.6m -c _highway_lstm_layer.c -o ./_highway_lstm_layer.o\r\nIn file included from /home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC/THC.h:4:0,\r\n                 from _highway_lstm_layer.c:483:\r\n/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/../../lib/include/THC/THCGeneral.h:10:18: fatal error: cuda.h: No such file or directory\r\ncompilation terminated.\r\nTraceback (most recent call last):\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/unixccompiler.py\", line 118, in _compile\r\n    extra_postargs)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/ccompiler.py\", line 909, in spawn\r\n    spawn(cmd, dry_run=self.dry_run)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/spawn.py\", line 36, in spawn\r\n    _spawn_posix(cmd, search_path, dry_run=dry_run)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/spawn.py\", line 159, in _spawn_posix\r\n    % (cmd, exit_status))\r\ndistutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/cffi/ffiplatform.py\", line 51, in _build\r\n    dist.run_command('build_ext')\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/dist.py\", line 974, in run_command\r\n    cmd_obj.run()\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/command/build_ext.py\", line 339, in run\r\n    self.build_extensions()\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/command/build_ext.py\", line 448, in build_extensions\r\n    self._build_extensions_serial()\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/command/build_ext.py\", line 473, in _build_extensions_serial\r\n    self.build_extension(ext)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/command/build_ext.py\", line 533, in build_extension\r\n    depends=ext.depends)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/ccompiler.py\", line 574, in compile\r\n    self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/distutils/unixccompiler.py\", line 120, in _compile\r\n    raise CompileError(msg)\r\ndistutils.errors.CompileError: command 'gcc' failed with exit status 1\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"build.py\", line 29, in <module>\r\n    ffi.build()\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/__init__.py\", line 186, in build\r\n    _build_extension(ffi, cffi_wrapper_name, target_dir, verbose)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/torch/utils/ffi/__init__.py\", line 109, in _build_extension\r\n    ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/cffi/api.py\", line 690, in compile\r\n    compiler_verbose=verbose, debug=debug, **kwds)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/cffi/recompiler.py\", line 1513, in recompile\r\n    compiler_verbose, debug)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/cffi/ffiplatform.py\", line 22, in compile\r\n    outputfilename = _build(tmpdir, ext, compiler_verbose, debug)\r\n  File \"/home/jawad/anaconda3_minsky/envs/allennlp/lib/python3.6/site-packages/cffi/ffiplatform.py\", line 58, in _build\r\n    raise VerificationError('%s: %s' % (e.__class__.__name__, e))\r\ncffi.error.VerificationError: CompileError: command 'gcc' failed with exit status 1\r\n```\r\n\r\nJawad"}}
{"actor":{"display_login":"jateeq"}}