{"action":"created","issue":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1548","repository_url":"https://api.github.com/repos/cooperative-computing-lab/cctools","labels_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1548/labels{/name}","comments_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1548/comments","events_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1548/events","html_url":"https://github.com/cooperative-computing-lab/cctools/issues/1548","id":191016243,"number":1548,"title":"parrot and icecube segfault on RHEL6.8","user":{"login":"btovar","id":3081826,"avatar_url":"https://avatars.githubusercontent.com/u/3081826?v=3","gravatar_id":"","url":"https://api.github.com/users/btovar","html_url":"https://github.com/btovar","followers_url":"https://api.github.com/users/btovar/followers","following_url":"https://api.github.com/users/btovar/following{/other_user}","gists_url":"https://api.github.com/users/btovar/gists{/gist_id}","starred_url":"https://api.github.com/users/btovar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/btovar/subscriptions","organizations_url":"https://api.github.com/users/btovar/orgs","repos_url":"https://api.github.com/users/btovar/repos","events_url":"https://api.github.com/users/btovar/events{/privacy}","received_events_url":"https://api.github.com/users/btovar/received_events","type":"User","site_admin":false},"labels":[{"id":31803945,"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/labels/bug","name":"bug","color":"fc2929","default":true},{"id":42528197,"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/labels/cvmfs","name":"cvmfs","color":"fbca04","default":false},{"id":42511968,"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/labels/Parrot","name":"Parrot","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":{"login":"trshaffer","id":6613013,"avatar_url":"https://avatars.githubusercontent.com/u/6613013?v=3","gravatar_id":"","url":"https://api.github.com/users/trshaffer","html_url":"https://github.com/trshaffer","followers_url":"https://api.github.com/users/trshaffer/followers","following_url":"https://api.github.com/users/trshaffer/following{/other_user}","gists_url":"https://api.github.com/users/trshaffer/gists{/gist_id}","starred_url":"https://api.github.com/users/trshaffer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trshaffer/subscriptions","organizations_url":"https://api.github.com/users/trshaffer/orgs","repos_url":"https://api.github.com/users/trshaffer/repos","events_url":"https://api.github.com/users/trshaffer/events{/privacy}","received_events_url":"https://api.github.com/users/trshaffer/received_events","type":"User","site_admin":false},"assignees":[{"login":"trshaffer","id":6613013,"avatar_url":"https://avatars.githubusercontent.com/u/6613013?v=3","gravatar_id":"","url":"https://api.github.com/users/trshaffer","html_url":"https://github.com/trshaffer","followers_url":"https://api.github.com/users/trshaffer/followers","following_url":"https://api.github.com/users/trshaffer/following{/other_user}","gists_url":"https://api.github.com/users/trshaffer/gists{/gist_id}","starred_url":"https://api.github.com/users/trshaffer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trshaffer/subscriptions","organizations_url":"https://api.github.com/users/trshaffer/orgs","repos_url":"https://api.github.com/users/trshaffer/repos","events_url":"https://api.github.com/users/trshaffer/events{/privacy}","received_events_url":"https://api.github.com/users/trshaffer/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/milestones/28","html_url":"https://github.com/cooperative-computing-lab/cctools/milestones/6.1","labels_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/milestones/28/labels","id":2008987,"number":28,"title":"6.1","description":"","creator":{"login":"btovar","id":3081826,"avatar_url":"https://avatars.githubusercontent.com/u/3081826?v=3","gravatar_id":"","url":"https://api.github.com/users/btovar","html_url":"https://github.com/btovar","followers_url":"https://api.github.com/users/btovar/followers","following_url":"https://api.github.com/users/btovar/following{/other_user}","gists_url":"https://api.github.com/users/btovar/gists{/gist_id}","starred_url":"https://api.github.com/users/btovar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/btovar/subscriptions","organizations_url":"https://api.github.com/users/btovar/orgs","repos_url":"https://api.github.com/users/btovar/repos","events_url":"https://api.github.com/users/btovar/events{/privacy}","received_events_url":"https://api.github.com/users/btovar/received_events","type":"User","site_admin":false},"open_issues":7,"closed_issues":7,"state":"open","created_at":"2016-09-16T11:12:26Z","updated_at":"2016-11-22T16:12:08Z","due_on":null,"closed_at":null},"comments":8,"created_at":"2016-11-22T14:06:29Z","updated_at":"2016-12-01T14:58:43Z","closed_at":null,"body":"From Gonzalo Merino:\r\n\r\nWe run opencl applications in a distributed environment. We rely in CVMFS for software distribution. In some sites, we do not have CVMFS native installations, therefore we rely on parrot (thanks a lot parrot developers!)\r\n\r\nWe are experiencing a weird issue with parrot at one of our sites, so I am writing this group to see if someone more expert than me in the internals can help us. This is what we observe:\r\n\r\nThere is one site where we are trying to run where trying to run the \"clinfo\" opencl binary via parrot crashes with segmentation fault. This is what we do:\r\n\r\n# cat run-parrot\r\nexport PARROT_CVMFS_REPO=\"<default-repositories>\"\r\nexport PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=yes\r\nexport HTTP_PROXY='INVALID-PROXY'\r\nparrot_run /bin/bash\r\n\r\n# ./run-parrot\r\n# /cvmfs/icecube.opensciencegrid.org/distrib/OpenCL_Linux/bin/x86_64/clinfo\r\nSegmentation fault\r\n\r\n\r\nWe are using parrot in cctools-6.0.10-x86_64-redhat6, and the OS in this site is RHEL 6.8\r\n\r\nThe node in which we are doing this has also native CVMFS installed (using fuse).\r\nIf we run the same  /cvmfs/icecube.opensciencegrid.org/distrib/OpenCL_Linux/bin/x86_64/clinfo command using the native CVMFS, the command runs just fine.\r\n\r\nWe are running this in several other RHEL6 or RHEL7 sites, where we can run this clinfo binary and other opencl applications inside parrot with no issues. There seems to be some problem with this specific RHEL 6.8 site.\r\n\r\nRunning parrot with \"debug all\" flag provides a lot of information, but I confess I am not able to get a clear idea of what is causing the problem from this debug dump. I have put the complete debug output in here in case someone in this group can help us with this:\r\n\r\nhttp://icecube.wisc.edu/~gmerino/parrot/parrot.log.err\r\n\r\n\r\nthanks a lot,\r\nGonzalo\r\n\r\n\r\n2016/11/17 06:32:55.00 parrot_run[144781] process: pid 144945 received signal 11 (Segmentation fault) (state 1)\r\n2016/11/17 06:32:55.00 parrot_run[144781] process: pid 144945 faulted on address 0x3038 (unmapped)\r\n2016/11/17 06:32:55.00 parrot_run[144781] debug: 144945 maps:\r\n00007fe1e79eb000-00007fe1e79f5000 rw-p            45000 08:03 30783532 /usr/lib64/libnvidia-fatbinaryloader.so.361.93.03\r\n00007fe1e77a6000-00007fe1e79f5328 r-wp                0 08:03 30783532 /usr/lib64/libnvidia-fatbinaryloader.so.361.93.03\r\n00000036c5e06000-00000036c5e08000 rw-p             6000 08:03 14131310 /lib64/librt-2.12.so\r\n00000036c5c00000-00000036c5e07bb0 r-wp                0 08:03 14131310 /lib64/librt-2.12.so\r\n00007fe1e831e000-00007fe1e843e000 rw-p           70d000 08:03 30783415 /usr/lib64/libnvidia-opencl.so.361.93.03\r\n00007fe1e7a11000-00007fe1e8449b88 r-wp                0 08:03 30783415 /usr/lib64/libnvidia-opencl.so.361.93.03\r\n00000036c4b8a000-00000036c4b90000 rw-p           18a000 08:03 14131224 /lib64/libc-2.12.so\r\n00000036c4800000-00000036c4b93928 r-wp                0 08:03 14131224 /lib64/libc-2.12.so\r\n00000036cea15000-00000036cea16000 rw-p            15000 08:03 14131240 /lib64/libgcc_s-4.4.7-20120601.so.1\r\n00000036ce800000-00000036cea15d58 r-wp                0 08:03 14131240 /lib64/libgcc_s-4.4.7-20120601.so.1\r\n00000036c4e02000-00000036c4e04000 rw-p             2000 08:03 14131283 /lib64/libdl-2.12.so\r\n00000036c4c00000-00000036c4e03100 r-wp                0 08:03 14131283 /lib64/libdl-2.12.so\r\n00000036c5282000-00000036c5284000 rw-p            82000 08:03 14131225 /lib64/libm-2.12.so\r\n00000036c5000000-00000036c52830b8 r-wp                0 08:03 14131225 /lib64/libm-2.12.so\r\n00000036c5617000-00000036c5619000 rw-p            17000 08:03 14131246 /lib64/libpthread-2.12.so\r\n00000036c5400000-00000036c561c3f0 r-wp                0 08:03 14131246 /lib64/libpthread-2.12.so\r\n00007fe1e866e000-00007fe1e866f000 rw-p             5000 08:03 30783442 /usr/lib64/libOpenCL.so.1.0.0\r\n00007fe1e8469000-00007fe1e866eff0 r-wp                0 08:03 30783442 /usr/lib64/libOpenCL.so.1.0.0\r\n0000000000400000-0000000000465000 r-xp                0 08:03 1902350404 /tmp/xs-gmerino/parrot.1000118/b5/b5e90992060ff4444d82317f4df78ae8\r\n0000000000665000-000000000066a000 rw-p            65000 08:03 1902350404 /tmp/xs-gmerino/parrot.1000118/b5/b5e90992060ff4444d82317f4df78ae8\r\n000000000066a000-000000000067c000 rw-p                0 00:00        0\r\n000000000263f000-0000000002660000 rw-p                0 00:00        0 [heap]\r\n00000036c4400000-00000036c4420000 r-xp                0 08:03 336794119 /lib64/ld-2.12.so\r\n00000036c461f000-00000036c4621000 r--p            1f000 08:03 336794119 /lib64/ld-2.12.so\r\n00000036c4621000-00000036c4622000 rw-p            21000 08:03 336794119 /lib64/ld-2.12.so\r\n00000036c4622000-00000036c4623000 rw-p                0 00:00        0\r\n00000036c4b90000-00000036c4b94000 rw-p                0 00:00        0\r\n00000036c5619000-00000036c561d000 rw-p                0 00:00        0\r\n00007fe1e7785000-00007fe1e77a6000 rw-p                0 00:00        0\r\n00007fe1e79f5000-00007fe1e79f6000 rw-p                0 00:00        0\r\n00007fe1e7a10000-00007fe1e7a11000 r--s         d0000000 00:05    99105 /dev/nvidia1\r\n00007fe1e843e000-00007fe1e844e000 rw-p                0 00:00        0\r\n00007fe1e8459000-00007fe1e8469000 rw-p                0 00:00        0\r\n00007fe1e866f000-00007fe1e8671000 rw-p                0 00:00        0\r\n00007ffdf4310000-00007ffdf4326000 rw-p                0 00:00        0 [stack]\r\n00007ffdf4375000-00007ffdf4376000 r-xp                0 00:00        0 [vdso]\r\nffffffffff600000-ffffffffff601000 r-xp                0 00:00        0 [vsyscall]"},"comment":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/comments/264194580","html_url":"https://github.com/cooperative-computing-lab/cctools/issues/1548#issuecomment-264194580","issue_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1548","id":264194580,"user":{"login":"dthain","id":2752914,"avatar_url":"https://avatars.githubusercontent.com/u/2752914?v=3","gravatar_id":"","url":"https://api.github.com/users/dthain","html_url":"https://github.com/dthain","followers_url":"https://api.github.com/users/dthain/followers","following_url":"https://api.github.com/users/dthain/following{/other_user}","gists_url":"https://api.github.com/users/dthain/gists{/gist_id}","starred_url":"https://api.github.com/users/dthain/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dthain/subscriptions","organizations_url":"https://api.github.com/users/dthain/orgs","repos_url":"https://api.github.com/users/dthain/repos","events_url":"https://api.github.com/users/dthain/events{/privacy}","received_events_url":"https://api.github.com/users/dthain/received_events","type":"User","site_admin":false},"created_at":"2016-12-01T14:58:42Z","updated_at":"2016-12-01T14:58:42Z","body":"Tim, if this is ready to go, please respond to Gonzalo and see if he is satisfied.\r\n"}}
{"actor":{"display_login":"dthain"}}