{"action":"created","issue":{"url":"https://api.github.com/repos/catkin/catkin_tools/issues/277","labels_url":"https://api.github.com/repos/catkin/catkin_tools/issues/277/labels{/name}","comments_url":"https://api.github.com/repos/catkin/catkin_tools/issues/277/comments","events_url":"https://api.github.com/repos/catkin/catkin_tools/issues/277/events","html_url":"https://github.com/catkin/catkin_tools/issues/277","id":127998909,"number":277,"title":"Large workspace issues","user":{"login":"mikepurvis","id":944666,"avatar_url":"https://avatars.githubusercontent.com/u/944666?v=3","gravatar_id":"","url":"https://api.github.com/users/mikepurvis","html_url":"https://github.com/mikepurvis","followers_url":"https://api.github.com/users/mikepurvis/followers","following_url":"https://api.github.com/users/mikepurvis/following{/other_user}","gists_url":"https://api.github.com/users/mikepurvis/gists{/gist_id}","starred_url":"https://api.github.com/users/mikepurvis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mikepurvis/subscriptions","organizations_url":"https://api.github.com/users/mikepurvis/orgs","repos_url":"https://api.github.com/users/mikepurvis/repos","events_url":"https://api.github.com/users/mikepurvis/events{/privacy}","received_events_url":"https://api.github.com/users/mikepurvis/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/catkin/catkin_tools/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/catkin/catkin_tools/labels/use%20case","name":"use case","color":"fef2c0"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2016-01-21T19:17:32Z","updated_at":"2016-01-22T03:35:03Z","closed_at":null,"body":"I'm having an interesting issue building a workspace with 300+ packages— at a certain point in the build, everything fails due to the linker having exhausted the open files limit. Representative output:\r\n\r\n```\r\n/usr/bin/ld: cannot find /usr/lib/libvtkCommon.so.5.8.0: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/libvtkRendering.so.5.8.0: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/libvtkHybrid.so.5.8.0: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/libvtkCharts.so.5.8.0: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_videostab.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_video.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_superres.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_stitching.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_photo.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_ocl.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_objdetect.so.2.4.8: Too many open files^M\r\n/usr/bin/ld: cannot find /usr/lib/x86_64-linux-gnu/libopencv_ml.so.2.4.8: Too many open files^M\r\n...\r\n```\r\n\r\nI've tried raising the limit with sysctl, but the issue persists. I can work around it by sourcing the setup file from the failed build, and then creating a new overlaid workspace with just the failed packages—which then builds fine.\r\n\r\nDoes catkin_tools leak fds? Is this something which the 0.4.0 executor will handle better?\r\n\r\nThanks for any thoughts or pointers."},"comment":{"url":"https://api.github.com/repos/catkin/catkin_tools/issues/comments/173795056","html_url":"https://github.com/catkin/catkin_tools/issues/277#issuecomment-173795056","issue_url":"https://api.github.com/repos/catkin/catkin_tools/issues/277","id":173795056,"user":{"login":"jbohren","id":1253450,"avatar_url":"https://avatars.githubusercontent.com/u/1253450?v=3","gravatar_id":"","url":"https://api.github.com/users/jbohren","html_url":"https://github.com/jbohren","followers_url":"https://api.github.com/users/jbohren/followers","following_url":"https://api.github.com/users/jbohren/following{/other_user}","gists_url":"https://api.github.com/users/jbohren/gists{/gist_id}","starred_url":"https://api.github.com/users/jbohren/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbohren/subscriptions","organizations_url":"https://api.github.com/users/jbohren/orgs","repos_url":"https://api.github.com/users/jbohren/repos","events_url":"https://api.github.com/users/jbohren/events{/privacy}","received_events_url":"https://api.github.com/users/jbohren/received_events","type":"User","site_admin":false},"created_at":"2016-01-22T03:35:03Z","updated_at":"2016-01-22T03:35:03Z","body":">```\r\n[build] Warning: Skipping package 'xx' because it has an unknown package build type: \"catkin\"\r\n```\r\n\r\n>This is attempting to build a workspace with no context, where catkin is part of the workspace itself.\r\n\r\nHaha, that's cute. I think your `catkin_tools` `master` isn't installed right. Did you re-run `python setup.py develop` or `python setup.py install` again after checking out `master`?"}}