{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/9065","repository_url":"https://api.github.com/repos/elastic/logstash","labels_url":"https://api.github.com/repos/elastic/logstash/issues/9065/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/9065/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/9065/events","html_url":"https://github.com/elastic/logstash/issues/9065","id":292701176,"node_id":"MDU6SXNzdWUyOTI3MDExNzY=","number":9065,"title":"Running modules with multiple pipelines","user":{"login":"acchen97","id":13039544,"node_id":"MDQ6VXNlcjEzMDM5NTQ0","avatar_url":"https://avatars1.githubusercontent.com/u/13039544?v=4","gravatar_id":"","url":"https://api.github.com/users/acchen97","html_url":"https://github.com/acchen97","followers_url":"https://api.github.com/users/acchen97/followers","following_url":"https://api.github.com/users/acchen97/following{/other_user}","gists_url":"https://api.github.com/users/acchen97/gists{/gist_id}","starred_url":"https://api.github.com/users/acchen97/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/acchen97/subscriptions","organizations_url":"https://api.github.com/users/acchen97/orgs","repos_url":"https://api.github.com/users/acchen97/repos","events_url":"https://api.github.com/users/acchen97/events{/privacy}","received_events_url":"https://api.github.com/users/acchen97/received_events","type":"User","site_admin":false},"labels":[{"id":90997545,"node_id":"MDU6TGFiZWw5MDk5NzU0NQ==","url":"https://api.github.com/repos/elastic/logstash/labels/enhancement","name":"enhancement","color":"009800","default":true},{"id":641186989,"node_id":"MDU6TGFiZWw2NDExODY5ODk=","url":"https://api.github.com/repos/elastic/logstash/labels/modules","name":"modules","color":"0e8a16","default":false},{"id":519576712,"node_id":"MDU6TGFiZWw1MTk1NzY3MTI=","url":"https://api.github.com/repos/elastic/logstash/labels/multiple%20pipelines","name":"multiple pipelines","color":"d4c5f9","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-01-30T09:01:28Z","updated_at":"2019-03-20T12:05:08Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Multiple pipelines currently cannot be used with modules. We can enable this feature by enhancing the `pipeline.yml` file to accept module pipelines. Using modules with multiple pipelines will only run the Logstash pipeline for that module. For initial module setup (i.e. importing dashboards, inject schema mapping), use the standard `bin/logstash --module netflow --setup`.\r\n\r\nFor example, Logstash can launch two custom pipelines and the netflow module pipeline in a single instance:\r\n\r\n```\r\n- pipeline.id: my-pipeline_1\r\n  path.config: \"/etc/path/to/p1.config\"\r\n  pipeline.workers: 3\r\n- pipeline.id: my-other-pipeline\r\n  path.config: \"/etc/different/path/p2.cfg\"\r\n  queue.type: persisted\r\n- pipeline.id: netflow-pipeline\r\n  module: netflow\r\n  netflow.var.input.tcp.port: 5606\r\n  netflow.var.elasticsearch.hosts: \"es.mycloud.com\"\r\n  netflow.var.elasticsearch.username: \"foo\"\r\n  netflow.var.elasticsearch.password: \"password\"\r\n  queue.type: persisted\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/474801423","html_url":"https://github.com/elastic/logstash/issues/9065#issuecomment-474801423","issue_url":"https://api.github.com/repos/elastic/logstash/issues/9065","id":474801423,"node_id":"MDEyOklzc3VlQ29tbWVudDQ3NDgwMTQyMw==","user":{"login":"Eniqmatic","id":45168587,"node_id":"MDQ6VXNlcjQ1MTY4NTg3","avatar_url":"https://avatars2.githubusercontent.com/u/45168587?v=4","gravatar_id":"","url":"https://api.github.com/users/Eniqmatic","html_url":"https://github.com/Eniqmatic","followers_url":"https://api.github.com/users/Eniqmatic/followers","following_url":"https://api.github.com/users/Eniqmatic/following{/other_user}","gists_url":"https://api.github.com/users/Eniqmatic/gists{/gist_id}","starred_url":"https://api.github.com/users/Eniqmatic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Eniqmatic/subscriptions","organizations_url":"https://api.github.com/users/Eniqmatic/orgs","repos_url":"https://api.github.com/users/Eniqmatic/repos","events_url":"https://api.github.com/users/Eniqmatic/events{/privacy}","received_events_url":"https://api.github.com/users/Eniqmatic/received_events","type":"User","site_admin":false},"created_at":"2019-03-20T12:05:08Z","updated_at":"2019-03-20T12:05:08Z","author_association":"NONE","body":"+1 just realised cannot use modules with central pipelines"}}
{"actor":{"display_login":"Eniqmatic"}}