{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/6429","repository_url":"https://api.github.com/repos/elastic/logstash","labels_url":"https://api.github.com/repos/elastic/logstash/issues/6429/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/6429/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/6429/events","html_url":"https://github.com/elastic/logstash/issues/6429","id":196098415,"number":6429,"title":"Ability to remove tags field from output broke in 5.0.1 and above","user":{"login":"ronnocol","id":5877013,"avatar_url":"https://avatars.githubusercontent.com/u/5877013?v=3","gravatar_id":"","url":"https://api.github.com/users/ronnocol","html_url":"https://github.com/ronnocol","followers_url":"https://api.github.com/users/ronnocol/followers","following_url":"https://api.github.com/users/ronnocol/following{/other_user}","gists_url":"https://api.github.com/users/ronnocol/gists{/gist_id}","starred_url":"https://api.github.com/users/ronnocol/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ronnocol/subscriptions","organizations_url":"https://api.github.com/users/ronnocol/orgs","repos_url":"https://api.github.com/users/ronnocol/repos","events_url":"https://api.github.com/users/ronnocol/events{/privacy}","received_events_url":"https://api.github.com/users/ronnocol/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-12-16T16:29:20Z","updated_at":"2016-12-18T03:49:17Z","closed_at":null,"body":"I'm trying to output to a very picky HTTP API, and the existence of a field in the JSON that is posted causes it confusion. I originally did the integration work with 5.0.0 (latest at the time) but then when we went to deploy, grabbed the latest version (5.1.0) I then checked every iteration back to 5.0.0 and found that the ability to remove the 'tags' field broke in 5.0.1.\r\n\r\n```text\r\n[ronnocol@tarpon logstash-5.0.0]$ bin/logstash -e 'filter { mutate { remove_field => [\"tags\"] }}'\r\nSending Logstash logs to /home/loconnor/projects/logstash-5.0.0/logs which is now configured via log4j2.properties.\r\nThe stdin plugin is now waiting for input:\r\n[2016-12-15T09:52:02,658][INFO ][logstash.pipeline        ] Starting pipeline {\"id\"=>\"main\", \"pipeline.workers\"=>8, \"pipeline.batch.size\"=>125, \"pipeline.batch.delay\"=>5, \"pipeline.max_inflight\"=>1000}\r\n[2016-12-15T09:52:02,675][INFO ][logstash.pipeline        ] Pipeline main started\r\n[2016-12-15T09:52:02,727][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}\r\nlsdkfj\r\n{\r\n    \"@timestamp\" => 2016-12-15T17:52:07.282Z,\r\n      \"@version\" => \"1\",\r\n          \"host\" => \"tarpon.engr.blah.com\",\r\n       \"message\" => \"lsdkfj\",\r\n          \"type\" => \"stdin\"\r\n}\r\n```\r\nNotice that the \"tags\" field has been properly removed.\r\n\r\nIn 5.0.1 and above, this same test no longer works:\r\n\r\n```text\r\n[loconnor@tarpon logstash-5.0.1]$ bin/logstash -e 'filter { mutate { remove_field => [\"tags\"] }}' \r\nSending Logstash's logs to /home/loconnor/projects/logstash-5.0.1/logs which is now configured via log4j2.properties\r\nThe stdin plugin is now waiting for input:\r\n[2016-12-15T10:30:44,329][INFO ][logstash.pipeline        ] Starting pipeline {\"id\"=>\"main\", \"pipeline.workers\"=>8, \"pipeline.batch.size\"=>125, \"pipeline.batch.delay\"=>5, \"pipeline.max_inflight\"=>1000}\r\n[2016-12-15T10:30:44,344][INFO ][logstash.pipeline        ] Pipeline main started\r\n[2016-12-15T10:30:44,390][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}\r\nasdf\r\n{\r\n    \"@timestamp\" => 2016-12-15T18:30:50.053Z,\r\n      \"@version\" => \"1\",\r\n          \"host\" => \"tarpon.engr.blah.com\",\r\n       \"message\" => \"asdf\",\r\n          \"type\" => \"stdin\",\r\n          \"tags\" => []\r\n}\r\n[2016-12-15T10:30:54,365][WARN ][logstash.agent           ] stopping pipeline {:id=>\"main\"}\r\n```\r\n\r\nThe existence of extra fields in the JSON causes some picky HTTP APIs to fail.\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/267801773","html_url":"https://github.com/elastic/logstash/issues/6429#issuecomment-267801773","issue_url":"https://api.github.com/repos/elastic/logstash/issues/6429","id":267801773,"user":{"login":"u0x01","id":9703404,"avatar_url":"https://avatars.githubusercontent.com/u/9703404?v=3","gravatar_id":"","url":"https://api.github.com/users/u0x01","html_url":"https://github.com/u0x01","followers_url":"https://api.github.com/users/u0x01/followers","following_url":"https://api.github.com/users/u0x01/following{/other_user}","gists_url":"https://api.github.com/users/u0x01/gists{/gist_id}","starred_url":"https://api.github.com/users/u0x01/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/u0x01/subscriptions","organizations_url":"https://api.github.com/users/u0x01/orgs","repos_url":"https://api.github.com/users/u0x01/repos","events_url":"https://api.github.com/users/u0x01/events{/privacy}","received_events_url":"https://api.github.com/users/u0x01/received_events","type":"User","site_admin":false},"created_at":"2016-12-18T03:49:17Z","updated_at":"2016-12-18T03:49:17Z","body":"I have this problem too"}}
{"actor":{"display_login":"u0x01"}}