{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/17183","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/17183/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/17183/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/17183/events","html_url":"https://github.com/kubernetes/kubernetes/issues/17183","id":116662801,"number":17183,"title":"Log management roadmap","user":{"login":"bgrant0607","id":7725777,"avatar_url":"https://avatars.githubusercontent.com/u/7725777?v=3","gravatar_id":"","url":"https://api.github.com/users/bgrant0607","html_url":"https://github.com/bgrant0607","followers_url":"https://api.github.com/users/bgrant0607/followers","following_url":"https://api.github.com/users/bgrant0607/following{/other_user}","gists_url":"https://api.github.com/users/bgrant0607/gists{/gist_id}","starred_url":"https://api.github.com/users/bgrant0607/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bgrant0607/subscriptions","organizations_url":"https://api.github.com/users/bgrant0607/orgs","repos_url":"https://api.github.com/users/bgrant0607/repos","events_url":"https://api.github.com/users/bgrant0607/events{/privacy}","received_events_url":"https://api.github.com/users/bgrant0607/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/logging","name":"area/logging","color":"fef2c0"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/kind/design","name":"kind/design","color":"c7def8"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P2","name":"priority/P2","color":"fbca04"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/cluster","name":"team/cluster","color":"d2b48c"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":11,"created_at":"2015-11-12T23:10:06Z","updated_at":"2016-08-17T18:32:31Z","closed_at":null,"body":"We need to decide where we're going with log management. \r\n\r\nWe have kubectl logs and the fluentd and ELK setups. We're not currently using Docker logging plugins.\r\n\r\nMore specific open issues:\r\n* rotation configuration, both for Docker logs and file-based logs, as in #13010\r\n* kubectl logs #11046 vs. Fluentd and other agents to push off node\r\n* how to capture kubernetes metadata: #8001\r\n\r\nForked from #16889\r\n\r\n@vishh @dchen1107 @saad-ali @ncdc "},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/240504629","html_url":"https://github.com/kubernetes/kubernetes/issues/17183#issuecomment-240504629","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/17183","id":240504629,"user":{"login":"devx","id":452006,"avatar_url":"https://avatars.githubusercontent.com/u/452006?v=3","gravatar_id":"","url":"https://api.github.com/users/devx","html_url":"https://github.com/devx","followers_url":"https://api.github.com/users/devx/followers","following_url":"https://api.github.com/users/devx/following{/other_user}","gists_url":"https://api.github.com/users/devx/gists{/gist_id}","starred_url":"https://api.github.com/users/devx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/devx/subscriptions","organizations_url":"https://api.github.com/users/devx/orgs","repos_url":"https://api.github.com/users/devx/repos","events_url":"https://api.github.com/users/devx/events{/privacy}","received_events_url":"https://api.github.com/users/devx/received_events","type":"User","site_admin":false},"created_at":"2016-08-17T18:32:31Z","updated_at":"2016-08-17T18:32:31Z","body":"After reading the entire thread and all the related links I would like to share my experience and how we have dealt with logging. We are still currently working on it!\r\n\r\nWe initially deployed a container that would use the k8’s API’s to get the logs, and metadata for all the containers in a replication controller. This worked however it has various drawbacks. As it increased the load of the API servers, not to mention that this would take away CPU resources from the applications that were supposed to run. In short it does not scale.\r\n\r\nOur latest experiment is to log at a lower level, and that is at the Docker daemon.  This strategy for us has been working and is very efficient.  Currently we use the Docker log driver with the fluentd plugin that sends to a small Golang binary running on every kubelet; which transforms the message and sends it to Kafka with TLS for transport. (Granted Kafka can be replaced with AWS Kinesis, or Googles Cloud Pub/Sub or Google Log service, but we currently are just testing Kafka.) This gives us more flexibility over our data as we don’t have static data pipelines, and can test various ways to manipulate our data, etc.  \r\n\r\nTo be honest what I would like is for k8’s to inject the metadata to Docker’s labels, so this information could be passed in the Docker log’s information.\r\n\r\n\r\n\r\n"}}
{"actor":{"display_login":"devx"}}