{"action":"created","issue":{"url":"https://api.github.com/repos/dpkp/kafka-python/issues/581","repository_url":"https://api.github.com/repos/dpkp/kafka-python","labels_url":"https://api.github.com/repos/dpkp/kafka-python/issues/581/labels{/name}","comments_url":"https://api.github.com/repos/dpkp/kafka-python/issues/581/comments","events_url":"https://api.github.com/repos/dpkp/kafka-python/issues/581/events","html_url":"https://github.com/dpkp/kafka-python/issues/581","id":140185243,"number":581,"title":"After consuming message new topic __consumet_offsets is created in the Kafka Broker","user":{"login":"iammehrabalam","id":6460392,"avatar_url":"https://avatars.githubusercontent.com/u/6460392?v=3","gravatar_id":"","url":"https://api.github.com/users/iammehrabalam","html_url":"https://github.com/iammehrabalam","followers_url":"https://api.github.com/users/iammehrabalam/followers","following_url":"https://api.github.com/users/iammehrabalam/following{/other_user}","gists_url":"https://api.github.com/users/iammehrabalam/gists{/gist_id}","starred_url":"https://api.github.com/users/iammehrabalam/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/iammehrabalam/subscriptions","organizations_url":"https://api.github.com/users/iammehrabalam/orgs","repos_url":"https://api.github.com/users/iammehrabalam/repos","events_url":"https://api.github.com/users/iammehrabalam/events{/privacy}","received_events_url":"https://api.github.com/users/iammehrabalam/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-03-11T13:40:47Z","updated_at":"2016-03-11T17:28:11Z","closed_at":"2016-03-11T17:28:11Z","body":"New topic name __consumer_offsets is created when consumer start consuming messages. Topic is created with 50 partition and each partition takes lot of space around GigaBytes to maintain two files .index and .log.\r\n\r\nPlease tell me the reason why we need to create new topic in Kafka broker and why it is taking lot of space?\r\n\r\nmy configuration \r\n----------------------\r\n\r\n{'enable_auto_commit': True,\r\n                         'auto_commit_interval_ms': 100,\r\n                         'auto_offset_reset': 'largest',\r\n                         'bootstrap_servers': KAFKA_BROKER_HOSTS,\r\n                         'group_id': 'something'\r\n}"},"comment":{"url":"https://api.github.com/repos/dpkp/kafka-python/issues/comments/195466414","html_url":"https://github.com/dpkp/kafka-python/issues/581#issuecomment-195466414","issue_url":"https://api.github.com/repos/dpkp/kafka-python/issues/581","id":195466414,"user":{"login":"dpkp","id":843444,"avatar_url":"https://avatars.githubusercontent.com/u/843444?v=3","gravatar_id":"","url":"https://api.github.com/users/dpkp","html_url":"https://github.com/dpkp","followers_url":"https://api.github.com/users/dpkp/followers","following_url":"https://api.github.com/users/dpkp/following{/other_user}","gists_url":"https://api.github.com/users/dpkp/gists{/gist_id}","starred_url":"https://api.github.com/users/dpkp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dpkp/subscriptions","organizations_url":"https://api.github.com/users/dpkp/orgs","repos_url":"https://api.github.com/users/dpkp/repos","events_url":"https://api.github.com/users/dpkp/events{/privacy}","received_events_url":"https://api.github.com/users/dpkp/received_events","type":"User","site_admin":false},"created_at":"2016-03-11T17:28:11Z","updated_at":"2016-03-11T17:28:11Z","body":"This is a kafka server feature (not specific to kafka-python). See http://kafka.apache.org/documentation.html#impl_offsettracking . For more information about kafka broker operations, I suggest joining the kafka users mailing list. More info at https://kafka.apache.org/contact.html"}}