{"action":"closed","issue":{"url":"https://api.github.com/repos/dpkp/kafka-python/issues/497","labels_url":"https://api.github.com/repos/dpkp/kafka-python/issues/497/labels{/name}","comments_url":"https://api.github.com/repos/dpkp/kafka-python/issues/497/comments","events_url":"https://api.github.com/repos/dpkp/kafka-python/issues/497/events","html_url":"https://github.com/dpkp/kafka-python/issues/497","id":125739008,"number":497,"title":"Duplicate records recieved when 'Not returning fetched records for partition' event fires","user":{"login":"CVTJNII","id":13871930,"avatar_url":"https://avatars.githubusercontent.com/u/13871930?v=3","gravatar_id":"","url":"https://api.github.com/users/CVTJNII","html_url":"https://github.com/CVTJNII","followers_url":"https://api.github.com/users/CVTJNII/followers","following_url":"https://api.github.com/users/CVTJNII/following{/other_user}","gists_url":"https://api.github.com/users/CVTJNII/gists{/gist_id}","starred_url":"https://api.github.com/users/CVTJNII/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/CVTJNII/subscriptions","organizations_url":"https://api.github.com/users/CVTJNII/orgs","repos_url":"https://api.github.com/users/CVTJNII/repos","events_url":"https://api.github.com/users/CVTJNII/events{/privacy}","received_events_url":"https://api.github.com/users/CVTJNII/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"dpkp","id":843444,"avatar_url":"https://avatars.githubusercontent.com/u/843444?v=3","gravatar_id":"","url":"https://api.github.com/users/dpkp","html_url":"https://github.com/dpkp","followers_url":"https://api.github.com/users/dpkp/followers","following_url":"https://api.github.com/users/dpkp/following{/other_user}","gists_url":"https://api.github.com/users/dpkp/gists{/gist_id}","starred_url":"https://api.github.com/users/dpkp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dpkp/subscriptions","organizations_url":"https://api.github.com/users/dpkp/orgs","repos_url":"https://api.github.com/users/dpkp/repos","events_url":"https://api.github.com/users/dpkp/events{/privacy}","received_events_url":"https://api.github.com/users/dpkp/received_events","type":"User","site_admin":false},"milestone":null,"comments":3,"created_at":"2016-01-09T05:12:21Z","updated_at":"2016-01-13T06:53:51Z","closed_at":"2016-01-13T06:53:51Z","body":"While running a custom test program against Kafka 0.9.0.0 and Kafka Python 0.9 branch commit 9a8af1499ca425366d934487469d9977fae7fe5f using kafka.KafkaConsumer I'm noticing duplicate message reception when the following error is thrown:\r\n\r\n```\r\n2016-01-09 05:02:03,041 cw16: Not returning fetched records for partition TopicPartition(topic=u'test', partition=16) since it is no longer assigned\r\n2016-01-09 05:02:03,041 cw6: Not returning fetched records for partition TopicPartition(topic=u'test', partition=24) since it is no longer assigned                                                                                                        2016-01-09 05:02:03,042 cw4: OffsetCommit failed for group pytester due to group error (UnknownMemberIdError - 25 - Returned from group requests (offset commits/fetches, heartbeats, etc) when the memberId is not in the current generation.), will rejoi\r\nn\r\n2016-01-09 05:02:03,042 cw4: Auto offset commit failed: UnknownMemberIdError - 25 - Returned from group requests (offset commits/fetches, heartbeats, etc) when the memberId is not in the current generation.\r\n2016-01-09 05:02:03,042 cw0: Not returning fetched records for partition TopicPartition(topic=u'test', partition=8) since it is no longer assigned\r\n2016-01-09 05:02:03,044 cw13: Not returning fetched records for partition TopicPartition(topic=u'test', partition=6) since it is no longer assigned\r\n2016-01-09 05:02:03,045 cw15: Not returning fetched records for partition TopicPartition(topic=u'test', partition=25) since it is no longer assigned\r\n2016-01-09 05:02:03,046 cw2: Not returning fetched records for partition TopicPartition(topic=u'test', partition=18) since it is no longer assigned\r\n2016-01-09 05:02:03,046 cw3: Not returning fetched records for partition TopicPartition(topic=u'test', partition=9) since it is no longer assigned\r\n2016-01-09 05:02:03,047 cw11: Not returning fetched records for partition TopicPartition(topic=u'test', partition=12) since it is no longer assigned\r\n2016-01-09 05:02:03,048 cw1: Not returning fetched records for partition TopicPartition(topic=u'test', partition=10) since it is no longer assigned\r\n2016-01-09 05:02:03,053 cw8: Not returning fetched records for partition TopicPartition(topic=u'test', partition=20) since it is no longer assigned\r\n2016-01-09 05:02:03,077 cw5: Not returning fetched records for partition TopicPartition(topic=u'test', partition=11) since it is no longer assigned\r\n2016-01-09 05:02:03,079 cw19: Not returning fetched records for partition TopicPartition(topic=u'test', partition=19) since it is no longer assigned\r\n2016-01-09 05:02:03,080 cw7: Not returning fetched records for partition TopicPartition(topic=u'test', partition=13) since it is no longer assigned\r\n2016-01-09 05:02:03,082 cw9: Not returning fetched records for partition TopicPartition(topic=u'test', partition=21) since it is no longer assigned\r\n2016-01-09 05:02:03,082 cw12: Not returning fetched records for partition TopicPartition(topic=u'test', partition=3) since it is no longer assigned\r\n2016-01-09 05:02:03,082 cw12: Not returning fetched records for partition TopicPartition(topic=u'test', partition=23) since it is no longer assigned\r\n2016-01-09 05:02:03,083 cw4: OffsetCommit failed for group pytester due to group error (UnknownMemberIdError - 25 - Returned from group requests (offset commits/fetches, heartbeats, etc) when the memberId is not in the current generation.), will rejoi\r\nn\r\n2016-01-09 05:02:03,083 cw10: Not returning fetched records for partition TopicPartition(topic=u'test', partition=15) since it is no longer assigned\r\n2016-01-09 05:02:03,083 cw4: Offset commit failed: group membership out of date This is likely to cause duplicate message delivery.\r\n2016-01-09 05:02:03,086 cw18: Not returning fetched records for partition TopicPartition(topic=u'test', partition=17) since it is no longer assigned\r\n2016-01-09 05:02:03,090 cw17: Not returning fetched records for partition TopicPartition(topic=u'test', partition=14) since it is no longer assigned\r\n2016-01-09 05:02:03,114 cw14: Not returning fetched records for partition TopicPartition(topic=u'test', partition=27) since it is no longer assigned\r\n2016-01-09 05:02:03,114 cw14: Not returning fetched records for partition TopicPartition(topic=u'test', partition=7) since it is no longer assigned\r\n2016-01-09 05:02:06,063 cw10: Skipping auto-commit reschedule -- it is disabled\r\n2016-01-09 05:02:06,296 cw4: Not returning fetched records for partition TopicPartition(topic=u'test', partition=22) since it is no longer assigned\r\n```\r\n\r\nIn this example 21/40 consumer nodes errored and at the same time I received 1380 duplicate messages.\r\n\r\nI've noticed duplicate and missing records under restart as well, but as my test is currently fairly high level I haven't drilled into them yet.  Would this message signify similar circumstances to a consumer starting?  What information would be useful to help troubleshoot this?"}}