{"action":"closed","issue":{"url":"https://api.github.com/repos/CommBank/ebenezer/issues/126","labels_url":"https://api.github.com/repos/CommBank/ebenezer/issues/126/labels{/name}","comments_url":"https://api.github.com/repos/CommBank/ebenezer/issues/126/comments","events_url":"https://api.github.com/repos/CommBank/ebenezer/issues/126/events","html_url":"https://github.com/CommBank/ebenezer/issues/126","id":116033053,"number":126,"title":"Unexpected count getting in from the counter","user":{"login":"maxmithun","id":4191454,"avatar_url":"https://avatars.githubusercontent.com/u/4191454?v=3","gravatar_id":"","url":"https://api.github.com/users/maxmithun","html_url":"https://github.com/maxmithun","followers_url":"https://api.github.com/users/maxmithun/followers","following_url":"https://api.github.com/users/maxmithun/following{/other_user}","gists_url":"https://api.github.com/users/maxmithun/gists{/gist_id}","starred_url":"https://api.github.com/users/maxmithun/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/maxmithun/subscriptions","organizations_url":"https://api.github.com/users/maxmithun/orgs","repos_url":"https://api.github.com/users/maxmithun/repos","events_url":"https://api.github.com/users/maxmithun/events{/privacy}","received_events_url":"https://api.github.com/users/maxmithun/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/CommBank/ebenezer/labels/bug","name":"bug","color":"fc2929"}],"state":"closed","locked":false,"assignee":{"login":"rowandavies","id":468519,"avatar_url":"https://avatars.githubusercontent.com/u/468519?v=3","gravatar_id":"","url":"https://api.github.com/users/rowandavies","html_url":"https://github.com/rowandavies","followers_url":"https://api.github.com/users/rowandavies/followers","following_url":"https://api.github.com/users/rowandavies/following{/other_user}","gists_url":"https://api.github.com/users/rowandavies/gists{/gist_id}","starred_url":"https://api.github.com/users/rowandavies/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rowandavies/subscriptions","organizations_url":"https://api.github.com/users/rowandavies/orgs","repos_url":"https://api.github.com/users/rowandavies/repos","events_url":"https://api.github.com/users/rowandavies/events{/privacy}","received_events_url":"https://api.github.com/users/rowandavies/received_events","type":"User","site_admin":false},"milestone":null,"comments":21,"created_at":"2015-11-10T05:52:14Z","updated_at":"2016-01-14T02:05:24Z","closed_at":"2016-01-14T02:05:24Z","body":"While writing the data from a TypedPipe to a disk we are getting a count more that the records written.\r\n\r\nThe count seems to be exactly double or near to it. The pipe used for writing is created by a left joining 2 pipes \r\n\r\nthe code used to write the records is mentioned below\r\n\r\n```\r\n pipe.writeExecution(ParquetScroogeSource[T](config.output))\r\n      .getAndResetCounters\r\n      .map { case (_, counters) => counters.get(StatKeys.tuplesWritten).getOrElse(0) }\r\n\r\n```\r\n\r\n(Rowan: edited `PartitionParquetScroogeSource` -> `ParquetScroogeSource`)"}}