{"action":"created","issue":{"url":"https://api.github.com/repos/linkedin/gobblin/issues/869","repository_url":"https://api.github.com/repos/linkedin/gobblin","labels_url":"https://api.github.com/repos/linkedin/gobblin/issues/869/labels{/name}","comments_url":"https://api.github.com/repos/linkedin/gobblin/issues/869/comments","events_url":"https://api.github.com/repos/linkedin/gobblin/issues/869/events","html_url":"https://github.com/linkedin/gobblin/pull/869","id":141995706,"number":869,"title":"Base interfaces for value auditing","user":{"login":"pcadabam","id":1166372,"avatar_url":"https://avatars.githubusercontent.com/u/1166372?v=3","gravatar_id":"","url":"https://api.github.com/users/pcadabam","html_url":"https://github.com/pcadabam","followers_url":"https://api.github.com/users/pcadabam/followers","following_url":"https://api.github.com/users/pcadabam/following{/other_user}","gists_url":"https://api.github.com/users/pcadabam/gists{/gist_id}","starred_url":"https://api.github.com/users/pcadabam/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pcadabam/subscriptions","organizations_url":"https://api.github.com/users/pcadabam/orgs","repos_url":"https://api.github.com/users/pcadabam/repos","events_url":"https://api.github.com/users/pcadabam/events{/privacy}","received_events_url":"https://api.github.com/users/pcadabam/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2016-03-18T22:49:38Z","updated_at":"2016-03-24T03:15:55Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/linkedin/gobblin/pulls/869","html_url":"https://github.com/linkedin/gobblin/pull/869","diff_url":"https://github.com/linkedin/gobblin/pull/869.diff","patch_url":"https://github.com/linkedin/gobblin/pull/869.patch"},"body":"Added base interfaces for value auditing. The pr mainly has interfaces for \r\n- `RowSelectionPolicy` - An interface to decide if a row needs to be audited\r\n- `ColomnProjectionPolicy` - An interface that projects certain columns/fields of an input {@link GenericRecord} to generate a new {@link GenericRecord} that can be audited.\r\n- `AuditSink` - An interface for persisting value audits\r\n- `ValueAuditGenerator` - The class that implements value based auditing. The class captures the values of certain columns from the rows in the dataset using the {@link ColumnProjectionPolicy}. This is done for every row or for a sample of the rows as defined by the {@link RowSelectionPolicy}\r\n- The module that drives auditing will create an instance of `ValueAuditGenerator` for each avro file being written and called `ValueAuditGenerator.audit(GenericRecord)`\r\n\r\n**The complete javadoc has been generated and hosted through github pages [here] (http://pcadabam.github.io/gobblin-audit-docs/) to easily navigate through the detailed documentation**\r\n\r\nI am adding some unit tests while this is being reviewed. \r\n@chavdar  can you review?"},"comment":{"url":"https://api.github.com/repos/linkedin/gobblin/issues/comments/200636946","html_url":"https://github.com/linkedin/gobblin/pull/869#issuecomment-200636946","issue_url":"https://api.github.com/repos/linkedin/gobblin/issues/869","id":200636946,"user":{"login":"coveralls","id":2354108,"avatar_url":"https://avatars.githubusercontent.com/u/2354108?v=3","gravatar_id":"","url":"https://api.github.com/users/coveralls","html_url":"https://github.com/coveralls","followers_url":"https://api.github.com/users/coveralls/followers","following_url":"https://api.github.com/users/coveralls/following{/other_user}","gists_url":"https://api.github.com/users/coveralls/gists{/gist_id}","starred_url":"https://api.github.com/users/coveralls/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/coveralls/subscriptions","organizations_url":"https://api.github.com/users/coveralls/orgs","repos_url":"https://api.github.com/users/coveralls/repos","events_url":"https://api.github.com/users/coveralls/events{/privacy}","received_events_url":"https://api.github.com/users/coveralls/received_events","type":"User","site_admin":false},"created_at":"2016-03-24T03:15:55Z","updated_at":"2016-03-24T03:15:55Z","body":"\n[![Coverage Status](https://coveralls.io/builds/5529412/badge)](https://coveralls.io/builds/5529412)\n\nCoverage increased (+0.07%) to 42.002% when pulling **8e4208a55f8f711c834090eeddd2a5f3938a88b7 on pcadabam:auditor** into **040e4ce10ee903ec0c349f35ae2d603f35bb18b6 on linkedin:master**.\n"}}