{"action":"created","issue":{"url":"https://api.github.com/repos/caskdata/cdap/issues/5299","repository_url":"https://api.github.com/repos/caskdata/cdap","labels_url":"https://api.github.com/repos/caskdata/cdap/issues/5299/labels{/name}","comments_url":"https://api.github.com/repos/caskdata/cdap/issues/5299/comments","events_url":"https://api.github.com/repos/caskdata/cdap/issues/5299/events","html_url":"https://github.com/caskdata/cdap/pull/5299","id":140541259,"number":5299,"title":"CDAP-5216 Improve determining dataset access type for MapReduce and Spark","user":{"login":"anwar6953","id":2440977,"avatar_url":"https://avatars.githubusercontent.com/u/2440977?v=3","gravatar_id":"","url":"https://api.github.com/users/anwar6953","html_url":"https://github.com/anwar6953","followers_url":"https://api.github.com/users/anwar6953/followers","following_url":"https://api.github.com/users/anwar6953/following{/other_user}","gists_url":"https://api.github.com/users/anwar6953/gists{/gist_id}","starred_url":"https://api.github.com/users/anwar6953/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anwar6953/subscriptions","organizations_url":"https://api.github.com/users/anwar6953/orgs","repos_url":"https://api.github.com/users/anwar6953/repos","events_url":"https://api.github.com/users/anwar6953/events{/privacy}","received_events_url":"https://api.github.com/users/anwar6953/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/caskdata/cdap/labels/3.4","name":"3.4","color":"0052cc"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2016-03-13T23:08:41Z","updated_at":"2016-03-22T00:27:55Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/caskdata/cdap/pulls/5299","html_url":"https://github.com/caskdata/cdap/pull/5299","diff_url":"https://github.com/caskdata/cdap/pull/5299.diff","patch_url":"https://github.com/caskdata/cdap/pull/5299.patch"},"body":"For MapReduce and Spark, we know the dataset access types (when setting as input or output of the MR/Spark program), so we can specify that particular accessType, instead of `AccessType.Unknown`.\r\n\r\nThis updates DynamicDatasetCache, SystemDatasetInstantiator, and DatasetFramework to have a `getDataset` method that takes in an `AccessType`.\r\nOne thing to note is that `RemoteDatasetFramework` and `InMemoryDatasetFramework` have implementation of this method that totally ignore this parameter, because it is only needed up until the `lineageWriterDatasetFramework`.\r\n\r\nhttps://issues.cask.co/browse/CDAP-5216\r\nhttp://builds.cask.co/browse/CDAP-DUT3688"},"comment":{"url":"https://api.github.com/repos/caskdata/cdap/issues/comments/199556115","html_url":"https://github.com/caskdata/cdap/pull/5299#issuecomment-199556115","issue_url":"https://api.github.com/repos/caskdata/cdap/issues/5299","id":199556115,"user":{"login":"anwar6953","id":2440977,"avatar_url":"https://avatars.githubusercontent.com/u/2440977?v=3","gravatar_id":"","url":"https://api.github.com/users/anwar6953","html_url":"https://github.com/anwar6953","followers_url":"https://api.github.com/users/anwar6953/followers","following_url":"https://api.github.com/users/anwar6953/following{/other_user}","gists_url":"https://api.github.com/users/anwar6953/gists{/gist_id}","starred_url":"https://api.github.com/users/anwar6953/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anwar6953/subscriptions","organizations_url":"https://api.github.com/users/anwar6953/orgs","repos_url":"https://api.github.com/users/anwar6953/repos","events_url":"https://api.github.com/users/anwar6953/events{/privacy}","received_events_url":"https://api.github.com/users/anwar6953/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T00:27:55Z","updated_at":"2016-03-22T00:27:55Z","body":"There's still the pending comment, which we need to figure out:\r\nhttps://github.com/caskdata/cdap/pull/5299#discussion_r56031188"}}